[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:18:48.018483  9741 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.131.126:34905
I20260709 12:18:48.020182  9741 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:18:48.021366  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:48.039227  9748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:48.039234  9747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:48.039311  9750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:49.169939  9749 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260709 12:18:49.170075  9741 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 12:18:49.175498  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:49.175783  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:49.176043  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599529176018 us; error 0 us; skew 500 ppm
I20260709 12:18:49.176986  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:49.183730  9741 webserver.cc:533] Webserver started at http://127.9.131.126:32879/ using document root <none> and password file <none>
I20260709 12:18:49.184721  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:49.184952  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:49.185408  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:49.192185  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599527842218-9741-0/minicluster-data/master-0-root/instance:
uuid: "7fdf5b338388423199a0f150c69d6fff"
format_stamp: "Formatted at 2026-07-09 12:18:49 on dist-test-slave-r7s7"
I20260709 12:18:49.200894  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:18:49.210383  9756 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:49.212287  9741 fs_manager.cc:730] Time spent opening block manager: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:18:49.212762  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599527842218-9741-0/minicluster-data/master-0-root
uuid: "7fdf5b338388423199a0f150c69d6fff"
format_stamp: "Formatted at 2026-07-09 12:18:49 on dist-test-slave-r7s7"
I20260709 12:18:49.213300  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599527842218-9741-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599527842218-9741-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599527842218-9741-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:49.279378  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:49.281085  9741 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:18:49.281540  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:49.355253  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.126:34905
I20260709 12:18:49.355338  9807 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.126:34905 every 8 connection(s)
I20260709 12:18:49.363449  9808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:49.386081  9808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff: Bootstrap starting.
I20260709 12:18:49.392165  9808 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:49.394048  9808 log.cc:826] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff: Log is configured to *not* fsync() on all Append() calls
I20260709 12:18:49.399211  9808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff: No bootstrap required, opened a new log
I20260709 12:18:49.420959  9808 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fdf5b338388423199a0f150c69d6fff" member_type: VOTER }
I20260709 12:18:49.421526  9808 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:49.421808  9808 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fdf5b338388423199a0f150c69d6fff, State: Initialized, Role: FOLLOWER
I20260709 12:18:49.422727  9808 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fdf5b338388423199a0f150c69d6fff" member_type: VOTER }
I20260709 12:18:49.423254  9808 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:18:49.423556  9808 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:18:49.423944  9808 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:49.428284  9808 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fdf5b338388423199a0f150c69d6fff" member_type: VOTER }
I20260709 12:18:49.429268  9808 leader_election.cc:304] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7fdf5b338388423199a0f150c69d6fff; no voters: 
I20260709 12:18:49.431134  9808 leader_election.cc:290] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:18:49.431480  9811 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:49.433601  9811 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff [term 1 LEADER]: Becoming Leader. State: Replica: 7fdf5b338388423199a0f150c69d6fff, State: Running, Role: LEADER
I20260709 12:18:49.434568  9811 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fdf5b338388423199a0f150c69d6fff" member_type: VOTER }
I20260709 12:18:49.435941  9808 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:18:49.445535  9813 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7fdf5b338388423199a0f150c69d6fff. Latest consensus state: current_term: 1 leader_uuid: "7fdf5b338388423199a0f150c69d6fff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fdf5b338388423199a0f150c69d6fff" member_type: VOTER } }
I20260709 12:18:49.446453  9813 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:49.445567  9812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7fdf5b338388423199a0f150c69d6fff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fdf5b338388423199a0f150c69d6fff" member_type: VOTER } }
I20260709 12:18:49.447193  9812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:49.450484  9820 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:18:49.462545  9820 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:18:49.471940  9741 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:18:49.481072  9820 catalog_manager.cc:1383] Generated new cluster ID: 87c33f15c9ed44dba568f7722a38e046
I20260709 12:18:49.481388  9820 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:18:49.496836  9820 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:18:49.498450  9820 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:18:49.520164  9820 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff: Generated new TSK 0
I20260709 12:18:49.521294  9820 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:18:49.539351  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:49.549769  9830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:49.552359  9831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:49.554060  9741 server_base.cc:1061] running on GCE node
W20260709 12:18:49.554139  9833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:49.555194  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:49.555473  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:49.555672  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599529555655 us; error 0 us; skew 500 ppm
I20260709 12:18:49.556510  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:49.560619  9741 webserver.cc:533] Webserver started at http://127.9.131.65:43361/ using document root <none> and password file <none>
I20260709 12:18:49.561386  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:49.561770  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:49.562165  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:49.563782  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599527842218-9741-0/minicluster-data/ts-0-root/instance:
uuid: "5f3068f957554638bff21f2bdbccc92a"
format_stamp: "Formatted at 2026-07-09 12:18:49 on dist-test-slave-r7s7"
I20260709 12:18:49.570943  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:18:49.576535  9838 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:49.577477  9741 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:18:49.577881  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599527842218-9741-0/minicluster-data/ts-0-root
uuid: "5f3068f957554638bff21f2bdbccc92a"
format_stamp: "Formatted at 2026-07-09 12:18:49 on dist-test-slave-r7s7"
I20260709 12:18:49.578287  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599527842218-9741-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599527842218-9741-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599527842218-9741-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:49.624492  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:49.626322  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:49.629210  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:49.635365  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:49.635982  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.001s	sys 0.000s
I20260709 12:18:49.636482  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:49.637753  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s	user 0.001s	sys 0.000s
I20260709 12:18:49.735121  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.65:35313
I20260709 12:18:49.735210  9900 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.65:35313 every 8 connection(s)
I20260709 12:18:49.742301  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:49.751482  9905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:49.753391  9906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:49.761863  9741 server_base.cc:1061] running on GCE node
W20260709 12:18:49.762913  9908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:49.764226  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:49.764520  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:49.764730  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599529764714 us; error 0 us; skew 500 ppm
I20260709 12:18:49.765383  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:49.768198  9901 heartbeater.cc:344] Connected to a master server at 127.9.131.126:34905
I20260709 12:18:49.768745  9901 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:49.769994  9901 heartbeater.cc:507] Master 127.9.131.126:34905 requested a full tablet report, sending...
I20260709 12:18:49.772624  9741 webserver.cc:533] Webserver started at http://127.9.131.66:37829/ using document root <none> and password file <none>
I20260709 12:18:49.773408  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:49.773694  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:49.774084  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:49.774063  9773 ts_manager.cc:194] Registered new tserver with Master: 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313)
I20260709 12:18:49.775720  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599527842218-9741-0/minicluster-data/ts-1-root/instance:
uuid: "3615592255dd42ba970d0805ce5f8f6c"
format_stamp: "Formatted at 2026-07-09 12:18:49 on dist-test-slave-r7s7"
I20260709 12:18:49.777208  9773 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47490
I20260709 12:18:49.783033  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:18:49.788411  9913 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:49.789335  9741 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:18:49.789664  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599527842218-9741-0/minicluster-data/ts-1-root
uuid: "3615592255dd42ba970d0805ce5f8f6c"
format_stamp: "Formatted at 2026-07-09 12:18:49 on dist-test-slave-r7s7"
I20260709 12:18:49.789953  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599527842218-9741-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599527842218-9741-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599527842218-9741-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:49.807194  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:49.808589  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:49.810994  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:49.814782  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:49.815001  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:49.815271  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:49.815426  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:49.913591  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.66:38569
I20260709 12:18:49.913956  9975 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.66:38569 every 8 connection(s)
I20260709 12:18:49.920099  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:49.929247  9979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:49.933101  9980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:49.935636  9976 heartbeater.cc:344] Connected to a master server at 127.9.131.126:34905
I20260709 12:18:49.935899  9741 server_base.cc:1061] running on GCE node
I20260709 12:18:49.936244  9976 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:49.937450  9976 heartbeater.cc:507] Master 127.9.131.126:34905 requested a full tablet report, sending...
W20260709 12:18:49.937631  9982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:49.938860  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:49.939142  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:49.939352  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599529939333 us; error 0 us; skew 500 ppm
I20260709 12:18:49.940074  9773 ts_manager.cc:194] Registered new tserver with Master: 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569)
I20260709 12:18:49.940120  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:49.941821  9773 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47494
I20260709 12:18:49.943544  9741 webserver.cc:533] Webserver started at http://127.9.131.67:44001/ using document root <none> and password file <none>
I20260709 12:18:49.944231  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:49.944480  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:49.944792  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:49.946314  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599527842218-9741-0/minicluster-data/ts-2-root/instance:
uuid: "1b35894035d040c1a9cb3349478e1f2c"
format_stamp: "Formatted at 2026-07-09 12:18:49 on dist-test-slave-r7s7"
I20260709 12:18:49.952421  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:18:49.956547  9987 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:49.957382  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 12:18:49.957738  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599527842218-9741-0/minicluster-data/ts-2-root
uuid: "1b35894035d040c1a9cb3349478e1f2c"
format_stamp: "Formatted at 2026-07-09 12:18:49 on dist-test-slave-r7s7"
I20260709 12:18:49.958109  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599527842218-9741-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599527842218-9741-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599527842218-9741-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:49.978809  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:49.980461  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:49.982144  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:49.985945  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:49.986251  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:49.986538  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:49.986748  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:50.077018  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.67:35063
I20260709 12:18:50.077692 10049 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.67:35063 every 8 connection(s)
I20260709 12:18:50.094630 10050 heartbeater.cc:344] Connected to a master server at 127.9.131.126:34905
I20260709 12:18:50.094993 10050 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:50.095818 10050 heartbeater.cc:507] Master 127.9.131.126:34905 requested a full tablet report, sending...
I20260709 12:18:50.098084  9773 ts_manager.cc:194] Registered new tserver with Master: 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:50.098229  9741 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016156484s
I20260709 12:18:50.099983  9773 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47504
I20260709 12:18:50.152096  9773 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47510:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:50.156183  9773 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:50.252099  9866 tablet_service.cc:1511] Processing CreateTablet for tablet edcfb35aafee4ee08151319ebb25cc59 (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:50.253942  9866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edcfb35aafee4ee08151319ebb25cc59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.262110  9865 tablet_service.cc:1511] Processing CreateTablet for tablet c7766e3f04a14cc0ab63c48ee33cd298 (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:50.265269  9864 tablet_service.cc:1511] Processing CreateTablet for tablet 09ddf2f4a1a4487db6eaa4786a28be51 (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:50.268077  9865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7766e3f04a14cc0ab63c48ee33cd298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.269719  9864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09ddf2f4a1a4487db6eaa4786a28be51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.301971  9863 tablet_service.cc:1511] Processing CreateTablet for tablet ccf74389f16242a3973eb6553bf32abe (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:50.304144  9863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf74389f16242a3973eb6553bf32abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.323099 10012 tablet_service.cc:1511] Processing CreateTablet for tablet ccf74389f16242a3973eb6553bf32abe (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:50.325105 10012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf74389f16242a3973eb6553bf32abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.327005 10015 tablet_service.cc:1511] Processing CreateTablet for tablet edcfb35aafee4ee08151319ebb25cc59 (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:50.328640 10013 tablet_service.cc:1511] Processing CreateTablet for tablet 09ddf2f4a1a4487db6eaa4786a28be51 (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:50.330334 10014 tablet_service.cc:1511] Processing CreateTablet for tablet c7766e3f04a14cc0ab63c48ee33cd298 (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:50.332239 10013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09ddf2f4a1a4487db6eaa4786a28be51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.332939  9862 tablet_service.cc:1511] Processing CreateTablet for tablet 0110b40df05c421892d32cc121aaa2d5 (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:50.335346  9862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0110b40df05c421892d32cc121aaa2d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.336593 10015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edcfb35aafee4ee08151319ebb25cc59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.338127 10014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7766e3f04a14cc0ab63c48ee33cd298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.361457  9861 tablet_service.cc:1511] Processing CreateTablet for tablet 630c508d2b1f426986a6b239b2f34cce (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:50.362924  9861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630c508d2b1f426986a6b239b2f34cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.366693 10011 tablet_service.cc:1511] Processing CreateTablet for tablet 0110b40df05c421892d32cc121aaa2d5 (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:50.368378 10011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0110b40df05c421892d32cc121aaa2d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.384816  9941 tablet_service.cc:1511] Processing CreateTablet for tablet edcfb35aafee4ee08151319ebb25cc59 (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:50.386250  9941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edcfb35aafee4ee08151319ebb25cc59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.389236  9940 tablet_service.cc:1511] Processing CreateTablet for tablet c7766e3f04a14cc0ab63c48ee33cd298 (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:50.390700  9940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7766e3f04a14cc0ab63c48ee33cd298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.394784 10068 tablet_bootstrap.cc:492] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a: Bootstrap starting.
I20260709 12:18:50.403200  9939 tablet_service.cc:1511] Processing CreateTablet for tablet 09ddf2f4a1a4487db6eaa4786a28be51 (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:50.403767  9938 tablet_service.cc:1511] Processing CreateTablet for tablet ccf74389f16242a3973eb6553bf32abe (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:50.407320  9937 tablet_service.cc:1511] Processing CreateTablet for tablet 0110b40df05c421892d32cc121aaa2d5 (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:50.420241  9936 tablet_service.cc:1511] Processing CreateTablet for tablet 630c508d2b1f426986a6b239b2f34cce (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:50.421162  9938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf74389f16242a3973eb6553bf32abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.424443  9939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09ddf2f4a1a4487db6eaa4786a28be51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.425858  9936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630c508d2b1f426986a6b239b2f34cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.428797  9937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0110b40df05c421892d32cc121aaa2d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.431046 10012 tablet_service.cc:1511] Processing CreateTablet for tablet 630c508d2b1f426986a6b239b2f34cce (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:50.438789 10012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630c508d2b1f426986a6b239b2f34cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.438594  9863 tablet_service.cc:1511] Processing CreateTablet for tablet 69ed8384453347aaafc0d6a5b2a4731d (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:50.440030  9863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ed8384453347aaafc0d6a5b2a4731d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.444712  9935 tablet_service.cc:1511] Processing CreateTablet for tablet 69ed8384453347aaafc0d6a5b2a4731d (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:50.448966  9935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ed8384453347aaafc0d6a5b2a4731d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.444702 10069 tablet_bootstrap.cc:492] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c: Bootstrap starting.
W20260709 12:18:50.460559  9821 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:50.500182 10014 tablet_service.cc:1511] Processing CreateTablet for tablet 69ed8384453347aaafc0d6a5b2a4731d (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:50.504333 10068 tablet_bootstrap.cc:654] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.501950 10014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ed8384453347aaafc0d6a5b2a4731d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.522823  9862 tablet_service.cc:1511] Processing CreateTablet for tablet 055c16b2f90a4fdb80e042e23b3577b9 (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:50.524359  9862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 055c16b2f90a4fdb80e042e23b3577b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.535372  9934 tablet_service.cc:1511] Processing CreateTablet for tablet 055c16b2f90a4fdb80e042e23b3577b9 (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:50.536881  9934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 055c16b2f90a4fdb80e042e23b3577b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.550127 10011 tablet_service.cc:1511] Processing CreateTablet for tablet 055c16b2f90a4fdb80e042e23b3577b9 (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:50.551539 10011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 055c16b2f90a4fdb80e042e23b3577b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.553036  9865 tablet_service.cc:1511] Processing CreateTablet for tablet 6b90c8dce8d644d3b2284f0a2428f862 (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:50.554271  9865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b90c8dce8d644d3b2284f0a2428f862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.564441  9936 tablet_service.cc:1511] Processing CreateTablet for tablet 6b90c8dce8d644d3b2284f0a2428f862 (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:50.566303  9936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b90c8dce8d644d3b2284f0a2428f862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.568217 10012 tablet_service.cc:1511] Processing CreateTablet for tablet 6b90c8dce8d644d3b2284f0a2428f862 (DEFAULT_TABLE table=test-workload [id=ba98b241cbf24dc0bb5bff6fa95ac9fc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:50.569506 10012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b90c8dce8d644d3b2284f0a2428f862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.575907 10071 tablet_bootstrap.cc:492] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c: Bootstrap starting.
I20260709 12:18:50.577534 10068 tablet_bootstrap.cc:492] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a: No bootstrap required, opened a new log
I20260709 12:18:50.578064 10068 ts_tablet_manager.cc:1403] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a: Time spent bootstrapping tablet: real 0.184s	user 0.014s	sys 0.006s
I20260709 12:18:50.580282 10069 tablet_bootstrap.cc:654] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.586983 10068 raft_consensus.cc:359] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.591064 10068 raft_consensus.cc:385] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.602413 10068 raft_consensus.cc:740] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.606401 10068 consensus_queue.cc:260] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.608909 10071 tablet_bootstrap.cc:654] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.621984  9901 heartbeater.cc:499] Master 127.9.131.126:34905 was elected leader, sending a full tablet report...
I20260709 12:18:50.622236 10068 ts_tablet_manager.cc:1434] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.005s
I20260709 12:18:50.630941 10068 tablet_bootstrap.cc:492] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a: Bootstrap starting.
I20260709 12:18:50.627609 10069 tablet_bootstrap.cc:492] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c: No bootstrap required, opened a new log
I20260709 12:18:50.632223 10069 ts_tablet_manager.cc:1403] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c: Time spent bootstrapping tablet: real 0.204s	user 0.022s	sys 0.005s
I20260709 12:18:50.635439 10069 raft_consensus.cc:359] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.636268 10069 raft_consensus.cc:385] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.636575 10069 raft_consensus.cc:740] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b35894035d040c1a9cb3349478e1f2c, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.640204 10069 consensus_queue.cc:260] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.645691 10068 tablet_bootstrap.cc:654] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.649381 10069 ts_tablet_manager.cc:1434] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.002s
I20260709 12:18:50.650307 10050 heartbeater.cc:499] Master 127.9.131.126:34905 was elected leader, sending a full tablet report...
I20260709 12:18:50.655958 10069 tablet_bootstrap.cc:492] T 0110b40df05c421892d32cc121aaa2d5 P 1b35894035d040c1a9cb3349478e1f2c: Bootstrap starting.
I20260709 12:18:50.657936 10068 tablet_bootstrap.cc:492] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a: No bootstrap required, opened a new log
I20260709 12:18:50.658516 10068 ts_tablet_manager.cc:1403] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.010s
I20260709 12:18:50.661751 10068 raft_consensus.cc:359] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.662689 10068 raft_consensus.cc:385] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.663125 10069 tablet_bootstrap.cc:654] T 0110b40df05c421892d32cc121aaa2d5 P 1b35894035d040c1a9cb3349478e1f2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.663064 10068 raft_consensus.cc:740] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.664008 10068 consensus_queue.cc:260] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.666469 10068 ts_tablet_manager.cc:1434] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:18:50.667601 10068 tablet_bootstrap.cc:492] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a: Bootstrap starting.
I20260709 12:18:50.674539 10068 tablet_bootstrap.cc:654] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.675549 10069 tablet_bootstrap.cc:492] T 0110b40df05c421892d32cc121aaa2d5 P 1b35894035d040c1a9cb3349478e1f2c: No bootstrap required, opened a new log
I20260709 12:18:50.676146 10069 ts_tablet_manager.cc:1403] T 0110b40df05c421892d32cc121aaa2d5 P 1b35894035d040c1a9cb3349478e1f2c: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.011s
I20260709 12:18:50.679680 10069 raft_consensus.cc:359] T 0110b40df05c421892d32cc121aaa2d5 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.680534 10069 raft_consensus.cc:385] T 0110b40df05c421892d32cc121aaa2d5 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.681071 10069 raft_consensus.cc:740] T 0110b40df05c421892d32cc121aaa2d5 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b35894035d040c1a9cb3349478e1f2c, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.682080 10069 consensus_queue.cc:260] T 0110b40df05c421892d32cc121aaa2d5 P 1b35894035d040c1a9cb3349478e1f2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.684955 10069 ts_tablet_manager.cc:1434] T 0110b40df05c421892d32cc121aaa2d5 P 1b35894035d040c1a9cb3349478e1f2c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:18:50.686024 10069 tablet_bootstrap.cc:492] T c7766e3f04a14cc0ab63c48ee33cd298 P 1b35894035d040c1a9cb3349478e1f2c: Bootstrap starting.
I20260709 12:18:50.687228 10068 tablet_bootstrap.cc:492] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a: No bootstrap required, opened a new log
I20260709 12:18:50.687785 10068 ts_tablet_manager.cc:1403] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.006s
I20260709 12:18:50.690901 10068 raft_consensus.cc:359] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.692047 10068 raft_consensus.cc:385] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.692457 10068 raft_consensus.cc:740] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.692783 10069 tablet_bootstrap.cc:654] T c7766e3f04a14cc0ab63c48ee33cd298 P 1b35894035d040c1a9cb3349478e1f2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.693300 10068 consensus_queue.cc:260] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.695981 10068 ts_tablet_manager.cc:1434] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:18:50.697142 10068 tablet_bootstrap.cc:492] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a: Bootstrap starting.
I20260709 12:18:50.704141 10068 tablet_bootstrap.cc:654] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.705468 10069 tablet_bootstrap.cc:492] T c7766e3f04a14cc0ab63c48ee33cd298 P 1b35894035d040c1a9cb3349478e1f2c: No bootstrap required, opened a new log
I20260709 12:18:50.705994 10069 ts_tablet_manager.cc:1403] T c7766e3f04a14cc0ab63c48ee33cd298 P 1b35894035d040c1a9cb3349478e1f2c: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 12:18:50.709962 10069 raft_consensus.cc:359] T c7766e3f04a14cc0ab63c48ee33cd298 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.710855 10069 raft_consensus.cc:385] T c7766e3f04a14cc0ab63c48ee33cd298 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.711217 10069 raft_consensus.cc:740] T c7766e3f04a14cc0ab63c48ee33cd298 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b35894035d040c1a9cb3349478e1f2c, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.712321 10069 consensus_queue.cc:260] T c7766e3f04a14cc0ab63c48ee33cd298 P 1b35894035d040c1a9cb3349478e1f2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.712960 10071 tablet_bootstrap.cc:492] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c: No bootstrap required, opened a new log
I20260709 12:18:50.713598 10071 ts_tablet_manager.cc:1403] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c: Time spent bootstrapping tablet: real 0.141s	user 0.026s	sys 0.069s
I20260709 12:18:50.715184 10069 ts_tablet_manager.cc:1434] T c7766e3f04a14cc0ab63c48ee33cd298 P 1b35894035d040c1a9cb3349478e1f2c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 12:18:50.716214 10069 tablet_bootstrap.cc:492] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c: Bootstrap starting.
I20260709 12:18:50.717792 10068 tablet_bootstrap.cc:492] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a: No bootstrap required, opened a new log
I20260709 12:18:50.717407 10071 raft_consensus.cc:359] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.718286 10071 raft_consensus.cc:385] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.718446 10068 ts_tablet_manager.cc:1403] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.005s
I20260709 12:18:50.718654 10071 raft_consensus.cc:740] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.719735 10071 consensus_queue.cc:260] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.722057 10068 raft_consensus.cc:359] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.722905 10068 raft_consensus.cc:385] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.723272 10068 raft_consensus.cc:740] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.723568 10069 tablet_bootstrap.cc:654] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.724386 10068 consensus_queue.cc:260] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.726950 10068 ts_tablet_manager.cc:1434] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:18:50.728235 10068 tablet_bootstrap.cc:492] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a: Bootstrap starting.
I20260709 12:18:50.728924 10071 ts_tablet_manager.cc:1434] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.009s
I20260709 12:18:50.729673  9976 heartbeater.cc:499] Master 127.9.131.126:34905 was elected leader, sending a full tablet report...
I20260709 12:18:50.735179 10069 tablet_bootstrap.cc:492] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c: No bootstrap required, opened a new log
I20260709 12:18:50.735731 10069 ts_tablet_manager.cc:1403] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:18:50.736912 10068 tablet_bootstrap.cc:654] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.738893 10071 tablet_bootstrap.cc:492] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c: Bootstrap starting.
I20260709 12:18:50.738845 10069 raft_consensus.cc:359] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.739636 10069 raft_consensus.cc:385] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.740010 10069 raft_consensus.cc:740] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b35894035d040c1a9cb3349478e1f2c, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.741120 10069 consensus_queue.cc:260] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
W20260709 12:18:50.742107  9902 tablet.cc:2406] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:18:50.743834 10069 ts_tablet_manager.cc:1434] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:18:50.745149 10069 tablet_bootstrap.cc:492] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c: Bootstrap starting.
I20260709 12:18:50.750955 10068 tablet_bootstrap.cc:492] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a: No bootstrap required, opened a new log
I20260709 12:18:50.751621 10068 ts_tablet_manager.cc:1403] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.008s
I20260709 12:18:50.755158 10071 tablet_bootstrap.cc:654] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.754802 10068 raft_consensus.cc:359] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.755777 10068 raft_consensus.cc:385] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.756183 10068 raft_consensus.cc:740] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.756964 10068 consensus_queue.cc:260] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.758853 10068 ts_tablet_manager.cc:1434] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 12:18:50.759090 10069 tablet_bootstrap.cc:654] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.760030 10068 tablet_bootstrap.cc:492] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a: Bootstrap starting.
I20260709 12:18:50.767485 10068 tablet_bootstrap.cc:654] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.773649 10071 tablet_bootstrap.cc:492] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c: No bootstrap required, opened a new log
I20260709 12:18:50.773648 10069 tablet_bootstrap.cc:492] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c: No bootstrap required, opened a new log
I20260709 12:18:50.774449 10069 ts_tablet_manager.cc:1403] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.012s
I20260709 12:18:50.774374 10071 ts_tablet_manager.cc:1403] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.007s
I20260709 12:18:50.777192 10068 tablet_bootstrap.cc:492] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a: No bootstrap required, opened a new log
I20260709 12:18:50.777726 10068 ts_tablet_manager.cc:1403] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.005s
I20260709 12:18:50.778056 10071 raft_consensus.cc:359] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.778215 10069 raft_consensus.cc:359] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.779107 10069 raft_consensus.cc:385] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.778898 10071 raft_consensus.cc:385] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.779479 10069 raft_consensus.cc:740] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b35894035d040c1a9cb3349478e1f2c, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.779583 10071 raft_consensus.cc:740] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.780550 10071 consensus_queue.cc:260] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.780881 10068 raft_consensus.cc:359] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.780727 10069 consensus_queue.cc:260] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.781652 10068 raft_consensus.cc:385] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.782094 10068 raft_consensus.cc:740] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.782904 10068 consensus_queue.cc:260] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.785272 10068 ts_tablet_manager.cc:1434] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:18:50.785285 10071 ts_tablet_manager.cc:1434] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 12:18:50.786363 10071 tablet_bootstrap.cc:492] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c: Bootstrap starting.
I20260709 12:18:50.786586 10068 tablet_bootstrap.cc:492] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a: Bootstrap starting.
I20260709 12:18:50.792358 10069 ts_tablet_manager.cc:1434] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:18:50.793295 10071 tablet_bootstrap.cc:654] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.793645 10068 tablet_bootstrap.cc:654] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.794389 10069 tablet_bootstrap.cc:492] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c: Bootstrap starting.
I20260709 12:18:50.806783 10073 raft_consensus.cc:493] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.807425 10073 raft_consensus.cc:515] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.808226 10069 tablet_bootstrap.cc:654] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.814232 10073 leader_election.cc:290] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:50.817489 10069 tablet_bootstrap.cc:492] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c: No bootstrap required, opened a new log
I20260709 12:18:50.818079 10069 ts_tablet_manager.cc:1403] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.005s
I20260709 12:18:50.822034 10071 tablet_bootstrap.cc:492] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c: No bootstrap required, opened a new log
I20260709 12:18:50.821970 10069 raft_consensus.cc:359] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.823239 10069 raft_consensus.cc:385] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.823673 10069 raft_consensus.cc:740] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b35894035d040c1a9cb3349478e1f2c, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.824682 10069 consensus_queue.cc:260] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.822777 10071 ts_tablet_manager.cc:1403] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.008s
I20260709 12:18:50.827070 10069 ts_tablet_manager.cc:1434] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.004s
I20260709 12:18:50.827617 10068 tablet_bootstrap.cc:492] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a: No bootstrap required, opened a new log
I20260709 12:18:50.828141 10069 tablet_bootstrap.cc:492] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c: Bootstrap starting.
I20260709 12:18:50.828197 10068 ts_tablet_manager.cc:1403] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a: Time spent bootstrapping tablet: real 0.042s	user 0.024s	sys 0.015s
I20260709 12:18:50.831341 10068 raft_consensus.cc:359] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.832221 10068 raft_consensus.cc:385] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.832645 10068 raft_consensus.cc:740] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.833539 10068 consensus_queue.cc:260] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.836498 10068 ts_tablet_manager.cc:1434] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:18:50.837673 10068 tablet_bootstrap.cc:492] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a: Bootstrap starting.
I20260709 12:18:50.839540 10069 tablet_bootstrap.cc:654] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.844867 10068 tablet_bootstrap.cc:654] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.847445 10075 raft_consensus.cc:493] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.847980 10075 raft_consensus.cc:515] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.848742 10069 tablet_bootstrap.cc:492] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c: No bootstrap required, opened a new log
I20260709 12:18:50.848532 10071 raft_consensus.cc:359] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.849213 10069 ts_tablet_manager.cc:1403] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.005s
I20260709 12:18:50.849215 10071 raft_consensus.cc:385] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.849723 10071 raft_consensus.cc:740] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.850742 10075 leader_election.cc:290] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569)
I20260709 12:18:50.852450 10069 raft_consensus.cc:359] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.853322 10069 raft_consensus.cc:385] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.853621 10069 raft_consensus.cc:740] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b35894035d040c1a9cb3349478e1f2c, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.854318 10069 consensus_queue.cc:260] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.857229 10069 ts_tablet_manager.cc:1434] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:18:50.858316 10069 tablet_bootstrap.cc:492] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c: Bootstrap starting.
I20260709 12:18:50.862958 10068 tablet_bootstrap.cc:492] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a: No bootstrap required, opened a new log
I20260709 12:18:50.863564 10068 ts_tablet_manager.cc:1403] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.003s
I20260709 12:18:50.866074 10069 tablet_bootstrap.cc:654] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.866290 10068 raft_consensus.cc:359] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.867255 10068 raft_consensus.cc:385] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.867578 10068 raft_consensus.cc:740] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.868350 10068 consensus_queue.cc:260] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.870680 10068 ts_tablet_manager.cc:1434] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:18:50.871937 10068 tablet_bootstrap.cc:492] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a: Bootstrap starting.
I20260709 12:18:50.877823 10068 tablet_bootstrap.cc:654] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.878314 10069 tablet_bootstrap.cc:492] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c: No bootstrap required, opened a new log
I20260709 12:18:50.878392 10073 raft_consensus.cc:493] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.878913 10069 ts_tablet_manager.cc:1403] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.002s
I20260709 12:18:50.878886 10073 raft_consensus.cc:515] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.881108 10073 leader_election.cc:290] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:50.881659 10069 raft_consensus.cc:359] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.882349 10069 raft_consensus.cc:385] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.882627 10069 raft_consensus.cc:740] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b35894035d040c1a9cb3349478e1f2c, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.883443 10069 consensus_queue.cc:260] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.885821 10069 ts_tablet_manager.cc:1434] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:18:50.886782 10069 tablet_bootstrap.cc:492] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c: Bootstrap starting.
I20260709 12:18:50.892863 10068 tablet_bootstrap.cc:492] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a: No bootstrap required, opened a new log
I20260709 12:18:50.893411 10068 ts_tablet_manager.cc:1403] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 12:18:50.893642 10069 tablet_bootstrap.cc:654] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.896354 10068 raft_consensus.cc:359] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.897100 10068 raft_consensus.cc:385] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.897442 10068 raft_consensus.cc:740] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.898200 10068 consensus_queue.cc:260] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.900604 10068 ts_tablet_manager.cc:1434] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:18:50.900764 10071 consensus_queue.cc:260] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.902913 10071 ts_tablet_manager.cc:1434] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c: Time spent starting tablet: real 0.077s	user 0.004s	sys 0.000s
I20260709 12:18:50.903697 10071 tablet_bootstrap.cc:492] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c: Bootstrap starting.
I20260709 12:18:50.906450  9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcfb35aafee4ee08151319ebb25cc59" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c" is_pre_election: true
I20260709 12:18:50.908576  9950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0110b40df05c421892d32cc121aaa2d5" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c" is_pre_election: true
I20260709 12:18:50.910298 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0110b40df05c421892d32cc121aaa2d5" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b35894035d040c1a9cb3349478e1f2c" is_pre_election: true
I20260709 12:18:50.910291 10025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcfb35aafee4ee08151319ebb25cc59" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b35894035d040c1a9cb3349478e1f2c" is_pre_election: true
I20260709 12:18:50.911175 10024 raft_consensus.cc:2468] T 0110b40df05c421892d32cc121aaa2d5 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 0.
I20260709 12:18:50.911573 10025 raft_consensus.cc:2468] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 0.
W20260709 12:18:50.912786  9841 leader_election.cc:343] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:50.913561  9841 leader_election.cc:343] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:50.914290 10073 raft_consensus.cc:493] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.914748 10073 raft_consensus.cc:515] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.916833 10073 leader_election.cc:290] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:50.916699  9841 leader_election.cc:304] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a; no voters: 3615592255dd42ba970d0805ce5f8f6c
I20260709 12:18:50.917506 10073 raft_consensus.cc:2804] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:50.917903 10073 raft_consensus.cc:493] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.918144 10069 tablet_bootstrap.cc:492] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c: No bootstrap required, opened a new log
I20260709 12:18:50.917951  9841 leader_election.cc:304] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a; no voters: 3615592255dd42ba970d0805ce5f8f6c
I20260709 12:18:50.918426 10073 raft_consensus.cc:3060] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.918638 10069 ts_tablet_manager.cc:1403] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 12:18:50.921463 10069 raft_consensus.cc:359] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.922161 10069 raft_consensus.cc:385] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.922443 10069 raft_consensus.cc:740] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b35894035d040c1a9cb3349478e1f2c, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.923377 10069 consensus_queue.cc:260] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.925014 10071 tablet_bootstrap.cc:654] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.925608 10069 ts_tablet_manager.cc:1434] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:18:50.925473 10073 raft_consensus.cc:515] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.927575 10073 leader_election.cc:290] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 election: Requested vote from peers 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:50.928409 10073 raft_consensus.cc:2804] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:50.928819 10073 raft_consensus.cc:493] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.929203 10073 raft_consensus.cc:3060] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.929945  9950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055c16b2f90a4fdb80e042e23b3577b9" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c" is_pre_election: true
I20260709 12:18:50.930624 10025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055c16b2f90a4fdb80e042e23b3577b9" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b35894035d040c1a9cb3349478e1f2c" is_pre_election: true
I20260709 12:18:50.931247 10025 raft_consensus.cc:2468] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 0.
I20260709 12:18:50.933915  9950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0110b40df05c421892d32cc121aaa2d5" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
I20260709 12:18:50.934787  9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf74389f16242a3973eb6553bf32abe" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c" is_pre_election: true
I20260709 12:18:50.935969 10025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0110b40df05c421892d32cc121aaa2d5" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
I20260709 12:18:50.935740 10073 raft_consensus.cc:515] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.936545 10025 raft_consensus.cc:3060] T 0110b40df05c421892d32cc121aaa2d5 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.937976 10073 leader_election.cc:290] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 election: Requested vote from peers 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
W20260709 12:18:50.940302  9990 leader_election.cc:343] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:50.941453  9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcfb35aafee4ee08151319ebb25cc59" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
I20260709 12:18:50.941932  9841 leader_election.cc:304] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a; no voters: 
I20260709 12:18:50.941453 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcfb35aafee4ee08151319ebb25cc59" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
I20260709 12:18:50.942858 10073 raft_consensus.cc:2804] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:50.942862 10024 raft_consensus.cc:3060] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.943275 10073 raft_consensus.cc:493] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.943779 10073 raft_consensus.cc:3060] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.949110  9876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf74389f16242a3973eb6553bf32abe" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3068f957554638bff21f2bdbccc92a" is_pre_election: true
I20260709 12:18:50.949965  9876 raft_consensus.cc:2468] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b35894035d040c1a9cb3349478e1f2c in term 0.
I20260709 12:18:50.951841  9988 leader_election.cc:304] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a; no voters: 3615592255dd42ba970d0805ce5f8f6c
I20260709 12:18:50.952881 10075 raft_consensus.cc:2804] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:50.953298 10075 raft_consensus.cc:493] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.953094 10073 raft_consensus.cc:515] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.953689 10075 raft_consensus.cc:3060] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:50.954010  9841 leader_election.cc:343] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:50.954923  9841 leader_election.cc:343] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:50.955546  9841 leader_election.cc:343] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:50.956085 10024 raft_consensus.cc:2468] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 1.
I20260709 12:18:50.957265 10025 raft_consensus.cc:2468] T 0110b40df05c421892d32cc121aaa2d5 P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 1.
I20260709 12:18:50.958616  9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055c16b2f90a4fdb80e042e23b3577b9" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
W20260709 12:18:50.959637  9841 leader_election.cc:343] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:50.962474 10071 tablet_bootstrap.cc:492] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c: No bootstrap required, opened a new log
I20260709 12:18:50.963061 10081 raft_consensus.cc:493] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.964756 10025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055c16b2f90a4fdb80e042e23b3577b9" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
I20260709 12:18:50.969506 10081 raft_consensus.cc:515] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.969506 10071 ts_tablet_manager.cc:1403] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c: Time spent bootstrapping tablet: real 0.066s	user 0.007s	sys 0.011s
I20260709 12:18:50.962508 10075 raft_consensus.cc:515] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.962592 10073 leader_election.cc:290] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 election: Requested vote from peers 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:50.969803 10025 raft_consensus.cc:3060] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.972885 10081 leader_election.cc:290] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:50.973594 10075 leader_election.cc:290] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 1 election: Requested vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569)
I20260709 12:18:50.975296  9876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf74389f16242a3973eb6553bf32abe" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
I20260709 12:18:50.976065  9876 raft_consensus.cc:3060] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.976058 10071 raft_consensus.cc:359] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.977037 10071 raft_consensus.cc:385] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.977450 10071 raft_consensus.cc:740] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.978209 10071 consensus_queue.cc:260] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.981244 10071 ts_tablet_manager.cc:1434] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:18:50.982308 10071 tablet_bootstrap.cc:492] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c: Bootstrap starting.
I20260709 12:18:50.964308  9841 leader_election.cc:304] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a; no voters: 3615592255dd42ba970d0805ce5f8f6c
I20260709 12:18:50.988422 10073 raft_consensus.cc:2804] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:50.988958 10073 raft_consensus.cc:697] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Becoming Leader. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Running, Role: LEADER
I20260709 12:18:50.988880  9841 leader_election.cc:304] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a; no voters: 3615592255dd42ba970d0805ce5f8f6c
I20260709 12:18:50.989401 10071 tablet_bootstrap.cc:654] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.989923 10073 consensus_queue.cc:237] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:50.993527  9876 raft_consensus.cc:2468] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b35894035d040c1a9cb3349478e1f2c in term 1.
I20260709 12:18:50.994949  9988 leader_election.cc:304] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a; no voters: 
I20260709 12:18:50.995913 10075 raft_consensus.cc:2804] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:50.999976 10102 raft_consensus.cc:2804] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:51.005060 10110 raft_consensus.cc:493] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.005734 10110 raft_consensus.cc:515] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.012432 10081 raft_consensus.cc:493] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.013031 10081 raft_consensus.cc:515] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.013509 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ddf2f4a1a4487db6eaa4786a28be51" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b35894035d040c1a9cb3349478e1f2c" is_pre_election: true
I20260709 12:18:51.014289 10024 raft_consensus.cc:2468] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3615592255dd42ba970d0805ce5f8f6c in term 0.
I20260709 12:18:51.014626 10075 raft_consensus.cc:697] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 1 LEADER]: Becoming Leader. State: Replica: 1b35894035d040c1a9cb3349478e1f2c, State: Running, Role: LEADER
I20260709 12:18:51.015142 10081 leader_election.cc:290] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:51.015465 10108 raft_consensus.cc:493] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.016814 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b35894035d040c1a9cb3349478e1f2c" is_pre_election: true
I20260709 12:18:51.016932 10108 raft_consensus.cc:515] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.017367 10112 raft_consensus.cc:493] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.015746 10075 consensus_queue.cc:237] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.017529 10024 raft_consensus.cc:2468] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3615592255dd42ba970d0805ce5f8f6c in term 0.
I20260709 12:18:51.017969 10112 raft_consensus.cc:515] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.020104  9916 leader_election.cc:304] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 3615592255dd42ba970d0805ce5f8f6c; no voters: 
I20260709 12:18:51.020393 10112 leader_election.cc:290] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:51.021077 10081 raft_consensus.cc:2804] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:51.021245  9916 leader_election.cc:304] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 3615592255dd42ba970d0805ce5f8f6c; no voters: 
I20260709 12:18:51.021502 10081 raft_consensus.cc:493] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.021862 10081 raft_consensus.cc:3060] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.024798 10110 leader_election.cc:290] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569)
I20260709 12:18:51.024928  9876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3068f957554638bff21f2bdbccc92a" is_pre_election: true
I20260709 12:18:51.025801  9876 raft_consensus.cc:2468] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b35894035d040c1a9cb3349478e1f2c in term 0.
I20260709 12:18:51.026597  9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c" is_pre_election: true
I20260709 12:18:51.030474  9951 raft_consensus.cc:2468] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 0.
I20260709 12:18:51.028136  9875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ddf2f4a1a4487db6eaa4786a28be51" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3068f957554638bff21f2bdbccc92a" is_pre_election: true
I20260709 12:18:51.031113  9988 leader_election.cc:304] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a; no voters: 
I20260709 12:18:51.031292 10108 leader_election.cc:290] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569)
I20260709 12:18:51.029449 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b35894035d040c1a9cb3349478e1f2c" is_pre_election: true
I20260709 12:18:51.029211 10081 raft_consensus.cc:515] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.031486  9875 raft_consensus.cc:2468] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b35894035d040c1a9cb3349478e1f2c in term 0.
I20260709 12:18:51.031944 10110 raft_consensus.cc:2804] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:51.040735 10024 raft_consensus.cc:2468] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 0.
I20260709 12:18:51.029227 10112 raft_consensus.cc:493] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.041792 10081 leader_election.cc:290] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 1 election: Requested vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:51.041940 10110 raft_consensus.cc:493] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.042348 10110 raft_consensus.cc:3060] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.042447 10081 raft_consensus.cc:2804] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:51.042810 10081 raft_consensus.cc:493] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.043139 10081 raft_consensus.cc:3060] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.036242  9841 leader_election.cc:304] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3615592255dd42ba970d0805ce5f8f6c, 5f3068f957554638bff21f2bdbccc92a; no voters: 
I20260709 12:18:51.038352 10025 raft_consensus.cc:2468] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 1.
I20260709 12:18:51.041630  9988 leader_election.cc:304] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a; no voters: 
I20260709 12:18:51.045490 10073 raft_consensus.cc:2804] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:51.032979 10102 raft_consensus.cc:697] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Becoming Leader. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Running, Role: LEADER
I20260709 12:18:51.045871 10073 raft_consensus.cc:493] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.041689 10112 raft_consensus.cc:515] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.052839 10110 raft_consensus.cc:515] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.048321 10073 raft_consensus.cc:3060] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.048786 10108 raft_consensus.cc:2804] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:51.057006 10109 raft_consensus.cc:493] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.060878 10111 raft_consensus.cc:493] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.061033 10109 raft_consensus.cc:515] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.062892 10071 tablet_bootstrap.cc:492] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c: No bootstrap required, opened a new log
I20260709 12:18:51.060359 10108 raft_consensus.cc:493] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.061957 10111 raft_consensus.cc:515] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.059381  9841 leader_election.cc:304] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a; no voters: 3615592255dd42ba970d0805ce5f8f6c
I20260709 12:18:51.046562 10102 consensus_queue.cc:237] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
W20260709 12:18:51.065653  9916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:35063, user_credentials={real_user=slave}} blocked reactor thread for 44487.2us
I20260709 12:18:51.066010  9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf74389f16242a3973eb6553bf32abe" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
I20260709 12:18:51.054535  9769 catalog_manager.cc:5697] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f3068f957554638bff21f2bdbccc92a (127.9.131.65). New cstate: current_term: 1 leader_uuid: "5f3068f957554638bff21f2bdbccc92a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:51.082093 10112 leader_election.cc:290] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:51.080905 10071 ts_tablet_manager.cc:1403] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c: Time spent bootstrapping tablet: real 0.098s	user 0.022s	sys 0.010s
I20260709 12:18:51.078814 10108 raft_consensus.cc:3060] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.084803 10109 leader_election.cc:290] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569)
I20260709 12:18:51.087488  9950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c" is_pre_election: true
I20260709 12:18:51.086766 10112 raft_consensus.cc:2804] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:51.100481 10025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ddf2f4a1a4487db6eaa4786a28be51" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
I20260709 12:18:51.104220  9949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ddf2f4a1a4487db6eaa4786a28be51" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c" is_pre_election: true
I20260709 12:18:51.107363  9949 raft_consensus.cc:2393] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b35894035d040c1a9cb3349478e1f2c in current term 1: Already voted for candidate 3615592255dd42ba970d0805ce5f8f6c in this term.
W20260709 12:18:51.104383  9990 leader_election.cc:343] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:51.101344 10112 raft_consensus.cc:697] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Becoming Leader. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Running, Role: LEADER
I20260709 12:18:51.104310  9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ed8384453347aaafc0d6a5b2a4731d" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c" is_pre_election: true
I20260709 12:18:51.107353  9875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
I20260709 12:18:51.113653  9876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ed8384453347aaafc0d6a5b2a4731d" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3068f957554638bff21f2bdbccc92a" is_pre_election: true
I20260709 12:18:51.114372  9876 raft_consensus.cc:2468] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b35894035d040c1a9cb3349478e1f2c in term 0.
I20260709 12:18:51.114297 10081 raft_consensus.cc:515] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.116700 10113 raft_consensus.cc:493] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.113656 10073 raft_consensus.cc:515] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.118002  9988 leader_election.cc:304] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a; no voters: 
I20260709 12:18:51.118475  9875 raft_consensus.cc:2393] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1b35894035d040c1a9cb3349478e1f2c in current term 1: Already voted for candidate 5f3068f957554638bff21f2bdbccc92a in this term.
I20260709 12:18:51.118772 10109 raft_consensus.cc:2804] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:51.119812 10109 raft_consensus.cc:493] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.119668  9874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ddf2f4a1a4487db6eaa4786a28be51" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3068f957554638bff21f2bdbccc92a" is_pre_election: true
I20260709 12:18:51.120239 10109 raft_consensus.cc:3060] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:51.110837  9841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:35063, user_credentials={real_user=slave}} blocked reactor thread for 50950.2us
I20260709 12:18:51.112432 10110 leader_election.cc:290] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 1 election: Requested vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569)
I20260709 12:18:51.120528  9874 raft_consensus.cc:2468] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3615592255dd42ba970d0805ce5f8f6c in term 0.
I20260709 12:18:51.117885  9950 raft_consensus.cc:2393] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b35894035d040c1a9cb3349478e1f2c in current term 1: Already voted for candidate 3615592255dd42ba970d0805ce5f8f6c in this term.
I20260709 12:18:51.122403  9876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3068f957554638bff21f2bdbccc92a" is_pre_election: true
I20260709 12:18:51.125140 10073 leader_election.cc:290] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 election: Requested vote from peers 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:51.123848  9873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ddf2f4a1a4487db6eaa4786a28be51" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
I20260709 12:18:51.129388  9873 raft_consensus.cc:3060] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.130803  9951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
I20260709 12:18:51.131078 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7766e3f04a14cc0ab63c48ee33cd298" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b35894035d040c1a9cb3349478e1f2c" is_pre_election: true
I20260709 12:18:51.133597  9951 raft_consensus.cc:2393] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f3068f957554638bff21f2bdbccc92a in current term 1: Already voted for candidate 3615592255dd42ba970d0805ce5f8f6c in this term.
I20260709 12:18:51.133843  9949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
I20260709 12:18:51.134500  9949 raft_consensus.cc:2393] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1b35894035d040c1a9cb3349478e1f2c in current term 1: Already voted for candidate 3615592255dd42ba970d0805ce5f8f6c in this term.
I20260709 12:18:51.132802 10024 raft_consensus.cc:2468] T c7766e3f04a14cc0ab63c48ee33cd298 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 0.
I20260709 12:18:51.136533  9876 raft_consensus.cc:2393] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3615592255dd42ba970d0805ce5f8f6c in current term 1: Already voted for candidate 5f3068f957554638bff21f2bdbccc92a in this term.
I20260709 12:18:51.134747  9950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7766e3f04a14cc0ab63c48ee33cd298" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c" is_pre_election: true
I20260709 12:18:51.137341  9950 raft_consensus.cc:2468] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 0.
I20260709 12:18:51.119700  9772 catalog_manager.cc:5697] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1b35894035d040c1a9cb3349478e1f2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.117193 10113 raft_consensus.cc:515] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.141139 10081 leader_election.cc:290] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 1 election: Requested vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:51.141624 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
I20260709 12:18:51.142225  9876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
I20260709 12:18:51.142516  9949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b90c8dce8d644d3b2284f0a2428f862" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c" is_pre_election: true
I20260709 12:18:51.124835 10112 consensus_queue.cc:237] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.144111 10023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
I20260709 12:18:51.144321 10024 raft_consensus.cc:2393] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f3068f957554638bff21f2bdbccc92a in current term 1: Already voted for candidate 1b35894035d040c1a9cb3349478e1f2c in this term.
I20260709 12:18:51.144295  9948 raft_consensus.cc:2468] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b35894035d040c1a9cb3349478e1f2c in term 0.
I20260709 12:18:51.145520  9990 leader_election.cc:304] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c; no voters: 3615592255dd42ba970d0805ce5f8f6c, 5f3068f957554638bff21f2bdbccc92a
I20260709 12:18:51.149614 10110 raft_consensus.cc:2749] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:18:51.149748 10109 raft_consensus.cc:515] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.152496 10109 leader_election.cc:290] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 1 election: Requested vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569)
I20260709 12:18:51.152709  9876 raft_consensus.cc:2393] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3615592255dd42ba970d0805ce5f8f6c in current term 1: Already voted for candidate 5f3068f957554638bff21f2bdbccc92a in this term.
I20260709 12:18:51.153474 10111 leader_election.cc:290] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:51.143211  9841 leader_election.cc:304] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a; no voters: 
I20260709 12:18:51.154194  9875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ed8384453347aaafc0d6a5b2a4731d" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
I20260709 12:18:51.156733  9875 raft_consensus.cc:3060] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.147009 10071 raft_consensus.cc:359] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.158463 10071 raft_consensus.cc:385] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.158795 10071 raft_consensus.cc:740] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.161036  9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ed8384453347aaafc0d6a5b2a4731d" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
I20260709 12:18:51.162151  9948 raft_consensus.cc:3060] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.166457  9873 raft_consensus.cc:2468] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3615592255dd42ba970d0805ce5f8f6c in term 1.
I20260709 12:18:51.163275 10071 consensus_queue.cc:260] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.170224 10071 ts_tablet_manager.cc:1434] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c: Time spent starting tablet: real 0.084s	user 0.007s	sys 0.000s
I20260709 12:18:51.163435 10111 raft_consensus.cc:2804] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:51.171121  9914 leader_election.cc:304] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3615592255dd42ba970d0805ce5f8f6c; no voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a
I20260709 12:18:51.174803 10113 leader_election.cc:290] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:51.176220 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ed8384453347aaafc0d6a5b2a4731d" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b35894035d040c1a9cb3349478e1f2c" is_pre_election: true
I20260709 12:18:51.177031 10024 raft_consensus.cc:2393] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3615592255dd42ba970d0805ce5f8f6c in current term 1: Already voted for candidate 1b35894035d040c1a9cb3349478e1f2c in this term.
I20260709 12:18:51.177757 10071 tablet_bootstrap.cc:492] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c: Bootstrap starting.
I20260709 12:18:51.173882 10111 raft_consensus.cc:493] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.181208 10111 raft_consensus.cc:3060] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.181275 10113 raft_consensus.cc:2749] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:18:51.182703  9875 raft_consensus.cc:2468] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b35894035d040c1a9cb3349478e1f2c in term 1.
I20260709 12:18:51.184247  9988 leader_election.cc:304] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a; no voters: 
W20260709 12:18:51.178922  9841 leader_election.cc:343] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:51.185048 10109 raft_consensus.cc:2804] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:51.185572 10109 raft_consensus.cc:697] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 1 LEADER]: Becoming Leader. State: Replica: 1b35894035d040c1a9cb3349478e1f2c, State: Running, Role: LEADER
I20260709 12:18:51.186388 10109 consensus_queue.cc:237] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.186847 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b90c8dce8d644d3b2284f0a2428f862" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b35894035d040c1a9cb3349478e1f2c" is_pre_election: true
I20260709 12:18:51.187582 10024 raft_consensus.cc:2468] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 0.
I20260709 12:18:51.187543  9914 leader_election.cc:304] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3615592255dd42ba970d0805ce5f8f6c, 5f3068f957554638bff21f2bdbccc92a; no voters: 
I20260709 12:18:51.189422 10113 raft_consensus.cc:2804] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:51.179379 10108 raft_consensus.cc:515] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.191499 10081 raft_consensus.cc:493] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.190308 10113 raft_consensus.cc:697] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 1 LEADER]: Becoming Leader. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Running, Role: LEADER
I20260709 12:18:51.197050 10081 raft_consensus.cc:515] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.198426  9948 raft_consensus.cc:2468] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b35894035d040c1a9cb3349478e1f2c in term 1.
I20260709 12:18:51.198226 10113 consensus_queue.cc:237] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.199293 10081 leader_election.cc:290] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:51.200637 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcfb35aafee4ee08151319ebb25cc59" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b35894035d040c1a9cb3349478e1f2c" is_pre_election: true
I20260709 12:18:51.201442 10024 raft_consensus.cc:2393] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3615592255dd42ba970d0805ce5f8f6c in current term 1: Already voted for candidate 5f3068f957554638bff21f2bdbccc92a in this term.
I20260709 12:18:51.201085  9841 leader_election.cc:304] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f3068f957554638bff21f2bdbccc92a; no voters: 1b35894035d040c1a9cb3349478e1f2c, 3615592255dd42ba970d0805ce5f8f6c
I20260709 12:18:51.202924 10102 raft_consensus.cc:2749] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:18:51.200999  9873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcfb35aafee4ee08151319ebb25cc59" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3068f957554638bff21f2bdbccc92a" is_pre_election: true
I20260709 12:18:51.203079  9841 leader_election.cc:304] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a; no voters: 3615592255dd42ba970d0805ce5f8f6c
I20260709 12:18:51.203703  9875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ed8384453347aaafc0d6a5b2a4731d" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3068f957554638bff21f2bdbccc92a" is_pre_election: true
I20260709 12:18:51.207625 10025 raft_consensus.cc:2393] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3615592255dd42ba970d0805ce5f8f6c in current term 1: Already voted for candidate 1b35894035d040c1a9cb3349478e1f2c in this term.
I20260709 12:18:51.208271 10102 raft_consensus.cc:2804] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:51.209650 10102 raft_consensus.cc:493] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.210369 10102 raft_consensus.cc:3060] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.215396  9875 raft_consensus.cc:2393] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3615592255dd42ba970d0805ce5f8f6c in current term 1: Already voted for candidate 1b35894035d040c1a9cb3349478e1f2c in this term.
I20260709 12:18:51.215193  9876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ddf2f4a1a4487db6eaa4786a28be51" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
I20260709 12:18:51.216178  9876 raft_consensus.cc:2393] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1b35894035d040c1a9cb3349478e1f2c in current term 1: Already voted for candidate 3615592255dd42ba970d0805ce5f8f6c in this term.
I20260709 12:18:51.212894 10108 leader_election.cc:290] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 1 election: Requested vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569)
I20260709 12:18:51.220171  9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ddf2f4a1a4487db6eaa4786a28be51" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
I20260709 12:18:51.216355  9914 leader_election.cc:304] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3615592255dd42ba970d0805ce5f8f6c; no voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a
I20260709 12:18:51.220603 10111 raft_consensus.cc:515] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.224081 10119 raft_consensus.cc:3060] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.226263 10025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7766e3f04a14cc0ab63c48ee33cd298" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
I20260709 12:18:51.226934 10025 raft_consensus.cc:3060] T c7766e3f04a14cc0ab63c48ee33cd298 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.232826 10102 raft_consensus.cc:515] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.233937 10025 raft_consensus.cc:2468] T c7766e3f04a14cc0ab63c48ee33cd298 P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 1.
I20260709 12:18:51.234948 10102 leader_election.cc:290] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 election: Requested vote from peers 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:51.235522  9841 leader_election.cc:304] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a; no voters: 
I20260709 12:18:51.225096 10111 leader_election.cc:290] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 election: Requested vote from peers 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:51.236449 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b90c8dce8d644d3b2284f0a2428f862" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
I20260709 12:18:51.238488 10024 raft_consensus.cc:3060] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.238677 10102 raft_consensus.cc:2804] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:51.236272  9990 leader_election.cc:304] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c; no voters: 3615592255dd42ba970d0805ce5f8f6c, 5f3068f957554638bff21f2bdbccc92a
I20260709 12:18:51.239881  9949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b90c8dce8d644d3b2284f0a2428f862" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
I20260709 12:18:51.239317 10102 raft_consensus.cc:697] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Becoming Leader. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Running, Role: LEADER
I20260709 12:18:51.239779 10108 raft_consensus.cc:2749] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:18:51.242274  9841 leader_election.cc:343] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:51.238165  9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7766e3f04a14cc0ab63c48ee33cd298" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
I20260709 12:18:51.236198  9914 leader_election.cc:304] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3615592255dd42ba970d0805ce5f8f6c; no voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a
I20260709 12:18:51.243089  9948 raft_consensus.cc:3060] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.243597 10081 raft_consensus.cc:2749] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:51.231662 10119 raft_consensus.cc:2749] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:51.247664 10071 tablet_bootstrap.cc:654] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.247175 10102 consensus_queue.cc:237] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.251536 10024 raft_consensus.cc:2468] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 1.
I20260709 12:18:51.252952  9841 leader_election.cc:304] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a; no voters: 3615592255dd42ba970d0805ce5f8f6c
I20260709 12:18:51.254348 10111 raft_consensus.cc:2804] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:51.254873 10111 raft_consensus.cc:697] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Becoming Leader. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Running, Role: LEADER
I20260709 12:18:51.255741 10111 consensus_queue.cc:237] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.271715  9948 raft_consensus.cc:2468] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 1.
I20260709 12:18:51.275278 10071 tablet_bootstrap.cc:492] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c: No bootstrap required, opened a new log
I20260709 12:18:51.275965 10071 ts_tablet_manager.cc:1403] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c: Time spent bootstrapping tablet: real 0.098s	user 0.014s	sys 0.008s
I20260709 12:18:51.284315 10071 raft_consensus.cc:359] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.285091 10071 raft_consensus.cc:385] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.285436 10071 raft_consensus.cc:740] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.286218 10071 consensus_queue.cc:260] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.288551 10071 ts_tablet_manager.cc:1434] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:18:51.287424  9769 catalog_manager.cc:5697] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f3068f957554638bff21f2bdbccc92a (127.9.131.65). New cstate: current_term: 1 leader_uuid: "5f3068f957554638bff21f2bdbccc92a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:51.289556 10071 tablet_bootstrap.cc:492] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c: Bootstrap starting.
I20260709 12:18:51.289625  9769 catalog_manager.cc:5697] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f3068f957554638bff21f2bdbccc92a (127.9.131.65). New cstate: current_term: 1 leader_uuid: "5f3068f957554638bff21f2bdbccc92a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:51.286633  9770 catalog_manager.cc:5697] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66). New cstate: current_term: 1 leader_uuid: "3615592255dd42ba970d0805ce5f8f6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:51.291639  9769 catalog_manager.cc:5697] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f3068f957554638bff21f2bdbccc92a (127.9.131.65). New cstate: current_term: 1 leader_uuid: "5f3068f957554638bff21f2bdbccc92a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:51.293825  9769 catalog_manager.cc:5697] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f3068f957554638bff21f2bdbccc92a (127.9.131.65). New cstate: current_term: 1 leader_uuid: "5f3068f957554638bff21f2bdbccc92a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:51.299223 10071 tablet_bootstrap.cc:654] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.314432  9770 catalog_manager.cc:5697] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1b35894035d040c1a9cb3349478e1f2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.316009 10071 tablet_bootstrap.cc:492] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c: No bootstrap required, opened a new log
I20260709 12:18:51.316552 10071 ts_tablet_manager.cc:1403] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.004s
I20260709 12:18:51.319829 10071 raft_consensus.cc:359] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.320705 10071 raft_consensus.cc:385] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.321036 10071 raft_consensus.cc:740] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.321843 10071 consensus_queue.cc:260] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.324739 10071 ts_tablet_manager.cc:1434] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 12:18:51.325739 10071 tablet_bootstrap.cc:492] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c: Bootstrap starting.
I20260709 12:18:51.332858 10071 tablet_bootstrap.cc:654] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.337810 10071 tablet_bootstrap.cc:492] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c: No bootstrap required, opened a new log
I20260709 12:18:51.338296 10071 ts_tablet_manager.cc:1403] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.003s
I20260709 12:18:51.340864 10071 raft_consensus.cc:359] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.341563 10071 raft_consensus.cc:385] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.341822 10071 raft_consensus.cc:740] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.342489 10071 consensus_queue.cc:260] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.344471 10071 ts_tablet_manager.cc:1434] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:18:51.345366 10071 tablet_bootstrap.cc:492] T 6b90c8dce8d644d3b2284f0a2428f862 P 3615592255dd42ba970d0805ce5f8f6c: Bootstrap starting.
I20260709 12:18:51.351682 10071 tablet_bootstrap.cc:654] T 6b90c8dce8d644d3b2284f0a2428f862 P 3615592255dd42ba970d0805ce5f8f6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.356405 10071 tablet_bootstrap.cc:492] T 6b90c8dce8d644d3b2284f0a2428f862 P 3615592255dd42ba970d0805ce5f8f6c: No bootstrap required, opened a new log
I20260709 12:18:51.357293 10071 ts_tablet_manager.cc:1403] T 6b90c8dce8d644d3b2284f0a2428f862 P 3615592255dd42ba970d0805ce5f8f6c: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.004s
I20260709 12:18:51.359743 10071 raft_consensus.cc:359] T 6b90c8dce8d644d3b2284f0a2428f862 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.360532 10071 raft_consensus.cc:385] T 6b90c8dce8d644d3b2284f0a2428f862 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.360991 10071 raft_consensus.cc:740] T 6b90c8dce8d644d3b2284f0a2428f862 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.362002 10071 consensus_queue.cc:260] T 6b90c8dce8d644d3b2284f0a2428f862 P 3615592255dd42ba970d0805ce5f8f6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.364282 10071 ts_tablet_manager.cc:1434] T 6b90c8dce8d644d3b2284f0a2428f862 P 3615592255dd42ba970d0805ce5f8f6c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:18:51.387885 10113 raft_consensus.cc:493] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.388370 10113 raft_consensus.cc:515] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.390098 10113 leader_election.cc:290] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:51.390906  9875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0110b40df05c421892d32cc121aaa2d5" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3068f957554638bff21f2bdbccc92a" is_pre_election: true
I20260709 12:18:51.391291 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0110b40df05c421892d32cc121aaa2d5" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b35894035d040c1a9cb3349478e1f2c" is_pre_election: true
I20260709 12:18:51.392040 10024 raft_consensus.cc:2393] T 0110b40df05c421892d32cc121aaa2d5 P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3615592255dd42ba970d0805ce5f8f6c in current term 1: Already voted for candidate 5f3068f957554638bff21f2bdbccc92a in this term.
I20260709 12:18:51.392937  9916 leader_election.cc:304] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3615592255dd42ba970d0805ce5f8f6c; no voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a
I20260709 12:18:51.393574 10113 raft_consensus.cc:3060] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.398134 10113 raft_consensus.cc:2749] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:51.418722 10108 consensus_queue.cc:1048] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:51.434271  9948 raft_consensus.cc:3060] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.442056 10109 consensus_queue.cc:1048] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:18:51.467585  9821 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:51.548115 10102 consensus_queue.cc:1048] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:51.560479 10112 consensus_queue.cc:1048] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:51.573135  9949 raft_consensus.cc:3060] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.581740 10112 consensus_queue.cc:1048] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:51.594851 10073 consensus_queue.cc:1048] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:51.609099 10113 consensus_queue.cc:1048] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:51.626776 10081 consensus_queue.cc:1048] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:51.648110 10081 raft_consensus.cc:493] T 6b90c8dce8d644d3b2284f0a2428f862 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.648708 10081 raft_consensus.cc:515] T 6b90c8dce8d644d3b2284f0a2428f862 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:51.651678 10081 leader_election.cc:290] T 6b90c8dce8d644d3b2284f0a2428f862 P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:51.651908  9875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b90c8dce8d644d3b2284f0a2428f862" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3068f957554638bff21f2bdbccc92a" is_pre_election: true
I20260709 12:18:51.653100 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b90c8dce8d644d3b2284f0a2428f862" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b35894035d040c1a9cb3349478e1f2c" is_pre_election: true
I20260709 12:18:51.653941 10024 raft_consensus.cc:2393] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3615592255dd42ba970d0805ce5f8f6c in current term 1: Already voted for candidate 5f3068f957554638bff21f2bdbccc92a in this term.
I20260709 12:18:51.655059  9916 leader_election.cc:304] T 6b90c8dce8d644d3b2284f0a2428f862 P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3615592255dd42ba970d0805ce5f8f6c; no voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a
I20260709 12:18:51.655961 10081 raft_consensus.cc:3060] T 6b90c8dce8d644d3b2284f0a2428f862 P 3615592255dd42ba970d0805ce5f8f6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.661347 10081 raft_consensus.cc:2749] T 6b90c8dce8d644d3b2284f0a2428f862 P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:51.664364 10073 consensus_queue.cc:1048] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:51.669349 10073 consensus_queue.cc:1048] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:51.681242 10111 consensus_queue.cc:1048] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:51.696126 10111 consensus_queue.cc:1048] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:51.710144 10073 consensus_queue.cc:1048] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:51.715448 10109 consensus_queue.cc:1048] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:51.727643 10073 consensus_queue.cc:1048] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:51.738969 10109 consensus_queue.cc:1048] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:18:52.583997  9821 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:53.100930 10110 raft_consensus.cc:493] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.101424 10110 raft_consensus.cc:515] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.103276 10110 leader_election.cc:290] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569)
I20260709 12:18:53.104104 10073 raft_consensus.cc:493] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.104173  9875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3068f957554638bff21f2bdbccc92a" is_pre_election: true
I20260709 12:18:53.104722 10073 raft_consensus.cc:515] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.105011  9949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c" is_pre_election: true
I20260709 12:18:53.105657  9949 raft_consensus.cc:2468] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b35894035d040c1a9cb3349478e1f2c in term 1.
I20260709 12:18:53.105787  9875 raft_consensus.cc:2468] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b35894035d040c1a9cb3349478e1f2c in term 1.
I20260709 12:18:53.107024 10073 leader_election.cc:290] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:53.107079  9990 leader_election.cc:304] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 3615592255dd42ba970d0805ce5f8f6c; no voters: 
I20260709 12:18:53.108080 10110 raft_consensus.cc:2804] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:53.108462 10110 raft_consensus.cc:493] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.108817 10110 raft_consensus.cc:3060] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.108955  9949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c" is_pre_election: true
I20260709 12:18:53.109200 10025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b35894035d040c1a9cb3349478e1f2c" is_pre_election: true
I20260709 12:18:53.109748  9949 raft_consensus.cc:2468] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 1.
I20260709 12:18:53.110914  9841 leader_election.cc:304] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3615592255dd42ba970d0805ce5f8f6c, 5f3068f957554638bff21f2bdbccc92a; no voters: 
I20260709 12:18:53.111584 10073 raft_consensus.cc:2804] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:53.112012 10073 raft_consensus.cc:493] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.112363 10073 raft_consensus.cc:3060] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.115157 10110 raft_consensus.cc:515] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.116489 10025 raft_consensus.cc:2393] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f3068f957554638bff21f2bdbccc92a in current term 2: Already voted for candidate 1b35894035d040c1a9cb3349478e1f2c in this term.
I20260709 12:18:53.117935 10110 leader_election.cc:290] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 2 election: Requested vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569)
I20260709 12:18:53.118211  9875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
I20260709 12:18:53.118505  9949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
I20260709 12:18:53.119019  9949 raft_consensus.cc:3060] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.118846 10073 raft_consensus.cc:515] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.120008  9875 raft_consensus.cc:2393] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1b35894035d040c1a9cb3349478e1f2c in current term 2: Already voted for candidate 5f3068f957554638bff21f2bdbccc92a in this term.
I20260709 12:18:53.120750 10073 leader_election.cc:290] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 2 election: Requested vote from peers 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:53.121783  9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
I20260709 12:18:53.122016 10025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
I20260709 12:18:53.122721 10025 raft_consensus.cc:2393] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f3068f957554638bff21f2bdbccc92a in current term 2: Already voted for candidate 1b35894035d040c1a9cb3349478e1f2c in this term.
I20260709 12:18:53.123653  9841 leader_election.cc:304] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f3068f957554638bff21f2bdbccc92a; no voters: 1b35894035d040c1a9cb3349478e1f2c, 3615592255dd42ba970d0805ce5f8f6c
I20260709 12:18:53.124305 10073 raft_consensus.cc:2749] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:53.124691  9949 raft_consensus.cc:2468] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b35894035d040c1a9cb3349478e1f2c in term 2.
I20260709 12:18:53.125648  9990 leader_election.cc:304] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 3615592255dd42ba970d0805ce5f8f6c; no voters: 5f3068f957554638bff21f2bdbccc92a
I20260709 12:18:53.126269 10110 raft_consensus.cc:2804] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:53.127077 10110 raft_consensus.cc:697] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 2 LEADER]: Becoming Leader. State: Replica: 1b35894035d040c1a9cb3349478e1f2c, State: Running, Role: LEADER
I20260709 12:18:53.127835 10110 consensus_queue.cc:237] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.135215  9769 catalog_manager.cc:5697] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c reported cstate change: term changed from 0 to 2, leader changed from <none> to 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67). New cstate: current_term: 2 leader_uuid: "1b35894035d040c1a9cb3349478e1f2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.288473  9949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09ddf2f4a1a4487db6eaa4786a28be51"
dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
mode: GRACEFUL
new_leader_uuid: "5f3068f957554638bff21f2bdbccc92a"
 from {username='slave'} at 127.0.0.1:39646
I20260709 12:18:53.289058  9949 raft_consensus.cc:606] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 1 LEADER]: Received request to transfer leadership to TS 5f3068f957554638bff21f2bdbccc92a
I20260709 12:18:53.303376 10025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccf74389f16242a3973eb6553bf32abe"
dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
mode: GRACEFUL
new_leader_uuid: "5f3068f957554638bff21f2bdbccc92a"
 from {username='slave'} at 127.0.0.1:50380
I20260709 12:18:53.303973 10025 raft_consensus.cc:606] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 1 LEADER]: Received request to transfer leadership to TS 5f3068f957554638bff21f2bdbccc92a
I20260709 12:18:53.317324  9875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0110b40df05c421892d32cc121aaa2d5"
dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
mode: GRACEFUL
new_leader_uuid: "3615592255dd42ba970d0805ce5f8f6c"
 from {username='slave'} at 127.0.0.1:40362
I20260709 12:18:53.317833  9875 raft_consensus.cc:606] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Received request to transfer leadership to TS 3615592255dd42ba970d0805ce5f8f6c
I20260709 12:18:53.322741 10025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce"
dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
mode: GRACEFUL
new_leader_uuid: "3615592255dd42ba970d0805ce5f8f6c"
 from {username='slave'} at 127.0.0.1:50380
I20260709 12:18:53.323263 10025 raft_consensus.cc:606] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 2 LEADER]: Received request to transfer leadership to TS 3615592255dd42ba970d0805ce5f8f6c
I20260709 12:18:53.328059 10025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69ed8384453347aaafc0d6a5b2a4731d"
dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
mode: GRACEFUL
new_leader_uuid: "3615592255dd42ba970d0805ce5f8f6c"
 from {username='slave'} at 127.0.0.1:50380
I20260709 12:18:53.328583 10025 raft_consensus.cc:606] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 1 LEADER]: Received request to transfer leadership to TS 3615592255dd42ba970d0805ce5f8f6c
I20260709 12:18:53.333410  9875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "055c16b2f90a4fdb80e042e23b3577b9"
dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
mode: GRACEFUL
new_leader_uuid: "3615592255dd42ba970d0805ce5f8f6c"
 from {username='slave'} at 127.0.0.1:40362
I20260709 12:18:53.333933  9875 raft_consensus.cc:606] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Received request to transfer leadership to TS 3615592255dd42ba970d0805ce5f8f6c
I20260709 12:18:53.338646  9875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b90c8dce8d644d3b2284f0a2428f862"
dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
mode: GRACEFUL
new_leader_uuid: "1b35894035d040c1a9cb3349478e1f2c"
 from {username='slave'} at 127.0.0.1:40362
I20260709 12:18:53.339174  9875 raft_consensus.cc:606] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Received request to transfer leadership to TS 1b35894035d040c1a9cb3349478e1f2c
I20260709 12:18:53.368489 10119 raft_consensus.cc:993] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c: : Instructing follower 5f3068f957554638bff21f2bdbccc92a to start an election
I20260709 12:18:53.368897 10160 raft_consensus.cc:1081] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 1 LEADER]: Signalling peer 5f3068f957554638bff21f2bdbccc92a to start an election
I20260709 12:18:53.370720  9875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09ddf2f4a1a4487db6eaa4786a28be51"
dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
 from {username='slave'} at 127.0.0.1:40350
I20260709 12:18:53.371241  9875 raft_consensus.cc:493] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:53.371524  9875 raft_consensus.cc:3060] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.376040  9875 raft_consensus.cc:515] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.377638  9875 leader_election.cc:290] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 2 election: Requested vote from peers 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:53.378959 10025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ddf2f4a1a4487db6eaa4786a28be51" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
I20260709 12:18:53.379681 10025 raft_consensus.cc:3060] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.378968  9949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ddf2f4a1a4487db6eaa4786a28be51" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
I20260709 12:18:53.380496  9949 raft_consensus.cc:3055] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:53.380834  9949 raft_consensus.cc:740] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Running, Role: LEADER
I20260709 12:18:53.381680  9949 consensus_queue.cc:260] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.382829  9949 raft_consensus.cc:3060] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.385457 10025 raft_consensus.cc:2468] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 2.
I20260709 12:18:53.386433  9841 leader_election.cc:304] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a; no voters: 
I20260709 12:18:53.387209 10073 raft_consensus.cc:2804] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:53.387737  9949 raft_consensus.cc:2468] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 2.
I20260709 12:18:53.388448 10073 raft_consensus.cc:697] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [term 2 LEADER]: Becoming Leader. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Running, Role: LEADER
I20260709 12:18:53.389328 10073 consensus_queue.cc:237] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.396871  9769 catalog_manager.cc:5697] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a reported cstate change: term changed from 1 to 2, leader changed from 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66) to 5f3068f957554638bff21f2bdbccc92a (127.9.131.65). New cstate: current_term: 2 leader_uuid: "5f3068f957554638bff21f2bdbccc92a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.406167 10150 raft_consensus.cc:993] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c: : Instructing follower 5f3068f957554638bff21f2bdbccc92a to start an election
I20260709 12:18:53.406582 10110 raft_consensus.cc:1081] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 1 LEADER]: Signalling peer 5f3068f957554638bff21f2bdbccc92a to start an election
I20260709 12:18:53.407999  9875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccf74389f16242a3973eb6553bf32abe"
dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
 from {username='slave'} at 127.0.0.1:40348
I20260709 12:18:53.408468  9875 raft_consensus.cc:493] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:53.408761  9875 raft_consensus.cc:3060] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.413147  9875 raft_consensus.cc:515] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.414901  9875 leader_election.cc:290] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 2 election: Requested vote from peers 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:53.415820  9949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf74389f16242a3973eb6553bf32abe" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
I20260709 12:18:53.416041 10025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf74389f16242a3973eb6553bf32abe" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
I20260709 12:18:53.416415  9949 raft_consensus.cc:3060] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.416559 10025 raft_consensus.cc:3055] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:53.416882 10025 raft_consensus.cc:740] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1b35894035d040c1a9cb3349478e1f2c, State: Running, Role: LEADER
I20260709 12:18:53.417520 10025 consensus_queue.cc:260] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.418510 10025 raft_consensus.cc:3060] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.422411 10073 raft_consensus.cc:993] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a: : Instructing follower 1b35894035d040c1a9cb3349478e1f2c to start an election
I20260709 12:18:53.422396  9949 raft_consensus.cc:2468] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 2.
I20260709 12:18:53.422900 10161 raft_consensus.cc:1081] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Signalling peer 1b35894035d040c1a9cb3349478e1f2c to start an election
I20260709 12:18:53.424443  9841 leader_election.cc:304] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3615592255dd42ba970d0805ce5f8f6c, 5f3068f957554638bff21f2bdbccc92a; no voters: 
I20260709 12:18:53.424508 10025 raft_consensus.cc:2468] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 2.
I20260709 12:18:53.424813 10024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b90c8dce8d644d3b2284f0a2428f862"
dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
 from {username='slave'} at 127.0.0.1:50360
I20260709 12:18:53.425175 10161 raft_consensus.cc:2804] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:53.425419 10024 raft_consensus.cc:493] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:53.425841 10024 raft_consensus.cc:3060] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.425704 10161 raft_consensus.cc:697] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [term 2 LEADER]: Becoming Leader. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Running, Role: LEADER
I20260709 12:18:53.426858 10161 consensus_queue.cc:237] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.430308 10024 raft_consensus.cc:515] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.432931 10024 leader_election.cc:290] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 2 election: Requested vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569)
I20260709 12:18:53.433182  9875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b90c8dce8d644d3b2284f0a2428f862" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
I20260709 12:18:53.433591  9949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b90c8dce8d644d3b2284f0a2428f862" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
I20260709 12:18:53.433804  9875 raft_consensus.cc:3055] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:53.434213  9949 raft_consensus.cc:3060] T 6b90c8dce8d644d3b2284f0a2428f862 P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.434228  9875 raft_consensus.cc:740] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Running, Role: LEADER
I20260709 12:18:53.435242  9875 consensus_queue.cc:260] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.435501  9769 catalog_manager.cc:5697] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a reported cstate change: term changed from 1 to 2, leader changed from 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67) to 5f3068f957554638bff21f2bdbccc92a (127.9.131.65). New cstate: current_term: 2 leader_uuid: "5f3068f957554638bff21f2bdbccc92a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.436528  9875 raft_consensus.cc:3060] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.439291  9949 raft_consensus.cc:2468] T 6b90c8dce8d644d3b2284f0a2428f862 P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b35894035d040c1a9cb3349478e1f2c in term 2.
I20260709 12:18:53.440459  9990 leader_election.cc:304] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 3615592255dd42ba970d0805ce5f8f6c; no voters: 
I20260709 12:18:53.441267 10110 raft_consensus.cc:2804] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:53.441641 10110 raft_consensus.cc:697] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c [term 2 LEADER]: Becoming Leader. State: Replica: 1b35894035d040c1a9cb3349478e1f2c, State: Running, Role: LEADER
I20260709 12:18:53.442698  9875 raft_consensus.cc:2468] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b35894035d040c1a9cb3349478e1f2c in term 2.
I20260709 12:18:53.442471 10110 consensus_queue.cc:237] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.450914  9769 catalog_manager.cc:5697] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c reported cstate change: term changed from 1 to 2, leader changed from 5f3068f957554638bff21f2bdbccc92a (127.9.131.65) to 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67). New cstate: current_term: 2 leader_uuid: "1b35894035d040c1a9cb3349478e1f2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:53.456904  9804 debug-util.cc:398] Leaking SignalData structure 0x7b0800062060 after lost signal to thread 9744
W20260709 12:18:53.457652  9804 debug-util.cc:398] Leaking SignalData structure 0x7b0800062740 after lost signal to thread 9807
W20260709 12:18:53.459514  9804 debug-util.cc:398] Leaking SignalData structure 0x7b0800093ea0 after lost signal to thread 10134
I20260709 12:18:53.463825 10150 raft_consensus.cc:993] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c: : Instructing follower 3615592255dd42ba970d0805ce5f8f6c to start an election
I20260709 12:18:53.464289 10110 raft_consensus.cc:1081] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 1 LEADER]: Signalling peer 3615592255dd42ba970d0805ce5f8f6c to start an election
I20260709 12:18:53.465713  9949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69ed8384453347aaafc0d6a5b2a4731d"
dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
 from {username='slave'} at 127.0.0.1:39640
I20260709 12:18:53.466311  9949 raft_consensus.cc:493] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:53.466681  9949 raft_consensus.cc:3060] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.473511  9949 raft_consensus.cc:515] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.475800  9949 leader_election.cc:290] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 2 election: Requested vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:53.476454  9875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ed8384453347aaafc0d6a5b2a4731d" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
I20260709 12:18:53.476738 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ed8384453347aaafc0d6a5b2a4731d" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
I20260709 12:18:53.477041  9875 raft_consensus.cc:3060] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.477322 10024 raft_consensus.cc:3055] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:53.477679 10024 raft_consensus.cc:740] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1b35894035d040c1a9cb3349478e1f2c, State: Running, Role: LEADER
I20260709 12:18:53.478492 10024 consensus_queue.cc:260] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.479759 10024 raft_consensus.cc:3060] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.484174  9875 raft_consensus.cc:2468] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3615592255dd42ba970d0805ce5f8f6c in term 2.
I20260709 12:18:53.484550 10024 raft_consensus.cc:2468] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3615592255dd42ba970d0805ce5f8f6c in term 2.
I20260709 12:18:53.485419  9914 leader_election.cc:304] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3615592255dd42ba970d0805ce5f8f6c, 5f3068f957554638bff21f2bdbccc92a; no voters: 
I20260709 12:18:53.486321 10160 raft_consensus.cc:2804] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:53.486860 10160 raft_consensus.cc:697] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [term 2 LEADER]: Becoming Leader. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Running, Role: LEADER
I20260709 12:18:53.487797 10160 consensus_queue.cc:237] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.497143  9769 catalog_manager.cc:5697] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c reported cstate change: term changed from 1 to 2, leader changed from 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67) to 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66). New cstate: current_term: 2 leader_uuid: "3615592255dd42ba970d0805ce5f8f6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.518821 10073 raft_consensus.cc:993] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a: : Instructing follower 3615592255dd42ba970d0805ce5f8f6c to start an election
I20260709 12:18:53.519306 10161 raft_consensus.cc:1081] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Signalling peer 3615592255dd42ba970d0805ce5f8f6c to start an election
I20260709 12:18:53.519467  9949 raft_consensus.cc:1275] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Refusing update from remote peer 1b35894035d040c1a9cb3349478e1f2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:18:53.520884 10110 consensus_queue.cc:1048] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.521126  9949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "055c16b2f90a4fdb80e042e23b3577b9"
dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
 from {username='slave'} at 127.0.0.1:39632
I20260709 12:18:53.521658  9949 raft_consensus.cc:493] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:53.522055  9949 raft_consensus.cc:3060] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.528751  9949 raft_consensus.cc:515] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.530479 10110 raft_consensus.cc:993] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c: : Instructing follower 3615592255dd42ba970d0805ce5f8f6c to start an election
I20260709 12:18:53.530946 10110 raft_consensus.cc:1081] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 2 LEADER]: Signalling peer 3615592255dd42ba970d0805ce5f8f6c to start an election
I20260709 12:18:53.532217 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055c16b2f90a4fdb80e042e23b3577b9" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
I20260709 12:18:53.532528  9875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055c16b2f90a4fdb80e042e23b3577b9" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
I20260709 12:18:53.532888 10024 raft_consensus.cc:3060] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.533753  9950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce"
dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
 from {username='slave'} at 127.0.0.1:39640
I20260709 12:18:53.534317  9950 raft_consensus.cc:493] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:53.534677  9950 raft_consensus.cc:3060] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:53.540678  9949 leader_election.cc:290] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 2 election: Requested vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:53.540684  9875 raft_consensus.cc:3055] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:53.541352  9875 raft_consensus.cc:740] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Running, Role: LEADER
I20260709 12:18:53.542093 10024 raft_consensus.cc:2468] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3615592255dd42ba970d0805ce5f8f6c in term 2.
I20260709 12:18:53.543982  9876 raft_consensus.cc:1275] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Refusing update from remote peer 1b35894035d040c1a9cb3349478e1f2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:18:53.544425  9916 leader_election.cc:304] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 3615592255dd42ba970d0805ce5f8f6c; no voters: 
I20260709 12:18:53.545296 10160 raft_consensus.cc:2804] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:53.545274  9875 consensus_queue.cc:260] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.545950 10160 raft_consensus.cc:697] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [term 2 LEADER]: Becoming Leader. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Running, Role: LEADER
I20260709 12:18:53.546605  9875 raft_consensus.cc:3060] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.546813 10160 consensus_queue.cc:237] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.548816  9950 raft_consensus.cc:515] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.551481 10110 consensus_queue.cc:1048] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.553359  9948 raft_consensus.cc:1240] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Rejecting Update request from peer 1b35894035d040c1a9cb3349478e1f2c for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:53.557056 10110 consensus_queue.cc:1059] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.557881 10150 raft_consensus.cc:3055] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:53.558269 10150 raft_consensus.cc:740] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1b35894035d040c1a9cb3349478e1f2c, State: Running, Role: LEADER
I20260709 12:18:53.559196 10150 consensus_queue.cc:260] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.560211 10150 raft_consensus.cc:3060] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:53.563768  9950 leader_election.cc:290] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 3 election: Requested vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:53.563687 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
I20260709 12:18:53.563687  9873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
I20260709 12:18:53.566869  9875 raft_consensus.cc:2468] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3615592255dd42ba970d0805ce5f8f6c in term 2.
I20260709 12:18:53.572016  9769 catalog_manager.cc:5697] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c reported cstate change: term changed from 1 to 2, leader changed from 5f3068f957554638bff21f2bdbccc92a (127.9.131.65) to 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66). New cstate: current_term: 2 leader_uuid: "3615592255dd42ba970d0805ce5f8f6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.573880 10024 raft_consensus.cc:2468] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3615592255dd42ba970d0805ce5f8f6c in term 3.
I20260709 12:18:53.575656  9916 leader_election.cc:304] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 3615592255dd42ba970d0805ce5f8f6c; no voters: 5f3068f957554638bff21f2bdbccc92a
I20260709 12:18:53.576826 10160 raft_consensus.cc:2804] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:53.577292 10160 raft_consensus.cc:697] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 3 LEADER]: Becoming Leader. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Running, Role: LEADER
I20260709 12:18:53.578100 10160 consensus_queue.cc:237] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.601783  9772 catalog_manager.cc:5697] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c reported cstate change: term changed from 2 to 3, leader changed from 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67) to 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66). New cstate: current_term: 3 leader_uuid: "3615592255dd42ba970d0805ce5f8f6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.755240 10073 raft_consensus.cc:993] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a: : Instructing follower 3615592255dd42ba970d0805ce5f8f6c to start an election
I20260709 12:18:53.755733 10161 raft_consensus.cc:1081] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Signalling peer 3615592255dd42ba970d0805ce5f8f6c to start an election
I20260709 12:18:53.757323  9950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0110b40df05c421892d32cc121aaa2d5"
dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
 from {username='slave'} at 127.0.0.1:39632
I20260709 12:18:53.757812  9950 raft_consensus.cc:493] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:53.758095  9950 raft_consensus.cc:3060] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.762949  9950 raft_consensus.cc:515] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.764869  9950 leader_election.cc:290] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 2 election: Requested vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:18:53.766014  9876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0110b40df05c421892d32cc121aaa2d5" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
I20260709 12:18:53.766232 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0110b40df05c421892d32cc121aaa2d5" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
I20260709 12:18:53.766966  9876 raft_consensus.cc:3055] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:53.766994 10024 raft_consensus.cc:3060] T 0110b40df05c421892d32cc121aaa2d5 P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.767354  9876 raft_consensus.cc:740] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Running, Role: LEADER
I20260709 12:18:53.768234  9876 consensus_queue.cc:260] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.769515  9876 raft_consensus.cc:3060] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.772332 10024 raft_consensus.cc:2468] T 0110b40df05c421892d32cc121aaa2d5 P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3615592255dd42ba970d0805ce5f8f6c in term 2.
I20260709 12:18:53.773383  9916 leader_election.cc:304] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 3615592255dd42ba970d0805ce5f8f6c; no voters: 
I20260709 12:18:53.774072 10160 raft_consensus.cc:2804] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:53.774474 10160 raft_consensus.cc:697] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [term 2 LEADER]: Becoming Leader. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Running, Role: LEADER
I20260709 12:18:53.775177 10160 consensus_queue.cc:237] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:53.777163  9876 raft_consensus.cc:2468] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3615592255dd42ba970d0805ce5f8f6c in term 2.
I20260709 12:18:53.783265  9772 catalog_manager.cc:5697] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c reported cstate change: term changed from 1 to 2, leader changed from 5f3068f957554638bff21f2bdbccc92a (127.9.131.65) to 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66). New cstate: current_term: 2 leader_uuid: "3615592255dd42ba970d0805ce5f8f6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.820210 10024 raft_consensus.cc:1275] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Refusing update from remote peer 5f3068f957554638bff21f2bdbccc92a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:53.821544 10161 consensus_queue.cc:1048] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:53.842027  9950 raft_consensus.cc:1275] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Refusing update from remote peer 5f3068f957554638bff21f2bdbccc92a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:53.843922 10073 consensus_queue.cc:1048] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:53.905761  9876 raft_consensus.cc:1275] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Refusing update from remote peer 1b35894035d040c1a9cb3349478e1f2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:53.907500 10150 consensus_queue.cc:1048] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:53.917297  9950 raft_consensus.cc:1275] T 6b90c8dce8d644d3b2284f0a2428f862 P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Refusing update from remote peer 1b35894035d040c1a9cb3349478e1f2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:53.918622 10178 consensus_queue.cc:1048] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:53.924414 10024 raft_consensus.cc:1275] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Refusing update from remote peer 5f3068f957554638bff21f2bdbccc92a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:53.925909 10161 consensus_queue.cc:1048] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:53.931458  9948 raft_consensus.cc:1275] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Refusing update from remote peer 5f3068f957554638bff21f2bdbccc92a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:53.935837 10161 consensus_queue.cc:1048] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:53.948452 10024 raft_consensus.cc:1275] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Refusing update from remote peer 3615592255dd42ba970d0805ce5f8f6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:53.949586 10160 consensus_queue.cc:1048] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:53.955149  9876 raft_consensus.cc:1275] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Refusing update from remote peer 3615592255dd42ba970d0805ce5f8f6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:53.956902 10160 consensus_queue.cc:1048] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:54.012984  9875 raft_consensus.cc:1275] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Refusing update from remote peer 3615592255dd42ba970d0805ce5f8f6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:54.014236 10119 consensus_queue.cc:1048] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:54.023576 10024 raft_consensus.cc:1275] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Refusing update from remote peer 3615592255dd42ba970d0805ce5f8f6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:54.025391 10119 consensus_queue.cc:1048] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:54.059645 10024 raft_consensus.cc:1275] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Refusing update from remote peer 3615592255dd42ba970d0805ce5f8f6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:54.061043 10185 consensus_queue.cc:1048] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:54.070134  9875 raft_consensus.cc:3060] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:54.077507  9875 raft_consensus.cc:1275] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 3 FOLLOWER]: Refusing update from remote peer 3615592255dd42ba970d0805ce5f8f6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:54.078994 10119 consensus_queue.cc:1048] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:54.358858 10024 raft_consensus.cc:1275] T 0110b40df05c421892d32cc121aaa2d5 P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Refusing update from remote peer 3615592255dd42ba970d0805ce5f8f6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:54.359015  9875 raft_consensus.cc:1275] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Refusing update from remote peer 3615592255dd42ba970d0805ce5f8f6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:54.360381 10185 consensus_queue.cc:1048] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:54.361058 10119 consensus_queue.cc:1048] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:56.371976  9741 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:18:56.372831  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:56.391513  9950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce"
dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
mode: GRACEFUL
new_leader_uuid: "1b35894035d040c1a9cb3349478e1f2c"
 from {username='slave'} at 127.0.0.1:52646
I20260709 12:18:56.392051  9950 raft_consensus.cc:606] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 3 LEADER]: Received request to transfer leadership to TS 1b35894035d040c1a9cb3349478e1f2c
I20260709 12:18:56.402024  9875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccf74389f16242a3973eb6553bf32abe"
dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
mode: GRACEFUL
new_leader_uuid: "1b35894035d040c1a9cb3349478e1f2c"
 from {username='slave'} at 127.0.0.1:49678
I20260709 12:18:56.402521  9875 raft_consensus.cc:606] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [term 2 LEADER]: Received request to transfer leadership to TS 1b35894035d040c1a9cb3349478e1f2c
I20260709 12:18:56.403563  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:56.404040  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:56.660689 10196 raft_consensus.cc:993] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c: : Instructing follower 1b35894035d040c1a9cb3349478e1f2c to start an election
I20260709 12:18:56.661104 10185 raft_consensus.cc:1081] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 3 LEADER]: Signalling peer 1b35894035d040c1a9cb3349478e1f2c to start an election
I20260709 12:18:56.662518 10024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce"
dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
 from {username='slave'} at 127.0.0.1:50366
I20260709 12:18:56.662978 10024 raft_consensus.cc:493] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:56.663244 10024 raft_consensus.cc:3060] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:56.667699 10024 raft_consensus.cc:515] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:56.669445 10024 leader_election.cc:290] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 4 election: Requested vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569)
I20260709 12:18:56.670089  9875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
I20260709 12:18:56.670609  9875 raft_consensus.cc:3060] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:56.670655  9950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
I20260709 12:18:56.671211  9950 raft_consensus.cc:3055] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:56.671533  9950 raft_consensus.cc:740] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Running, Role: LEADER
I20260709 12:18:56.672325  9950 consensus_queue.cc:260] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:56.673518  9950 raft_consensus.cc:3060] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:56.676002  9875 raft_consensus.cc:2468] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b35894035d040c1a9cb3349478e1f2c in term 4.
I20260709 12:18:56.676990  9988 leader_election.cc:304] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a; no voters: 
I20260709 12:18:56.677644 10190 raft_consensus.cc:2804] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:56.678700  9950 raft_consensus.cc:2468] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b35894035d040c1a9cb3349478e1f2c in term 4.
I20260709 12:18:56.678993 10190 raft_consensus.cc:697] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 4 LEADER]: Becoming Leader. State: Replica: 1b35894035d040c1a9cb3349478e1f2c, State: Running, Role: LEADER
I20260709 12:18:56.679800 10190 consensus_queue.cc:237] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:56.687219  9772 catalog_manager.cc:5697] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c reported cstate change: term changed from 3 to 4, leader changed from 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66) to 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67). New cstate: current_term: 4 leader_uuid: "1b35894035d040c1a9cb3349478e1f2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:56.830075 10173 raft_consensus.cc:993] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a: : Instructing follower 1b35894035d040c1a9cb3349478e1f2c to start an election
I20260709 12:18:56.830488 10195 raft_consensus.cc:1081] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [term 2 LEADER]: Signalling peer 1b35894035d040c1a9cb3349478e1f2c to start an election
I20260709 12:18:56.831991 10024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccf74389f16242a3973eb6553bf32abe"
dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
 from {username='slave'} at 127.0.0.1:50360
I20260709 12:18:56.832437 10024 raft_consensus.cc:493] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:56.832679 10024 raft_consensus.cc:3060] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:56.837015 10024 raft_consensus.cc:515] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:56.838562 10024 leader_election.cc:290] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 3 election: Requested vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569)
I20260709 12:18:56.839547  9875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf74389f16242a3973eb6553bf32abe" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
I20260709 12:18:56.839658  9950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf74389f16242a3973eb6553bf32abe" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
I20260709 12:18:56.840178  9950 raft_consensus.cc:3060] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:56.840111  9875 raft_consensus.cc:3055] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:56.840580  9875 raft_consensus.cc:740] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Running, Role: LEADER
I20260709 12:18:56.841171  9875 consensus_queue.cc:260] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:56.842130  9875 raft_consensus.cc:3060] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:56.845398  9950 raft_consensus.cc:2468] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b35894035d040c1a9cb3349478e1f2c in term 3.
I20260709 12:18:56.846246  9875 raft_consensus.cc:2468] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b35894035d040c1a9cb3349478e1f2c in term 3.
I20260709 12:18:56.846490  9990 leader_election.cc:304] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 3615592255dd42ba970d0805ce5f8f6c; no voters: 
I20260709 12:18:56.847282 10190 raft_consensus.cc:2804] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:56.847657 10190 raft_consensus.cc:697] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 3 LEADER]: Becoming Leader. State: Replica: 1b35894035d040c1a9cb3349478e1f2c, State: Running, Role: LEADER
I20260709 12:18:56.848309 10190 consensus_queue.cc:237] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:18:56.855026  9772 catalog_manager.cc:5697] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c reported cstate change: term changed from 2 to 3, leader changed from 5f3068f957554638bff21f2bdbccc92a (127.9.131.65) to 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67). New cstate: current_term: 3 leader_uuid: "1b35894035d040c1a9cb3349478e1f2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:57.088600  9950 raft_consensus.cc:1275] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 4 FOLLOWER]: Refusing update from remote peer 1b35894035d040c1a9cb3349478e1f2c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:57.089855 10190 consensus_queue.cc:1048] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:57.098869  9875 raft_consensus.cc:1275] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 4 FOLLOWER]: Refusing update from remote peer 1b35894035d040c1a9cb3349478e1f2c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:57.100596 10197 consensus_queue.cc:1048] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:57.241034  9875 raft_consensus.cc:1275] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [term 3 FOLLOWER]: Refusing update from remote peer 1b35894035d040c1a9cb3349478e1f2c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:57.242312 10197 consensus_queue.cc:1048] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:57.250821  9950 raft_consensus.cc:1275] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Refusing update from remote peer 1b35894035d040c1a9cb3349478e1f2c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:57.252401 10197 consensus_queue.cc:1048] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:57.404932  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:57.409658  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:57.410014  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:58.411058  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:58.416520  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:58.416960  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:59.418004  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:59.423698  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:59.424126  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:00.425267  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:00.431447  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:00.431876  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:01.432757  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:01.437507  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:01.437891  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:02.438822  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:02.443818  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:02.444205  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:03.445143  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:03.450066  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:03.450528  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:04.451530  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:04.456388  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:04.456810  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:05.457819  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:05.462543  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:05.462958  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:06.490264  9741 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:19:06.494613  9875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edcfb35aafee4ee08151319ebb25cc59"
dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
mode: GRACEFUL
new_leader_uuid: "3615592255dd42ba970d0805ce5f8f6c"
 from {username='slave'} at 127.0.0.1:40362
I20260709 12:19:06.495255  9875 raft_consensus.cc:606] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Received request to transfer leadership to TS 3615592255dd42ba970d0805ce5f8f6c
I20260709 12:19:06.499985  9875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7766e3f04a14cc0ab63c48ee33cd298"
dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
mode: GRACEFUL
new_leader_uuid: "3615592255dd42ba970d0805ce5f8f6c"
 from {username='slave'} at 127.0.0.1:40362
I20260709 12:19:06.500458  9875 raft_consensus.cc:606] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Received request to transfer leadership to TS 3615592255dd42ba970d0805ce5f8f6c
I20260709 12:19:06.504967  9875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09ddf2f4a1a4487db6eaa4786a28be51"
dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
mode: GRACEFUL
new_leader_uuid: "3615592255dd42ba970d0805ce5f8f6c"
 from {username='slave'} at 127.0.0.1:40362
I20260709 12:19:06.505375  9875 raft_consensus.cc:606] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [term 2 LEADER]: Received request to transfer leadership to TS 3615592255dd42ba970d0805ce5f8f6c
I20260709 12:19:06.509836 10024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccf74389f16242a3973eb6553bf32abe"
dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
mode: GRACEFUL
new_leader_uuid: "3615592255dd42ba970d0805ce5f8f6c"
 from {username='slave'} at 127.0.0.1:50380
I20260709 12:19:06.510298 10024 raft_consensus.cc:606] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 3 LEADER]: Received request to transfer leadership to TS 3615592255dd42ba970d0805ce5f8f6c
I20260709 12:19:06.518186 10024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce"
dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
mode: GRACEFUL
new_leader_uuid: "3615592255dd42ba970d0805ce5f8f6c"
 from {username='slave'} at 127.0.0.1:50380
I20260709 12:19:06.518685 10024 raft_consensus.cc:606] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 4 LEADER]: Received request to transfer leadership to TS 3615592255dd42ba970d0805ce5f8f6c
I20260709 12:19:06.599195 10214 raft_consensus.cc:993] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c: : Instructing follower 3615592255dd42ba970d0805ce5f8f6c to start an election
I20260709 12:19:06.599601 10214 raft_consensus.cc:1081] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 4 LEADER]: Signalling peer 3615592255dd42ba970d0805ce5f8f6c to start an election
I20260709 12:19:06.601281  9948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce"
dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
 from {username='slave'} at 127.0.0.1:39640
I20260709 12:19:06.601884  9948 raft_consensus.cc:493] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:06.602314  9948 raft_consensus.cc:3060] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:06.608155  9948 raft_consensus.cc:515] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:06.610471  9948 leader_election.cc:290] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 5 election: Requested vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:19:06.611354  9875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
I20260709 12:19:06.611370 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
I20260709 12:19:06.612190  9875 raft_consensus.cc:3060] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:06.612270 10024 raft_consensus.cc:3055] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:06.612562 10024 raft_consensus.cc:740] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1b35894035d040c1a9cb3349478e1f2c, State: Running, Role: LEADER
I20260709 12:19:06.613219 10024 consensus_queue.cc:260] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:06.614151 10024 raft_consensus.cc:3060] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:06.616817  9875 raft_consensus.cc:2468] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3615592255dd42ba970d0805ce5f8f6c in term 5.
I20260709 12:19:06.617996  9914 leader_election.cc:304] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3615592255dd42ba970d0805ce5f8f6c, 5f3068f957554638bff21f2bdbccc92a; no voters: 
I20260709 12:19:06.618902 10217 raft_consensus.cc:2804] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:06.619232 10024 raft_consensus.cc:2468] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3615592255dd42ba970d0805ce5f8f6c in term 5.
I20260709 12:19:06.620106 10217 raft_consensus.cc:697] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 5 LEADER]: Becoming Leader. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Running, Role: LEADER
I20260709 12:19:06.621117 10217 consensus_queue.cc:237] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:06.627592  9772 catalog_manager.cc:5697] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c reported cstate change: term changed from 4 to 5, leader changed from 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67) to 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66). New cstate: current_term: 5 leader_uuid: "3615592255dd42ba970d0805ce5f8f6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:06.634357 10224 raft_consensus.cc:993] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a: : Instructing follower 3615592255dd42ba970d0805ce5f8f6c to start an election
I20260709 12:19:06.634953 10218 raft_consensus.cc:1081] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [term 2 LEADER]: Signalling peer 3615592255dd42ba970d0805ce5f8f6c to start an election
I20260709 12:19:06.636489  9948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09ddf2f4a1a4487db6eaa4786a28be51"
dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
 from {username='slave'} at 127.0.0.1:39632
I20260709 12:19:06.637017  9948 raft_consensus.cc:493] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:06.637315  9948 raft_consensus.cc:3060] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:06.643112  9948 raft_consensus.cc:515] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:06.644816  9948 leader_election.cc:290] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 3 election: Requested vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:19:06.645875 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ddf2f4a1a4487db6eaa4786a28be51" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
I20260709 12:19:06.646418 10024 raft_consensus.cc:3060] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:06.646236  9875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ddf2f4a1a4487db6eaa4786a28be51" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
I20260709 12:19:06.646889  9875 raft_consensus.cc:3055] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:06.647185  9875 raft_consensus.cc:740] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Running, Role: LEADER
I20260709 12:19:06.647897  9875 consensus_queue.cc:260] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:06.649140  9875 raft_consensus.cc:3060] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:06.652554 10024 raft_consensus.cc:2468] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3615592255dd42ba970d0805ce5f8f6c in term 3.
I20260709 12:19:06.653599  9916 leader_election.cc:304] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 3615592255dd42ba970d0805ce5f8f6c; no voters: 
I20260709 12:19:06.654331 10217 raft_consensus.cc:2804] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:06.654685  9875 raft_consensus.cc:2468] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3615592255dd42ba970d0805ce5f8f6c in term 3.
I20260709 12:19:06.654814 10217 raft_consensus.cc:697] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 3 LEADER]: Becoming Leader. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Running, Role: LEADER
I20260709 12:19:06.655709 10217 consensus_queue.cc:237] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:06.662554  9772 catalog_manager.cc:5697] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c reported cstate change: term changed from 2 to 3, leader changed from 5f3068f957554638bff21f2bdbccc92a (127.9.131.65) to 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66). New cstate: current_term: 3 leader_uuid: "3615592255dd42ba970d0805ce5f8f6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:06.723361 10224 raft_consensus.cc:993] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a: : Instructing follower 3615592255dd42ba970d0805ce5f8f6c to start an election
I20260709 12:19:06.723773 10218 raft_consensus.cc:1081] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Signalling peer 3615592255dd42ba970d0805ce5f8f6c to start an election
I20260709 12:19:06.725334  9948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edcfb35aafee4ee08151319ebb25cc59"
dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
 from {username='slave'} at 127.0.0.1:39632
I20260709 12:19:06.725960  9948 raft_consensus.cc:493] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:06.726333  9948 raft_consensus.cc:3060] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:06.733405  9948 raft_consensus.cc:515] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:06.735054  9948 leader_election.cc:290] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 2 election: Requested vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:19:06.736032  9875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcfb35aafee4ee08151319ebb25cc59" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
I20260709 12:19:06.736065 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcfb35aafee4ee08151319ebb25cc59" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
I20260709 12:19:06.736685  9875 raft_consensus.cc:3055] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:06.736743 10024 raft_consensus.cc:3060] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:06.737107  9875 raft_consensus.cc:740] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Running, Role: LEADER
I20260709 12:19:06.737775  9875 consensus_queue.cc:260] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:06.738682  9875 raft_consensus.cc:3060] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:06.741087 10024 raft_consensus.cc:2468] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3615592255dd42ba970d0805ce5f8f6c in term 2.
I20260709 12:19:06.742004  9916 leader_election.cc:304] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 3615592255dd42ba970d0805ce5f8f6c; no voters: 
I20260709 12:19:06.742638 10217 raft_consensus.cc:2804] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:06.742895  9875 raft_consensus.cc:2468] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3615592255dd42ba970d0805ce5f8f6c in term 2.
I20260709 12:19:06.742988 10217 raft_consensus.cc:697] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [term 2 LEADER]: Becoming Leader. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Running, Role: LEADER
I20260709 12:19:06.743875 10217 consensus_queue.cc:237] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:06.750761  9772 catalog_manager.cc:5697] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c reported cstate change: term changed from 1 to 2, leader changed from 5f3068f957554638bff21f2bdbccc92a (127.9.131.65) to 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66). New cstate: current_term: 2 leader_uuid: "3615592255dd42ba970d0805ce5f8f6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:06.755743 10224 raft_consensus.cc:993] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a: : Instructing follower 3615592255dd42ba970d0805ce5f8f6c to start an election
I20260709 12:19:06.756266 10218 raft_consensus.cc:1081] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Signalling peer 3615592255dd42ba970d0805ce5f8f6c to start an election
I20260709 12:19:06.757778  9948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7766e3f04a14cc0ab63c48ee33cd298"
dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
 from {username='slave'} at 127.0.0.1:39632
I20260709 12:19:06.758275  9948 raft_consensus.cc:493] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:06.758574  9948 raft_consensus.cc:3060] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:06.763291  9948 raft_consensus.cc:515] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:06.764891  9948 leader_election.cc:290] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 2 election: Requested vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:19:06.765722  9875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7766e3f04a14cc0ab63c48ee33cd298" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
I20260709 12:19:06.765842 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7766e3f04a14cc0ab63c48ee33cd298" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
I20260709 12:19:06.766191  9875 raft_consensus.cc:3055] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:06.766286 10024 raft_consensus.cc:3060] T c7766e3f04a14cc0ab63c48ee33cd298 P 1b35894035d040c1a9cb3349478e1f2c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:06.766467  9875 raft_consensus.cc:740] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Running, Role: LEADER
I20260709 12:19:06.767128  9875 consensus_queue.cc:260] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:06.767923  9875 raft_consensus.cc:3060] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:06.770370 10024 raft_consensus.cc:2468] T c7766e3f04a14cc0ab63c48ee33cd298 P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3615592255dd42ba970d0805ce5f8f6c in term 2.
I20260709 12:19:06.771262  9916 leader_election.cc:304] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 3615592255dd42ba970d0805ce5f8f6c; no voters: 
I20260709 12:19:06.771970 10217 raft_consensus.cc:2804] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:06.771925  9875 raft_consensus.cc:2468] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3615592255dd42ba970d0805ce5f8f6c in term 2.
I20260709 12:19:06.772535 10217 raft_consensus.cc:697] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c [term 2 LEADER]: Becoming Leader. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Running, Role: LEADER
I20260709 12:19:06.773341 10217 consensus_queue.cc:237] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:06.779947  9772 catalog_manager.cc:5697] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c reported cstate change: term changed from 1 to 2, leader changed from 5f3068f957554638bff21f2bdbccc92a (127.9.131.65) to 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66). New cstate: current_term: 2 leader_uuid: "3615592255dd42ba970d0805ce5f8f6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:06.988314 10219 raft_consensus.cc:993] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c: : Instructing follower 3615592255dd42ba970d0805ce5f8f6c to start an election
I20260709 12:19:06.988736 10219 raft_consensus.cc:1081] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 3 LEADER]: Signalling peer 3615592255dd42ba970d0805ce5f8f6c to start an election
I20260709 12:19:06.990106  9948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccf74389f16242a3973eb6553bf32abe"
dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
 from {username='slave'} at 127.0.0.1:39640
I20260709 12:19:06.990594  9948 raft_consensus.cc:493] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:06.990942  9948 raft_consensus.cc:3060] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:06.995416  9948 raft_consensus.cc:515] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:06.996999  9948 leader_election.cc:290] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 4 election: Requested vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:19:06.997797  9875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf74389f16242a3973eb6553bf32abe" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
I20260709 12:19:06.997915 10024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf74389f16242a3973eb6553bf32abe" candidate_uuid: "3615592255dd42ba970d0805ce5f8f6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
I20260709 12:19:06.998373  9875 raft_consensus.cc:3060] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:06.998448 10024 raft_consensus.cc:3055] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:06.998827 10024 raft_consensus.cc:740] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1b35894035d040c1a9cb3349478e1f2c, State: Running, Role: LEADER
I20260709 12:19:06.999444 10024 consensus_queue.cc:260] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:07.000355 10024 raft_consensus.cc:3060] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:07.002655  9875 raft_consensus.cc:2468] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3615592255dd42ba970d0805ce5f8f6c in term 4.
I20260709 12:19:07.003501  9914 leader_election.cc:304] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3615592255dd42ba970d0805ce5f8f6c, 5f3068f957554638bff21f2bdbccc92a; no voters: 
I20260709 12:19:07.004217 10217 raft_consensus.cc:2804] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:07.004463 10024 raft_consensus.cc:2468] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3615592255dd42ba970d0805ce5f8f6c in term 4.
I20260709 12:19:07.004575 10217 raft_consensus.cc:697] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c [term 4 LEADER]: Becoming Leader. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Running, Role: LEADER
I20260709 12:19:07.005400 10217 consensus_queue.cc:237] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:07.011575  9772 catalog_manager.cc:5697] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c reported cstate change: term changed from 3 to 4, leader changed from 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67) to 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66). New cstate: current_term: 4 leader_uuid: "3615592255dd42ba970d0805ce5f8f6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:07.019688 10024 raft_consensus.cc:1275] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 5 FOLLOWER]: Refusing update from remote peer 3615592255dd42ba970d0805ce5f8f6c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:07.020984 10217 consensus_queue.cc:1048] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:07.034770  9875 raft_consensus.cc:1275] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 5 FOLLOWER]: Refusing update from remote peer 3615592255dd42ba970d0805ce5f8f6c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:07.038578 10234 consensus_queue.cc:1048] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:07.147397  9876 raft_consensus.cc:1275] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Refusing update from remote peer 3615592255dd42ba970d0805ce5f8f6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:07.148778 10220 consensus_queue.cc:1048] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:07.157681 10024 raft_consensus.cc:1275] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Refusing update from remote peer 3615592255dd42ba970d0805ce5f8f6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:07.159258 10233 consensus_queue.cc:1048] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:07.198485  9876 raft_consensus.cc:1275] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Refusing update from remote peer 3615592255dd42ba970d0805ce5f8f6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:07.199930 10233 consensus_queue.cc:1048] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:07.209455 10024 raft_consensus.cc:1275] T c7766e3f04a14cc0ab63c48ee33cd298 P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Refusing update from remote peer 3615592255dd42ba970d0805ce5f8f6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:07.210695 10217 consensus_queue.cc:1048] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:07.219480 10024 raft_consensus.cc:1275] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Refusing update from remote peer 3615592255dd42ba970d0805ce5f8f6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:07.220645 10217 consensus_queue.cc:1048] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:07.229665  9876 raft_consensus.cc:1275] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [term 3 FOLLOWER]: Refusing update from remote peer 3615592255dd42ba970d0805ce5f8f6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:07.231618 10233 consensus_queue.cc:1048] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:07.602399 10025 raft_consensus.cc:1275] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 4 FOLLOWER]: Refusing update from remote peer 3615592255dd42ba970d0805ce5f8f6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:07.604050 10217 consensus_queue.cc:1048] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:07.616551  9876 raft_consensus.cc:1275] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [term 4 FOLLOWER]: Refusing update from remote peer 3615592255dd42ba970d0805ce5f8f6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:07.617790 10233 consensus_queue.cc:1048] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:19:08.816732  9916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:35063, user_credentials={real_user=slave}} blocked reactor thread for 90906.3us
W20260709 12:19:09.902606  9972 debug-util.cc:398] Leaking SignalData structure 0x7b080012d080 after lost signal to thread 9744
W20260709 12:19:09.903348  9972 debug-util.cc:398] Leaking SignalData structure 0x7b080012d760 after lost signal to thread 9807
W20260709 12:19:09.904165  9972 debug-util.cc:398] Leaking SignalData structure 0x7b080017c4c0 after lost signal to thread 9900
W20260709 12:19:09.904872  9972 debug-util.cc:398] Leaking SignalData structure 0x7b0800093b20 after lost signal to thread 9975
W20260709 12:19:09.905550  9972 debug-util.cc:398] Leaking SignalData structure 0x7b08000a8660 after lost signal to thread 10049
I20260709 12:19:10.323175  9741 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:19:10.324201  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:10.334149  9948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0110b40df05c421892d32cc121aaa2d5"
dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
mode: GRACEFUL
new_leader_uuid: "5f3068f957554638bff21f2bdbccc92a"
 from {username='slave'} at 127.0.0.1:52646
I20260709 12:19:10.335093  9948 raft_consensus.cc:606] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [term 2 LEADER]: Received request to transfer leadership to TS 5f3068f957554638bff21f2bdbccc92a
I20260709 12:19:10.338266  9948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "055c16b2f90a4fdb80e042e23b3577b9"
dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
mode: GRACEFUL
new_leader_uuid: "1b35894035d040c1a9cb3349478e1f2c"
 from {username='slave'} at 127.0.0.1:52646
I20260709 12:19:10.338884  9948 raft_consensus.cc:606] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [term 2 LEADER]: Received request to transfer leadership to TS 1b35894035d040c1a9cb3349478e1f2c
I20260709 12:19:10.341732  9948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce"
dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
mode: GRACEFUL
new_leader_uuid: "5f3068f957554638bff21f2bdbccc92a"
 from {username='slave'} at 127.0.0.1:52646
I20260709 12:19:10.342262  9948 raft_consensus.cc:606] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 5 LEADER]: Received request to transfer leadership to TS 5f3068f957554638bff21f2bdbccc92a
I20260709 12:19:10.344494  9948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69ed8384453347aaafc0d6a5b2a4731d"
dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
mode: GRACEFUL
new_leader_uuid: "5f3068f957554638bff21f2bdbccc92a"
 from {username='slave'} at 127.0.0.1:52646
I20260709 12:19:10.345021  9948 raft_consensus.cc:606] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [term 2 LEADER]: Received request to transfer leadership to TS 5f3068f957554638bff21f2bdbccc92a
I20260709 12:19:10.347347  9948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edcfb35aafee4ee08151319ebb25cc59"
dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
mode: GRACEFUL
new_leader_uuid: "1b35894035d040c1a9cb3349478e1f2c"
 from {username='slave'} at 127.0.0.1:52646
I20260709 12:19:10.347819  9948 raft_consensus.cc:606] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [term 2 LEADER]: Received request to transfer leadership to TS 1b35894035d040c1a9cb3349478e1f2c
I20260709 12:19:10.348979  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:10.349442  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:10.473202 10249 raft_consensus.cc:993] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c: : Instructing follower 1b35894035d040c1a9cb3349478e1f2c to start an election
I20260709 12:19:10.473747 10251 raft_consensus.cc:1081] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [term 2 LEADER]: Signalling peer 1b35894035d040c1a9cb3349478e1f2c to start an election
I20260709 12:19:10.475400 10024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edcfb35aafee4ee08151319ebb25cc59"
dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
 from {username='slave'} at 127.0.0.1:50366
I20260709 12:19:10.476016 10024 raft_consensus.cc:493] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:10.476425 10024 raft_consensus.cc:3060] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:10.484078 10024 raft_consensus.cc:515] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:10.486759 10024 leader_election.cc:290] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 3 election: Requested vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569)
I20260709 12:19:10.487671  9876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcfb35aafee4ee08151319ebb25cc59" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
I20260709 12:19:10.488298  9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcfb35aafee4ee08151319ebb25cc59" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
I20260709 12:19:10.488503  9876 raft_consensus.cc:3060] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:10.488837  9948 raft_consensus.cc:3055] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:10.489164  9948 raft_consensus.cc:740] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Running, Role: LEADER
I20260709 12:19:10.490017  9948 consensus_queue.cc:260] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:10.491338  9948 raft_consensus.cc:3060] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:10.495720  9876 raft_consensus.cc:2468] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b35894035d040c1a9cb3349478e1f2c in term 3.
I20260709 12:19:10.497184  9988 leader_election.cc:304] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a; no voters: 
I20260709 12:19:10.498059 10219 raft_consensus.cc:2804] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:10.498468  9948 raft_consensus.cc:2468] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b35894035d040c1a9cb3349478e1f2c in term 3.
I20260709 12:19:10.499722 10219 raft_consensus.cc:697] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c [term 3 LEADER]: Becoming Leader. State: Replica: 1b35894035d040c1a9cb3349478e1f2c, State: Running, Role: LEADER
I20260709 12:19:10.500747 10219 consensus_queue.cc:237] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:10.501549 10249 raft_consensus.cc:993] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c: : Instructing follower 1b35894035d040c1a9cb3349478e1f2c to start an election
I20260709 12:19:10.502102 10251 raft_consensus.cc:1081] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [term 2 LEADER]: Signalling peer 1b35894035d040c1a9cb3349478e1f2c to start an election
I20260709 12:19:10.503710 10024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "055c16b2f90a4fdb80e042e23b3577b9"
dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
 from {username='slave'} at 127.0.0.1:50366
I20260709 12:19:10.504292 10024 raft_consensus.cc:493] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:10.504655 10024 raft_consensus.cc:3060] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:10.511008 10024 raft_consensus.cc:515] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:10.512962 10024 leader_election.cc:290] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 3 election: Requested vote from peers 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313), 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569)
I20260709 12:19:10.516721  9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055c16b2f90a4fdb80e042e23b3577b9" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
I20260709 12:19:10.516768  9876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055c16b2f90a4fdb80e042e23b3577b9" candidate_uuid: "1b35894035d040c1a9cb3349478e1f2c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
I20260709 12:19:10.517486  9948 raft_consensus.cc:3055] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:10.517581  9876 raft_consensus.cc:3060] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:10.517838  9948 raft_consensus.cc:740] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Running, Role: LEADER
I20260709 12:19:10.518581  9948 consensus_queue.cc:260] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:10.519721  9948 raft_consensus.cc:3060] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:10.522846  9772 catalog_manager.cc:5697] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c reported cstate change: term changed from 2 to 3, leader changed from 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66) to 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67). New cstate: current_term: 3 leader_uuid: "1b35894035d040c1a9cb3349478e1f2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:10.524633  9876 raft_consensus.cc:2468] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b35894035d040c1a9cb3349478e1f2c in term 3.
I20260709 12:19:10.526012  9988 leader_election.cc:304] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a; no voters: 
I20260709 12:19:10.526909 10219 raft_consensus.cc:2804] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:10.527418 10219 raft_consensus.cc:697] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c [term 3 LEADER]: Becoming Leader. State: Replica: 1b35894035d040c1a9cb3349478e1f2c, State: Running, Role: LEADER
I20260709 12:19:10.526882  9948 raft_consensus.cc:2468] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b35894035d040c1a9cb3349478e1f2c in term 3.
I20260709 12:19:10.528331 10219 consensus_queue.cc:237] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:10.543808  9772 catalog_manager.cc:5697] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c reported cstate change: term changed from 2 to 3, leader changed from 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66) to 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67). New cstate: current_term: 3 leader_uuid: "1b35894035d040c1a9cb3349478e1f2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:10.696816 10251 raft_consensus.cc:993] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c: : Instructing follower 5f3068f957554638bff21f2bdbccc92a to start an election
I20260709 12:19:10.697405 10249 raft_consensus.cc:1081] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 5 LEADER]: Signalling peer 5f3068f957554638bff21f2bdbccc92a to start an election
I20260709 12:19:10.698874  9876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce"
dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
 from {username='slave'} at 127.0.0.1:40350
I20260709 12:19:10.699352  9876 raft_consensus.cc:493] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:10.699637  9876 raft_consensus.cc:3060] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:10.704064  9876 raft_consensus.cc:515] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:10.706429  9876 leader_election.cc:290] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 6 election: Requested vote from peers 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:19:10.707427  9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
I20260709 12:19:10.707747 10025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630c508d2b1f426986a6b239b2f34cce" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
I20260709 12:19:10.708094  9948 raft_consensus.cc:3055] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:10.708280 10025 raft_consensus.cc:3060] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:10.708436  9948 raft_consensus.cc:740] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Running, Role: LEADER
I20260709 12:19:10.709252  9948 consensus_queue.cc:260] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:10.710409  9948 raft_consensus.cc:3060] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:10.715528 10025 raft_consensus.cc:2468] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 6.
I20260709 12:19:10.716810  9948 raft_consensus.cc:2468] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 6.
I20260709 12:19:10.716971  9841 leader_election.cc:304] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a; no voters: 
I20260709 12:19:10.718803 10259 raft_consensus.cc:2804] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:10.720108 10259 raft_consensus.cc:697] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 6 LEADER]: Becoming Leader. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Running, Role: LEADER
I20260709 12:19:10.720933 10259 consensus_queue.cc:237] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:10.728889  9772 catalog_manager.cc:5697] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a reported cstate change: term changed from 5 to 6, leader changed from 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66) to 5f3068f957554638bff21f2bdbccc92a (127.9.131.65). New cstate: current_term: 6 leader_uuid: "5f3068f957554638bff21f2bdbccc92a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:10.795338 10249 raft_consensus.cc:993] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c: : Instructing follower 5f3068f957554638bff21f2bdbccc92a to start an election
I20260709 12:19:10.795768 10251 raft_consensus.cc:1081] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [term 2 LEADER]: Signalling peer 5f3068f957554638bff21f2bdbccc92a to start an election
I20260709 12:19:10.797343  9869 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0110b40df05c421892d32cc121aaa2d5"
dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
 from {username='slave'} at 127.0.0.1:40350
I20260709 12:19:10.797796  9869 raft_consensus.cc:493] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:10.798075  9869 raft_consensus.cc:3060] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:10.803551  9869 raft_consensus.cc:515] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:10.805379  9869 leader_election.cc:290] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 3 election: Requested vote from peers 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:19:10.806200  9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0110b40df05c421892d32cc121aaa2d5" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
I20260709 12:19:10.806321 10025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0110b40df05c421892d32cc121aaa2d5" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
I20260709 12:19:10.806818  9948 raft_consensus.cc:3055] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:10.806907 10025 raft_consensus.cc:3060] T 0110b40df05c421892d32cc121aaa2d5 P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:10.807185  9948 raft_consensus.cc:740] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Running, Role: LEADER
I20260709 12:19:10.807999  9948 consensus_queue.cc:260] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:10.809203  9948 raft_consensus.cc:3060] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:10.811767 10025 raft_consensus.cc:2468] T 0110b40df05c421892d32cc121aaa2d5 P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 3.
I20260709 12:19:10.812794  9841 leader_election.cc:304] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a; no voters: 
I20260709 12:19:10.813408 10259 raft_consensus.cc:2804] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:10.813791 10259 raft_consensus.cc:697] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 3 LEADER]: Becoming Leader. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Running, Role: LEADER
I20260709 12:19:10.814647 10259 consensus_queue.cc:237] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:10.815312  9948 raft_consensus.cc:2468] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 3.
I20260709 12:19:10.822456  9772 catalog_manager.cc:5697] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a reported cstate change: term changed from 2 to 3, leader changed from 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66) to 5f3068f957554638bff21f2bdbccc92a (127.9.131.65). New cstate: current_term: 3 leader_uuid: "5f3068f957554638bff21f2bdbccc92a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:10.843396 10249 raft_consensus.cc:993] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c: : Instructing follower 5f3068f957554638bff21f2bdbccc92a to start an election
I20260709 12:19:10.843906 10251 raft_consensus.cc:1081] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [term 2 LEADER]: Signalling peer 5f3068f957554638bff21f2bdbccc92a to start an election
I20260709 12:19:10.845384  9869 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69ed8384453347aaafc0d6a5b2a4731d"
dest_uuid: "5f3068f957554638bff21f2bdbccc92a"
 from {username='slave'} at 127.0.0.1:40350
I20260709 12:19:10.845878  9869 raft_consensus.cc:493] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:10.846164  9869 raft_consensus.cc:3060] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:10.850853  9869 raft_consensus.cc:515] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:10.852500  9869 leader_election.cc:290] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 3 election: Requested vote from peers 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569), 1b35894035d040c1a9cb3349478e1f2c (127.9.131.67:35063)
I20260709 12:19:10.853205  9948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ed8384453347aaafc0d6a5b2a4731d" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3615592255dd42ba970d0805ce5f8f6c"
I20260709 12:19:10.853478 10025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ed8384453347aaafc0d6a5b2a4731d" candidate_uuid: "5f3068f957554638bff21f2bdbccc92a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1b35894035d040c1a9cb3349478e1f2c"
I20260709 12:19:10.853819  9948 raft_consensus.cc:3055] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:10.854039 10025 raft_consensus.cc:3060] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:10.854167  9948 raft_consensus.cc:740] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3615592255dd42ba970d0805ce5f8f6c, State: Running, Role: LEADER
I20260709 12:19:10.854928  9948 consensus_queue.cc:260] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:10.856094  9948 raft_consensus.cc:3060] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:10.858893 10025 raft_consensus.cc:2468] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 3.
I20260709 12:19:10.859935  9841 leader_election.cc:304] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b35894035d040c1a9cb3349478e1f2c, 5f3068f957554638bff21f2bdbccc92a; no voters: 
I20260709 12:19:10.860585 10259 raft_consensus.cc:2804] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:10.860973 10259 raft_consensus.cc:697] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a [term 3 LEADER]: Becoming Leader. State: Replica: 5f3068f957554638bff21f2bdbccc92a, State: Running, Role: LEADER
I20260709 12:19:10.861667 10259 consensus_queue.cc:237] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } }
I20260709 12:19:10.862659  9948 raft_consensus.cc:2468] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f3068f957554638bff21f2bdbccc92a in term 3.
I20260709 12:19:10.869452  9772 catalog_manager.cc:5697] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a reported cstate change: term changed from 2 to 3, leader changed from 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66) to 5f3068f957554638bff21f2bdbccc92a (127.9.131.65). New cstate: current_term: 3 leader_uuid: "5f3068f957554638bff21f2bdbccc92a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:11.046550  9948 raft_consensus.cc:1275] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Refusing update from remote peer 1b35894035d040c1a9cb3349478e1f2c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:11.047972 10219 consensus_queue.cc:1048] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:11.062911  9869 raft_consensus.cc:1275] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [term 3 FOLLOWER]: Refusing update from remote peer 1b35894035d040c1a9cb3349478e1f2c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:11.064457 10219 consensus_queue.cc:1048] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:11.070536  9948 raft_consensus.cc:1275] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Refusing update from remote peer 1b35894035d040c1a9cb3349478e1f2c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:11.072063 10219 consensus_queue.cc:1048] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:11.087949  9876 raft_consensus.cc:1275] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [term 3 FOLLOWER]: Refusing update from remote peer 1b35894035d040c1a9cb3349478e1f2c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:11.098546 10268 consensus_queue.cc:1048] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f3068f957554638bff21f2bdbccc92a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:11.251926  9948 raft_consensus.cc:1275] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Refusing update from remote peer 5f3068f957554638bff21f2bdbccc92a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:11.253402 10259 consensus_queue.cc:1048] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:11.264209 10025 raft_consensus.cc:1275] T 0110b40df05c421892d32cc121aaa2d5 P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Refusing update from remote peer 5f3068f957554638bff21f2bdbccc92a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:11.266322 10259 consensus_queue.cc:1048] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:11.280066  9948 raft_consensus.cc:1275] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Refusing update from remote peer 5f3068f957554638bff21f2bdbccc92a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:11.282229 10275 consensus_queue.cc:1048] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:11.301836 10025 raft_consensus.cc:1275] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Refusing update from remote peer 5f3068f957554638bff21f2bdbccc92a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:11.303251 10275 consensus_queue.cc:1048] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:11.317572 10025 raft_consensus.cc:1275] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 6 FOLLOWER]: Refusing update from remote peer 5f3068f957554638bff21f2bdbccc92a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:19:11.318938 10275 consensus_queue.cc:1048] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b35894035d040c1a9cb3349478e1f2c" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:11.329154  9948 raft_consensus.cc:1275] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 6 FOLLOWER]: Refusing update from remote peer 5f3068f957554638bff21f2bdbccc92a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:19:11.330801 10259 consensus_queue.cc:1048] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3615592255dd42ba970d0805ce5f8f6c" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:11.350517  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:11.355418  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:11.355813  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:12.356850  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:12.362210  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:12.362579  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:13.363541  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:13.368431  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:13.368851  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:14.369863  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:14.374751  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:14.375174  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:15.376224  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:15.382102  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:15.382516  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:16.383548  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:16.388542  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:16.388952  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:17.389972  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:17.395114  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:17.395589  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:18.396677  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:18.401557  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:18.402004  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:19.403257  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:19.408445  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:19.408864  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:20.436995  9741 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:19:20.437682  9741 tablet_server.cc:179] TabletServer@127.9.131.65:0 shutting down...
W20260709 12:19:20.440826  9914 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:19:20.445181  9914 consensus_peers.cc:597] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c -> Peer 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313): Couldn't send request to peer 5f3068f957554638bff21f2bdbccc92a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:20.457950  9988 consensus_peers.cc:597] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c -> Peer 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313): Couldn't send request to peer 5f3068f957554638bff21f2bdbccc92a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:20.467554  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:20.468372  9741 tablet_replica.cc:333] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a: stopping tablet replica
I20260709 12:19:20.469048  9741 raft_consensus.cc:2243] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:20.469619  9741 raft_consensus.cc:2272] T 6b90c8dce8d644d3b2284f0a2428f862 P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.471956  9741 tablet_replica.cc:333] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a: stopping tablet replica
I20260709 12:19:20.472415  9741 raft_consensus.cc:2243] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:20.473150  9741 raft_consensus.cc:2272] T 0110b40df05c421892d32cc121aaa2d5 P 5f3068f957554638bff21f2bdbccc92a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.474778  9741 tablet_replica.cc:333] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a: stopping tablet replica
I20260709 12:19:20.475214  9741 raft_consensus.cc:2243] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:20.475600  9741 raft_consensus.cc:2272] T c7766e3f04a14cc0ab63c48ee33cd298 P 5f3068f957554638bff21f2bdbccc92a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.477217  9741 tablet_replica.cc:333] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a: stopping tablet replica
I20260709 12:19:20.477617  9741 raft_consensus.cc:2243] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:20.477975  9741 raft_consensus.cc:2272] T 055c16b2f90a4fdb80e042e23b3577b9 P 5f3068f957554638bff21f2bdbccc92a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.479632  9741 tablet_replica.cc:333] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a: stopping tablet replica
I20260709 12:19:20.480123  9741 raft_consensus.cc:2243] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:20.480474  9741 raft_consensus.cc:2272] T 09ddf2f4a1a4487db6eaa4786a28be51 P 5f3068f957554638bff21f2bdbccc92a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.482041  9741 tablet_replica.cc:333] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a: stopping tablet replica
I20260709 12:19:20.482455  9741 raft_consensus.cc:2243] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:20.482829  9741 raft_consensus.cc:2272] T ccf74389f16242a3973eb6553bf32abe P 5f3068f957554638bff21f2bdbccc92a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.484408  9741 tablet_replica.cc:333] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a: stopping tablet replica
I20260709 12:19:20.484802  9741 raft_consensus.cc:2243] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:19:20.485482  9741 raft_consensus.cc:2272] T 630c508d2b1f426986a6b239b2f34cce P 5f3068f957554638bff21f2bdbccc92a [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.487002  9741 tablet_replica.cc:333] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a: stopping tablet replica
I20260709 12:19:20.487382  9741 raft_consensus.cc:2243] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:20.488142  9741 raft_consensus.cc:2272] T 69ed8384453347aaafc0d6a5b2a4731d P 5f3068f957554638bff21f2bdbccc92a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.489604  9741 tablet_replica.cc:333] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a: stopping tablet replica
I20260709 12:19:20.490038  9741 raft_consensus.cc:2243] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:20.490425  9741 raft_consensus.cc:2272] T edcfb35aafee4ee08151319ebb25cc59 P 5f3068f957554638bff21f2bdbccc92a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.575361  9741 tablet_server.cc:196] TabletServer@127.9.131.65:0 shutdown complete.
W20260709 12:19:20.575453  9988 consensus_peers.cc:597] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c -> Peer 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313): Couldn't send request to peer 5f3068f957554638bff21f2bdbccc92a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:35313: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:20.593214  9741 tablet_server.cc:179] TabletServer@127.9.131.66:0 shutting down...
I20260709 12:19:20.617486  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:20.618130  9741 tablet_replica.cc:333] T 6b90c8dce8d644d3b2284f0a2428f862 P 3615592255dd42ba970d0805ce5f8f6c: stopping tablet replica
I20260709 12:19:20.618755  9741 raft_consensus.cc:2243] T 6b90c8dce8d644d3b2284f0a2428f862 P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:20.619222  9741 raft_consensus.cc:2272] T 6b90c8dce8d644d3b2284f0a2428f862 P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.621052  9741 tablet_replica.cc:333] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c: stopping tablet replica
I20260709 12:19:20.621558  9741 raft_consensus.cc:2243] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:20.621977  9741 raft_consensus.cc:2272] T 0110b40df05c421892d32cc121aaa2d5 P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.623648  9741 tablet_replica.cc:333] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c: stopping tablet replica
I20260709 12:19:20.624161  9741 raft_consensus.cc:2243] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:19:20.625043  9741 raft_consensus.cc:2272] T ccf74389f16242a3973eb6553bf32abe P 3615592255dd42ba970d0805ce5f8f6c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.626677  9741 tablet_replica.cc:333] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c: stopping tablet replica
I20260709 12:19:20.627135  9741 raft_consensus.cc:2243] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:20.627548  9741 raft_consensus.cc:2272] T edcfb35aafee4ee08151319ebb25cc59 P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.629295  9741 tablet_replica.cc:333] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c: stopping tablet replica
I20260709 12:19:20.629782  9741 raft_consensus.cc:2243] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:20.630170  9741 raft_consensus.cc:2272] T 69ed8384453347aaafc0d6a5b2a4731d P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.631753  9741 tablet_replica.cc:333] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c: stopping tablet replica
I20260709 12:19:20.632239  9741 raft_consensus.cc:2243] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:20.632616  9741 raft_consensus.cc:2272] T 055c16b2f90a4fdb80e042e23b3577b9 P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.634136  9741 tablet_replica.cc:333] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c: stopping tablet replica
I20260709 12:19:20.634567  9741 raft_consensus.cc:2243] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:20.635349  9741 raft_consensus.cc:2272] T 09ddf2f4a1a4487db6eaa4786a28be51 P 3615592255dd42ba970d0805ce5f8f6c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.636996  9741 tablet_replica.cc:333] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c: stopping tablet replica
I20260709 12:19:20.637413  9741 raft_consensus.cc:2243] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:20.638154  9741 raft_consensus.cc:2272] T c7766e3f04a14cc0ab63c48ee33cd298 P 3615592255dd42ba970d0805ce5f8f6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.639703  9741 tablet_replica.cc:333] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c: stopping tablet replica
I20260709 12:19:20.640127  9741 raft_consensus.cc:2243] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:20.640506  9741 raft_consensus.cc:2272] T 630c508d2b1f426986a6b239b2f34cce P 3615592255dd42ba970d0805ce5f8f6c [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:20.675567  9990 consensus_peers.cc:597] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c -> Peer 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569): Couldn't send request to peer 3615592255dd42ba970d0805ce5f8f6c. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:38569: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:20.688835  9741 tablet_server.cc:196] TabletServer@127.9.131.66:0 shutdown complete.
I20260709 12:19:20.707202  9741 tablet_server.cc:179] TabletServer@127.9.131.67:0 shutting down...
W20260709 12:19:20.713410  9990 consensus_peers.cc:597] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c -> Peer 3615592255dd42ba970d0805ce5f8f6c (127.9.131.66:38569): Couldn't send request to peer 3615592255dd42ba970d0805ce5f8f6c. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:38569: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:20.733863  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:20.734637  9741 tablet_replica.cc:333] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c: stopping tablet replica
I20260709 12:19:20.735219  9741 raft_consensus.cc:2243] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:20.735745  9741 raft_consensus.cc:2272] T 09ddf2f4a1a4487db6eaa4786a28be51 P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.738154  9741 tablet_replica.cc:333] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c: stopping tablet replica
I20260709 12:19:20.738742  9741 raft_consensus.cc:2243] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:20.739636  9741 raft_consensus.cc:2272] T 055c16b2f90a4fdb80e042e23b3577b9 P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:20.741624  9988 consensus_peers.cc:597] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c -> Peer 5f3068f957554638bff21f2bdbccc92a (127.9.131.65:35313): Couldn't send request to peer 5f3068f957554638bff21f2bdbccc92a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:35313: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:20.741824  9741 tablet_replica.cc:333] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c: stopping tablet replica
I20260709 12:19:20.742398  9741 raft_consensus.cc:2243] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:20.742914  9741 raft_consensus.cc:2272] T 630c508d2b1f426986a6b239b2f34cce P 1b35894035d040c1a9cb3349478e1f2c [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.744691  9741 tablet_replica.cc:333] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c: stopping tablet replica
I20260709 12:19:20.745178  9741 raft_consensus.cc:2243] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:20.745625  9741 raft_consensus.cc:2272] T 69ed8384453347aaafc0d6a5b2a4731d P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.747339  9741 tablet_replica.cc:333] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c: stopping tablet replica
I20260709 12:19:20.747920  9741 raft_consensus.cc:2243] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:20.748735  9741 raft_consensus.cc:2272] T edcfb35aafee4ee08151319ebb25cc59 P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.750499  9741 tablet_replica.cc:333] T c7766e3f04a14cc0ab63c48ee33cd298 P 1b35894035d040c1a9cb3349478e1f2c: stopping tablet replica
I20260709 12:19:20.751017  9741 raft_consensus.cc:2243] T c7766e3f04a14cc0ab63c48ee33cd298 P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:20.751430  9741 raft_consensus.cc:2272] T c7766e3f04a14cc0ab63c48ee33cd298 P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.753113  9741 tablet_replica.cc:333] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c: stopping tablet replica
I20260709 12:19:20.753549  9741 raft_consensus.cc:2243] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:20.754287  9741 raft_consensus.cc:2272] T 6b90c8dce8d644d3b2284f0a2428f862 P 1b35894035d040c1a9cb3349478e1f2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.756385  9741 tablet_replica.cc:333] T 0110b40df05c421892d32cc121aaa2d5 P 1b35894035d040c1a9cb3349478e1f2c: stopping tablet replica
I20260709 12:19:20.756850  9741 raft_consensus.cc:2243] T 0110b40df05c421892d32cc121aaa2d5 P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:20.757262  9741 raft_consensus.cc:2272] T 0110b40df05c421892d32cc121aaa2d5 P 1b35894035d040c1a9cb3349478e1f2c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.758914  9741 tablet_replica.cc:333] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c: stopping tablet replica
I20260709 12:19:20.759411  9741 raft_consensus.cc:2243] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:20.759845  9741 raft_consensus.cc:2272] T ccf74389f16242a3973eb6553bf32abe P 1b35894035d040c1a9cb3349478e1f2c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.787142  9741 tablet_server.cc:196] TabletServer@127.9.131.67:0 shutdown complete.
I20260709 12:19:20.804656  9741 master.cc:562] Master@127.9.131.126:34905 shutting down...
I20260709 12:19:20.866714  9828 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 12:19:20.917479  9741 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:20.918113  9741 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.918438  9741 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7fdf5b338388423199a0f150c69d6fff: stopping tablet replica
I20260709 12:19:20.958086  9741 master.cc:584] Master@127.9.131.126:34905 shutdown complete.
1b35894035d040c1a9cb3349478e1f2c  1
3615592255dd42ba970d0805ce5f8f6c  4
5f3068f957554638bff21f2bdbccc92a  4
1b35894035d040c1a9cb3349478e1f2c  3
3615592255dd42ba970d0805ce5f8f6c  3
5f3068f957554638bff21f2bdbccc92a  3
1b35894035d040c1a9cb3349478e1f2c  1
3615592255dd42ba970d0805ce5f8f6c  8
5f3068f957554638bff21f2bdbccc92a  0
1b35894035d040c1a9cb3349478e1f2c  3
3615592255dd42ba970d0805ce5f8f6c  3
5f3068f957554638bff21f2bdbccc92a  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (32982 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:19:20.997800  9741 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.131.126:46267
I20260709 12:19:20.998942  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:21.004606 10291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:21.004644 10292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:21.005697 10294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:21.008006  9741 server_base.cc:1061] running on GCE node
I20260709 12:19:21.008966  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:21.009153  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:21.009308  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599561009292 us; error 0 us; skew 500 ppm
I20260709 12:19:21.009836  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:21.012281  9741 webserver.cc:533] Webserver started at http://127.9.131.126:44043/ using document root <none> and password file <none>
I20260709 12:19:21.012755  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:21.012925  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:21.013196  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:21.014367  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599527842218-9741-0/minicluster-data/master-0-root/instance:
uuid: "9f980e0f2df14158a3c34b8ef94f256c"
format_stamp: "Formatted at 2026-07-09 12:19:21 on dist-test-slave-r7s7"
I20260709 12:19:21.018962  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:19:21.022580 10299 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:21.023339  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:19:21.023669  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599527842218-9741-0/minicluster-data/master-0-root
uuid: "9f980e0f2df14158a3c34b8ef94f256c"
format_stamp: "Formatted at 2026-07-09 12:19:21 on dist-test-slave-r7s7"
I20260709 12:19:21.024001  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599527842218-9741-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599527842218-9741-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599527842218-9741-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:21.044073  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:21.045315  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:21.082612  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.126:46267
I20260709 12:19:21.082690 10350 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.126:46267 every 8 connection(s)
I20260709 12:19:21.086645 10351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.096446 10351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c: Bootstrap starting.
I20260709 12:19:21.101213 10351 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:21.105381 10351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c: No bootstrap required, opened a new log
I20260709 12:19:21.107563 10351 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f980e0f2df14158a3c34b8ef94f256c" member_type: VOTER }
I20260709 12:19:21.108044 10351 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:21.108284 10351 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f980e0f2df14158a3c34b8ef94f256c, State: Initialized, Role: FOLLOWER
I20260709 12:19:21.109457 10351 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f980e0f2df14158a3c34b8ef94f256c" member_type: VOTER }
I20260709 12:19:21.110036 10351 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:19:21.110325 10351 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:19:21.110638 10351 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:21.116616 10351 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f980e0f2df14158a3c34b8ef94f256c" member_type: VOTER }
I20260709 12:19:21.117158 10351 leader_election.cc:304] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f980e0f2df14158a3c34b8ef94f256c; no voters: 
I20260709 12:19:21.118251 10351 leader_election.cc:290] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:19:21.118554 10354 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:21.119841 10354 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c [term 1 LEADER]: Becoming Leader. State: Replica: 9f980e0f2df14158a3c34b8ef94f256c, State: Running, Role: LEADER
I20260709 12:19:21.120488 10354 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f980e0f2df14158a3c34b8ef94f256c" member_type: VOTER }
I20260709 12:19:21.121084 10351 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:19:21.124934 10356 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f980e0f2df14158a3c34b8ef94f256c. Latest consensus state: current_term: 1 leader_uuid: "9f980e0f2df14158a3c34b8ef94f256c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f980e0f2df14158a3c34b8ef94f256c" member_type: VOTER } }
I20260709 12:19:21.125422 10356 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:21.127693 10355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f980e0f2df14158a3c34b8ef94f256c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f980e0f2df14158a3c34b8ef94f256c" member_type: VOTER } }
I20260709 12:19:21.128345 10355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:21.134589  9741 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
W20260709 12:19:21.137967 10370 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260709 12:19:21.138252 10370 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260709 12:19:21.138664 10361 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:19:21.143321 10361 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:19:21.152105 10361 catalog_manager.cc:1383] Generated new cluster ID: 1328aeed87424dca8894dae0021363f7
I20260709 12:19:21.152437 10361 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:19:21.175426 10361 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:19:21.176748 10361 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:19:21.200944 10361 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c: Generated new TSK 0
I20260709 12:19:21.201556 10361 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:19:21.265489  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:21.271528 10372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:21.272449 10373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:21.274037 10375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:21.274152  9741 server_base.cc:1061] running on GCE node
I20260709 12:19:21.275265  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:21.275477  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:21.275640  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599561275620 us; error 0 us; skew 500 ppm
I20260709 12:19:21.276229  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:21.278573  9741 webserver.cc:533] Webserver started at http://127.9.131.65:44413/ using document root <none> and password file <none>
I20260709 12:19:21.279078  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:21.279270  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:21.279517  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:21.280579  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599527842218-9741-0/minicluster-data/ts-0-root/instance:
uuid: "390add5b62d0491e947fbaa913806886"
format_stamp: "Formatted at 2026-07-09 12:19:21 on dist-test-slave-r7s7"
I20260709 12:19:21.284955  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:19:21.288466 10380 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:21.289289  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 12:19:21.289595  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599527842218-9741-0/minicluster-data/ts-0-root
uuid: "390add5b62d0491e947fbaa913806886"
format_stamp: "Formatted at 2026-07-09 12:19:21 on dist-test-slave-r7s7"
I20260709 12:19:21.289907  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599527842218-9741-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599527842218-9741-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599527842218-9741-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:21.311681  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:21.312949  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:21.314438  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:21.316799  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:21.317015  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:21.317245  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:21.317411  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:21.358567  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.65:35155
I20260709 12:19:21.358667 10442 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.65:35155 every 8 connection(s)
I20260709 12:19:21.363221  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:21.369817 10447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:21.371383 10448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:21.374866 10450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:21.375342  9741 server_base.cc:1061] running on GCE node
I20260709 12:19:21.376411  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:21.376613  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:21.376708 10443 heartbeater.cc:344] Connected to a master server at 127.9.131.126:46267
I20260709 12:19:21.376788  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599561376770 us; error 0 us; skew 500 ppm
I20260709 12:19:21.377125 10443 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:21.377456  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:21.377843 10443 heartbeater.cc:507] Master 127.9.131.126:46267 requested a full tablet report, sending...
I20260709 12:19:21.380300  9741 webserver.cc:533] Webserver started at http://127.9.131.66:36671/ using document root <none> and password file <none>
I20260709 12:19:21.380481 10316 ts_manager.cc:194] Registered new tserver with Master: 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155)
I20260709 12:19:21.380985  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:21.381238  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:21.381556  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:21.382840 10316 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39900
I20260709 12:19:21.383033  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599527842218-9741-0/minicluster-data/ts-1-root/instance:
uuid: "fa2b7127d769426dbf6b610f74536106"
format_stamp: "Formatted at 2026-07-09 12:19:21 on dist-test-slave-r7s7"
I20260709 12:19:21.387758  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.006s
I20260709 12:19:21.391062 10455 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:21.391893  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:19:21.392179  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599527842218-9741-0/minicluster-data/ts-1-root
uuid: "fa2b7127d769426dbf6b610f74536106"
format_stamp: "Formatted at 2026-07-09 12:19:21 on dist-test-slave-r7s7"
I20260709 12:19:21.392441  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599527842218-9741-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599527842218-9741-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599527842218-9741-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:21.418363  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:21.419584  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:21.421113  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:21.423264  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:21.423462  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:21.423686  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:21.423832  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:21.462530  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.66:40395
I20260709 12:19:21.462644 10517 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.66:40395 every 8 connection(s)
I20260709 12:19:21.467126  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:21.474769 10522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:21.475790 10521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:21.477599 10524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:21.478259  9741 server_base.cc:1061] running on GCE node
I20260709 12:19:21.479099  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:21.479310  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:21.479466  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599561479450 us; error 0 us; skew 500 ppm
I20260709 12:19:21.479820 10518 heartbeater.cc:344] Connected to a master server at 127.9.131.126:46267
I20260709 12:19:21.480093  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:21.480238 10518 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:21.481139 10518 heartbeater.cc:507] Master 127.9.131.126:46267 requested a full tablet report, sending...
I20260709 12:19:21.483062  9741 webserver.cc:533] Webserver started at http://127.9.131.67:33289/ using document root <none> and password file <none>
I20260709 12:19:21.483222 10316 ts_manager.cc:194] Registered new tserver with Master: fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395)
I20260709 12:19:21.483578  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:21.483793  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:21.484074  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:21.484681 10316 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39910
I20260709 12:19:21.485193  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599527842218-9741-0/minicluster-data/ts-2-root/instance:
uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
format_stamp: "Formatted at 2026-07-09 12:19:21 on dist-test-slave-r7s7"
I20260709 12:19:21.489660  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:19:21.493059 10529 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:21.493921  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:19:21.494262  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599527842218-9741-0/minicluster-data/ts-2-root
uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
format_stamp: "Formatted at 2026-07-09 12:19:21 on dist-test-slave-r7s7"
I20260709 12:19:21.494529  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599527842218-9741-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599527842218-9741-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599527842218-9741-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:21.514144  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:21.515374  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:21.516893  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:21.519068  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:21.519276  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:21.519495  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:21.519668  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:21.558445  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.67:45275
I20260709 12:19:21.558528 10591 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.67:45275 every 8 connection(s)
I20260709 12:19:21.571811 10592 heartbeater.cc:344] Connected to a master server at 127.9.131.126:46267
I20260709 12:19:21.572217 10592 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:21.572926 10592 heartbeater.cc:507] Master 127.9.131.126:46267 requested a full tablet report, sending...
I20260709 12:19:21.574775 10316 ts_manager.cc:194] Registered new tserver with Master: 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:21.575609  9741 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014218498s
I20260709 12:19:21.576162 10316 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39916
I20260709 12:19:21.600112 10316 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39918:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:19:21.602833 10316 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:19:21.681140 10557 tablet_service.cc:1511] Processing CreateTablet for tablet fd82dd15e20c4a50a0c70f53ca8b0c37 (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:19:21.682766 10557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd82dd15e20c4a50a0c70f53ca8b0c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.685048 10556 tablet_service.cc:1511] Processing CreateTablet for tablet f298960b2387414094881ba3dfd8e6ad (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:19:21.686619 10556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f298960b2387414094881ba3dfd8e6ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.689093 10555 tablet_service.cc:1511] Processing CreateTablet for tablet b945359b04724fd1b32b67ebac2a75c4 (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:19:21.690716 10555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b945359b04724fd1b32b67ebac2a75c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.691972 10554 tablet_service.cc:1511] Processing CreateTablet for tablet 79327c96f319433192eb5f752085848d (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:19:21.693277 10554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79327c96f319433192eb5f752085848d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.693106 10553 tablet_service.cc:1511] Processing CreateTablet for tablet dde0882b03d245e58bd916123081e004 (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:19:21.694594 10553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde0882b03d245e58bd916123081e004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.700441 10552 tablet_service.cc:1511] Processing CreateTablet for tablet b4752da4a6a447ad93fdacdb010730ca (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:19:21.701825 10552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4752da4a6a447ad93fdacdb010730ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.705976 10551 tablet_service.cc:1511] Processing CreateTablet for tablet 6dca734c6e434c1595f96ef0b2825c17 (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:19:21.710582 10551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dca734c6e434c1595f96ef0b2825c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.718148 10404 tablet_service.cc:1511] Processing CreateTablet for tablet dde0882b03d245e58bd916123081e004 (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:19:21.718727 10408 tablet_service.cc:1511] Processing CreateTablet for tablet fd82dd15e20c4a50a0c70f53ca8b0c37 (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:19:21.719646 10404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde0882b03d245e58bd916123081e004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.720952 10407 tablet_service.cc:1511] Processing CreateTablet for tablet f298960b2387414094881ba3dfd8e6ad (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:19:21.722352 10407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f298960b2387414094881ba3dfd8e6ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.723147 10403 tablet_service.cc:1511] Processing CreateTablet for tablet b4752da4a6a447ad93fdacdb010730ca (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:19:21.724469 10403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4752da4a6a447ad93fdacdb010730ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.725085 10406 tablet_service.cc:1511] Processing CreateTablet for tablet b945359b04724fd1b32b67ebac2a75c4 (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:19:21.726500 10406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b945359b04724fd1b32b67ebac2a75c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.726882 10402 tablet_service.cc:1511] Processing CreateTablet for tablet 6dca734c6e434c1595f96ef0b2825c17 (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:19:21.728307 10402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dca734c6e434c1595f96ef0b2825c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.729177 10405 tablet_service.cc:1511] Processing CreateTablet for tablet 79327c96f319433192eb5f752085848d (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:19:21.730588 10405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79327c96f319433192eb5f752085848d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.732039 10401 tablet_service.cc:1511] Processing CreateTablet for tablet d7128a5d9b774f3cb0ebdabf0e1c2e3c (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:19:21.733997 10401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7128a5d9b774f3cb0ebdabf0e1c2e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.743921 10408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd82dd15e20c4a50a0c70f53ca8b0c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.745100 10549 tablet_service.cc:1511] Processing CreateTablet for tablet 82aae21e47564b3abcc7247912bd13f7 (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:19:21.746475 10549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82aae21e47564b3abcc7247912bd13f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.749086 10399 tablet_service.cc:1511] Processing CreateTablet for tablet bb6df9ee5d9940198397a007388de659 (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:19:21.750442 10399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6df9ee5d9940198397a007388de659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.735916 10550 tablet_service.cc:1511] Processing CreateTablet for tablet d7128a5d9b774f3cb0ebdabf0e1c2e3c (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:19:21.754194 10550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7128a5d9b774f3cb0ebdabf0e1c2e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.737272 10400 tablet_service.cc:1511] Processing CreateTablet for tablet 82aae21e47564b3abcc7247912bd13f7 (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:19:21.756130 10607 tablet_bootstrap.cc:492] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Bootstrap starting.
I20260709 12:19:21.756727 10400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82aae21e47564b3abcc7247912bd13f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.762269 10607 tablet_bootstrap.cc:654] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:21.764473 10555 tablet_service.cc:1511] Processing CreateTablet for tablet bb6df9ee5d9940198397a007388de659 (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:19:21.765841 10555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6df9ee5d9940198397a007388de659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.810375 10607 tablet_bootstrap.cc:492] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a: No bootstrap required, opened a new log
I20260709 12:19:21.810926 10607 ts_tablet_manager.cc:1403] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Time spent bootstrapping tablet: real 0.055s	user 0.021s	sys 0.031s
I20260709 12:19:21.813910 10607 raft_consensus.cc:359] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:21.814695 10607 raft_consensus.cc:385] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:21.815024 10607 raft_consensus.cc:740] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bfa1b0cf96346a5a3ee6ea10de9496a, State: Initialized, Role: FOLLOWER
I20260709 12:19:21.816012 10607 consensus_queue.cc:260] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:21.818014 10483 tablet_service.cc:1511] Processing CreateTablet for tablet fd82dd15e20c4a50a0c70f53ca8b0c37 (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:19:21.819340 10483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd82dd15e20c4a50a0c70f53ca8b0c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.829715 10482 tablet_service.cc:1511] Processing CreateTablet for tablet f298960b2387414094881ba3dfd8e6ad (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:19:21.831370 10482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f298960b2387414094881ba3dfd8e6ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.837276 10477 tablet_service.cc:1511] Processing CreateTablet for tablet 6dca734c6e434c1595f96ef0b2825c17 (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:19:21.833163 10480 tablet_service.cc:1511] Processing CreateTablet for tablet 79327c96f319433192eb5f752085848d (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:19:21.834535 10475 tablet_service.cc:1511] Processing CreateTablet for tablet 82aae21e47564b3abcc7247912bd13f7 (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:19:21.830245 10609 tablet_bootstrap.cc:492] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886: Bootstrap starting.
I20260709 12:19:21.834889 10479 tablet_service.cc:1511] Processing CreateTablet for tablet dde0882b03d245e58bd916123081e004 (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:19:21.840214 10476 tablet_service.cc:1511] Processing CreateTablet for tablet d7128a5d9b774f3cb0ebdabf0e1c2e3c (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:19:21.842552 10481 tablet_service.cc:1511] Processing CreateTablet for tablet b945359b04724fd1b32b67ebac2a75c4 (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:19:21.842779 10478 tablet_service.cc:1511] Processing CreateTablet for tablet b4752da4a6a447ad93fdacdb010730ca (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:19:21.844031 10475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82aae21e47564b3abcc7247912bd13f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.836323 10474 tablet_service.cc:1511] Processing CreateTablet for tablet bb6df9ee5d9940198397a007388de659 (DEFAULT_TABLE table=test-workload [id=5951b2f7e1134b1b8e598eed482b7546]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:19:21.844650 10479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde0882b03d245e58bd916123081e004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.845243 10478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4752da4a6a447ad93fdacdb010730ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.845887 10476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7128a5d9b774f3cb0ebdabf0e1c2e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.848213 10474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6df9ee5d9940198397a007388de659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.852460 10480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79327c96f319433192eb5f752085848d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.854805 10481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b945359b04724fd1b32b67ebac2a75c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.856530 10477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dca734c6e434c1595f96ef0b2825c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:21.900477 10592 heartbeater.cc:499] Master 127.9.131.126:46267 was elected leader, sending a full tablet report...
I20260709 12:19:21.903169 10609 tablet_bootstrap.cc:654] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:21.900633 10607 ts_tablet_manager.cc:1434] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Time spent starting tablet: real 0.089s	user 0.043s	sys 0.031s
I20260709 12:19:21.908131 10607 tablet_bootstrap.cc:492] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Bootstrap starting.
I20260709 12:19:21.918108 10611 tablet_bootstrap.cc:492] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106: Bootstrap starting.
I20260709 12:19:21.919718 10609 tablet_bootstrap.cc:492] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886: No bootstrap required, opened a new log
I20260709 12:19:21.920250 10609 ts_tablet_manager.cc:1403] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886: Time spent bootstrapping tablet: real 0.090s	user 0.006s	sys 0.018s
I20260709 12:19:21.923223 10609 raft_consensus.cc:359] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:21.924096 10607 tablet_bootstrap.cc:654] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:21.924037 10609 raft_consensus.cc:385] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:21.924607 10609 raft_consensus.cc:740] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 390add5b62d0491e947fbaa913806886, State: Initialized, Role: FOLLOWER
I20260709 12:19:21.925786 10611 tablet_bootstrap.cc:654] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:21.925432 10609 consensus_queue.cc:260] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:21.934964 10609 ts_tablet_manager.cc:1434] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.010s
I20260709 12:19:21.935760 10611 tablet_bootstrap.cc:492] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106: No bootstrap required, opened a new log
I20260709 12:19:21.936306 10611 ts_tablet_manager.cc:1403] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.011s
I20260709 12:19:21.937638 10443 heartbeater.cc:499] Master 127.9.131.126:46267 was elected leader, sending a full tablet report...
I20260709 12:19:21.938746 10607 tablet_bootstrap.cc:492] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a: No bootstrap required, opened a new log
I20260709 12:19:21.939288 10607 ts_tablet_manager.cc:1403] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.008s
I20260709 12:19:21.939301 10611 raft_consensus.cc:359] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } }
I20260709 12:19:21.940280 10611 raft_consensus.cc:385] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:21.940619 10611 raft_consensus.cc:740] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa2b7127d769426dbf6b610f74536106, State: Initialized, Role: FOLLOWER
I20260709 12:19:21.941866 10609 tablet_bootstrap.cc:492] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886: Bootstrap starting.
I20260709 12:19:21.941548 10611 consensus_queue.cc:260] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } }
I20260709 12:19:21.942308 10607 raft_consensus.cc:359] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:21.943032 10607 raft_consensus.cc:385] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:21.943398 10607 raft_consensus.cc:740] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bfa1b0cf96346a5a3ee6ea10de9496a, State: Initialized, Role: FOLLOWER
I20260709 12:19:21.944422 10607 consensus_queue.cc:260] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:21.947044 10607 ts_tablet_manager.cc:1434] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:21.948172 10607 tablet_bootstrap.cc:492] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Bootstrap starting.
I20260709 12:19:21.948521 10609 tablet_bootstrap.cc:654] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:21.955096 10607 tablet_bootstrap.cc:654] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:21.967604 10518 heartbeater.cc:499] Master 127.9.131.126:46267 was elected leader, sending a full tablet report...
I20260709 12:19:21.968587 10607 tablet_bootstrap.cc:492] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a: No bootstrap required, opened a new log
I20260709 12:19:21.968751 10609 tablet_bootstrap.cc:492] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886: No bootstrap required, opened a new log
I20260709 12:19:21.969120 10607 ts_tablet_manager.cc:1403] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 12:19:21.969276 10609 ts_tablet_manager.cc:1403] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.011s
I20260709 12:19:21.972163 10607 raft_consensus.cc:359] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:21.972347 10609 raft_consensus.cc:359] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:21.972981 10607 raft_consensus.cc:385] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:21.973137 10609 raft_consensus.cc:385] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:21.973414 10607 raft_consensus.cc:740] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bfa1b0cf96346a5a3ee6ea10de9496a, State: Initialized, Role: FOLLOWER
I20260709 12:19:21.973533 10609 raft_consensus.cc:740] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 390add5b62d0491e947fbaa913806886, State: Initialized, Role: FOLLOWER
I20260709 12:19:21.974417 10607 consensus_queue.cc:260] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:21.974556 10609 consensus_queue.cc:260] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:21.973513 10611 ts_tablet_manager.cc:1434] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106: Time spent starting tablet: real 0.037s	user 0.021s	sys 0.008s
I20260709 12:19:21.976727 10611 tablet_bootstrap.cc:492] T b945359b04724fd1b32b67ebac2a75c4 P fa2b7127d769426dbf6b610f74536106: Bootstrap starting.
I20260709 12:19:21.977339 10609 ts_tablet_manager.cc:1434] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:19:21.978367 10609 tablet_bootstrap.cc:492] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886: Bootstrap starting.
I20260709 12:19:21.980105 10607 ts_tablet_manager.cc:1434] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:19:21.981103 10607 tablet_bootstrap.cc:492] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a: Bootstrap starting.
I20260709 12:19:21.986537 10609 tablet_bootstrap.cc:654] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:21.987407 10607 tablet_bootstrap.cc:654] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:21.988442 10611 tablet_bootstrap.cc:654] T b945359b04724fd1b32b67ebac2a75c4 P fa2b7127d769426dbf6b610f74536106: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:21.998852 10609 tablet_bootstrap.cc:492] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886: No bootstrap required, opened a new log
I20260709 12:19:21.999348 10609 ts_tablet_manager.cc:1403] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.003s
I20260709 12:19:22.001859 10607 tablet_bootstrap.cc:492] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a: No bootstrap required, opened a new log
I20260709 12:19:22.002358 10611 tablet_bootstrap.cc:492] T b945359b04724fd1b32b67ebac2a75c4 P fa2b7127d769426dbf6b610f74536106: No bootstrap required, opened a new log
I20260709 12:19:22.002444 10607 ts_tablet_manager.cc:1403] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.001s
I20260709 12:19:22.002329 10609 raft_consensus.cc:359] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } }
I20260709 12:19:22.003079 10611 ts_tablet_manager.cc:1403] T b945359b04724fd1b32b67ebac2a75c4 P fa2b7127d769426dbf6b610f74536106: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.010s
I20260709 12:19:22.003376 10609 raft_consensus.cc:385] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.003741 10609 raft_consensus.cc:740] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 390add5b62d0491e947fbaa913806886, State: Initialized, Role: FOLLOWER
I20260709 12:19:22.004603 10609 consensus_queue.cc:260] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } }
I20260709 12:19:22.005884 10607 raft_consensus.cc:359] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.006117 10611 raft_consensus.cc:359] T b945359b04724fd1b32b67ebac2a75c4 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.006652 10607 raft_consensus.cc:385] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.006903 10611 raft_consensus.cc:385] T b945359b04724fd1b32b67ebac2a75c4 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.007099 10607 raft_consensus.cc:740] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bfa1b0cf96346a5a3ee6ea10de9496a, State: Initialized, Role: FOLLOWER
I20260709 12:19:22.007311 10611 raft_consensus.cc:740] T b945359b04724fd1b32b67ebac2a75c4 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa2b7127d769426dbf6b610f74536106, State: Initialized, Role: FOLLOWER
I20260709 12:19:22.008601 10609 ts_tablet_manager.cc:1434] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:19:22.008149 10611 consensus_queue.cc:260] T b945359b04724fd1b32b67ebac2a75c4 P fa2b7127d769426dbf6b610f74536106 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.008216 10607 consensus_queue.cc:260] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.009640 10609 tablet_bootstrap.cc:492] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886: Bootstrap starting.
I20260709 12:19:22.010579 10611 ts_tablet_manager.cc:1434] T b945359b04724fd1b32b67ebac2a75c4 P fa2b7127d769426dbf6b610f74536106: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:22.011638 10611 tablet_bootstrap.cc:492] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106: Bootstrap starting.
I20260709 12:19:22.012727 10607 ts_tablet_manager.cc:1434] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:19:22.013814 10607 tablet_bootstrap.cc:492] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Bootstrap starting.
I20260709 12:19:22.015961 10616 raft_consensus.cc:493] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.016362 10609 tablet_bootstrap.cc:654] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:22.016469 10616 raft_consensus.cc:515] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } }
I20260709 12:19:22.020840 10616 leader_election.cc:290] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275), 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155)
I20260709 12:19:22.027961 10609 tablet_bootstrap.cc:492] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886: No bootstrap required, opened a new log
I20260709 12:19:22.028620 10609 ts_tablet_manager.cc:1403] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 12:19:22.030679 10611 tablet_bootstrap.cc:654] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:22.031710 10609 raft_consensus.cc:359] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.032589 10609 raft_consensus.cc:385] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.032949 10609 raft_consensus.cc:740] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 390add5b62d0491e947fbaa913806886, State: Initialized, Role: FOLLOWER
I20260709 12:19:22.033780 10607 tablet_bootstrap.cc:654] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:22.033910 10609 consensus_queue.cc:260] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.039804 10609 ts_tablet_manager.cc:1434] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:19:22.040982 10609 tablet_bootstrap.cc:492] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886: Bootstrap starting.
I20260709 12:19:22.046470 10607 tablet_bootstrap.cc:492] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a: No bootstrap required, opened a new log
I20260709 12:19:22.047031 10607 ts_tablet_manager.cc:1403] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 12:19:22.047914 10609 tablet_bootstrap.cc:654] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:22.050045 10607 raft_consensus.cc:359] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } }
I20260709 12:19:22.052157 10611 tablet_bootstrap.cc:492] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106: No bootstrap required, opened a new log
I20260709 12:19:22.052851 10611 ts_tablet_manager.cc:1403] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.004s
I20260709 12:19:22.050848 10607 raft_consensus.cc:385] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.053748 10607 raft_consensus.cc:740] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bfa1b0cf96346a5a3ee6ea10de9496a, State: Initialized, Role: FOLLOWER
I20260709 12:19:22.054746 10607 consensus_queue.cc:260] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } }
I20260709 12:19:22.055318 10609 tablet_bootstrap.cc:492] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886: No bootstrap required, opened a new log
I20260709 12:19:22.055963 10609 ts_tablet_manager.cc:1403] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.006s
I20260709 12:19:22.055724 10611 raft_consensus.cc:359] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.056433 10611 raft_consensus.cc:385] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.056751 10611 raft_consensus.cc:740] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa2b7127d769426dbf6b610f74536106, State: Initialized, Role: FOLLOWER
I20260709 12:19:22.057592 10611 consensus_queue.cc:260] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.059221 10609 raft_consensus.cc:359] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.059947 10611 ts_tablet_manager.cc:1434] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:19:22.060318 10609 raft_consensus.cc:385] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.060709 10609 raft_consensus.cc:740] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 390add5b62d0491e947fbaa913806886, State: Initialized, Role: FOLLOWER
I20260709 12:19:22.061038 10611 tablet_bootstrap.cc:492] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106: Bootstrap starting.
I20260709 12:19:22.062048 10607 ts_tablet_manager.cc:1434] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:19:22.061666 10609 consensus_queue.cc:260] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
W20260709 12:19:22.062440 10593 tablet.cc:2406] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:19:22.063058 10607 tablet_bootstrap.cc:492] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a: Bootstrap starting.
I20260709 12:19:22.064532 10609 ts_tablet_manager.cc:1434] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:19:22.064968 10610 raft_consensus.cc:493] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.065724 10609 tablet_bootstrap.cc:492] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886: Bootstrap starting.
I20260709 12:19:22.065469 10610 raft_consensus.cc:515] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.072786 10609 tablet_bootstrap.cc:654] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:22.076330 10607 tablet_bootstrap.cc:654] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:22.078249 10611 tablet_bootstrap.cc:654] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:22.081513 10613 raft_consensus.cc:493] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.082054 10613 raft_consensus.cc:515] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.087543 10613 leader_election.cc:290] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:22.100591 10418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd82dd15e20c4a50a0c70f53ca8b0c37" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "390add5b62d0491e947fbaa913806886" is_pre_election: true
I20260709 12:19:22.101473 10418 raft_consensus.cc:2468] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2b7127d769426dbf6b610f74536106 in term 0.
I20260709 12:19:22.103073 10457 leader_election.cc:304] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 390add5b62d0491e947fbaa913806886, fa2b7127d769426dbf6b610f74536106; no voters: 
I20260709 12:19:22.104076 10616 raft_consensus.cc:2804] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:22.104482 10616 raft_consensus.cc:493] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.104835 10616 raft_consensus.cc:3060] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.106823 10609 tablet_bootstrap.cc:492] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886: No bootstrap required, opened a new log
I20260709 12:19:22.107414 10609 ts_tablet_manager.cc:1403] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.005s
I20260709 12:19:22.107688 10610 leader_election.cc:290] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155), fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395)
I20260709 12:19:22.110584 10609 raft_consensus.cc:359] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.111426 10609 raft_consensus.cc:385] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.111792 10609 raft_consensus.cc:740] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 390add5b62d0491e947fbaa913806886, State: Initialized, Role: FOLLOWER
I20260709 12:19:22.112895 10616 raft_consensus.cc:515] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } }
I20260709 12:19:22.114827 10609 consensus_queue.cc:260] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.116601 10418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd82dd15e20c4a50a0c70f53ca8b0c37" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "390add5b62d0491e947fbaa913806886"
I20260709 12:19:22.117327 10418 raft_consensus.cc:3060] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.117388 10609 ts_tablet_manager.cc:1434] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:19:22.118642 10609 tablet_bootstrap.cc:492] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886: Bootstrap starting.
I20260709 12:19:22.122949 10613 raft_consensus.cc:493] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.123476 10613 raft_consensus.cc:515] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.125736 10613 leader_election.cc:290] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:22.126550 10609 tablet_bootstrap.cc:654] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:22.128450 10418 raft_consensus.cc:2468] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2b7127d769426dbf6b610f74536106 in term 1.
I20260709 12:19:22.129711 10457 leader_election.cc:304] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 390add5b62d0491e947fbaa913806886, fa2b7127d769426dbf6b610f74536106; no voters: 
W20260709 12:19:22.130033 10364 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:22.132884 10567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd82dd15e20c4a50a0c70f53ca8b0c37" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" is_pre_election: true
I20260709 12:19:22.133155 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd82dd15e20c4a50a0c70f53ca8b0c37" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
I20260709 12:19:22.133630 10567 raft_consensus.cc:2468] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2b7127d769426dbf6b610f74536106 in term 0.
I20260709 12:19:22.135622 10610 raft_consensus.cc:493] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.136224 10610 raft_consensus.cc:515] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.139514 10616 leader_election.cc:290] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 1 election: Requested vote from peers 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275), 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155)
I20260709 12:19:22.142350 10610 leader_election.cc:290] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155), fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395)
I20260709 12:19:22.142094 10616 raft_consensus.cc:2804] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:22.151979 10493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945359b04724fd1b32b67ebac2a75c4" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa2b7127d769426dbf6b610f74536106" is_pre_election: true
I20260709 12:19:22.155367 10493 raft_consensus.cc:2468] T b945359b04724fd1b32b67ebac2a75c4 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 0.
I20260709 12:19:22.150714 10616 raft_consensus.cc:697] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [term 1 LEADER]: Becoming Leader. State: Replica: fa2b7127d769426dbf6b610f74536106, State: Running, Role: LEADER
I20260709 12:19:22.158648 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4752da4a6a447ad93fdacdb010730ca" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa2b7127d769426dbf6b610f74536106" is_pre_election: true
I20260709 12:19:22.159746 10610 raft_consensus.cc:493] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.160346 10384 leader_election.cc:304] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 390add5b62d0491e947fbaa913806886, fa2b7127d769426dbf6b610f74536106; no voters: 
I20260709 12:19:22.160318 10610 raft_consensus.cc:515] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.161360 10613 raft_consensus.cc:2804] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:22.161724 10613 raft_consensus.cc:493] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.162083 10613 raft_consensus.cc:3060] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:22.162196 10384 leader_election.cc:343] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:22.163028 10610 leader_election.cc:290] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155), fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395)
I20260709 12:19:22.176055 10616 consensus_queue.cc:237] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } }
I20260709 12:19:22.178580 10613 raft_consensus.cc:515] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.180256 10491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dca734c6e434c1595f96ef0b2825c17" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa2b7127d769426dbf6b610f74536106" is_pre_election: true
I20260709 12:19:22.180747 10613 leader_election.cc:290] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 1 election: Requested vote from peers fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:22.181459 10493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde0882b03d245e58bd916123081e004" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa2b7127d769426dbf6b610f74536106" is_pre_election: true
I20260709 12:19:22.181646 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945359b04724fd1b32b67ebac2a75c4" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa2b7127d769426dbf6b610f74536106"
I20260709 12:19:22.182184 10490 raft_consensus.cc:3060] T b945359b04724fd1b32b67ebac2a75c4 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.182622 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79327c96f319433192eb5f752085848d" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa2b7127d769426dbf6b610f74536106" is_pre_election: true
I20260709 12:19:22.183224 10492 raft_consensus.cc:2468] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bfa1b0cf96346a5a3ee6ea10de9496a in term 0.
W20260709 12:19:22.185256 10533 leader_election.cc:343] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:22.180490 10611 tablet_bootstrap.cc:492] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106: No bootstrap required, opened a new log
I20260709 12:19:22.185506 10609 tablet_bootstrap.cc:492] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886: No bootstrap required, opened a new log
I20260709 12:19:22.185935 10609 ts_tablet_manager.cc:1403] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.000s
I20260709 12:19:22.185978 10611 ts_tablet_manager.cc:1403] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106: Time spent bootstrapping tablet: real 0.125s	user 0.024s	sys 0.012s
I20260709 12:19:22.188395 10609 raft_consensus.cc:359] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.189383 10609 raft_consensus.cc:385] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.189785 10609 raft_consensus.cc:740] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 390add5b62d0491e947fbaa913806886, State: Initialized, Role: FOLLOWER
W20260709 12:19:22.189854 10533 leader_election.cc:343] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:22.190593 10533 leader_election.cc:304] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bfa1b0cf96346a5a3ee6ea10de9496a, fa2b7127d769426dbf6b610f74536106; no voters: 
I20260709 12:19:22.190589 10490 raft_consensus.cc:2468] T b945359b04724fd1b32b67ebac2a75c4 P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 1.
I20260709 12:19:22.190656 10609 consensus_queue.cc:260] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.191617 10610 raft_consensus.cc:2804] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:22.192003 10610 raft_consensus.cc:493] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.192338 10610 raft_consensus.cc:3060] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.192792 10384 leader_election.cc:304] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 390add5b62d0491e947fbaa913806886, fa2b7127d769426dbf6b610f74536106; no voters: 
I20260709 12:19:22.194435 10613 raft_consensus.cc:2804] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:22.194936 10613 raft_consensus.cc:697] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [term 1 LEADER]: Becoming Leader. State: Replica: 390add5b62d0491e947fbaa913806886, State: Running, Role: LEADER
I20260709 12:19:22.195793 10613 consensus_queue.cc:237] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.189301 10611 raft_consensus.cc:359] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.200544 10611 raft_consensus.cc:385] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.200699 10567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945359b04724fd1b32b67ebac2a75c4" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" is_pre_election: true
I20260709 12:19:22.201128 10609 ts_tablet_manager.cc:1434] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 12:19:22.201359 10567 raft_consensus.cc:2468] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 0.
I20260709 12:19:22.201462 10610 raft_consensus.cc:515] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.202222 10609 tablet_bootstrap.cc:492] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886: Bootstrap starting.
I20260709 12:19:22.200886 10611 raft_consensus.cc:740] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa2b7127d769426dbf6b610f74536106, State: Initialized, Role: FOLLOWER
I20260709 12:19:22.203380 10607 tablet_bootstrap.cc:492] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a: No bootstrap required, opened a new log
I20260709 12:19:22.203315 10611 consensus_queue.cc:260] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.204627 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79327c96f319433192eb5f752085848d" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa2b7127d769426dbf6b610f74536106"
I20260709 12:19:22.205178 10492 raft_consensus.cc:3060] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.206451 10611 ts_tablet_manager.cc:1434] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:19:22.208282 10567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4752da4a6a447ad93fdacdb010730ca" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" is_pre_election: true
I20260709 12:19:22.209839 10609 tablet_bootstrap.cc:654] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:22.209707 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945359b04724fd1b32b67ebac2a75c4" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
I20260709 12:19:22.210786 10566 raft_consensus.cc:3060] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.213165 10492 raft_consensus.cc:2468] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfa1b0cf96346a5a3ee6ea10de9496a in term 1.
I20260709 12:19:22.214078 10418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79327c96f319433192eb5f752085848d" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "390add5b62d0491e947fbaa913806886" is_pre_election: true
I20260709 12:19:22.214324 10533 leader_election.cc:304] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bfa1b0cf96346a5a3ee6ea10de9496a, fa2b7127d769426dbf6b610f74536106; no voters: 
I20260709 12:19:22.214819 10418 raft_consensus.cc:2468] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bfa1b0cf96346a5a3ee6ea10de9496a in term 0.
I20260709 12:19:22.203959 10607 ts_tablet_manager.cc:1403] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a: Time spent bootstrapping tablet: real 0.141s	user 0.024s	sys 0.023s
I20260709 12:19:22.216204 10417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde0882b03d245e58bd916123081e004" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "390add5b62d0491e947fbaa913806886" is_pre_election: true
I20260709 12:19:22.216929 10417 raft_consensus.cc:2468] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bfa1b0cf96346a5a3ee6ea10de9496a in term 0.
I20260709 12:19:22.214421 10611 tablet_bootstrap.cc:492] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106: Bootstrap starting.
I20260709 12:19:22.218935 10610 leader_election.cc:290] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 1 election: Requested vote from peers 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155), fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395)
I20260709 12:19:22.219137 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79327c96f319433192eb5f752085848d" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "390add5b62d0491e947fbaa913806886"
I20260709 12:19:22.219913 10415 raft_consensus.cc:3060] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.220202 10610 raft_consensus.cc:2804] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:22.220712 10610 raft_consensus.cc:697] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 LEADER]: Becoming Leader. State: Replica: 3bfa1b0cf96346a5a3ee6ea10de9496a, State: Running, Role: LEADER
I20260709 12:19:22.218178 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dca734c6e434c1595f96ef0b2825c17" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "390add5b62d0491e947fbaa913806886" is_pre_election: true
I20260709 12:19:22.221709 10610 consensus_queue.cc:237] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.228806 10566 raft_consensus.cc:2468] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 1.
W20260709 12:19:22.229527 10383 leader_election.cc:343] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:22.231243 10607 raft_consensus.cc:359] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.233045 10607 raft_consensus.cc:385] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.235584 10607 raft_consensus.cc:740] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bfa1b0cf96346a5a3ee6ea10de9496a, State: Initialized, Role: FOLLOWER
I20260709 12:19:22.236480 10607 consensus_queue.cc:260] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.231777 10415 raft_consensus.cc:2468] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfa1b0cf96346a5a3ee6ea10de9496a in term 1.
I20260709 12:19:22.233410 10383 leader_election.cc:304] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 390add5b62d0491e947fbaa913806886; no voters: 3bfa1b0cf96346a5a3ee6ea10de9496a, fa2b7127d769426dbf6b610f74536106
I20260709 12:19:22.245609 10315 catalog_manager.cc:5697] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 reported cstate change: term changed from 0 to 1, leader changed from <none> to 390add5b62d0491e947fbaa913806886 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "390add5b62d0491e947fbaa913806886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:22.253880 10640 raft_consensus.cc:2749] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:22.253711 10611 tablet_bootstrap.cc:654] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:22.255017 10531 leader_election.cc:304] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 390add5b62d0491e947fbaa913806886, 3bfa1b0cf96346a5a3ee6ea10de9496a; no voters: fa2b7127d769426dbf6b610f74536106
W20260709 12:19:22.256464 10531 leader_election.cc:343] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:22.256901 10531 leader_election.cc:304] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bfa1b0cf96346a5a3ee6ea10de9496a; no voters: 390add5b62d0491e947fbaa913806886, fa2b7127d769426dbf6b610f74536106
I20260709 12:19:22.258675 10640 raft_consensus.cc:493] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.253605 10312 catalog_manager.cc:5697] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa2b7127d769426dbf6b610f74536106 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "fa2b7127d769426dbf6b610f74536106" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:22.259181 10640 raft_consensus.cc:515] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.261816 10642 raft_consensus.cc:2804] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:22.262341 10642 raft_consensus.cc:493] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.262751 10642 raft_consensus.cc:3060] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.262584 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7128a5d9b774f3cb0ebdabf0e1c2e3c" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa2b7127d769426dbf6b610f74536106" is_pre_election: true
W20260709 12:19:22.264197 10384 leader_election.cc:343] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:22.265934 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7128a5d9b774f3cb0ebdabf0e1c2e3c" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" is_pre_election: true
W20260709 12:19:22.267465 10383 leader_election.cc:343] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:22.268251 10383 leader_election.cc:304] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 390add5b62d0491e947fbaa913806886; no voters: 3bfa1b0cf96346a5a3ee6ea10de9496a, fa2b7127d769426dbf6b610f74536106
I20260709 12:19:22.269083 10613 raft_consensus.cc:2749] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:22.270011 10640 leader_election.cc:290] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:22.273656 10642 raft_consensus.cc:515] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.276948 10607 ts_tablet_manager.cc:1434] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.009s
I20260709 12:19:22.277565 10609 tablet_bootstrap.cc:492] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886: No bootstrap required, opened a new log
I20260709 12:19:22.280731 10611 tablet_bootstrap.cc:492] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106: No bootstrap required, opened a new log
I20260709 12:19:22.281073 10609 ts_tablet_manager.cc:1403] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886: Time spent bootstrapping tablet: real 0.079s	user 0.015s	sys 0.005s
I20260709 12:19:22.281164 10611 ts_tablet_manager.cc:1403] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.006s
I20260709 12:19:22.284137 10607 tablet_bootstrap.cc:492] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a: Bootstrap starting.
I20260709 12:19:22.278074 10646 raft_consensus.cc:2749] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:22.283921 10609 raft_consensus.cc:359] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.284792 10611 raft_consensus.cc:359] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.285290 10609 raft_consensus.cc:385] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.285447 10611 raft_consensus.cc:385] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.285748 10609 raft_consensus.cc:740] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 390add5b62d0491e947fbaa913806886, State: Initialized, Role: FOLLOWER
I20260709 12:19:22.285780 10611 raft_consensus.cc:740] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa2b7127d769426dbf6b610f74536106, State: Initialized, Role: FOLLOWER
I20260709 12:19:22.286643 10609 consensus_queue.cc:260] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.286755 10611 consensus_queue.cc:260] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.289518 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde0882b03d245e58bd916123081e004" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "390add5b62d0491e947fbaa913806886"
I20260709 12:19:22.290089 10415 raft_consensus.cc:3060] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.290990 10611 ts_tablet_manager.cc:1434] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:19:22.291241 10607 tablet_bootstrap.cc:654] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:22.292676 10609 ts_tablet_manager.cc:1434] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:19:22.293910 10609 tablet_bootstrap.cc:492] T 82aae21e47564b3abcc7247912bd13f7 P 390add5b62d0491e947fbaa913806886: Bootstrap starting.
I20260709 12:19:22.297813 10415 raft_consensus.cc:2468] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfa1b0cf96346a5a3ee6ea10de9496a in term 1.
I20260709 12:19:22.299188 10531 leader_election.cc:304] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 390add5b62d0491e947fbaa913806886, 3bfa1b0cf96346a5a3ee6ea10de9496a; no voters: 
I20260709 12:19:22.300123 10646 raft_consensus.cc:2804] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:22.300645 10646 raft_consensus.cc:697] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 LEADER]: Becoming Leader. State: Replica: 3bfa1b0cf96346a5a3ee6ea10de9496a, State: Running, Role: LEADER
I20260709 12:19:22.300853 10611 tablet_bootstrap.cc:492] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106: Bootstrap starting.
I20260709 12:19:22.301568 10646 consensus_queue.cc:237] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.305215 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde0882b03d245e58bd916123081e004" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa2b7127d769426dbf6b610f74536106"
W20260709 12:19:22.306779 10533 leader_election.cc:343] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:22.307402 10611 tablet_bootstrap.cc:654] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:22.308395 10642 leader_election.cc:290] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 1 election: Requested vote from peers 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155), fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395)
I20260709 12:19:22.310333 10316 catalog_manager.cc:5697] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67). New cstate: current_term: 1 leader_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:22.312953 10609 tablet_bootstrap.cc:654] T 82aae21e47564b3abcc7247912bd13f7 P 390add5b62d0491e947fbaa913806886: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:22.317690 10642 raft_consensus.cc:493] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.318364 10642 raft_consensus.cc:515] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.321612 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4752da4a6a447ad93fdacdb010730ca" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "390add5b62d0491e947fbaa913806886" is_pre_election: true
I20260709 12:19:22.322391 10415 raft_consensus.cc:2468] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bfa1b0cf96346a5a3ee6ea10de9496a in term 0.
I20260709 12:19:22.323841 10531 leader_election.cc:304] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 390add5b62d0491e947fbaa913806886, 3bfa1b0cf96346a5a3ee6ea10de9496a; no voters: 
I20260709 12:19:22.324661 10610 raft_consensus.cc:2804] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:22.325083 10610 raft_consensus.cc:493] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.325399 10610 raft_consensus.cc:3060] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.326619 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4752da4a6a447ad93fdacdb010730ca" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa2b7127d769426dbf6b610f74536106" is_pre_election: true
W20260709 12:19:22.328294 10533 leader_election.cc:343] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:22.328887 10642 leader_election.cc:290] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155), fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395)
I20260709 12:19:22.330305 10611 tablet_bootstrap.cc:492] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106: No bootstrap required, opened a new log
I20260709 12:19:22.330857 10611 ts_tablet_manager.cc:1403] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.000s
I20260709 12:19:22.334069 10611 raft_consensus.cc:359] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.335327 10610 raft_consensus.cc:515] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.339625 10611 raft_consensus.cc:385] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.340072 10611 raft_consensus.cc:740] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa2b7127d769426dbf6b610f74536106, State: Initialized, Role: FOLLOWER
I20260709 12:19:22.341843 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4752da4a6a447ad93fdacdb010730ca" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "390add5b62d0491e947fbaa913806886"
I20260709 12:19:22.342059 10610 leader_election.cc:290] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 1 election: Requested vote from peers 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155), fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395)
I20260709 12:19:22.338835 10607 tablet_bootstrap.cc:492] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a: No bootstrap required, opened a new log
I20260709 12:19:22.342505 10415 raft_consensus.cc:3060] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.342875 10607 ts_tablet_manager.cc:1403] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a: Time spent bootstrapping tablet: real 0.059s	user 0.026s	sys 0.022s
I20260709 12:19:22.343449 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4752da4a6a447ad93fdacdb010730ca" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa2b7127d769426dbf6b610f74536106"
I20260709 12:19:22.343941 10609 tablet_bootstrap.cc:492] T 82aae21e47564b3abcc7247912bd13f7 P 390add5b62d0491e947fbaa913806886: No bootstrap required, opened a new log
I20260709 12:19:22.344364 10609 ts_tablet_manager.cc:1403] T 82aae21e47564b3abcc7247912bd13f7 P 390add5b62d0491e947fbaa913806886: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.008s
W20260709 12:19:22.344851 10533 leader_election.cc:343] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:22.345921 10607 raft_consensus.cc:359] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.346643 10607 raft_consensus.cc:385] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.346937 10607 raft_consensus.cc:740] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bfa1b0cf96346a5a3ee6ea10de9496a, State: Initialized, Role: FOLLOWER
I20260709 12:19:22.346909 10609 raft_consensus.cc:359] T 82aae21e47564b3abcc7247912bd13f7 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.347708 10609 raft_consensus.cc:385] T 82aae21e47564b3abcc7247912bd13f7 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.348021 10609 raft_consensus.cc:740] T 82aae21e47564b3abcc7247912bd13f7 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 390add5b62d0491e947fbaa913806886, State: Initialized, Role: FOLLOWER
I20260709 12:19:22.347895 10607 consensus_queue.cc:260] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.348305 10312 catalog_manager.cc:5697] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67). New cstate: current_term: 1 leader_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:22.348894 10609 consensus_queue.cc:260] T 82aae21e47564b3abcc7247912bd13f7 P 390add5b62d0491e947fbaa913806886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.350011 10415 raft_consensus.cc:2468] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfa1b0cf96346a5a3ee6ea10de9496a in term 1.
I20260709 12:19:22.350689 10607 ts_tablet_manager.cc:1434] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:22.351303 10531 leader_election.cc:304] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 390add5b62d0491e947fbaa913806886, 3bfa1b0cf96346a5a3ee6ea10de9496a; no voters: fa2b7127d769426dbf6b610f74536106
I20260709 12:19:22.351594 10607 tablet_bootstrap.cc:492] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Bootstrap starting.
I20260709 12:19:22.352442 10610 raft_consensus.cc:2804] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:22.352893 10610 raft_consensus.cc:697] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 LEADER]: Becoming Leader. State: Replica: 3bfa1b0cf96346a5a3ee6ea10de9496a, State: Running, Role: LEADER
I20260709 12:19:22.353685 10610 consensus_queue.cc:237] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.358022 10607 tablet_bootstrap.cc:654] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:22.358536 10609 ts_tablet_manager.cc:1434] T 82aae21e47564b3abcc7247912bd13f7 P 390add5b62d0491e947fbaa913806886: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:19:22.340930 10611 consensus_queue.cc:260] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.360937 10611 ts_tablet_manager.cc:1434] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.003s
I20260709 12:19:22.367636 10609 tablet_bootstrap.cc:492] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886: Bootstrap starting.
I20260709 12:19:22.370870 10616 raft_consensus.cc:493] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.371459 10616 raft_consensus.cc:515] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.373687 10616 leader_election.cc:290] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:22.374038 10607 tablet_bootstrap.cc:492] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a: No bootstrap required, opened a new log
I20260709 12:19:22.374471 10607 ts_tablet_manager.cc:1403] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.004s
I20260709 12:19:22.374660 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aae21e47564b3abcc7247912bd13f7" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "390add5b62d0491e947fbaa913806886" is_pre_election: true
I20260709 12:19:22.375273 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aae21e47564b3abcc7247912bd13f7" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" is_pre_election: true
I20260709 12:19:22.375413 10415 raft_consensus.cc:2468] T 82aae21e47564b3abcc7247912bd13f7 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2b7127d769426dbf6b610f74536106 in term 0.
W20260709 12:19:22.376928 10458 leader_election.cc:343] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:22.377192 10607 raft_consensus.cc:359] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.377849 10607 raft_consensus.cc:385] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.378115 10607 raft_consensus.cc:740] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bfa1b0cf96346a5a3ee6ea10de9496a, State: Initialized, Role: FOLLOWER
I20260709 12:19:22.378759 10607 consensus_queue.cc:260] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.380759 10607 ts_tablet_manager.cc:1434] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:19:22.381711 10607 tablet_bootstrap.cc:492] T 82aae21e47564b3abcc7247912bd13f7 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Bootstrap starting.
I20260709 12:19:22.382885 10457 leader_election.cc:304] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 390add5b62d0491e947fbaa913806886, fa2b7127d769426dbf6b610f74536106; no voters: 3bfa1b0cf96346a5a3ee6ea10de9496a
I20260709 12:19:22.384181 10635 raft_consensus.cc:2804] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:22.384626 10635 raft_consensus.cc:493] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.384975 10635 raft_consensus.cc:3060] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.387251 10607 tablet_bootstrap.cc:654] T 82aae21e47564b3abcc7247912bd13f7 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:22.388489 10616 raft_consensus.cc:493] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.389068 10616 raft_consensus.cc:515] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.389015 10611 tablet_bootstrap.cc:492] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106: Bootstrap starting.
I20260709 12:19:22.396149 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dca734c6e434c1595f96ef0b2825c17" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "390add5b62d0491e947fbaa913806886" is_pre_election: true
I20260709 12:19:22.397616 10609 tablet_bootstrap.cc:654] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:22.396795 10316 catalog_manager.cc:5697] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67). New cstate: current_term: 1 leader_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:22.397651 10457 leader_election.cc:343] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:22.400795 10607 tablet_bootstrap.cc:492] T 82aae21e47564b3abcc7247912bd13f7 P 3bfa1b0cf96346a5a3ee6ea10de9496a: No bootstrap required, opened a new log
I20260709 12:19:22.401292 10607 ts_tablet_manager.cc:1403] T 82aae21e47564b3abcc7247912bd13f7 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 12:19:22.401829 10611 tablet_bootstrap.cc:654] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:22.403753 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dca734c6e434c1595f96ef0b2825c17" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" is_pre_election: true
I20260709 12:19:22.406247 10566 raft_consensus.cc:2468] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2b7127d769426dbf6b610f74536106 in term 0.
I20260709 12:19:22.407541 10609 tablet_bootstrap.cc:492] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886: No bootstrap required, opened a new log
I20260709 12:19:22.404273 10616 leader_election.cc:290] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:22.404021 10607 raft_consensus.cc:359] T 82aae21e47564b3abcc7247912bd13f7 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.408077 10609 ts_tablet_manager.cc:1403] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.000s
I20260709 12:19:22.408224 10607 raft_consensus.cc:385] T 82aae21e47564b3abcc7247912bd13f7 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.408560 10607 raft_consensus.cc:740] T 82aae21e47564b3abcc7247912bd13f7 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bfa1b0cf96346a5a3ee6ea10de9496a, State: Initialized, Role: FOLLOWER
I20260709 12:19:22.409269 10607 consensus_queue.cc:260] T 82aae21e47564b3abcc7247912bd13f7 P 3bfa1b0cf96346a5a3ee6ea10de9496a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.410772 10609 raft_consensus.cc:359] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.407482 10458 leader_election.cc:304] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bfa1b0cf96346a5a3ee6ea10de9496a, fa2b7127d769426dbf6b610f74536106; no voters: 390add5b62d0491e947fbaa913806886
I20260709 12:19:22.411239 10607 ts_tablet_manager.cc:1434] T 82aae21e47564b3abcc7247912bd13f7 P 3bfa1b0cf96346a5a3ee6ea10de9496a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:19:22.411897 10616 raft_consensus.cc:2804] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:22.412369 10616 raft_consensus.cc:493] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.412755 10616 raft_consensus.cc:3060] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.412902 10607 tablet_bootstrap.cc:492] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 3bfa1b0cf96346a5a3ee6ea10de9496a: Bootstrap starting.
I20260709 12:19:22.404989 10635 raft_consensus.cc:515] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.418054 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aae21e47564b3abcc7247912bd13f7" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "390add5b62d0491e947fbaa913806886"
I20260709 12:19:22.418702 10415 raft_consensus.cc:3060] T 82aae21e47564b3abcc7247912bd13f7 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.419144 10607 tablet_bootstrap.cc:654] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 3bfa1b0cf96346a5a3ee6ea10de9496a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:22.420408 10640 raft_consensus.cc:493] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.420877 10640 raft_consensus.cc:515] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.421801 10609 raft_consensus.cc:385] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.422096 10609 raft_consensus.cc:740] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 390add5b62d0491e947fbaa913806886, State: Initialized, Role: FOLLOWER
I20260709 12:19:22.422914 10640 leader_election.cc:290] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:22.422873 10609 consensus_queue.cc:260] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.424623 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f298960b2387414094881ba3dfd8e6ad" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa2b7127d769426dbf6b610f74536106" is_pre_election: true
I20260709 12:19:22.425571 10415 raft_consensus.cc:2468] T 82aae21e47564b3abcc7247912bd13f7 P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2b7127d769426dbf6b610f74536106 in term 1.
I20260709 12:19:22.426728 10457 leader_election.cc:304] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 390add5b62d0491e947fbaa913806886, fa2b7127d769426dbf6b610f74536106; no voters: 
I20260709 12:19:22.426821 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f298960b2387414094881ba3dfd8e6ad" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" is_pre_election: true
W20260709 12:19:22.427253 10384 leader_election.cc:343] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:22.427415 10566 raft_consensus.cc:2468] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 0.
I20260709 12:19:22.428908 10383 leader_election.cc:304] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 390add5b62d0491e947fbaa913806886, 3bfa1b0cf96346a5a3ee6ea10de9496a; no voters: fa2b7127d769426dbf6b610f74536106
I20260709 12:19:22.430176 10613 raft_consensus.cc:2804] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:22.430539 10613 raft_consensus.cc:493] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.430894 10613 raft_consensus.cc:3060] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.432178 10611 tablet_bootstrap.cc:492] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106: No bootstrap required, opened a new log
I20260709 12:19:22.432715 10611 ts_tablet_manager.cc:1403] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.007s
I20260709 12:19:22.435032 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aae21e47564b3abcc7247912bd13f7" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
I20260709 12:19:22.424865 10609 ts_tablet_manager.cc:1434] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:19:22.435688 10566 raft_consensus.cc:3060] T 82aae21e47564b3abcc7247912bd13f7 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.436563 10611 raft_consensus.cc:359] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.437384 10611 raft_consensus.cc:385] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.437721 10611 raft_consensus.cc:740] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa2b7127d769426dbf6b610f74536106, State: Initialized, Role: FOLLOWER
I20260709 12:19:22.438685 10611 consensus_queue.cc:260] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.442396 10607 tablet_bootstrap.cc:492] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 3bfa1b0cf96346a5a3ee6ea10de9496a: No bootstrap required, opened a new log
I20260709 12:19:22.442549 10611 ts_tablet_manager.cc:1434] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:19:22.442893 10607 ts_tablet_manager.cc:1403] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 3bfa1b0cf96346a5a3ee6ea10de9496a: Time spent bootstrapping tablet: real 0.030s	user 0.024s	sys 0.000s
I20260709 12:19:22.445611 10607 raft_consensus.cc:359] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.446282 10607 raft_consensus.cc:385] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.446398 10566 raft_consensus.cc:2468] T 82aae21e47564b3abcc7247912bd13f7 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2b7127d769426dbf6b610f74536106 in term 1.
I20260709 12:19:22.446810 10663 raft_consensus.cc:2804] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:22.448539 10607 raft_consensus.cc:740] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bfa1b0cf96346a5a3ee6ea10de9496a, State: Initialized, Role: FOLLOWER
I20260709 12:19:22.449520 10607 consensus_queue.cc:260] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 3bfa1b0cf96346a5a3ee6ea10de9496a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.451998 10607 ts_tablet_manager.cc:1434] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 3bfa1b0cf96346a5a3ee6ea10de9496a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:19:22.452823 10611 tablet_bootstrap.cc:492] T bb6df9ee5d9940198397a007388de659 P fa2b7127d769426dbf6b610f74536106: Bootstrap starting.
I20260709 12:19:22.454088 10635 leader_election.cc:290] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 1 election: Requested vote from peers 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:22.454417 10664 raft_consensus.cc:493] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.454963 10664 raft_consensus.cc:515] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.455962 10663 raft_consensus.cc:697] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 [term 1 LEADER]: Becoming Leader. State: Replica: fa2b7127d769426dbf6b610f74536106, State: Running, Role: LEADER
I20260709 12:19:22.454334 10613 raft_consensus.cc:515] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.456900 10663 consensus_queue.cc:237] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.459183 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f298960b2387414094881ba3dfd8e6ad" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa2b7127d769426dbf6b610f74536106"
I20260709 12:19:22.459815 10611 tablet_bootstrap.cc:654] T bb6df9ee5d9940198397a007388de659 P fa2b7127d769426dbf6b610f74536106: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:22.461354 10384 leader_election.cc:343] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:22.426184 10616 raft_consensus.cc:515] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.464419 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7128a5d9b774f3cb0ebdabf0e1c2e3c" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" is_pre_election: true
I20260709 12:19:22.465163 10566 raft_consensus.cc:2468] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2b7127d769426dbf6b610f74536106 in term 0.
I20260709 12:19:22.467012 10458 leader_election.cc:304] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bfa1b0cf96346a5a3ee6ea10de9496a, fa2b7127d769426dbf6b610f74536106; no voters: 
I20260709 12:19:22.467530 10567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f298960b2387414094881ba3dfd8e6ad" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
I20260709 12:19:22.468860 10567 raft_consensus.cc:3060] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.467762 10664 leader_election.cc:290] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:22.467763 10613 leader_election.cc:290] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 1 election: Requested vote from peers fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:22.474529 10662 raft_consensus.cc:2804] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:22.475034 10662 raft_consensus.cc:493] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.475605 10662 raft_consensus.cc:3060] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.478039 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dca734c6e434c1595f96ef0b2825c17" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
I20260709 12:19:22.478680 10566 raft_consensus.cc:3060] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.488345 10566 raft_consensus.cc:2468] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2b7127d769426dbf6b610f74536106 in term 1.
I20260709 12:19:22.467840 10616 leader_election.cc:290] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 1 election: Requested vote from peers 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
W20260709 12:19:22.489379 10457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:35155, user_credentials={real_user=slave}} blocked reactor thread for 62741.9us
I20260709 12:19:22.491129 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7128a5d9b774f3cb0ebdabf0e1c2e3c" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "390add5b62d0491e947fbaa913806886" is_pre_election: true
I20260709 12:19:22.491770 10415 raft_consensus.cc:2468] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa2b7127d769426dbf6b610f74536106 in term 0.
I20260709 12:19:22.491937 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dca734c6e434c1595f96ef0b2825c17" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "390add5b62d0491e947fbaa913806886"
I20260709 12:19:22.492571 10416 raft_consensus.cc:3060] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.493233 10567 raft_consensus.cc:2468] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 1.
I20260709 12:19:22.492635 10316 catalog_manager.cc:5697] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa2b7127d769426dbf6b610f74536106 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "fa2b7127d769426dbf6b610f74536106" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:22.495535 10383 leader_election.cc:304] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 390add5b62d0491e947fbaa913806886, 3bfa1b0cf96346a5a3ee6ea10de9496a; no voters: fa2b7127d769426dbf6b610f74536106
I20260709 12:19:22.496907 10613 raft_consensus.cc:2804] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:22.497428 10613 raft_consensus.cc:697] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 1 LEADER]: Becoming Leader. State: Replica: 390add5b62d0491e947fbaa913806886, State: Running, Role: LEADER
I20260709 12:19:22.495927 10458 leader_election.cc:304] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bfa1b0cf96346a5a3ee6ea10de9496a, fa2b7127d769426dbf6b610f74536106; no voters: 
I20260709 12:19:22.498342 10613 consensus_queue.cc:237] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.502103 10611 tablet_bootstrap.cc:492] T bb6df9ee5d9940198397a007388de659 P fa2b7127d769426dbf6b610f74536106: No bootstrap required, opened a new log
I20260709 12:19:22.502606 10611 ts_tablet_manager.cc:1403] T bb6df9ee5d9940198397a007388de659 P fa2b7127d769426dbf6b610f74536106: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.012s
I20260709 12:19:22.500864 10662 raft_consensus.cc:515] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.503484 10416 raft_consensus.cc:2468] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2b7127d769426dbf6b610f74536106 in term 1.
I20260709 12:19:22.504611 10661 raft_consensus.cc:2804] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:22.505532 10611 raft_consensus.cc:359] T bb6df9ee5d9940198397a007388de659 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.505841 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7128a5d9b774f3cb0ebdabf0e1c2e3c" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
I20260709 12:19:22.506263 10611 raft_consensus.cc:385] T bb6df9ee5d9940198397a007388de659 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.506409 10566 raft_consensus.cc:3060] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.506578 10611 raft_consensus.cc:740] T bb6df9ee5d9940198397a007388de659 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa2b7127d769426dbf6b610f74536106, State: Initialized, Role: FOLLOWER
I20260709 12:19:22.506556 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7128a5d9b774f3cb0ebdabf0e1c2e3c" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "390add5b62d0491e947fbaa913806886"
I20260709 12:19:22.507308 10415 raft_consensus.cc:3060] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.507503 10611 consensus_queue.cc:260] T bb6df9ee5d9940198397a007388de659 P fa2b7127d769426dbf6b610f74536106 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.506520 10662 leader_election.cc:290] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 1 election: Requested vote from peers 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:22.509955 10611 ts_tablet_manager.cc:1434] T bb6df9ee5d9940198397a007388de659 P fa2b7127d769426dbf6b610f74536106: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:22.510462 10640 raft_consensus.cc:493] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.510900 10611 tablet_bootstrap.cc:492] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106: Bootstrap starting.
I20260709 12:19:22.511001 10640 raft_consensus.cc:515] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.513442 10640 leader_election.cc:290] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:22.514703 10415 raft_consensus.cc:2468] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2b7127d769426dbf6b610f74536106 in term 1.
I20260709 12:19:22.515407 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6df9ee5d9940198397a007388de659" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa2b7127d769426dbf6b610f74536106" is_pre_election: true
I20260709 12:19:22.516010 10457 leader_election.cc:304] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 390add5b62d0491e947fbaa913806886, fa2b7127d769426dbf6b610f74536106; no voters: 
I20260709 12:19:22.516188 10492 raft_consensus.cc:2468] T bb6df9ee5d9940198397a007388de659 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 0.
I20260709 12:19:22.516880 10662 raft_consensus.cc:2804] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:22.505491 10661 raft_consensus.cc:697] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [term 1 LEADER]: Becoming Leader. State: Replica: fa2b7127d769426dbf6b610f74536106, State: Running, Role: LEADER
I20260709 12:19:22.517412 10662 raft_consensus.cc:697] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [term 1 LEADER]: Becoming Leader. State: Replica: fa2b7127d769426dbf6b610f74536106, State: Running, Role: LEADER
I20260709 12:19:22.518174 10662 consensus_queue.cc:237] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.518445 10565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6df9ee5d9940198397a007388de659" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" is_pre_election: true
I20260709 12:19:22.519186 10565 raft_consensus.cc:2468] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 0.
I20260709 12:19:22.518174 10661 consensus_queue.cc:237] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.522245 10611 tablet_bootstrap.cc:654] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:22.522450 10384 leader_election.cc:304] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 390add5b62d0491e947fbaa913806886, fa2b7127d769426dbf6b610f74536106; no voters: 
I20260709 12:19:22.524163 10640 raft_consensus.cc:2804] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:22.524572 10640 raft_consensus.cc:493] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.524920 10640 raft_consensus.cc:3060] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.532752 10611 tablet_bootstrap.cc:492] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106: No bootstrap required, opened a new log
I20260709 12:19:22.534500 10611 ts_tablet_manager.cc:1403] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.003s
I20260709 12:19:22.540457 10640 raft_consensus.cc:515] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.542568 10611 raft_consensus.cc:359] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.543474 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6df9ee5d9940198397a007388de659" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa2b7127d769426dbf6b610f74536106"
I20260709 12:19:22.547596 10611 raft_consensus.cc:385] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.547832 10492 raft_consensus.cc:3060] T bb6df9ee5d9940198397a007388de659 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.536799 10566 raft_consensus.cc:2468] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2b7127d769426dbf6b610f74536106 in term 1.
I20260709 12:19:22.544364 10640 leader_election.cc:290] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 1 election: Requested vote from peers fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:22.545411 10567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6df9ee5d9940198397a007388de659" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
I20260709 12:19:22.550591 10567 raft_consensus.cc:3060] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.549875 10315 catalog_manager.cc:5697] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa2b7127d769426dbf6b610f74536106 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "fa2b7127d769426dbf6b610f74536106" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:22.547930 10611 raft_consensus.cc:740] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa2b7127d769426dbf6b610f74536106, State: Initialized, Role: FOLLOWER
I20260709 12:19:22.551728 10315 catalog_manager.cc:5697] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa2b7127d769426dbf6b610f74536106 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "fa2b7127d769426dbf6b610f74536106" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:22.543185 10316 catalog_manager.cc:5697] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 reported cstate change: term changed from 0 to 1, leader changed from <none> to 390add5b62d0491e947fbaa913806886 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "390add5b62d0491e947fbaa913806886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:22.553035 10611 consensus_queue.cc:260] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.557536 10611 ts_tablet_manager.cc:1434] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:19:22.557770 10567 raft_consensus.cc:2468] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 1.
I20260709 12:19:22.558467 10611 tablet_bootstrap.cc:492] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106: Bootstrap starting.
I20260709 12:19:22.559106 10383 leader_election.cc:304] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 390add5b62d0491e947fbaa913806886, 3bfa1b0cf96346a5a3ee6ea10de9496a; no voters: 
I20260709 12:19:22.560046 10640 raft_consensus.cc:2804] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:22.560575 10640 raft_consensus.cc:697] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [term 1 LEADER]: Becoming Leader. State: Replica: 390add5b62d0491e947fbaa913806886, State: Running, Role: LEADER
I20260709 12:19:22.561380 10640 consensus_queue.cc:237] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.563848 10611 tablet_bootstrap.cc:654] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:22.566483 10492 raft_consensus.cc:2468] T bb6df9ee5d9940198397a007388de659 P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 1.
I20260709 12:19:22.577163 10611 tablet_bootstrap.cc:492] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106: No bootstrap required, opened a new log
I20260709 12:19:22.577562 10611 ts_tablet_manager.cc:1403] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 12:19:22.577536 10316 catalog_manager.cc:5697] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 reported cstate change: term changed from 0 to 1, leader changed from <none> to 390add5b62d0491e947fbaa913806886 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "390add5b62d0491e947fbaa913806886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:22.579919 10611 raft_consensus.cc:359] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.580399 10611 raft_consensus.cc:385] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:22.580605 10611 raft_consensus.cc:740] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa2b7127d769426dbf6b610f74536106, State: Initialized, Role: FOLLOWER
I20260709 12:19:22.581106 10611 consensus_queue.cc:260] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.582547 10611 ts_tablet_manager.cc:1434] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.002s
I20260709 12:19:22.613106 10661 raft_consensus.cc:493] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.613564 10661 raft_consensus.cc:515] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.615437 10661 leader_election.cc:290] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:22.616147 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde0882b03d245e58bd916123081e004" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "390add5b62d0491e947fbaa913806886" is_pre_election: true
I20260709 12:19:22.616417 10567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde0882b03d245e58bd916123081e004" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" is_pre_election: true
I20260709 12:19:22.616964 10416 raft_consensus.cc:2393] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2b7127d769426dbf6b610f74536106 in current term 1: Already voted for candidate 3bfa1b0cf96346a5a3ee6ea10de9496a in this term.
I20260709 12:19:22.617940 10661 raft_consensus.cc:493] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.617880 10457 leader_election.cc:304] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2b7127d769426dbf6b610f74536106; no voters: 390add5b62d0491e947fbaa913806886, 3bfa1b0cf96346a5a3ee6ea10de9496a
I20260709 12:19:22.618742 10662 raft_consensus.cc:3060] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.618466 10661 raft_consensus.cc:515] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.620304 10661 leader_election.cc:290] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:22.621022 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f298960b2387414094881ba3dfd8e6ad" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "390add5b62d0491e947fbaa913806886" is_pre_election: true
I20260709 12:19:22.621889 10567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f298960b2387414094881ba3dfd8e6ad" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" is_pre_election: true
I20260709 12:19:22.622610 10567 raft_consensus.cc:2393] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa2b7127d769426dbf6b610f74536106 in current term 1: Already voted for candidate 390add5b62d0491e947fbaa913806886 in this term.
I20260709 12:19:22.623461 10458 leader_election.cc:304] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa2b7127d769426dbf6b610f74536106; no voters: 390add5b62d0491e947fbaa913806886, 3bfa1b0cf96346a5a3ee6ea10de9496a
I20260709 12:19:22.624110 10661 raft_consensus.cc:3060] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.625286 10662 raft_consensus.cc:2749] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:22.629254 10661 raft_consensus.cc:2749] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:22.641345 10610 consensus_queue.cc:1048] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:22.656533 10610 consensus_queue.cc:1048] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Connected to new peer: Peer: permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:22.688820 10567 raft_consensus.cc:3060] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.695199 10661 consensus_queue.cc:1048] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:22.705749 10663 consensus_queue.cc:1048] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [LEADER]: Connected to new peer: Peer: permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:22.713589 10640 consensus_queue.cc:1048] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:22.725570 10681 consensus_queue.cc:1048] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:22.750877 10610 consensus_queue.cc:1048] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Connected to new peer: Peer: permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:22.761790 10642 consensus_queue.cc:1048] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:22.790655 10492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd82dd15e20c4a50a0c70f53ca8b0c37"
dest_uuid: "fa2b7127d769426dbf6b610f74536106"
mode: GRACEFUL
new_leader_uuid: "390add5b62d0491e947fbaa913806886"
 from {username='slave'} at 127.0.0.1:38724
I20260709 12:19:22.791282 10492 raft_consensus.cc:606] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [term 1 LEADER]: Received request to transfer leadership to TS 390add5b62d0491e947fbaa913806886
I20260709 12:19:22.808969 10567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79327c96f319433192eb5f752085848d"
dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
mode: GRACEFUL
new_leader_uuid: "390add5b62d0491e947fbaa913806886"
 from {username='slave'} at 127.0.0.1:38728
I20260709 12:19:22.809469 10567 raft_consensus.cc:606] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 LEADER]: Received request to transfer leadership to TS 390add5b62d0491e947fbaa913806886
I20260709 12:19:22.814430 10567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dde0882b03d245e58bd916123081e004"
dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
mode: GRACEFUL
new_leader_uuid: "390add5b62d0491e947fbaa913806886"
 from {username='slave'} at 127.0.0.1:38728
I20260709 12:19:22.814921 10567 raft_consensus.cc:606] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 LEADER]: Received request to transfer leadership to TS 390add5b62d0491e947fbaa913806886
I20260709 12:19:22.819568 10567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4752da4a6a447ad93fdacdb010730ca"
dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
mode: GRACEFUL
new_leader_uuid: "fa2b7127d769426dbf6b610f74536106"
 from {username='slave'} at 127.0.0.1:38728
I20260709 12:19:22.820122 10567 raft_consensus.cc:606] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 LEADER]: Received request to transfer leadership to TS fa2b7127d769426dbf6b610f74536106
I20260709 12:19:22.822912 10642 consensus_queue.cc:1048] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Connected to new peer: Peer: permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:22.832962 10492 raft_consensus.cc:3060] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:22.841645 10610 consensus_queue.cc:1048] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:22.849818 10610 raft_consensus.cc:993] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a: : Instructing follower fa2b7127d769426dbf6b610f74536106 to start an election
I20260709 12:19:22.850270 10642 raft_consensus.cc:1081] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 LEADER]: Signalling peer fa2b7127d769426dbf6b610f74536106 to start an election
I20260709 12:19:22.850435 10416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb6df9ee5d9940198397a007388de659"
dest_uuid: "390add5b62d0491e947fbaa913806886"
mode: GRACEFUL
new_leader_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
 from {username='slave'} at 127.0.0.1:48768
I20260709 12:19:22.851032 10416 raft_consensus.cc:606] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [term 1 LEADER]: Received request to transfer leadership to TS 3bfa1b0cf96346a5a3ee6ea10de9496a
I20260709 12:19:22.851760 10492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4752da4a6a447ad93fdacdb010730ca"
dest_uuid: "fa2b7127d769426dbf6b610f74536106"
 from {username='slave'} at 127.0.0.1:38714
I20260709 12:19:22.852377 10492 raft_consensus.cc:493] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:22.852736 10492 raft_consensus.cc:3060] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:22.857285 10492 raft_consensus.cc:515] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.859009 10492 leader_election.cc:290] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 2 election: Requested vote from peers 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:22.860002 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4752da4a6a447ad93fdacdb010730ca" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "390add5b62d0491e947fbaa913806886"
I20260709 12:19:22.860126 10567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4752da4a6a447ad93fdacdb010730ca" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
I20260709 12:19:22.860812 10416 raft_consensus.cc:3060] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:22.860910 10567 raft_consensus.cc:3055] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:22.861274 10567 raft_consensus.cc:740] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3bfa1b0cf96346a5a3ee6ea10de9496a, State: Running, Role: LEADER
I20260709 12:19:22.862089 10567 consensus_queue.cc:260] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.863405 10567 raft_consensus.cc:3060] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:22.867931 10416 raft_consensus.cc:2468] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2b7127d769426dbf6b610f74536106 in term 2.
I20260709 12:19:22.869206 10457 leader_election.cc:304] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 390add5b62d0491e947fbaa913806886, fa2b7127d769426dbf6b610f74536106; no voters: 
I20260709 12:19:22.870011 10661 raft_consensus.cc:2804] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:22.870296 10567 raft_consensus.cc:2468] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2b7127d769426dbf6b610f74536106 in term 2.
I20260709 12:19:22.870405 10661 raft_consensus.cc:697] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [term 2 LEADER]: Becoming Leader. State: Replica: fa2b7127d769426dbf6b610f74536106, State: Running, Role: LEADER
I20260709 12:19:22.871311 10661 consensus_queue.cc:237] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.878080 10315 catalog_manager.cc:5697] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 reported cstate change: term changed from 1 to 2, leader changed from 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67) to fa2b7127d769426dbf6b610f74536106 (127.9.131.66). New cstate: current_term: 2 leader_uuid: "fa2b7127d769426dbf6b610f74536106" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:22.949793 10613 consensus_queue.cc:1048] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:22.956308 10681 raft_consensus.cc:993] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886: : Instructing follower 3bfa1b0cf96346a5a3ee6ea10de9496a to start an election
I20260709 12:19:22.956776 10640 raft_consensus.cc:1081] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [term 1 LEADER]: Signalling peer 3bfa1b0cf96346a5a3ee6ea10de9496a to start an election
I20260709 12:19:22.958400 10566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb6df9ee5d9940198397a007388de659"
dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
 from {username='slave'} at 127.0.0.1:38714
I20260709 12:19:22.959923 10566 raft_consensus.cc:493] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:22.960332 10566 raft_consensus.cc:3060] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:22.961810 10613 consensus_queue.cc:1048] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:22.967816 10566 raft_consensus.cc:515] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.972698 10566 leader_election.cc:290] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 2 election: Requested vote from peers 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155), fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395)
I20260709 12:19:22.973419 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6df9ee5d9940198397a007388de659" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "390add5b62d0491e947fbaa913806886"
I20260709 12:19:22.974013 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6df9ee5d9940198397a007388de659" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa2b7127d769426dbf6b610f74536106"
I20260709 12:19:22.974969 10492 raft_consensus.cc:3060] T bb6df9ee5d9940198397a007388de659 P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:22.974493 10416 raft_consensus.cc:3055] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:22.975658 10416 raft_consensus.cc:740] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 390add5b62d0491e947fbaa913806886, State: Running, Role: LEADER
I20260709 12:19:22.976467 10416 consensus_queue.cc:260] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.977780 10416 raft_consensus.cc:3060] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:22.982012 10492 raft_consensus.cc:2468] T bb6df9ee5d9940198397a007388de659 P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfa1b0cf96346a5a3ee6ea10de9496a in term 2.
I20260709 12:19:22.983378 10533 leader_election.cc:304] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bfa1b0cf96346a5a3ee6ea10de9496a, fa2b7127d769426dbf6b610f74536106; no voters: 
I20260709 12:19:22.983392 10613 consensus_queue.cc:1048] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:22.984320 10642 raft_consensus.cc:2804] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:22.984817 10642 raft_consensus.cc:697] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 LEADER]: Becoming Leader. State: Replica: 3bfa1b0cf96346a5a3ee6ea10de9496a, State: Running, Role: LEADER
I20260709 12:19:22.985641 10642 consensus_queue.cc:237] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:22.986462 10416 raft_consensus.cc:2468] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfa1b0cf96346a5a3ee6ea10de9496a in term 2.
I20260709 12:19:22.995114 10316 catalog_manager.cc:5697] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a reported cstate change: term changed from 1 to 2, leader changed from 390add5b62d0491e947fbaa913806886 (127.9.131.65) to 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67). New cstate: current_term: 2 leader_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:22.997596 10613 consensus_queue.cc:1048] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:23.013916 10661 consensus_queue.cc:1048] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:23.017298 10663 consensus_queue.cc:1048] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 [LEADER]: Connected to new peer: Peer: permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:23.026235 10616 consensus_queue.cc:1048] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [LEADER]: Connected to new peer: Peer: permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:23.026700 10662 consensus_queue.cc:1048] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [LEADER]: Connected to new peer: Peer: permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:23.042450 10616 consensus_queue.cc:1048] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:23.052585 10616 consensus_queue.cc:1048] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:23.185571 10646 raft_consensus.cc:993] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a: : Instructing follower 390add5b62d0491e947fbaa913806886 to start an election
I20260709 12:19:23.185990 10610 raft_consensus.cc:1081] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 LEADER]: Signalling peer 390add5b62d0491e947fbaa913806886 to start an election
I20260709 12:19:23.187403 10416 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79327c96f319433192eb5f752085848d"
dest_uuid: "390add5b62d0491e947fbaa913806886"
 from {username='slave'} at 127.0.0.1:48762
I20260709 12:19:23.187997 10416 raft_consensus.cc:493] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:23.188374 10416 raft_consensus.cc:3060] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.193070 10416 raft_consensus.cc:515] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:23.194852 10416 leader_election.cc:290] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 2 election: Requested vote from peers fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:23.195695 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79327c96f319433192eb5f752085848d" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa2b7127d769426dbf6b610f74536106"
I20260709 12:19:23.196041 10567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79327c96f319433192eb5f752085848d" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
I20260709 12:19:23.196321 10492 raft_consensus.cc:3060] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.196594 10567 raft_consensus.cc:3055] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:23.196894 10567 raft_consensus.cc:740] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3bfa1b0cf96346a5a3ee6ea10de9496a, State: Running, Role: LEADER
I20260709 12:19:23.197541 10567 consensus_queue.cc:260] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:23.198433 10567 raft_consensus.cc:3060] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.201249 10492 raft_consensus.cc:2468] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 2.
I20260709 12:19:23.202453 10384 leader_election.cc:304] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 390add5b62d0491e947fbaa913806886, fa2b7127d769426dbf6b610f74536106; no voters: 
I20260709 12:19:23.203168 10613 raft_consensus.cc:2804] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:23.203265 10567 raft_consensus.cc:2468] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 2.
I20260709 12:19:23.203667 10613 raft_consensus.cc:697] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [term 2 LEADER]: Becoming Leader. State: Replica: 390add5b62d0491e947fbaa913806886, State: Running, Role: LEADER
I20260709 12:19:23.204499 10613 consensus_queue.cc:237] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:23.211217 10315 catalog_manager.cc:5697] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 reported cstate change: term changed from 1 to 2, leader changed from 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67) to 390add5b62d0491e947fbaa913806886 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "390add5b62d0491e947fbaa913806886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:23.240872 10646 raft_consensus.cc:993] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a: : Instructing follower 390add5b62d0491e947fbaa913806886 to start an election
I20260709 12:19:23.241295 10610 raft_consensus.cc:1081] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 LEADER]: Signalling peer 390add5b62d0491e947fbaa913806886 to start an election
I20260709 12:19:23.242909 10416 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dde0882b03d245e58bd916123081e004"
dest_uuid: "390add5b62d0491e947fbaa913806886"
 from {username='slave'} at 127.0.0.1:48762
I20260709 12:19:23.243402 10416 raft_consensus.cc:493] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:23.243695 10416 raft_consensus.cc:3060] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.248344 10416 raft_consensus.cc:515] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:23.250079 10416 leader_election.cc:290] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 2 election: Requested vote from peers fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:23.250926 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde0882b03d245e58bd916123081e004" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa2b7127d769426dbf6b610f74536106"
I20260709 12:19:23.251127 10567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde0882b03d245e58bd916123081e004" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
I20260709 12:19:23.251422 10492 raft_consensus.cc:3060] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.251631 10567 raft_consensus.cc:3055] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:23.251992 10567 raft_consensus.cc:740] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3bfa1b0cf96346a5a3ee6ea10de9496a, State: Running, Role: LEADER
I20260709 12:19:23.252677 10567 consensus_queue.cc:260] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:23.253577 10567 raft_consensus.cc:3060] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.256304 10566 raft_consensus.cc:1275] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Refusing update from remote peer fa2b7127d769426dbf6b610f74536106: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:23.257697 10492 raft_consensus.cc:2468] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 2.
I20260709 12:19:23.257789 10616 consensus_queue.cc:1048] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:23.258705 10384 leader_election.cc:304] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 390add5b62d0491e947fbaa913806886, fa2b7127d769426dbf6b610f74536106; no voters: 
I20260709 12:19:23.259193 10567 raft_consensus.cc:2468] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 2.
I20260709 12:19:23.259399 10613 raft_consensus.cc:2804] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:23.259900 10613 raft_consensus.cc:697] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 2 LEADER]: Becoming Leader. State: Replica: 390add5b62d0491e947fbaa913806886, State: Running, Role: LEADER
I20260709 12:19:23.260711 10613 consensus_queue.cc:237] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:23.265695 10416 raft_consensus.cc:1275] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Refusing update from remote peer fa2b7127d769426dbf6b610f74536106: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:23.267059 10662 consensus_queue.cc:1048] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [LEADER]: Connected to new peer: Peer: permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:23.269366 10316 catalog_manager.cc:5697] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 reported cstate change: term changed from 1 to 2, leader changed from 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67) to 390add5b62d0491e947fbaa913806886 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "390add5b62d0491e947fbaa913806886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:23.321869 10616 raft_consensus.cc:993] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106: : Instructing follower 390add5b62d0491e947fbaa913806886 to start an election
I20260709 12:19:23.322371 10662 raft_consensus.cc:1081] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [term 1 LEADER]: Signalling peer 390add5b62d0491e947fbaa913806886 to start an election
I20260709 12:19:23.323760 10416 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd82dd15e20c4a50a0c70f53ca8b0c37"
dest_uuid: "390add5b62d0491e947fbaa913806886"
 from {username='slave'} at 127.0.0.1:48754
I20260709 12:19:23.324258 10416 raft_consensus.cc:493] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:23.324615 10416 raft_consensus.cc:3060] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.330457 10416 raft_consensus.cc:515] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } }
I20260709 12:19:23.332077 10416 leader_election.cc:290] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 2 election: Requested vote from peers 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275), fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395)
I20260709 12:19:23.332962 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd82dd15e20c4a50a0c70f53ca8b0c37" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
I20260709 12:19:23.333106 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd82dd15e20c4a50a0c70f53ca8b0c37" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa2b7127d769426dbf6b610f74536106"
I20260709 12:19:23.333655 10566 raft_consensus.cc:3060] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.333720 10492 raft_consensus.cc:3055] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:23.334196 10492 raft_consensus.cc:740] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa2b7127d769426dbf6b610f74536106, State: Running, Role: LEADER
I20260709 12:19:23.335016 10492 consensus_queue.cc:260] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } }
I20260709 12:19:23.336290 10492 raft_consensus.cc:3060] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.340709 10566 raft_consensus.cc:2468] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 2.
I20260709 12:19:23.341921 10383 leader_election.cc:304] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 390add5b62d0491e947fbaa913806886, 3bfa1b0cf96346a5a3ee6ea10de9496a; no voters: 
I20260709 12:19:23.342799 10613 raft_consensus.cc:2804] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:23.342875 10492 raft_consensus.cc:2468] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 2.
I20260709 12:19:23.343222 10613 raft_consensus.cc:697] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [term 2 LEADER]: Becoming Leader. State: Replica: 390add5b62d0491e947fbaa913806886, State: Running, Role: LEADER
I20260709 12:19:23.344349 10613 consensus_queue.cc:237] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } }
I20260709 12:19:23.350594 10315 catalog_manager.cc:5697] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 reported cstate change: term changed from 1 to 2, leader changed from fa2b7127d769426dbf6b610f74536106 (127.9.131.66) to 390add5b62d0491e947fbaa913806886 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "390add5b62d0491e947fbaa913806886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:23.431252 10492 raft_consensus.cc:1275] T bb6df9ee5d9940198397a007388de659 P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Refusing update from remote peer 3bfa1b0cf96346a5a3ee6ea10de9496a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:23.432574 10610 consensus_queue.cc:1048] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:23.440979 10416 raft_consensus.cc:1275] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Refusing update from remote peer 3bfa1b0cf96346a5a3ee6ea10de9496a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:23.442608 10610 consensus_queue.cc:1048] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Connected to new peer: Peer: permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:23.641726 10566 raft_consensus.cc:1275] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Refusing update from remote peer 390add5b62d0491e947fbaa913806886: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:23.643078 10613 consensus_queue.cc:1048] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:23.652515 10492 raft_consensus.cc:1275] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Refusing update from remote peer 390add5b62d0491e947fbaa913806886: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:23.655730 10681 consensus_queue.cc:1048] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:23.719275 10566 raft_consensus.cc:1275] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Refusing update from remote peer 390add5b62d0491e947fbaa913806886: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:23.720628 10681 consensus_queue.cc:1048] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:23.731068 10492 raft_consensus.cc:1275] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Refusing update from remote peer 390add5b62d0491e947fbaa913806886: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:23.732489 10640 consensus_queue.cc:1048] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:23.743963 10566 raft_consensus.cc:1275] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Refusing update from remote peer 390add5b62d0491e947fbaa913806886: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:23.745239 10640 consensus_queue.cc:1048] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:23.754467 10492 raft_consensus.cc:1275] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Refusing update from remote peer 390add5b62d0491e947fbaa913806886: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:23.756603 10613 consensus_queue.cc:1048] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:25.882503  9741 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:19:25.883188  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:25.898694 10416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dde0882b03d245e58bd916123081e004"
dest_uuid: "390add5b62d0491e947fbaa913806886"
mode: GRACEFUL
new_leader_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
 from {username='slave'} at 127.0.0.1:48330
I20260709 12:19:25.899199 10416 raft_consensus.cc:606] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 2 LEADER]: Received request to transfer leadership to TS 3bfa1b0cf96346a5a3ee6ea10de9496a
I20260709 12:19:25.901541 10416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f298960b2387414094881ba3dfd8e6ad"
dest_uuid: "390add5b62d0491e947fbaa913806886"
mode: GRACEFUL
new_leader_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
 from {username='slave'} at 127.0.0.1:48330
I20260709 12:19:25.902035 10416 raft_consensus.cc:606] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 1 LEADER]: Received request to transfer leadership to TS 3bfa1b0cf96346a5a3ee6ea10de9496a
I20260709 12:19:25.903088  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:25.903494  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:25.942317 10640 raft_consensus.cc:993] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886: : Instructing follower 3bfa1b0cf96346a5a3ee6ea10de9496a to start an election
I20260709 12:19:25.942791 10707 raft_consensus.cc:1081] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 2 LEADER]: Signalling peer 3bfa1b0cf96346a5a3ee6ea10de9496a to start an election
I20260709 12:19:25.944394 10566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dde0882b03d245e58bd916123081e004"
dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
 from {username='slave'} at 127.0.0.1:38714
I20260709 12:19:25.944916 10566 raft_consensus.cc:493] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:25.945202 10566 raft_consensus.cc:3060] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:25.949932 10566 raft_consensus.cc:515] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:25.951583 10566 leader_election.cc:290] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 3 election: Requested vote from peers 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155), fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395)
I20260709 12:19:25.952549 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde0882b03d245e58bd916123081e004" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "390add5b62d0491e947fbaa913806886"
I20260709 12:19:25.952672 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde0882b03d245e58bd916123081e004" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fa2b7127d769426dbf6b610f74536106"
I20260709 12:19:25.953126 10416 raft_consensus.cc:3055] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:25.953269 10492 raft_consensus.cc:3060] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:25.953420 10416 raft_consensus.cc:740] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 390add5b62d0491e947fbaa913806886, State: Running, Role: LEADER
I20260709 12:19:25.954191 10416 consensus_queue.cc:260] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:25.955191 10416 raft_consensus.cc:3060] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:25.958385 10492 raft_consensus.cc:2468] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfa1b0cf96346a5a3ee6ea10de9496a in term 3.
I20260709 12:19:25.959499 10533 leader_election.cc:304] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bfa1b0cf96346a5a3ee6ea10de9496a, fa2b7127d769426dbf6b610f74536106; no voters: 
I20260709 12:19:25.960391 10610 raft_consensus.cc:2804] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:25.960515 10416 raft_consensus.cc:2468] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfa1b0cf96346a5a3ee6ea10de9496a in term 3.
I20260709 12:19:25.961521 10610 raft_consensus.cc:697] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 LEADER]: Becoming Leader. State: Replica: 3bfa1b0cf96346a5a3ee6ea10de9496a, State: Running, Role: LEADER
I20260709 12:19:25.962277 10610 consensus_queue.cc:237] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:25.969321 10315 catalog_manager.cc:5697] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a reported cstate change: term changed from 2 to 3, leader changed from 390add5b62d0491e947fbaa913806886 (127.9.131.65) to 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67). New cstate: current_term: 3 leader_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:26.177068 10640 raft_consensus.cc:993] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886: : Instructing follower 3bfa1b0cf96346a5a3ee6ea10de9496a to start an election
I20260709 12:19:26.177495 10707 raft_consensus.cc:1081] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 1 LEADER]: Signalling peer 3bfa1b0cf96346a5a3ee6ea10de9496a to start an election
I20260709 12:19:26.179171 10566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f298960b2387414094881ba3dfd8e6ad"
dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
 from {username='slave'} at 127.0.0.1:38714
I20260709 12:19:26.179764 10566 raft_consensus.cc:493] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:26.180123 10566 raft_consensus.cc:3060] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:26.185504 10566 raft_consensus.cc:515] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:26.186885 10566 leader_election.cc:290] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 2 election: Requested vote from peers 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155), fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395)
I20260709 12:19:26.187980 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f298960b2387414094881ba3dfd8e6ad" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "390add5b62d0491e947fbaa913806886"
I20260709 12:19:26.187980 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f298960b2387414094881ba3dfd8e6ad" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa2b7127d769426dbf6b610f74536106"
I20260709 12:19:26.188704 10492 raft_consensus.cc:3060] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:26.188678 10416 raft_consensus.cc:3055] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:26.189190 10416 raft_consensus.cc:740] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 390add5b62d0491e947fbaa913806886, State: Running, Role: LEADER
I20260709 12:19:26.189956 10416 consensus_queue.cc:260] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:26.191159 10416 raft_consensus.cc:3060] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:26.195302 10492 raft_consensus.cc:2468] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfa1b0cf96346a5a3ee6ea10de9496a in term 2.
I20260709 12:19:26.196552 10533 leader_election.cc:304] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bfa1b0cf96346a5a3ee6ea10de9496a, fa2b7127d769426dbf6b610f74536106; no voters: 
I20260709 12:19:26.197393 10610 raft_consensus.cc:2804] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:26.197639 10416 raft_consensus.cc:2468] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfa1b0cf96346a5a3ee6ea10de9496a in term 2.
I20260709 12:19:26.197868 10610 raft_consensus.cc:697] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 LEADER]: Becoming Leader. State: Replica: 3bfa1b0cf96346a5a3ee6ea10de9496a, State: Running, Role: LEADER
I20260709 12:19:26.198714 10610 consensus_queue.cc:237] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:26.205572 10315 catalog_manager.cc:5697] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a reported cstate change: term changed from 1 to 2, leader changed from 390add5b62d0491e947fbaa913806886 (127.9.131.65) to 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67). New cstate: current_term: 2 leader_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:26.464002 10492 raft_consensus.cc:1275] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106 [term 3 FOLLOWER]: Refusing update from remote peer 3bfa1b0cf96346a5a3ee6ea10de9496a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:26.465101 10610 consensus_queue.cc:1048] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:26.474502 10416 raft_consensus.cc:1275] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 3 FOLLOWER]: Refusing update from remote peer 3bfa1b0cf96346a5a3ee6ea10de9496a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:26.476191 10719 consensus_queue.cc:1048] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Connected to new peer: Peer: permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:26.646018 10492 raft_consensus.cc:1275] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Refusing update from remote peer 3bfa1b0cf96346a5a3ee6ea10de9496a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:26.647465 10719 consensus_queue.cc:1048] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:26.657166 10416 raft_consensus.cc:1275] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Refusing update from remote peer 3bfa1b0cf96346a5a3ee6ea10de9496a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:26.658422 10710 consensus_queue.cc:1048] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Connected to new peer: Peer: permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:26.904486  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:26.909713  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:26.910086  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:27.911123  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:27.916899  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:27.917315  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:28.918412  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:28.924531  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:28.924949  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:29.926147  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:29.931731  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:29.932209  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:30.933151  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:30.938289  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:30.938699  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:31.939903  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:31.945365  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:31.945809  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:32.946882  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:32.953317  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:32.953732  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:33.954628  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:33.961935  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:33.962339  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:34.963220  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:34.968875  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:34.969305  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:36.002966  9741 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:19:36.011070 10567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f298960b2387414094881ba3dfd8e6ad"
dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
mode: GRACEFUL
new_leader_uuid: "390add5b62d0491e947fbaa913806886"
 from {username='slave'} at 127.0.0.1:38728
I20260709 12:19:36.011749 10567 raft_consensus.cc:606] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 LEADER]: Received request to transfer leadership to TS 390add5b62d0491e947fbaa913806886
I20260709 12:19:36.022301 10567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dde0882b03d245e58bd916123081e004"
dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
mode: GRACEFUL
new_leader_uuid: "390add5b62d0491e947fbaa913806886"
 from {username='slave'} at 127.0.0.1:38728
I20260709 12:19:36.022842 10567 raft_consensus.cc:606] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 LEADER]: Received request to transfer leadership to TS 390add5b62d0491e947fbaa913806886
I20260709 12:19:36.027796 10492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4752da4a6a447ad93fdacdb010730ca"
dest_uuid: "fa2b7127d769426dbf6b610f74536106"
mode: GRACEFUL
new_leader_uuid: "390add5b62d0491e947fbaa913806886"
 from {username='slave'} at 127.0.0.1:38724
I20260709 12:19:36.028301 10492 raft_consensus.cc:606] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [term 2 LEADER]: Received request to transfer leadership to TS 390add5b62d0491e947fbaa913806886
I20260709 12:19:36.033078 10492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6dca734c6e434c1595f96ef0b2825c17"
dest_uuid: "fa2b7127d769426dbf6b610f74536106"
mode: GRACEFUL
new_leader_uuid: "390add5b62d0491e947fbaa913806886"
 from {username='slave'} at 127.0.0.1:38724
I20260709 12:19:36.033512 10492 raft_consensus.cc:606] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [term 1 LEADER]: Received request to transfer leadership to TS 390add5b62d0491e947fbaa913806886
I20260709 12:19:36.038156 10492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7128a5d9b774f3cb0ebdabf0e1c2e3c"
dest_uuid: "fa2b7127d769426dbf6b610f74536106"
mode: GRACEFUL
new_leader_uuid: "390add5b62d0491e947fbaa913806886"
 from {username='slave'} at 127.0.0.1:38724
I20260709 12:19:36.038609 10492 raft_consensus.cc:606] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [term 1 LEADER]: Received request to transfer leadership to TS 390add5b62d0491e947fbaa913806886
I20260709 12:19:36.068291 10710 raft_consensus.cc:993] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a: : Instructing follower 390add5b62d0491e947fbaa913806886 to start an election
I20260709 12:19:36.068800 10737 raft_consensus.cc:1081] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 LEADER]: Signalling peer 390add5b62d0491e947fbaa913806886 to start an election
I20260709 12:19:36.070313 10416 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dde0882b03d245e58bd916123081e004"
dest_uuid: "390add5b62d0491e947fbaa913806886"
 from {username='slave'} at 127.0.0.1:48762
I20260709 12:19:36.070763 10416 raft_consensus.cc:493] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:36.071069 10416 raft_consensus.cc:3060] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:36.075827 10416 raft_consensus.cc:515] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:36.077661 10416 leader_election.cc:290] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 4 election: Requested vote from peers fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:36.078613 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde0882b03d245e58bd916123081e004" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fa2b7127d769426dbf6b610f74536106"
I20260709 12:19:36.078814 10567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde0882b03d245e58bd916123081e004" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
I20260709 12:19:36.079356 10492 raft_consensus.cc:3060] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:36.079533 10567 raft_consensus.cc:3055] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:36.079919 10567 raft_consensus.cc:740] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3bfa1b0cf96346a5a3ee6ea10de9496a, State: Running, Role: LEADER
I20260709 12:19:36.080674 10567 consensus_queue.cc:260] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:36.081684 10567 raft_consensus.cc:3060] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:36.084360 10492 raft_consensus.cc:2468] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 4.
I20260709 12:19:36.085681 10384 leader_election.cc:304] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 390add5b62d0491e947fbaa913806886, fa2b7127d769426dbf6b610f74536106; no voters: 
I20260709 12:19:36.086562 10707 raft_consensus.cc:2804] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:36.087500 10707 raft_consensus.cc:697] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 4 LEADER]: Becoming Leader. State: Replica: 390add5b62d0491e947fbaa913806886, State: Running, Role: LEADER
I20260709 12:19:36.087574 10567 raft_consensus.cc:2468] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 4.
I20260709 12:19:36.088533 10707 consensus_queue.cc:237] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:36.096153 10316 catalog_manager.cc:5697] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 reported cstate change: term changed from 3 to 4, leader changed from 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67) to 390add5b62d0491e947fbaa913806886 (127.9.131.65). New cstate: current_term: 4 leader_uuid: "390add5b62d0491e947fbaa913806886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.112080 10710 raft_consensus.cc:993] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a: : Instructing follower 390add5b62d0491e947fbaa913806886 to start an election
I20260709 12:19:36.112475 10710 raft_consensus.cc:1081] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 LEADER]: Signalling peer 390add5b62d0491e947fbaa913806886 to start an election
I20260709 12:19:36.113844 10416 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f298960b2387414094881ba3dfd8e6ad"
dest_uuid: "390add5b62d0491e947fbaa913806886"
 from {username='slave'} at 127.0.0.1:48762
I20260709 12:19:36.114261 10416 raft_consensus.cc:493] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:36.114537 10416 raft_consensus.cc:3060] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.119089 10416 raft_consensus.cc:515] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:36.120677 10416 leader_election.cc:290] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 3 election: Requested vote from peers fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:36.121551 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f298960b2387414094881ba3dfd8e6ad" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fa2b7127d769426dbf6b610f74536106"
I20260709 12:19:36.121551 10567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f298960b2387414094881ba3dfd8e6ad" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
I20260709 12:19:36.122184 10492 raft_consensus.cc:3060] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.122308 10567 raft_consensus.cc:3055] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:36.122859 10567 raft_consensus.cc:740] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3bfa1b0cf96346a5a3ee6ea10de9496a, State: Running, Role: LEADER
I20260709 12:19:36.123914 10567 consensus_queue.cc:260] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:36.124981 10567 raft_consensus.cc:3060] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.127331 10492 raft_consensus.cc:2468] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 3.
I20260709 12:19:36.128270 10384 leader_election.cc:304] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 390add5b62d0491e947fbaa913806886, fa2b7127d769426dbf6b610f74536106; no voters: 
I20260709 12:19:36.128938 10707 raft_consensus.cc:2804] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:36.129279 10707 raft_consensus.cc:697] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 3 LEADER]: Becoming Leader. State: Replica: 390add5b62d0491e947fbaa913806886, State: Running, Role: LEADER
I20260709 12:19:36.129928 10707 consensus_queue.cc:237] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:36.130134 10567 raft_consensus.cc:2468] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 3.
I20260709 12:19:36.136660 10316 catalog_manager.cc:5697] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 reported cstate change: term changed from 2 to 3, leader changed from 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67) to 390add5b62d0491e947fbaa913806886 (127.9.131.65). New cstate: current_term: 3 leader_uuid: "390add5b62d0491e947fbaa913806886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.185413 10731 raft_consensus.cc:993] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106: : Instructing follower 390add5b62d0491e947fbaa913806886 to start an election
I20260709 12:19:36.185817 10731 raft_consensus.cc:1081] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [term 1 LEADER]: Signalling peer 390add5b62d0491e947fbaa913806886 to start an election
I20260709 12:19:36.187279 10416 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7128a5d9b774f3cb0ebdabf0e1c2e3c"
dest_uuid: "390add5b62d0491e947fbaa913806886"
 from {username='slave'} at 127.0.0.1:48754
I20260709 12:19:36.187742 10416 raft_consensus.cc:493] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:36.188060 10416 raft_consensus.cc:3060] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.192226 10416 raft_consensus.cc:515] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:36.193701 10416 leader_election.cc:290] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 2 election: Requested vote from peers fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:36.194471 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7128a5d9b774f3cb0ebdabf0e1c2e3c" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa2b7127d769426dbf6b610f74536106"
I20260709 12:19:36.194664 10567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7128a5d9b774f3cb0ebdabf0e1c2e3c" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
I20260709 12:19:36.195006 10492 raft_consensus.cc:3055] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:36.195163 10567 raft_consensus.cc:3060] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.195290 10492 raft_consensus.cc:740] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa2b7127d769426dbf6b610f74536106, State: Running, Role: LEADER
I20260709 12:19:36.196080 10492 consensus_queue.cc:260] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:36.197129 10492 raft_consensus.cc:3060] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.200011 10567 raft_consensus.cc:2468] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 2.
I20260709 12:19:36.201037 10383 leader_election.cc:304] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 390add5b62d0491e947fbaa913806886, 3bfa1b0cf96346a5a3ee6ea10de9496a; no voters: 
I20260709 12:19:36.201152 10492 raft_consensus.cc:2468] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 2.
I20260709 12:19:36.201659 10707 raft_consensus.cc:2804] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:36.202049 10707 raft_consensus.cc:697] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [term 2 LEADER]: Becoming Leader. State: Replica: 390add5b62d0491e947fbaa913806886, State: Running, Role: LEADER
I20260709 12:19:36.202818 10707 consensus_queue.cc:237] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:36.209769 10316 catalog_manager.cc:5697] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 reported cstate change: term changed from 1 to 2, leader changed from fa2b7127d769426dbf6b610f74536106 (127.9.131.66) to 390add5b62d0491e947fbaa913806886 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "390add5b62d0491e947fbaa913806886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.388249 10745 raft_consensus.cc:993] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106: : Instructing follower 390add5b62d0491e947fbaa913806886 to start an election
I20260709 12:19:36.388702 10731 raft_consensus.cc:1081] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [term 1 LEADER]: Signalling peer 390add5b62d0491e947fbaa913806886 to start an election
I20260709 12:19:36.390059 10416 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6dca734c6e434c1595f96ef0b2825c17"
dest_uuid: "390add5b62d0491e947fbaa913806886"
 from {username='slave'} at 127.0.0.1:48754
I20260709 12:19:36.390468 10416 raft_consensus.cc:493] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:36.390719 10416 raft_consensus.cc:3060] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.394937 10416 raft_consensus.cc:515] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:36.396471 10416 leader_election.cc:290] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 2 election: Requested vote from peers fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:36.397258 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dca734c6e434c1595f96ef0b2825c17" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa2b7127d769426dbf6b610f74536106"
I20260709 12:19:36.397380 10567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dca734c6e434c1595f96ef0b2825c17" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
I20260709 12:19:36.397782 10492 raft_consensus.cc:3055] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:36.397861 10567 raft_consensus.cc:3060] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.398169 10492 raft_consensus.cc:740] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa2b7127d769426dbf6b610f74536106, State: Running, Role: LEADER
I20260709 12:19:36.398913 10492 consensus_queue.cc:260] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:36.399983 10492 raft_consensus.cc:3060] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.403436 10567 raft_consensus.cc:2468] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 2.
I20260709 12:19:36.404381 10383 leader_election.cc:304] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 390add5b62d0491e947fbaa913806886, 3bfa1b0cf96346a5a3ee6ea10de9496a; no voters: 
I20260709 12:19:36.404508 10492 raft_consensus.cc:2468] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 2.
I20260709 12:19:36.405026 10707 raft_consensus.cc:2804] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:36.405447 10707 raft_consensus.cc:697] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886 [term 2 LEADER]: Becoming Leader. State: Replica: 390add5b62d0491e947fbaa913806886, State: Running, Role: LEADER
I20260709 12:19:36.406172 10707 consensus_queue.cc:237] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:36.412515 10316 catalog_manager.cc:5697] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886 reported cstate change: term changed from 1 to 2, leader changed from fa2b7127d769426dbf6b610f74536106 (127.9.131.66) to 390add5b62d0491e947fbaa913806886 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "390add5b62d0491e947fbaa913806886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.486156 10745 raft_consensus.cc:993] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106: : Instructing follower 390add5b62d0491e947fbaa913806886 to start an election
I20260709 12:19:36.486569 10731 raft_consensus.cc:1081] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [term 2 LEADER]: Signalling peer 390add5b62d0491e947fbaa913806886 to start an election
I20260709 12:19:36.487823 10416 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4752da4a6a447ad93fdacdb010730ca"
dest_uuid: "390add5b62d0491e947fbaa913806886"
 from {username='slave'} at 127.0.0.1:48754
I20260709 12:19:36.488273 10416 raft_consensus.cc:493] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:36.488561 10416 raft_consensus.cc:3060] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.492832 10416 raft_consensus.cc:515] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:36.494320 10416 leader_election.cc:290] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 3 election: Requested vote from peers fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:36.495189 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4752da4a6a447ad93fdacdb010730ca" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fa2b7127d769426dbf6b610f74536106"
I20260709 12:19:36.495321 10567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4752da4a6a447ad93fdacdb010730ca" candidate_uuid: "390add5b62d0491e947fbaa913806886" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
I20260709 12:19:36.495765 10492 raft_consensus.cc:3055] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:36.495811 10567 raft_consensus.cc:3060] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.496254 10492 raft_consensus.cc:740] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fa2b7127d769426dbf6b610f74536106, State: Running, Role: LEADER
I20260709 12:19:36.496985 10492 consensus_queue.cc:260] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:36.497958 10492 raft_consensus.cc:3060] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.498064 10566 raft_consensus.cc:1275] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 4 FOLLOWER]: Refusing update from remote peer 390add5b62d0491e947fbaa913806886: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:36.499418 10707 consensus_queue.cc:1048] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:36.501974 10567 raft_consensus.cc:2468] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 3.
I20260709 12:19:36.503181 10383 leader_election.cc:304] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 390add5b62d0491e947fbaa913806886, 3bfa1b0cf96346a5a3ee6ea10de9496a; no voters: 
I20260709 12:19:36.503492 10492 raft_consensus.cc:2468] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390add5b62d0491e947fbaa913806886 in term 3.
I20260709 12:19:36.504107 10707 raft_consensus.cc:2804] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:36.504659 10707 raft_consensus.cc:697] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [term 3 LEADER]: Becoming Leader. State: Replica: 390add5b62d0491e947fbaa913806886, State: Running, Role: LEADER
I20260709 12:19:36.505534 10707 consensus_queue.cc:237] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:36.512964 10492 raft_consensus.cc:1275] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106 [term 4 FOLLOWER]: Refusing update from remote peer 390add5b62d0491e947fbaa913806886: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:36.514652 10707 consensus_queue.cc:1048] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:36.517459 10316 catalog_manager.cc:5697] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 reported cstate change: term changed from 2 to 3, leader changed from fa2b7127d769426dbf6b610f74536106 (127.9.131.66) to 390add5b62d0491e947fbaa913806886 (127.9.131.65). New cstate: current_term: 3 leader_uuid: "390add5b62d0491e947fbaa913806886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.577850 10492 raft_consensus.cc:1275] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [term 3 FOLLOWER]: Refusing update from remote peer 390add5b62d0491e947fbaa913806886: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:36.579131 10749 consensus_queue.cc:1048] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:36.588584 10566 raft_consensus.cc:1275] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 FOLLOWER]: Refusing update from remote peer 390add5b62d0491e947fbaa913806886: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:36.590348 10756 consensus_queue.cc:1048] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:36.594815 10567 raft_consensus.cc:1275] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Refusing update from remote peer 390add5b62d0491e947fbaa913806886: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:36.597856 10707 consensus_queue.cc:1048] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:36.608222 10490 raft_consensus.cc:1275] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Refusing update from remote peer 390add5b62d0491e947fbaa913806886: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:36.609735 10738 consensus_queue.cc:1048] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:36.882685 10566 raft_consensus.cc:1275] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Refusing update from remote peer 390add5b62d0491e947fbaa913806886: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:36.883999 10738 consensus_queue.cc:1048] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:36.892228 10490 raft_consensus.cc:1275] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Refusing update from remote peer 390add5b62d0491e947fbaa913806886: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:36.895413 10707 consensus_queue.cc:1048] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:36.896729 10490 raft_consensus.cc:1275] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [term 3 FOLLOWER]: Refusing update from remote peer 390add5b62d0491e947fbaa913806886: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:36.898711 10738 consensus_queue.cc:1048] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:36.909435 10566 raft_consensus.cc:1275] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 FOLLOWER]: Refusing update from remote peer 390add5b62d0491e947fbaa913806886: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:36.911231 10756 consensus_queue.cc:1048] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:39.078202  9741 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:19:39.078972  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:39.087949 10416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79327c96f319433192eb5f752085848d"
dest_uuid: "390add5b62d0491e947fbaa913806886"
mode: GRACEFUL
new_leader_uuid: "fa2b7127d769426dbf6b610f74536106"
 from {username='slave'} at 127.0.0.1:48330
I20260709 12:19:39.088754 10416 raft_consensus.cc:606] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [term 2 LEADER]: Received request to transfer leadership to TS fa2b7127d769426dbf6b610f74536106
I20260709 12:19:39.091706 10416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b945359b04724fd1b32b67ebac2a75c4"
dest_uuid: "390add5b62d0491e947fbaa913806886"
mode: GRACEFUL
new_leader_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
 from {username='slave'} at 127.0.0.1:48330
I20260709 12:19:39.092188 10416 raft_consensus.cc:606] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [term 1 LEADER]: Received request to transfer leadership to TS 3bfa1b0cf96346a5a3ee6ea10de9496a
I20260709 12:19:39.094620 10416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f298960b2387414094881ba3dfd8e6ad"
dest_uuid: "390add5b62d0491e947fbaa913806886"
mode: GRACEFUL
new_leader_uuid: "fa2b7127d769426dbf6b610f74536106"
 from {username='slave'} at 127.0.0.1:48330
I20260709 12:19:39.095101 10416 raft_consensus.cc:606] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 3 LEADER]: Received request to transfer leadership to TS fa2b7127d769426dbf6b610f74536106
I20260709 12:19:39.097478 10416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd82dd15e20c4a50a0c70f53ca8b0c37"
dest_uuid: "390add5b62d0491e947fbaa913806886"
mode: GRACEFUL
new_leader_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
 from {username='slave'} at 127.0.0.1:48330
I20260709 12:19:39.097904 10416 raft_consensus.cc:606] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [term 2 LEADER]: Received request to transfer leadership to TS 3bfa1b0cf96346a5a3ee6ea10de9496a
I20260709 12:19:39.098902  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:19:39.099385  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:39.109561 10756 raft_consensus.cc:993] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886: : Instructing follower fa2b7127d769426dbf6b610f74536106 to start an election
I20260709 12:19:39.110004 10756 raft_consensus.cc:1081] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [term 2 LEADER]: Signalling peer fa2b7127d769426dbf6b610f74536106 to start an election
I20260709 12:19:39.111590 10492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79327c96f319433192eb5f752085848d"
dest_uuid: "fa2b7127d769426dbf6b610f74536106"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:19:39.112056 10492 raft_consensus.cc:493] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:39.112358 10492 raft_consensus.cc:3060] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:39.117813 10492 raft_consensus.cc:515] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:39.119848 10492 leader_election.cc:290] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 3 election: Requested vote from peers 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:39.120769 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79327c96f319433192eb5f752085848d" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "390add5b62d0491e947fbaa913806886"
I20260709 12:19:39.121232 10566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79327c96f319433192eb5f752085848d" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
I20260709 12:19:39.121542 10416 raft_consensus.cc:3055] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:39.121804 10566 raft_consensus.cc:3060] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:39.121863 10416 raft_consensus.cc:740] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 390add5b62d0491e947fbaa913806886, State: Running, Role: LEADER
I20260709 12:19:39.122843 10416 consensus_queue.cc:260] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:39.124423 10416 raft_consensus.cc:3060] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:39.127585 10768 raft_consensus.cc:993] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886: : Instructing follower 3bfa1b0cf96346a5a3ee6ea10de9496a to start an election
I20260709 12:19:39.128033 10756 raft_consensus.cc:1081] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [term 2 LEADER]: Signalling peer 3bfa1b0cf96346a5a3ee6ea10de9496a to start an election
I20260709 12:19:39.129307 10566 raft_consensus.cc:2468] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2b7127d769426dbf6b610f74536106 in term 3.
I20260709 12:19:39.129603 10567 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd82dd15e20c4a50a0c70f53ca8b0c37"
dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
 from {username='slave'} at 127.0.0.1:38714
I20260709 12:19:39.130105 10567 raft_consensus.cc:493] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:39.130460 10567 raft_consensus.cc:3060] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:39.130620 10458 leader_election.cc:304] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bfa1b0cf96346a5a3ee6ea10de9496a, fa2b7127d769426dbf6b610f74536106; no voters: 
I20260709 12:19:39.131558 10766 raft_consensus.cc:2804] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:39.131734 10416 raft_consensus.cc:2468] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2b7127d769426dbf6b610f74536106 in term 3.
I20260709 12:19:39.132805 10766 raft_consensus.cc:697] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 [term 3 LEADER]: Becoming Leader. State: Replica: fa2b7127d769426dbf6b610f74536106, State: Running, Role: LEADER
I20260709 12:19:39.133839 10766 consensus_queue.cc:237] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:39.138216 10567 raft_consensus.cc:515] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } }
I20260709 12:19:39.140471 10567 leader_election.cc:290] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 3 election: Requested vote from peers fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395), 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155)
I20260709 12:19:39.141409 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd82dd15e20c4a50a0c70f53ca8b0c37" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "390add5b62d0491e947fbaa913806886"
I20260709 12:19:39.141961 10416 raft_consensus.cc:3055] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:39.142252 10416 raft_consensus.cc:740] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 390add5b62d0491e947fbaa913806886, State: Running, Role: LEADER
I20260709 12:19:39.143028 10416 consensus_queue.cc:260] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } }
I20260709 12:19:39.143123 10316 catalog_manager.cc:5697] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 reported cstate change: term changed from 2 to 3, leader changed from 390add5b62d0491e947fbaa913806886 (127.9.131.65) to fa2b7127d769426dbf6b610f74536106 (127.9.131.66). New cstate: current_term: 3 leader_uuid: "fa2b7127d769426dbf6b610f74536106" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:39.144166 10416 raft_consensus.cc:3060] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:39.146734 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd82dd15e20c4a50a0c70f53ca8b0c37" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fa2b7127d769426dbf6b610f74536106"
I20260709 12:19:39.147269 10492 raft_consensus.cc:3060] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:39.151002 10416 raft_consensus.cc:2468] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfa1b0cf96346a5a3ee6ea10de9496a in term 3.
I20260709 12:19:39.152673 10531 leader_election.cc:304] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 390add5b62d0491e947fbaa913806886, 3bfa1b0cf96346a5a3ee6ea10de9496a; no voters: 
I20260709 12:19:39.153832 10710 raft_consensus.cc:2804] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:39.154148 10492 raft_consensus.cc:2468] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfa1b0cf96346a5a3ee6ea10de9496a in term 3.
I20260709 12:19:39.155678 10710 raft_consensus.cc:697] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 LEADER]: Becoming Leader. State: Replica: 3bfa1b0cf96346a5a3ee6ea10de9496a, State: Running, Role: LEADER
I20260709 12:19:39.156553 10710 consensus_queue.cc:237] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } }
I20260709 12:19:39.164278 10316 catalog_manager.cc:5697] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a reported cstate change: term changed from 2 to 3, leader changed from 390add5b62d0491e947fbaa913806886 (127.9.131.65) to 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67). New cstate: current_term: 3 leader_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:39.310168 10768 raft_consensus.cc:993] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886: : Instructing follower 3bfa1b0cf96346a5a3ee6ea10de9496a to start an election
I20260709 12:19:39.310688 10756 raft_consensus.cc:1081] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [term 1 LEADER]: Signalling peer 3bfa1b0cf96346a5a3ee6ea10de9496a to start an election
I20260709 12:19:39.312084 10567 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b945359b04724fd1b32b67ebac2a75c4"
dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
 from {username='slave'} at 127.0.0.1:38714
I20260709 12:19:39.312517 10567 raft_consensus.cc:493] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:39.312775 10567 raft_consensus.cc:3060] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:39.317092 10567 raft_consensus.cc:515] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:39.318583 10567 leader_election.cc:290] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 2 election: Requested vote from peers 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155), fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395)
I20260709 12:19:39.319300 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945359b04724fd1b32b67ebac2a75c4" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "390add5b62d0491e947fbaa913806886"
I20260709 12:19:39.319561 10492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945359b04724fd1b32b67ebac2a75c4" candidate_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa2b7127d769426dbf6b610f74536106"
I20260709 12:19:39.319893 10416 raft_consensus.cc:3055] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:39.320062 10492 raft_consensus.cc:3060] T b945359b04724fd1b32b67ebac2a75c4 P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:39.320215 10416 raft_consensus.cc:740] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 390add5b62d0491e947fbaa913806886, State: Running, Role: LEADER
I20260709 12:19:39.320989 10416 consensus_queue.cc:260] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:39.322162 10416 raft_consensus.cc:3060] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:39.326371 10492 raft_consensus.cc:2468] T b945359b04724fd1b32b67ebac2a75c4 P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfa1b0cf96346a5a3ee6ea10de9496a in term 2.
I20260709 12:19:39.327658 10533 leader_election.cc:304] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bfa1b0cf96346a5a3ee6ea10de9496a, fa2b7127d769426dbf6b610f74536106; no voters: 
I20260709 12:19:39.328317 10416 raft_consensus.cc:2468] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bfa1b0cf96346a5a3ee6ea10de9496a in term 2.
I20260709 12:19:39.328471 10710 raft_consensus.cc:2804] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:39.328962 10710 raft_consensus.cc:697] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 LEADER]: Becoming Leader. State: Replica: 3bfa1b0cf96346a5a3ee6ea10de9496a, State: Running, Role: LEADER
I20260709 12:19:39.329895 10710 consensus_queue.cc:237] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:39.336455 10316 catalog_manager.cc:5697] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a reported cstate change: term changed from 1 to 2, leader changed from 390add5b62d0491e947fbaa913806886 (127.9.131.65) to 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67). New cstate: current_term: 2 leader_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:39.493290 10768 raft_consensus.cc:993] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886: : Instructing follower fa2b7127d769426dbf6b610f74536106 to start an election
I20260709 12:19:39.493697 10756 raft_consensus.cc:1081] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 3 LEADER]: Signalling peer fa2b7127d769426dbf6b610f74536106 to start an election
I20260709 12:19:39.494940 10492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f298960b2387414094881ba3dfd8e6ad"
dest_uuid: "fa2b7127d769426dbf6b610f74536106"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:19:39.495332 10492 raft_consensus.cc:493] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:39.495589 10492 raft_consensus.cc:3060] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:39.499622 10492 raft_consensus.cc:515] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:39.501098 10492 leader_election.cc:290] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 4 election: Requested vote from peers 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155), 3bfa1b0cf96346a5a3ee6ea10de9496a (127.9.131.67:45275)
I20260709 12:19:39.502024 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f298960b2387414094881ba3dfd8e6ad" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "390add5b62d0491e947fbaa913806886"
I20260709 12:19:39.502174 10567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f298960b2387414094881ba3dfd8e6ad" candidate_uuid: "fa2b7127d769426dbf6b610f74536106" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a"
I20260709 12:19:39.502470 10416 raft_consensus.cc:3055] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:39.502615 10567 raft_consensus.cc:3060] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:39.502732 10416 raft_consensus.cc:740] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 390add5b62d0491e947fbaa913806886, State: Running, Role: LEADER
I20260709 12:19:39.503420 10416 consensus_queue.cc:260] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:39.504338 10416 raft_consensus.cc:3060] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:39.506930 10567 raft_consensus.cc:2468] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2b7127d769426dbf6b610f74536106 in term 4.
I20260709 12:19:39.507793 10458 leader_election.cc:304] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bfa1b0cf96346a5a3ee6ea10de9496a, fa2b7127d769426dbf6b610f74536106; no voters: 
I20260709 12:19:39.508450 10766 raft_consensus.cc:2804] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:39.508460 10416 raft_consensus.cc:2468] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa2b7127d769426dbf6b610f74536106 in term 4.
I20260709 12:19:39.508852 10766 raft_consensus.cc:697] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [term 4 LEADER]: Becoming Leader. State: Replica: fa2b7127d769426dbf6b610f74536106, State: Running, Role: LEADER
I20260709 12:19:39.509727 10766 consensus_queue.cc:237] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } }
I20260709 12:19:39.518100 10316 catalog_manager.cc:5697] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 reported cstate change: term changed from 3 to 4, leader changed from 390add5b62d0491e947fbaa913806886 (127.9.131.65) to fa2b7127d769426dbf6b610f74536106 (127.9.131.66). New cstate: current_term: 4 leader_uuid: "fa2b7127d769426dbf6b610f74536106" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:39.548488 10567 raft_consensus.cc:1275] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 FOLLOWER]: Refusing update from remote peer fa2b7127d769426dbf6b610f74536106: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:39.549544 10766 consensus_queue.cc:1048] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:39.560544 10416 raft_consensus.cc:1275] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [term 3 FOLLOWER]: Refusing update from remote peer fa2b7127d769426dbf6b610f74536106: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:39.561748 10766 consensus_queue.cc:1048] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 [LEADER]: Connected to new peer: Peer: permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:39.723989 10492 raft_consensus.cc:1275] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [term 3 FOLLOWER]: Refusing update from remote peer 3bfa1b0cf96346a5a3ee6ea10de9496a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:39.725165 10710 consensus_queue.cc:1048] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:39.735483 10416 raft_consensus.cc:1275] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [term 3 FOLLOWER]: Refusing update from remote peer 3bfa1b0cf96346a5a3ee6ea10de9496a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:39.737123 10785 consensus_queue.cc:1048] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Connected to new peer: Peer: permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:39.749580 10416 raft_consensus.cc:1275] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Refusing update from remote peer 3bfa1b0cf96346a5a3ee6ea10de9496a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:39.750800 10785 consensus_queue.cc:1048] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Connected to new peer: Peer: permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:39.758880 10492 raft_consensus.cc:1275] T b945359b04724fd1b32b67ebac2a75c4 P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Refusing update from remote peer 3bfa1b0cf96346a5a3ee6ea10de9496a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:39.760851 10774 consensus_queue.cc:1048] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa2b7127d769426dbf6b610f74536106" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 40395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:39.895820 10567 raft_consensus.cc:1275] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 4 FOLLOWER]: Refusing update from remote peer fa2b7127d769426dbf6b610f74536106: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:39.896929 10766 consensus_queue.cc:1048] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bfa1b0cf96346a5a3ee6ea10de9496a" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:39.906749 10416 raft_consensus.cc:1275] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 4 FOLLOWER]: Refusing update from remote peer fa2b7127d769426dbf6b610f74536106: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:39.908360 10790 consensus_queue.cc:1048] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [LEADER]: Connected to new peer: Peer: permanent_uuid: "390add5b62d0491e947fbaa913806886" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 35155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:40.100322  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:40.105687  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:40.106107  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:41.107048  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:41.112994  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:41.113406  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:42.114302  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:42.119572  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:42.120059  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:43.120998  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:43.127774  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:43.128219  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:44.129170  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:44.135026  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:44.135530  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:45.136540  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:45.141718  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:45.142167  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:46.143239  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:46.148922  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:46.149343  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:47.150255  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:47.156006  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:47.156435  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:48.157308  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:48.163228  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:48.163725  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:49.197784  9741 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:19:49.198367  9741 tablet_server.cc:179] TabletServer@127.9.131.65:0 shutting down...
W20260709 12:19:49.209897 10457 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 12:19:49.214468 10457 consensus_peers.cc:597] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 -> Peer 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155): Couldn't send request to peer 390add5b62d0491e947fbaa913806886. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:49.228017  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:49.229777  9741 tablet_replica.cc:333] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886: stopping tablet replica
I20260709 12:19:49.231536  9741 raft_consensus.cc:2243] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:49.233337  9741 raft_consensus.cc:2272] T 6dca734c6e434c1595f96ef0b2825c17 P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.235963  9741 tablet_replica.cc:333] T 82aae21e47564b3abcc7247912bd13f7 P 390add5b62d0491e947fbaa913806886: stopping tablet replica
I20260709 12:19:49.236611  9741 raft_consensus.cc:2243] T 82aae21e47564b3abcc7247912bd13f7 P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:49.237139  9741 raft_consensus.cc:2272] T 82aae21e47564b3abcc7247912bd13f7 P 390add5b62d0491e947fbaa913806886 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.239233  9741 tablet_replica.cc:333] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886: stopping tablet replica
I20260709 12:19:49.239826  9741 raft_consensus.cc:2243] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:49.240455  9741 raft_consensus.cc:2272] T bb6df9ee5d9940198397a007388de659 P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.242547  9741 tablet_replica.cc:333] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886: stopping tablet replica
I20260709 12:19:49.243117  9741 raft_consensus.cc:2243] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:49.243687  9741 raft_consensus.cc:2272] T f298960b2387414094881ba3dfd8e6ad P 390add5b62d0491e947fbaa913806886 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.246912  9741 tablet_replica.cc:333] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886: stopping tablet replica
I20260709 12:19:49.247686  9741 raft_consensus.cc:2243] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:49.248435  9741 raft_consensus.cc:2272] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 390add5b62d0491e947fbaa913806886 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.250487  9741 tablet_replica.cc:333] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886: stopping tablet replica
I20260709 12:19:49.251003  9741 raft_consensus.cc:2243] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:49.251848  9741 raft_consensus.cc:2272] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.253751  9741 tablet_replica.cc:333] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886: stopping tablet replica
I20260709 12:19:49.254328  9741 raft_consensus.cc:2243] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:49.254766  9741 raft_consensus.cc:2272] T b945359b04724fd1b32b67ebac2a75c4 P 390add5b62d0491e947fbaa913806886 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.256649  9741 tablet_replica.cc:333] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886: stopping tablet replica
I20260709 12:19:49.257110  9741 raft_consensus.cc:2243] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:49.257558  9741 raft_consensus.cc:2272] T 79327c96f319433192eb5f752085848d P 390add5b62d0491e947fbaa913806886 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.259454  9741 tablet_replica.cc:333] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886: stopping tablet replica
I20260709 12:19:49.259979  9741 raft_consensus.cc:2243] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:49.260766  9741 raft_consensus.cc:2272] T b4752da4a6a447ad93fdacdb010730ca P 390add5b62d0491e947fbaa913806886 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.262586  9741 tablet_replica.cc:333] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886: stopping tablet replica
I20260709 12:19:49.263022  9741 raft_consensus.cc:2243] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:19:49.263809  9741 raft_consensus.cc:2272] T dde0882b03d245e58bd916123081e004 P 390add5b62d0491e947fbaa913806886 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:49.277302 10457 consensus_peers.cc:597] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 -> Peer 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155): Couldn't send request to peer 390add5b62d0491e947fbaa913806886. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:49.294875  9741 tablet_server.cc:196] TabletServer@127.9.131.65:0 shutdown complete.
I20260709 12:19:49.317456  9741 tablet_server.cc:179] TabletServer@127.9.131.66:0 shutting down...
W20260709 12:19:49.327498 10457 consensus_peers.cc:597] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 -> Peer 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155): Couldn't send request to peer 390add5b62d0491e947fbaa913806886. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:35155: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:49.345268  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:49.346017  9741 tablet_replica.cc:333] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106: stopping tablet replica
I20260709 12:19:49.346685  9741 raft_consensus.cc:2243] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:19:49.347519  9741 raft_consensus.cc:2272] T f298960b2387414094881ba3dfd8e6ad P fa2b7127d769426dbf6b610f74536106 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.349380  9741 tablet_replica.cc:333] T bb6df9ee5d9940198397a007388de659 P fa2b7127d769426dbf6b610f74536106: stopping tablet replica
I20260709 12:19:49.349933  9741 raft_consensus.cc:2243] T bb6df9ee5d9940198397a007388de659 P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:49.350358  9741 raft_consensus.cc:2272] T bb6df9ee5d9940198397a007388de659 P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.352157  9741 tablet_replica.cc:333] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106: stopping tablet replica
I20260709 12:19:49.352734  9741 raft_consensus.cc:2243] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:49.353193  9741 raft_consensus.cc:2272] T b4752da4a6a447ad93fdacdb010730ca P fa2b7127d769426dbf6b610f74536106 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.355119  9741 tablet_replica.cc:333] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106: stopping tablet replica
I20260709 12:19:49.355620  9741 raft_consensus.cc:2243] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:49.356074  9741 raft_consensus.cc:2272] T dde0882b03d245e58bd916123081e004 P fa2b7127d769426dbf6b610f74536106 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.357801  9741 tablet_replica.cc:333] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106: stopping tablet replica
I20260709 12:19:49.358274  9741 raft_consensus.cc:2243] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:49.359066  9741 raft_consensus.cc:2272] T 82aae21e47564b3abcc7247912bd13f7 P fa2b7127d769426dbf6b610f74536106 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.361004  9741 tablet_replica.cc:333] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106: stopping tablet replica
I20260709 12:19:49.361538  9741 raft_consensus.cc:2243] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:49.362010  9741 raft_consensus.cc:2272] T 6dca734c6e434c1595f96ef0b2825c17 P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.363740  9741 tablet_replica.cc:333] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106: stopping tablet replica
I20260709 12:19:49.364225  9741 raft_consensus.cc:2243] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:49.365011  9741 raft_consensus.cc:2272] T 79327c96f319433192eb5f752085848d P fa2b7127d769426dbf6b610f74536106 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.366852  9741 tablet_replica.cc:333] T b945359b04724fd1b32b67ebac2a75c4 P fa2b7127d769426dbf6b610f74536106: stopping tablet replica
I20260709 12:19:49.367321  9741 raft_consensus.cc:2243] T b945359b04724fd1b32b67ebac2a75c4 P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:49.368049  9741 raft_consensus.cc:2272] T b945359b04724fd1b32b67ebac2a75c4 P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.370005  9741 tablet_replica.cc:333] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106: stopping tablet replica
I20260709 12:19:49.370587  9741 raft_consensus.cc:2243] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:49.371121  9741 raft_consensus.cc:2272] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P fa2b7127d769426dbf6b610f74536106 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.373736  9741 tablet_replica.cc:333] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106: stopping tablet replica
I20260709 12:19:49.374204  9741 raft_consensus.cc:2243] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:49.374802  9741 raft_consensus.cc:2272] T fd82dd15e20c4a50a0c70f53ca8b0c37 P fa2b7127d769426dbf6b610f74536106 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:49.375418 10533 consensus_peers.cc:597] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a -> Peer fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395): Couldn't send request to peer fa2b7127d769426dbf6b610f74536106. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:49.391243 10533 connection.cc:573] client connection to 127.9.131.66:40395 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:19:49.394305 10531 consensus_peers.cc:597] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a -> Peer 390add5b62d0491e947fbaa913806886 (127.9.131.65:35155): Couldn't send request to peer 390add5b62d0491e947fbaa913806886. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:35155: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:49.395565 10533 consensus_peers.cc:597] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a -> Peer fa2b7127d769426dbf6b610f74536106 (127.9.131.66:40395): Couldn't send request to peer fa2b7127d769426dbf6b610f74536106. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:40395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:49.396023  9741 tablet_server.cc:196] TabletServer@127.9.131.66:0 shutdown complete.
I20260709 12:19:49.422083  9741 tablet_server.cc:179] TabletServer@127.9.131.67:0 shutting down...
I20260709 12:19:49.444469  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:49.445117  9741 tablet_replica.cc:333] T 82aae21e47564b3abcc7247912bd13f7 P 3bfa1b0cf96346a5a3ee6ea10de9496a: stopping tablet replica
I20260709 12:19:49.445644  9741 raft_consensus.cc:2243] T 82aae21e47564b3abcc7247912bd13f7 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:49.446065  9741 raft_consensus.cc:2272] T 82aae21e47564b3abcc7247912bd13f7 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.447978  9741 tablet_replica.cc:333] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a: stopping tablet replica
I20260709 12:19:49.448494  9741 raft_consensus.cc:2243] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:49.449240  9741 raft_consensus.cc:2272] T bb6df9ee5d9940198397a007388de659 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.451007  9741 tablet_replica.cc:333] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a: stopping tablet replica
I20260709 12:19:49.451498  9741 raft_consensus.cc:2243] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:49.451931  9741 raft_consensus.cc:2272] T f298960b2387414094881ba3dfd8e6ad P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.453619  9741 tablet_replica.cc:333] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a: stopping tablet replica
I20260709 12:19:49.454097  9741 raft_consensus.cc:2243] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:49.454871  9741 raft_consensus.cc:2272] T fd82dd15e20c4a50a0c70f53ca8b0c37 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.456668  9741 tablet_replica.cc:333] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a: stopping tablet replica
I20260709 12:19:49.457110  9741 raft_consensus.cc:2243] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:49.457500  9741 raft_consensus.cc:2272] T 6dca734c6e434c1595f96ef0b2825c17 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.459244  9741 tablet_replica.cc:333] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a: stopping tablet replica
I20260709 12:19:49.459674  9741 raft_consensus.cc:2243] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:49.460130  9741 raft_consensus.cc:2272] T 79327c96f319433192eb5f752085848d P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.461767  9741 tablet_replica.cc:333] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a: stopping tablet replica
I20260709 12:19:49.462224  9741 raft_consensus.cc:2243] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:49.462657  9741 raft_consensus.cc:2272] T b4752da4a6a447ad93fdacdb010730ca P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.464344  9741 tablet_replica.cc:333] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a: stopping tablet replica
I20260709 12:19:49.464809  9741 raft_consensus.cc:2243] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:49.465220  9741 raft_consensus.cc:2272] T dde0882b03d245e58bd916123081e004 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.466902  9741 tablet_replica.cc:333] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 3bfa1b0cf96346a5a3ee6ea10de9496a: stopping tablet replica
I20260709 12:19:49.467346  9741 raft_consensus.cc:2243] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:49.467782  9741 raft_consensus.cc:2272] T d7128a5d9b774f3cb0ebdabf0e1c2e3c P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.469432  9741 tablet_replica.cc:333] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a: stopping tablet replica
I20260709 12:19:49.469846  9741 raft_consensus.cc:2243] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:49.470587  9741 raft_consensus.cc:2272] T b945359b04724fd1b32b67ebac2a75c4 P 3bfa1b0cf96346a5a3ee6ea10de9496a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.498986  9741 tablet_server.cc:196] TabletServer@127.9.131.67:0 shutdown complete.
I20260709 12:19:49.519039  9741 master.cc:562] Master@127.9.131.126:46267 shutting down...
I20260709 12:19:49.540323  9741 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:49.540953  9741 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:49.541298  9741 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9f980e0f2df14158a3c34b8ef94f256c: stopping tablet replica
I20260709 12:19:49.559809  9741 master.cc:584] Master@127.9.131.126:46267 shutdown complete.
390add5b62d0491e947fbaa913806886  5
3bfa1b0cf96346a5a3ee6ea10de9496a  1
fa2b7127d769426dbf6b610f74536106  4
390add5b62d0491e947fbaa913806886  3
3bfa1b0cf96346a5a3ee6ea10de9496a  3
fa2b7127d769426dbf6b610f74536106  4
390add5b62d0491e947fbaa913806886  8
3bfa1b0cf96346a5a3ee6ea10de9496a  1
fa2b7127d769426dbf6b610f74536106  1
390add5b62d0491e947fbaa913806886  4
3bfa1b0cf96346a5a3ee6ea10de9496a  3
fa2b7127d769426dbf6b610f74536106  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28600 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:19:49.598611  9741 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.131.126:46265
I20260709 12:19:49.599725  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:49.605163 10809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:49.605408 10810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:49.606124 10812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:49.606840  9741 server_base.cc:1061] running on GCE node
I20260709 12:19:49.607729  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:49.608140  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:49.608300  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599589608279 us; error 0 us; skew 500 ppm
I20260709 12:19:49.608830  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:49.611155  9741 webserver.cc:533] Webserver started at http://127.9.131.126:42545/ using document root <none> and password file <none>
I20260709 12:19:49.611640  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:49.611820  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:49.612128  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:49.613230  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/master-0-root/instance:
uuid: "b5a9c6dd870a436699566823a8e6e1ca"
format_stamp: "Formatted at 2026-07-09 12:19:49 on dist-test-slave-r7s7"
I20260709 12:19:49.617842  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 12:19:49.621173 10817 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:49.621897  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:19:49.622169  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/master-0-root
uuid: "b5a9c6dd870a436699566823a8e6e1ca"
format_stamp: "Formatted at 2026-07-09 12:19:49 on dist-test-slave-r7s7"
I20260709 12:19:49.622449  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:49.637944  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:49.639314  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:49.676903  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.126:46265
I20260709 12:19:49.677009 10868 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.126:46265 every 8 connection(s)
I20260709 12:19:49.680821 10869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:49.691299 10869 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca: Bootstrap starting.
I20260709 12:19:49.696121 10869 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.700736 10869 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca: No bootstrap required, opened a new log
I20260709 12:19:49.702960 10869 raft_consensus.cc:359] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5a9c6dd870a436699566823a8e6e1ca" member_type: VOTER }
I20260709 12:19:49.703430 10869 raft_consensus.cc:385] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.703639 10869 raft_consensus.cc:740] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5a9c6dd870a436699566823a8e6e1ca, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.704187 10869 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5a9c6dd870a436699566823a8e6e1ca" member_type: VOTER }
I20260709 12:19:49.704663 10869 raft_consensus.cc:399] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:19:49.704873 10869 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:19:49.705137 10869 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.709486 10869 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5a9c6dd870a436699566823a8e6e1ca" member_type: VOTER }
I20260709 12:19:49.710033 10869 leader_election.cc:304] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b5a9c6dd870a436699566823a8e6e1ca; no voters: 
I20260709 12:19:49.711169 10869 leader_election.cc:290] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:19:49.711596 10872 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.713032 10872 raft_consensus.cc:697] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca [term 1 LEADER]: Becoming Leader. State: Replica: b5a9c6dd870a436699566823a8e6e1ca, State: Running, Role: LEADER
I20260709 12:19:49.713675 10872 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5a9c6dd870a436699566823a8e6e1ca" member_type: VOTER }
I20260709 12:19:49.714102 10869 sys_catalog.cc:565] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:19:49.718844 10873 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b5a9c6dd870a436699566823a8e6e1ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5a9c6dd870a436699566823a8e6e1ca" member_type: VOTER } }
I20260709 12:19:49.719028 10874 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5a9c6dd870a436699566823a8e6e1ca. Latest consensus state: current_term: 1 leader_uuid: "b5a9c6dd870a436699566823a8e6e1ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5a9c6dd870a436699566823a8e6e1ca" member_type: VOTER } }
I20260709 12:19:49.719600 10873 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:49.719750 10874 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:49.725121 10879 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:19:49.732998 10879 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:19:49.734040  9741 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:19:49.742285 10879 catalog_manager.cc:1383] Generated new cluster ID: 07f83a3790d04b7393a65f8fb8f7dd82
I20260709 12:19:49.742524 10879 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:19:49.764896 10879 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:19:49.766113 10879 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:19:49.779453 10879 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca: Generated new TSK 0
I20260709 12:19:49.780093 10879 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:19:49.800452  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:49.806499 10890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:49.806911 10891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:49.808712 10893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:49.809504  9741 server_base.cc:1061] running on GCE node
I20260709 12:19:49.810339  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:49.810530  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:49.810693  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599589810673 us; error 0 us; skew 500 ppm
I20260709 12:19:49.811200  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:49.813473  9741 webserver.cc:533] Webserver started at http://127.9.131.65:36193/ using document root <none> and password file <none>
I20260709 12:19:49.813977  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:49.814150  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:49.814422  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:49.815577  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-0-root/instance:
uuid: "9e8170bbe8244e40a2b2e5011e69b697"
format_stamp: "Formatted at 2026-07-09 12:19:49 on dist-test-slave-r7s7"
I20260709 12:19:49.820284  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:19:49.824268 10898 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:49.825177  9741 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:19:49.825493  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-0-root
uuid: "9e8170bbe8244e40a2b2e5011e69b697"
format_stamp: "Formatted at 2026-07-09 12:19:49 on dist-test-slave-r7s7"
I20260709 12:19:49.825836  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:49.840858  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:49.842088  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:49.843569  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:49.845988  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:49.846199  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:49.846431  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:49.846606  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:49.887518  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.65:46109
I20260709 12:19:49.887631 10960 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.65:46109 every 8 connection(s)
I20260709 12:19:49.892558  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:49.899516 10965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:49.901298 10966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:49.904881  9741 server_base.cc:1061] running on GCE node
W20260709 12:19:49.905702 10968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:49.906366 10961 heartbeater.cc:344] Connected to a master server at 127.9.131.126:46265
I20260709 12:19:49.906697 10961 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:49.906812  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:49.907064  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:49.907222  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599589907207 us; error 0 us; skew 500 ppm
I20260709 12:19:49.907449 10961 heartbeater.cc:507] Master 127.9.131.126:46265 requested a full tablet report, sending...
I20260709 12:19:49.907799  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:49.909900 10834 ts_manager.cc:194] Registered new tserver with Master: 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109)
I20260709 12:19:49.910704  9741 webserver.cc:533] Webserver started at http://127.9.131.66:37337/ using document root <none> and password file <none>
I20260709 12:19:49.911336  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:49.911580  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:49.911949  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:49.912367 10834 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35608
I20260709 12:19:49.913473  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-1-root/instance:
uuid: "2201bad9e18849b09cf82de29dd032d3"
format_stamp: "Formatted at 2026-07-09 12:19:49 on dist-test-slave-r7s7"
I20260709 12:19:49.918263  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:19:49.922024 10973 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:49.922760  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:19:49.923058  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-1-root
uuid: "2201bad9e18849b09cf82de29dd032d3"
format_stamp: "Formatted at 2026-07-09 12:19:49 on dist-test-slave-r7s7"
I20260709 12:19:49.923337  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:49.948235  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:49.949445  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:49.950866  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:49.953125  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:49.953383  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:49.953670  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:49.953886  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:49.992774  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.66:41383
I20260709 12:19:49.992913 11035 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.66:41383 every 8 connection(s)
I20260709 12:19:49.997390  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:50.004868 11039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:50.006669 11040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:50.008469  9741 server_base.cc:1061] running on GCE node
W20260709 12:19:50.010030 11042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:50.011086  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:50.011315  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:50.011478  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599590011459 us; error 0 us; skew 500 ppm
I20260709 12:19:50.011945 11036 heartbeater.cc:344] Connected to a master server at 127.9.131.126:46265
I20260709 12:19:50.012112  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:50.012326 11036 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:50.013211 11036 heartbeater.cc:507] Master 127.9.131.126:46265 requested a full tablet report, sending...
I20260709 12:19:50.014957  9741 webserver.cc:533] Webserver started at http://127.9.131.67:33463/ using document root <none> and password file <none>
I20260709 12:19:50.015614  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:50.015828  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:50.015928 10834 ts_manager.cc:194] Registered new tserver with Master: 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:50.016147  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:50.017346  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-2-root/instance:
uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
format_stamp: "Formatted at 2026-07-09 12:19:50 on dist-test-slave-r7s7"
I20260709 12:19:50.017373 10834 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35614
I20260709 12:19:50.022042  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:19:50.025750 11047 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:50.026537  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:19:50.026862  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-2-root
uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
format_stamp: "Formatted at 2026-07-09 12:19:50 on dist-test-slave-r7s7"
I20260709 12:19:50.027170  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:50.039988  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:50.041158  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:50.042568  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:50.045099  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:50.045300  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:50.045503  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:50.045644  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:50.084893  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.67:40209
I20260709 12:19:50.085031 11109 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.67:40209 every 8 connection(s)
I20260709 12:19:50.100040 11110 heartbeater.cc:344] Connected to a master server at 127.9.131.126:46265
I20260709 12:19:50.100432 11110 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:50.101188 11110 heartbeater.cc:507] Master 127.9.131.126:46265 requested a full tablet report, sending...
I20260709 12:19:50.103441 10834 ts_manager.cc:194] Registered new tserver with Master: 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:50.103579  9741 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015006726s
I20260709 12:19:50.104820 10834 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35620
I20260709 12:19:50.129822 10834 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35628:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:19:50.135842 10834 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:19:50.327937 11000 tablet_service.cc:1511] Processing CreateTablet for tablet 32589fba10354b9588f7cb0a69c6e92d (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:19:50.328357 10999 tablet_service.cc:1511] Processing CreateTablet for tablet f1f6166d836f41229df11ee42cd8e4c7 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:19:50.329463 11000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32589fba10354b9588f7cb0a69c6e92d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.330152 10999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f6166d836f41229df11ee42cd8e4c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.330797 10925 tablet_service.cc:1511] Processing CreateTablet for tablet 32589fba10354b9588f7cb0a69c6e92d (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:19:50.331512 11001 tablet_service.cc:1511] Processing CreateTablet for tablet d263972b0e844fa281354fac07ccef80 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:19:50.333022 11001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d263972b0e844fa281354fac07ccef80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.333545 10924 tablet_service.cc:1511] Processing CreateTablet for tablet f1f6166d836f41229df11ee42cd8e4c7 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:19:50.329126 10926 tablet_service.cc:1511] Processing CreateTablet for tablet d263972b0e844fa281354fac07ccef80 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:19:50.332134 10925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32589fba10354b9588f7cb0a69c6e92d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.337361 10926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d263972b0e844fa281354fac07ccef80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.340342 10924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f6166d836f41229df11ee42cd8e4c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.351231 10923 tablet_service.cc:1511] Processing CreateTablet for tablet 74d2f9dca08d41e7a77146322049c40c (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:19:50.352751 10923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d2f9dca08d41e7a77146322049c40c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.352442 10998 tablet_service.cc:1511] Processing CreateTablet for tablet 74d2f9dca08d41e7a77146322049c40c (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:19:50.353768 10998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d2f9dca08d41e7a77146322049c40c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.354907 10922 tablet_service.cc:1511] Processing CreateTablet for tablet 49f51062a99d4696bd7480d6804e7d72 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:19:50.356208 10922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f51062a99d4696bd7480d6804e7d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.357913 10997 tablet_service.cc:1511] Processing CreateTablet for tablet 49f51062a99d4696bd7480d6804e7d72 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:19:50.359278 10997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f51062a99d4696bd7480d6804e7d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.377686 11075 tablet_service.cc:1511] Processing CreateTablet for tablet d263972b0e844fa281354fac07ccef80 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:19:50.379096 11075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d263972b0e844fa281354fac07ccef80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.381080 11074 tablet_service.cc:1511] Processing CreateTablet for tablet 32589fba10354b9588f7cb0a69c6e92d (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:19:50.382223 11125 tablet_bootstrap.cc:492] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:50.382543 11074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32589fba10354b9588f7cb0a69c6e92d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.385082 11073 tablet_service.cc:1511] Processing CreateTablet for tablet f1f6166d836f41229df11ee42cd8e4c7 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:19:50.385847 11126 tablet_bootstrap.cc:492] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:50.386518 11073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f6166d836f41229df11ee42cd8e4c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.389218 11072 tablet_service.cc:1511] Processing CreateTablet for tablet 74d2f9dca08d41e7a77146322049c40c (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:19:50.390623 11072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d2f9dca08d41e7a77146322049c40c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.393149 11071 tablet_service.cc:1511] Processing CreateTablet for tablet 49f51062a99d4696bd7480d6804e7d72 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:19:50.394479 11071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f51062a99d4696bd7480d6804e7d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.398448 11070 tablet_service.cc:1511] Processing CreateTablet for tablet c486c31e8ba74d8a9b17989a20d141bf (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:19:50.399909 11070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c486c31e8ba74d8a9b17989a20d141bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.400055 11126 tablet_bootstrap.cc:654] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.410918 11125 tablet_bootstrap.cc:654] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.402258 10922 tablet_service.cc:1511] Processing CreateTablet for tablet c486c31e8ba74d8a9b17989a20d141bf (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:19:50.413590 10922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c486c31e8ba74d8a9b17989a20d141bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.420634 10925 tablet_service.cc:1511] Processing CreateTablet for tablet 015a67e38c364985be24b18358579506 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:19:50.424968 11001 tablet_service.cc:1511] Processing CreateTablet for tablet 015a67e38c364985be24b18358579506 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:19:50.426260 10925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 015a67e38c364985be24b18358579506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.426438 11001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 015a67e38c364985be24b18358579506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.416436 10999 tablet_service.cc:1511] Processing CreateTablet for tablet c486c31e8ba74d8a9b17989a20d141bf (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:19:50.437721 10999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c486c31e8ba74d8a9b17989a20d141bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.438751 11069 tablet_service.cc:1511] Processing CreateTablet for tablet 015a67e38c364985be24b18358579506 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:19:50.440099 11069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 015a67e38c364985be24b18358579506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.440991 11126 tablet_bootstrap.cc:492] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:50.441471 11126 ts_tablet_manager.cc:1403] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.057s	user 0.016s	sys 0.000s
I20260709 12:19:50.445520 11126 raft_consensus.cc:359] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.450661 11126 raft_consensus.cc:385] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.451078 11126 raft_consensus.cc:740] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.453090 11126 consensus_queue.cc:260] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.455386 11125 tablet_bootstrap.cc:492] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:50.456789 11125 ts_tablet_manager.cc:1403] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.000s
I20260709 12:19:50.456933 10926 tablet_service.cc:1511] Processing CreateTablet for tablet 90e76c15ad9c49ab9b98a5d216125beb (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:19:50.458199 10926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90e76c15ad9c49ab9b98a5d216125beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.459767 11125 raft_consensus.cc:359] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.464828 11125 raft_consensus.cc:385] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.465224 11125 raft_consensus.cc:740] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.466027 11125 consensus_queue.cc:260] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.468740 10961 heartbeater.cc:499] Master 127.9.131.126:46265 was elected leader, sending a full tablet report...
I20260709 12:19:50.469911 11126 ts_tablet_manager.cc:1434] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:19:50.470988 11126 tablet_bootstrap.cc:492] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:50.477921 11126 tablet_bootstrap.cc:654] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.479288 10999 tablet_service.cc:1511] Processing CreateTablet for tablet 90e76c15ad9c49ab9b98a5d216125beb (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:19:50.480686 10999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90e76c15ad9c49ab9b98a5d216125beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.506055 11125 ts_tablet_manager.cc:1434] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.049s	user 0.013s	sys 0.009s
I20260709 12:19:50.506433 11036 heartbeater.cc:499] Master 127.9.131.126:46265 was elected leader, sending a full tablet report...
I20260709 12:19:50.507156 11125 tablet_bootstrap.cc:492] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:50.510339 11074 tablet_service.cc:1511] Processing CreateTablet for tablet 90e76c15ad9c49ab9b98a5d216125beb (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:19:50.511941 11074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90e76c15ad9c49ab9b98a5d216125beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.514304 11125 tablet_bootstrap.cc:654] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.506105 11128 tablet_bootstrap.cc:492] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:50.523191 10925 tablet_service.cc:1511] Processing CreateTablet for tablet c9432c125c17431e881ba1329e02a201 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:19:50.524757 10925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9432c125c17431e881ba1329e02a201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.532784 11001 tablet_service.cc:1511] Processing CreateTablet for tablet c9432c125c17431e881ba1329e02a201 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:19:50.534267 11001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9432c125c17431e881ba1329e02a201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.528607 11072 tablet_service.cc:1511] Processing CreateTablet for tablet c9432c125c17431e881ba1329e02a201 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:19:50.536983 11072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9432c125c17431e881ba1329e02a201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.540920 10926 tablet_service.cc:1511] Processing CreateTablet for tablet 84ba0a33a7f74af5b5fd862bbb01e3cb (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:19:50.542533 10926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84ba0a33a7f74af5b5fd862bbb01e3cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.540959 11128 tablet_bootstrap.cc:654] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.548550 11131 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.549081 11131 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.551954 11131 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:50.557729 10997 tablet_service.cc:1511] Processing CreateTablet for tablet 84ba0a33a7f74af5b5fd862bbb01e3cb (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:19:50.559273 10997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84ba0a33a7f74af5b5fd862bbb01e3cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.574826 11125 tablet_bootstrap.cc:492] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:50.575457 11125 ts_tablet_manager.cc:1403] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.069s	user 0.009s	sys 0.015s
I20260709 12:19:50.580695 10922 tablet_service.cc:1511] Processing CreateTablet for tablet 2f281b53af584a8bab9bb1d343d005f8 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:19:50.582034 10922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f281b53af584a8bab9bb1d343d005f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.584343 11130 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.584851 11130 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.586964 11125 raft_consensus.cc:359] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.587709 11125 raft_consensus.cc:385] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.580695 10998 tablet_service.cc:1511] Processing CreateTablet for tablet 2f281b53af584a8bab9bb1d343d005f8 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:19:50.576742 11126 tablet_bootstrap.cc:492] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:50.571712 11073 tablet_service.cc:1511] Processing CreateTablet for tablet 84ba0a33a7f74af5b5fd862bbb01e3cb (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:19:50.592082 11125 raft_consensus.cc:740] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.594318 11125 consensus_queue.cc:260] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.594381 10998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f281b53af584a8bab9bb1d343d005f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.588532 11130 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:50.602530 11072 tablet_service.cc:1511] Processing CreateTablet for tablet 2f281b53af584a8bab9bb1d343d005f8 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:19:50.608415 11073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84ba0a33a7f74af5b5fd862bbb01e3cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.600101 11126 ts_tablet_manager.cc:1403] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.129s	user 0.016s	sys 0.025s
I20260709 12:19:50.627724 11072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f281b53af584a8bab9bb1d343d005f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.628602 11069 tablet_service.cc:1511] Processing CreateTablet for tablet 78fb947776bd4e70b1f04a0af3390ae3 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:19:50.629891 11069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78fb947776bd4e70b1f04a0af3390ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.632035 10926 tablet_service.cc:1511] Processing CreateTablet for tablet 78fb947776bd4e70b1f04a0af3390ae3 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:19:50.633446 10926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78fb947776bd4e70b1f04a0af3390ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.640507 10998 tablet_service.cc:1511] Processing CreateTablet for tablet 78fb947776bd4e70b1f04a0af3390ae3 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:19:50.641949 10998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78fb947776bd4e70b1f04a0af3390ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.645246 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:50.647110 11125 ts_tablet_manager.cc:1434] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.000s
W20260709 12:19:50.647960 10977 leader_election.cc:343] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.652315 11125 tablet_bootstrap.cc:492] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:50.658222 11126 raft_consensus.cc:359] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.659147 11126 raft_consensus.cc:385] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.659473 11126 raft_consensus.cc:740] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.660537 11126 consensus_queue.cc:260] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.662990 11126 ts_tablet_manager.cc:1434] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.049s	user 0.002s	sys 0.003s
I20260709 12:19:50.667248 11125 tablet_bootstrap.cc:654] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.671489 11131 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.672062 11131 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.674147 11131 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:50.677546 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:50.678983 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:50.679071 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:50.681676 11126 tablet_bootstrap.cc:492] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
W20260709 12:19:50.682104 10974 leader_election.cc:343] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.682545 10974 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:19:50.683748 10974 leader_election.cc:343] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.683589 10922 tablet_service.cc:1511] Processing CreateTablet for tablet d3625831778d468cb424c06fc474c323 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:19:50.686213 11131 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:50.687397 10977 leader_election.cc:343] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.688027 10977 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:50.688557 11126 tablet_bootstrap.cc:654] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.695170 11131 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:50.695463 11001 tablet_service.cc:1511] Processing CreateTablet for tablet b156bebcd53a4b6ea1f83c42906a5a03 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:19:50.697409 11001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b156bebcd53a4b6ea1f83c42906a5a03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.697736 10925 tablet_service.cc:1511] Processing CreateTablet for tablet b156bebcd53a4b6ea1f83c42906a5a03 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:19:50.698293 11128 tablet_bootstrap.cc:492] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:50.698848 11128 ts_tablet_manager.cc:1403] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.193s	user 0.007s	sys 0.014s
I20260709 12:19:50.698941 10925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b156bebcd53a4b6ea1f83c42906a5a03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.701488 10998 tablet_service.cc:1511] Processing CreateTablet for tablet d3625831778d468cb424c06fc474c323 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:19:50.702941 10998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3625831778d468cb424c06fc474c323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.702374 11128 raft_consensus.cc:359] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.703368 11128 raft_consensus.cc:385] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.703689 11128 raft_consensus.cc:740] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.704715 11128 consensus_queue.cc:260] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.708899 11073 tablet_service.cc:1511] Processing CreateTablet for tablet b156bebcd53a4b6ea1f83c42906a5a03 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:19:50.709303 10997 tablet_service.cc:1511] Processing CreateTablet for tablet 3b768aea2bd34049a2aa54e4f4f19bf6 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:19:50.710016 11126 tablet_bootstrap.cc:492] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:50.712426 10997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b768aea2bd34049a2aa54e4f4f19bf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.713263 11126 ts_tablet_manager.cc:1403] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.011s
I20260709 12:19:50.713346 11073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b156bebcd53a4b6ea1f83c42906a5a03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.712203 11069 tablet_service.cc:1511] Processing CreateTablet for tablet 3b768aea2bd34049a2aa54e4f4f19bf6 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:19:50.715749 11069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b768aea2bd34049a2aa54e4f4f19bf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.717839 11125 tablet_bootstrap.cc:492] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:50.717598 10924 tablet_service.cc:1511] Processing CreateTablet for tablet 3b768aea2bd34049a2aa54e4f4f19bf6 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:19:50.718317 11125 ts_tablet_manager.cc:1403] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.070s	user 0.011s	sys 0.000s
I20260709 12:19:50.718961 10924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b768aea2bd34049a2aa54e4f4f19bf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.720889 10923 tablet_service.cc:1511] Processing CreateTablet for tablet 661c79d4d9c74a30911ec88c18ba8229 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:19:50.721315 11125 raft_consensus.cc:359] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.722016 11125 raft_consensus.cc:385] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.722211 10923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 661c79d4d9c74a30911ec88c18ba8229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.722328 11125 raft_consensus.cc:740] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.723513 11126 raft_consensus.cc:359] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.724453 11126 raft_consensus.cc:385] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.724792 11126 raft_consensus.cc:740] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.724897 11072 tablet_service.cc:1511] Processing CreateTablet for tablet d3625831778d468cb424c06fc474c323 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:19:50.726279 11072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3625831778d468cb424c06fc474c323. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:50.726924 10882 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:50.726784 11125 consensus_queue.cc:260] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.725804 11126 consensus_queue.cc:260] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.731084 11126 ts_tablet_manager.cc:1434] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:19:50.732242 11126 tablet_bootstrap.cc:492] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:50.738561 11126 tablet_bootstrap.cc:654] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.729061 11125 ts_tablet_manager.cc:1434] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:19:50.739882 11125 tablet_bootstrap.cc:492] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:50.746054 11125 tablet_bootstrap.cc:654] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.754858 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:19:50.756364 10899 leader_election.cc:343] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.757136 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:50.757903 11011 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:50.759805 10901 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:50.760596 11110 heartbeater.cc:499] Master 127.9.131.126:46265 was elected leader, sending a full tablet report...
I20260709 12:19:50.761032 11130 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:50.761386 11130 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:50.761714 11130 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.761664 11128 ts_tablet_manager.cc:1434] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.002s
I20260709 12:19:50.764842 11128 tablet_bootstrap.cc:492] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:50.769662 10922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3625831778d468cb424c06fc474c323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.770083 11128 tablet_bootstrap.cc:654] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.772914 11126 tablet_bootstrap.cc:492] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:50.773475 11126 ts_tablet_manager.cc:1403] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.005s
I20260709 12:19:50.776436 11126 raft_consensus.cc:359] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.778082 11126 raft_consensus.cc:385] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.778838 11126 raft_consensus.cc:740] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.780426 11126 consensus_queue.cc:260] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.782351 10998 tablet_service.cc:1511] Processing CreateTablet for tablet 661c79d4d9c74a30911ec88c18ba8229 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:19:50.783850 10998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 661c79d4d9c74a30911ec88c18ba8229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.789544 11130 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.790999 10926 tablet_service.cc:1511] Processing CreateTablet for tablet 9b668506e6eb4a57aa83a9e45c3eb356 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:19:50.792341 10926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b668506e6eb4a57aa83a9e45c3eb356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.792549 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:50.793128 11011 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.793805 11128 tablet_bootstrap.cc:492] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:50.794306 11128 ts_tablet_manager.cc:1403] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.016s
I20260709 12:19:50.787588 11072 tablet_service.cc:1511] Processing CreateTablet for tablet 661c79d4d9c74a30911ec88c18ba8229 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:19:50.803931 11128 raft_consensus.cc:359] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.805416 11001 tablet_service.cc:1511] Processing CreateTablet for tablet 9b668506e6eb4a57aa83a9e45c3eb356 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:19:50.805763 11128 raft_consensus.cc:385] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.806169 11128 raft_consensus.cc:740] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.806690 11001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b668506e6eb4a57aa83a9e45c3eb356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.807039 11128 consensus_queue.cc:260] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.807363 11011 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:50.808797 10901 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:50.805697 11072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 661c79d4d9c74a30911ec88c18ba8229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.812979 11126 ts_tablet_manager.cc:1434] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.039s	user 0.013s	sys 0.001s
I20260709 12:19:50.813345 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:19:50.817591 10899 leader_election.cc:343] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.815081 11128 ts_tablet_manager.cc:1434] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:19:50.818158 11069 tablet_service.cc:1511] Processing CreateTablet for tablet 9b668506e6eb4a57aa83a9e45c3eb356 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:19:50.819233 11128 tablet_bootstrap.cc:492] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:50.822362 10921 tablet_service.cc:1511] Processing CreateTablet for tablet a8c81137a7dc49c9953309b2d9d22d7e (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:19:50.823735 10921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c81137a7dc49c9953309b2d9d22d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.825312 11125 tablet_bootstrap.cc:492] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:50.825834 11125 ts_tablet_manager.cc:1403] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.086s	user 0.010s	sys 0.014s
I20260709 12:19:50.822362 11126 tablet_bootstrap.cc:492] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:50.815714 11130 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:50.833482 11125 raft_consensus.cc:359] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.833868 11130 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:50.834245 11125 raft_consensus.cc:385] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.834437 11130 raft_consensus.cc:697] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:19:50.837709 11125 raft_consensus.cc:740] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.835443 11130 consensus_queue.cc:237] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.838724 11125 consensus_queue.cc:260] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.845755 11125 ts_tablet_manager.cc:1434] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 12:19:50.845877 11069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b668506e6eb4a57aa83a9e45c3eb356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.846815 11125 tablet_bootstrap.cc:492] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:50.850142 10997 tablet_service.cc:1511] Processing CreateTablet for tablet a8c81137a7dc49c9953309b2d9d22d7e (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:19:50.851477 10997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c81137a7dc49c9953309b2d9d22d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.854797 11125 tablet_bootstrap.cc:654] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.855747 11128 tablet_bootstrap.cc:654] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.867101 11126 tablet_bootstrap.cc:654] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.877281 11147 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.877821 11147 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.881822 11073 tablet_service.cc:1511] Processing CreateTablet for tablet a8c81137a7dc49c9953309b2d9d22d7e (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:19:50.883157 11073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c81137a7dc49c9953309b2d9d22d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.886929 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:50.887609 11084 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:50.888921 10899 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:50.889997 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:50.889963 10924 tablet_service.cc:1511] Processing CreateTablet for tablet 02ce8649e6b64336a3064cc1da978105 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:19:50.890833 11011 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:50.891590 10924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02ce8649e6b64336a3064cc1da978105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.892177 11146 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:50.892563 11146 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:50.893136 11146 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.899314 10999 tablet_service.cc:1511] Processing CreateTablet for tablet 02ce8649e6b64336a3064cc1da978105 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:19:50.904361 10999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02ce8649e6b64336a3064cc1da978105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.899953 11147 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:50.930603 11125 tablet_bootstrap.cc:492] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:50.931242 11125 ts_tablet_manager.cc:1403] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.085s	user 0.007s	sys 0.011s
I20260709 12:19:50.934478 11125 raft_consensus.cc:359] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.935357 11125 raft_consensus.cc:385] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.935675 11125 raft_consensus.cc:740] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.943143 11125 consensus_queue.cc:260] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.944253 11073 tablet_service.cc:1511] Processing CreateTablet for tablet 02ce8649e6b64336a3064cc1da978105 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:19:50.945554 11073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02ce8649e6b64336a3064cc1da978105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.948838 11128 tablet_bootstrap.cc:492] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:50.949445 11128 ts_tablet_manager.cc:1403] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.130s	user 0.043s	sys 0.051s
I20260709 12:19:50.962792 11126 tablet_bootstrap.cc:492] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:50.963352 11126 ts_tablet_manager.cc:1403] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.141s	user 0.020s	sys 0.017s
I20260709 12:19:50.963848 10832 catalog_manager.cc:5697] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:50.966420 11126 raft_consensus.cc:359] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.967190 11126 raft_consensus.cc:385] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.967517 11126 raft_consensus.cc:740] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.968304 11126 consensus_queue.cc:260] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.970474 11126 ts_tablet_manager.cc:1434] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:50.971429 11126 tablet_bootstrap.cc:492] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:50.973102 10997 tablet_service.cc:1511] Processing CreateTablet for tablet e76df1b7dc3b4bada7c1112da8ce327b (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:19:50.970126 10926 tablet_service.cc:1511] Processing CreateTablet for tablet e76df1b7dc3b4bada7c1112da8ce327b (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:19:50.974478 10997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e76df1b7dc3b4bada7c1112da8ce327b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.978091 11131 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.978590 11131 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.979615 11126 tablet_bootstrap.cc:654] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.980726 11131 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:50.981937 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:50.982219 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:50.982793 10936 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 0.
W20260709 12:19:50.983523 10974 leader_election.cc:343] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.974498 10926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e76df1b7dc3b4bada7c1112da8ce327b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.986397 10977 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:50.987658 11069 tablet_service.cc:1511] Processing CreateTablet for tablet e76df1b7dc3b4bada7c1112da8ce327b (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:19:50.990100 11126 tablet_bootstrap.cc:492] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:50.990170 11069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e76df1b7dc3b4bada7c1112da8ce327b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:50.990859 11142 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.991330 11142 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.993206 11128 raft_consensus.cc:359] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.999766 11128 raft_consensus.cc:385] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.996635 11146 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.005429 11128 raft_consensus.cc:740] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.000731 11142 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109)
I20260709 12:19:50.996088 11131 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:51.008378 11131 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.008481 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:51.008811 11131 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.009063 11011 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.009110 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:51.009815 11084 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.008656 11128 consensus_queue.cc:260] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.016245 11011 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:51.014657 11128 ts_tablet_manager.cc:1434] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.065s	user 0.016s	sys 0.000s
I20260709 12:19:51.006966 11146 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:51.017577 10901 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:51.017961 11128 tablet_bootstrap.cc:492] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:51.018450 11146 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:51.018954 11146 raft_consensus.cc:697] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:19:51.004720 11126 ts_tablet_manager.cc:1403] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.006s
I20260709 12:19:51.020939 11146 consensus_queue.cc:237] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:50.985051 11125 ts_tablet_manager.cc:1434] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.053s	user 0.014s	sys 0.007s
I20260709 12:19:51.022688 11126 raft_consensus.cc:359] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.006254 10924 tablet_service.cc:1511] Processing CreateTablet for tablet 660a349ad34749648cae6a025708c84d (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:19:51.024158 11125 tablet_bootstrap.cc:492] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:51.025265 11126 raft_consensus.cc:385] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.026518 11126 raft_consensus.cc:740] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.026829 10924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 660a349ad34749648cae6a025708c84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.027478 11126 consensus_queue.cc:260] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.029884 11126 ts_tablet_manager.cc:1434] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:19:51.016453 11131 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.035208 11131 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:51.036469 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:51.037098 10997 tablet_service.cc:1511] Processing CreateTablet for tablet 660a349ad34749648cae6a025708c84d (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:19:51.038684 10997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 660a349ad34749648cae6a025708c84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.038456 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:51.039247 11085 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.040445 11126 tablet_bootstrap.cc:492] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:51.037101 10936 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.047468 11126 tablet_bootstrap.cc:654] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.049149 11073 tablet_service.cc:1511] Processing CreateTablet for tablet 660a349ad34749648cae6a025708c84d (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:19:51.050486 11073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 660a349ad34749648cae6a025708c84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.053440 10921 tablet_service.cc:1511] Processing CreateTablet for tablet 0ccace425f6c4d5ea9588504233ffee0 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:19:51.054715 10921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ccace425f6c4d5ea9588504233ffee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.054968 10923 tablet_service.cc:1511] Processing CreateTablet for tablet f850953ee221438f81da7fc8c8b44f9b (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:19:51.056255 10923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f850953ee221438f81da7fc8c8b44f9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.056391 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:51.057075 10935 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:51.058547 11051 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:51.053442 10999 tablet_service.cc:1511] Processing CreateTablet for tablet 0ccace425f6c4d5ea9588504233ffee0 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:19:51.058799 11128 tablet_bootstrap.cc:654] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.061156 10999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ccace425f6c4d5ea9588504233ffee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.061884 11142 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:51.062266 11142 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.062994 11142 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.064338 11001 tablet_service.cc:1511] Processing CreateTablet for tablet f850953ee221438f81da7fc8c8b44f9b (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:19:51.020727 11084 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:51.062987 11125 tablet_bootstrap.cc:654] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.071619 11001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f850953ee221438f81da7fc8c8b44f9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.072679 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:51.072669 11072 tablet_service.cc:1511] Processing CreateTablet for tablet 0ccace425f6c4d5ea9588504233ffee0 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:19:51.074265 11011 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:51.074816 11072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ccace425f6c4d5ea9588504233ffee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.106581 10832 catalog_manager.cc:5697] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:51.112524 10936 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:19:51.113791 10977 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:51.114686 11131 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:51.118168 11131 raft_consensus.cc:697] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:19:51.119005 11131 consensus_queue.cc:237] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.120026 11128 tablet_bootstrap.cc:492] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:51.120519 11128 ts_tablet_manager.cc:1403] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.103s	user 0.022s	sys 0.029s
I20260709 12:19:51.123515 11128 raft_consensus.cc:359] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.124236 11128 raft_consensus.cc:385] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.124517 11128 raft_consensus.cc:740] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.125677 11128 consensus_queue.cc:260] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.130692 10921 tablet_service.cc:1511] Processing CreateTablet for tablet 38e2bba2f11943899027eb26325e2b6a (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:19:51.132067 10921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38e2bba2f11943899027eb26325e2b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.132143 11085 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:19:51.131850 10833 catalog_manager.cc:5697] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:51.142611 10926 tablet_service.cc:1511] Processing CreateTablet for tablet d3426d7ccdd943b882b65c3977a20040 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:19:51.144088 10926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3426d7ccdd943b882b65c3977a20040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.144979 11142 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.147151 11142 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109)
I20260709 12:19:51.149384 10999 tablet_service.cc:1511] Processing CreateTablet for tablet 38e2bba2f11943899027eb26325e2b6a (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:19:51.148645 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:51.150420 10936 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.150668 10999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38e2bba2f11943899027eb26325e2b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.151216 11069 tablet_service.cc:1511] Processing CreateTablet for tablet f850953ee221438f81da7fc8c8b44f9b (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:19:51.152462 11069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f850953ee221438f81da7fc8c8b44f9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.154201 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:51.154785 11011 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.155927 11146 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.156404 11146 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.158360 11146 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:51.165330 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:51.168244 11126 tablet_bootstrap.cc:492] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:51.167315 11010 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:51.168728 11126 ts_tablet_manager.cc:1403] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.129s	user 0.010s	sys 0.010s
I20260709 12:19:51.173020 10901 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:51.174072 11011 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:51.178222 11146 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:51.184891 11146 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.185245 11146 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.188709 11126 raft_consensus.cc:359] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.189504 11126 raft_consensus.cc:385] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.189769 11126 raft_consensus.cc:740] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.190447 11126 consensus_queue.cc:260] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.192267 11050 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:51.192852 11126 ts_tablet_manager.cc:1434] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.003s
I20260709 12:19:51.193701 11142 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:51.193965 11072 tablet_service.cc:1511] Processing CreateTablet for tablet 38e2bba2f11943899027eb26325e2b6a (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:19:51.195382 11072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38e2bba2f11943899027eb26325e2b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.196506 11126 tablet_bootstrap.cc:492] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:51.198925 10936 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:51.199913 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:19:51.201375 10899 leader_election.cc:343] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.201745 11142 raft_consensus.cc:697] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:19:51.202621 11142 consensus_queue.cc:237] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.207788 11126 tablet_bootstrap.cc:654] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.218753 10999 tablet_service.cc:1511] Processing CreateTablet for tablet d3426d7ccdd943b882b65c3977a20040 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:19:51.220269 10999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3426d7ccdd943b882b65c3977a20040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.224097 11125 tablet_bootstrap.cc:492] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:51.223579 11146 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.224617 11125 ts_tablet_manager.cc:1403] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.201s	user 0.023s	sys 0.004s
I20260709 12:19:51.224769 11128 ts_tablet_manager.cc:1434] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.104s	user 0.032s	sys 0.021s
I20260709 12:19:51.225769 11128 tablet_bootstrap.cc:492] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:51.227408 11073 tablet_service.cc:1511] Processing CreateTablet for tablet d3426d7ccdd943b882b65c3977a20040 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:19:51.228111 11125 raft_consensus.cc:359] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.228714 11073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3426d7ccdd943b882b65c3977a20040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.228883 11125 raft_consensus.cc:385] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.229243 11125 raft_consensus.cc:740] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.229988 11125 consensus_queue.cc:260] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.232005 11128 tablet_bootstrap.cc:654] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.233906 10926 tablet_service.cc:1511] Processing CreateTablet for tablet 0cb303f7380c4693b70bda660f0f86a6 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:19:51.237653 11001 tablet_service.cc:1511] Processing CreateTablet for tablet 0cb303f7380c4693b70bda660f0f86a6 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:19:51.238556 11074 tablet_service.cc:1511] Processing CreateTablet for tablet 0cb303f7380c4693b70bda660f0f86a6 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:19:51.242987 11001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cb303f7380c4693b70bda660f0f86a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.246016 11074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cb303f7380c4693b70bda660f0f86a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.251219 10997 tablet_service.cc:1511] Processing CreateTablet for tablet d9b41c3859494dab9f6f8bc6bccc8062 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:19:51.252728 10997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9b41c3859494dab9f6f8bc6bccc8062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.259907 10926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cb303f7380c4693b70bda660f0f86a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.265759 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:51.266423 11011 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.271028 10834 catalog_manager.cc:5697] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:51.272451 11165 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.280043 10921 tablet_service.cc:1511] Processing CreateTablet for tablet d9b41c3859494dab9f6f8bc6bccc8062 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:19:51.280845 11070 tablet_service.cc:1511] Processing CreateTablet for tablet d9b41c3859494dab9f6f8bc6bccc8062 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:19:51.281414 10921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9b41c3859494dab9f6f8bc6bccc8062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.282500 10924 tablet_service.cc:1511] Processing CreateTablet for tablet b1c7453ea4954ac4ad9465233dd1e839 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:19:51.290309 11075 tablet_service.cc:1511] Processing CreateTablet for tablet bda5e552d0f54d1daafad75449fbb509 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:19:51.283761 10924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1c7453ea4954ac4ad9465233dd1e839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.293210 11146 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:51.295336 11126 tablet_bootstrap.cc:492] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:51.295804 11126 ts_tablet_manager.cc:1403] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.100s	user 0.009s	sys 0.008s
I20260709 12:19:51.299929 10923 tablet_service.cc:1511] Processing CreateTablet for tablet bda5e552d0f54d1daafad75449fbb509 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:19:51.301275 10923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda5e552d0f54d1daafad75449fbb509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.301860 10925 tablet_service.cc:1511] Processing CreateTablet for tablet 2ab5cd1b86b54cb89fdd3eef419ac66a (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:19:51.303395 10925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ab5cd1b86b54cb89fdd3eef419ac66a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.297688 11165 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.305012 10998 tablet_service.cc:1511] Processing CreateTablet for tablet b1c7453ea4954ac4ad9465233dd1e839 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:19:51.287433 11071 tablet_service.cc:1511] Processing CreateTablet for tablet b1c7453ea4954ac4ad9465233dd1e839 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:19:51.306381 10998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1c7453ea4954ac4ad9465233dd1e839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.307500 11075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda5e552d0f54d1daafad75449fbb509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.308434 11000 tablet_service.cc:1511] Processing CreateTablet for tablet bda5e552d0f54d1daafad75449fbb509 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:19:51.309587 11070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9b41c3859494dab9f6f8bc6bccc8062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.309856 11000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda5e552d0f54d1daafad75449fbb509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.310199 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:51.310448 10996 tablet_service.cc:1511] Processing CreateTablet for tablet 2ab5cd1b86b54cb89fdd3eef419ac66a (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:19:51.311255 11128 tablet_bootstrap.cc:492] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:51.311704 10996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ab5cd1b86b54cb89fdd3eef419ac66a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:51.311668 10899 leader_election.cc:343] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.311733 11128 ts_tablet_manager.cc:1403] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.086s	user 0.009s	sys 0.031s
I20260709 12:19:51.314540 11071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1c7453ea4954ac4ad9465233dd1e839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.315657 11165 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:51.315822 11128 raft_consensus.cc:359] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.317320 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:51.321300 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:51.326524 10936 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
W20260709 12:19:51.329280 11050 leader_election.cc:343] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.330293 11051 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:51.327474 11068 tablet_service.cc:1511] Processing CreateTablet for tablet 2ab5cd1b86b54cb89fdd3eef419ac66a (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:19:51.287446 11011 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:51.333189 11068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ab5cd1b86b54cb89fdd3eef419ac66a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.335104 11126 raft_consensus.cc:359] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.336465 11146 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:51.348398 11165 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:51.348853 10901 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:51.349519 11125 ts_tablet_manager.cc:1434] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.125s	user 0.007s	sys 0.001s
I20260709 12:19:51.350085 11146 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:51.350555 11125 tablet_bootstrap.cc:492] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:51.324204 11128 raft_consensus.cc:385] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.351644 11128 raft_consensus.cc:740] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.352537 11128 consensus_queue.cc:260] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.335845 11126 raft_consensus.cc:385] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.361924 11126 raft_consensus.cc:740] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.363123 10922 tablet_service.cc:1511] Processing CreateTablet for tablet 83b4e206b7694af695234c0e758055e2 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:19:51.364454 10922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83b4e206b7694af695234c0e758055e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.366586 10995 tablet_service.cc:1511] Processing CreateTablet for tablet 83b4e206b7694af695234c0e758055e2 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:19:51.364089 11126 consensus_queue.cc:260] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.368880 11126 ts_tablet_manager.cc:1434] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.000s
I20260709 12:19:51.351262 11146 raft_consensus.cc:697] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:19:51.369581 11085 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.369776 11146 consensus_queue.cc:237] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.368965 10995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83b4e206b7694af695234c0e758055e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.348834 11165 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.373867 11165 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.382390 11130 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:51.354758 11128 ts_tablet_manager.cc:1434] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.000s
I20260709 12:19:51.387338 10920 tablet_service.cc:1511] Processing CreateTablet for tablet dc9fc876e22f4072a34df693254c2f5e (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:19:51.389019 11126 tablet_bootstrap.cc:492] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:51.392889 11073 tablet_service.cc:1511] Processing CreateTablet for tablet 83b4e206b7694af695234c0e758055e2 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:19:51.394194 11073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83b4e206b7694af695234c0e758055e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.398676 10920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc9fc876e22f4072a34df693254c2f5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.401976 11125 tablet_bootstrap.cc:654] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.404426 11001 tablet_service.cc:1511] Processing CreateTablet for tablet dc9fc876e22f4072a34df693254c2f5e (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:19:51.397789 11165 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.411398 11128 tablet_bootstrap.cc:492] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:51.443465 10999 tablet_service.cc:1511] Processing CreateTablet for tablet 33ccd4bc26b14304b81583bf6a6d3efb (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:19:51.446286 10921 tablet_service.cc:1511] Processing CreateTablet for tablet f0bf4b65018642ba928b62c815b01489 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:19:51.447682 10921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0bf4b65018642ba928b62c815b01489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.463567 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:51.463884 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:51.464322 10936 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:51.465440 11050 leader_election.cc:343] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.466563 11165 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:51.468811 10926 tablet_service.cc:1511] Processing CreateTablet for tablet 33ccd4bc26b14304b81583bf6a6d3efb (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:19:51.470019 10926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ccd4bc26b14304b81583bf6a6d3efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.468849 11126 tablet_bootstrap.cc:654] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.471148 10936 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:51.472437 11051 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:51.480050 11165 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:51.480737 11165 raft_consensus.cc:697] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:19:51.501746 10834 catalog_manager.cc:5697] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:51.506516 11000 tablet_service.cc:1511] Processing CreateTablet for tablet f0bf4b65018642ba928b62c815b01489 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:19:51.506906 10994 tablet_service.cc:1511] Processing CreateTablet for tablet 9a101fb991414a5f840476aaa2d8e5b3 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:19:51.496762 11165 consensus_queue.cc:237] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.512856 11071 tablet_service.cc:1511] Processing CreateTablet for tablet f0bf4b65018642ba928b62c815b01489 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:19:51.522020 11126 tablet_bootstrap.cc:492] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:51.521944 11073 tablet_service.cc:1511] Processing CreateTablet for tablet 9a101fb991414a5f840476aaa2d8e5b3 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:19:51.522542 11126 ts_tablet_manager.cc:1403] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.134s	user 0.014s	sys 0.003s
I20260709 12:19:51.523497 10926 tablet_service.cc:1511] Processing CreateTablet for tablet 9a101fb991414a5f840476aaa2d8e5b3 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:19:51.524962 11001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc9fc876e22f4072a34df693254c2f5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.525496 11126 raft_consensus.cc:359] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.526263 11126 raft_consensus.cc:385] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.526525 11126 raft_consensus.cc:740] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.526846 10926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a101fb991414a5f840476aaa2d8e5b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.528766 11126 consensus_queue.cc:260] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.530700 10923 tablet_service.cc:1511] Processing CreateTablet for tablet 5b7e00767e0a443fab6f928812d5f6e2 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:19:51.532101 10923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b7e00767e0a443fab6f928812d5f6e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.532430 11126 ts_tablet_manager.cc:1434] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:19:51.533499 11126 tablet_bootstrap.cc:492] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:51.536599 10999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ccd4bc26b14304b81583bf6a6d3efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.537914 11125 tablet_bootstrap.cc:492] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:51.538153 11161 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:51.538527 11125 ts_tablet_manager.cc:1403] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.188s	user 0.023s	sys 0.019s
I20260709 12:19:51.538415 11075 tablet_service.cc:1511] Processing CreateTablet for tablet 33ccd4bc26b14304b81583bf6a6d3efb (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:19:51.540834 11071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0bf4b65018642ba928b62c815b01489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.544800 11000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0bf4b65018642ba928b62c815b01489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.539340 11074 tablet_service.cc:1511] Processing CreateTablet for tablet dc9fc876e22f4072a34df693254c2f5e (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:19:51.549587 11125 raft_consensus.cc:359] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.552235 11125 raft_consensus.cc:385] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.552575 11125 raft_consensus.cc:740] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.553448 11125 consensus_queue.cc:260] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.565068 11128 tablet_bootstrap.cc:654] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.566581 11161 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:51.567109 11126 tablet_bootstrap.cc:654] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.567934 11073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a101fb991414a5f840476aaa2d8e5b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.569291 11074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc9fc876e22f4072a34df693254c2f5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.570479 10999 tablet_service.cc:1511] Processing CreateTablet for tablet 5b7e00767e0a443fab6f928812d5f6e2 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:19:51.572185 11075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ccd4bc26b14304b81583bf6a6d3efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.574303 10921 tablet_service.cc:1511] Processing CreateTablet for tablet 59db2d2bb22c41aebd0d2073e2ba7d52 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:19:51.571753 11069 tablet_service.cc:1511] Processing CreateTablet for tablet 5b7e00767e0a443fab6f928812d5f6e2 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:19:51.581743 11068 tablet_service.cc:1511] Processing CreateTablet for tablet 59db2d2bb22c41aebd0d2073e2ba7d52 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:19:51.575286 11130 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:51.584086 11131 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.584584 11131 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.577781 10998 tablet_service.cc:1511] Processing CreateTablet for tablet 59db2d2bb22c41aebd0d2073e2ba7d52 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:19:51.586717 11131 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:51.581735 11069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b7e00767e0a443fab6f928812d5f6e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.588351 10994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a101fb991414a5f840476aaa2d8e5b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.588487 11068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59db2d2bb22c41aebd0d2073e2ba7d52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.589624 11125 ts_tablet_manager.cc:1434] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.002s
I20260709 12:19:51.589495 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:51.590147 10935 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 0.
I20260709 12:19:51.590915 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:51.591724 10977 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:19:51.592411 10974 leader_election.cc:343] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.593176 11131 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:51.593561 11131 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.593789 11125 tablet_bootstrap.cc:492] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:51.593874 11131 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.594098 10998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59db2d2bb22c41aebd0d2073e2ba7d52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.597422 10995 tablet_service.cc:1511] Processing CreateTablet for tablet d88dec874a3240d69746dfb302cf057e (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:19:51.598531 10921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59db2d2bb22c41aebd0d2073e2ba7d52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.598758 10995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88dec874a3240d69746dfb302cf057e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.583536 10920 tablet_service.cc:1511] Processing CreateTablet for tablet d88dec874a3240d69746dfb302cf057e (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:19:51.608990 11130 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:51.609885 11142 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:51.610088 10920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88dec874a3240d69746dfb302cf057e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.626742 10999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b7e00767e0a443fab6f928812d5f6e2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:51.663216 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 70382.4us
I20260709 12:19:51.688256 11126 tablet_bootstrap.cc:492] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:51.688678 11126 ts_tablet_manager.cc:1403] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.155s	user 0.013s	sys 0.004s
I20260709 12:19:51.693539 11131 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.698145 11142 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:51.708117 11173 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.708639 11173 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.710899 11173 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:51.695761 11131 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:51.719274 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:51.719841 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:51.720408 10999 tablet_service.cc:1511] Processing CreateTablet for tablet f1b28a94627d4cbd8f41c75a4ef23953 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
W20260709 12:19:51.721395 10901 leader_election.cc:343] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.722554 10834 catalog_manager.cc:5697] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:51.721665 10999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b28a94627d4cbd8f41c75a4ef23953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.719925 10935 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.717533 11074 tablet_service.cc:1511] Processing CreateTablet for tablet d88dec874a3240d69746dfb302cf057e (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:19:51.734990 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:51.736240 11074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88dec874a3240d69746dfb302cf057e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:51.738469 10899 leader_election.cc:343] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.739007 10899 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:51.740018 11130 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:51.744235 10926 tablet_service.cc:1511] Processing CreateTablet for tablet f1b28a94627d4cbd8f41c75a4ef23953 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:19:51.745524 10926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b28a94627d4cbd8f41c75a4ef23953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.756217 11073 tablet_service.cc:1511] Processing CreateTablet for tablet f1b28a94627d4cbd8f41c75a4ef23953 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:19:51.757411 11073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b28a94627d4cbd8f41c75a4ef23953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.769580 11126 raft_consensus.cc:359] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.771060 11126 raft_consensus.cc:385] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.771504 11126 raft_consensus.cc:740] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.779625 11126 consensus_queue.cc:260] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.782140 11128 tablet_bootstrap.cc:492] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:51.782671 11128 ts_tablet_manager.cc:1403] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.372s	user 0.022s	sys 0.022s
I20260709 12:19:51.784876 11126 ts_tablet_manager.cc:1434] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.096s	user 0.006s	sys 0.001s
I20260709 12:19:51.786079 11126 tablet_bootstrap.cc:492] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:51.785605 11128 raft_consensus.cc:359] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.786513 11128 raft_consensus.cc:385] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.786814 11128 raft_consensus.cc:740] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.787708 11128 consensus_queue.cc:260] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.789614 11125 tablet_bootstrap.cc:700] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: Time spent opening tablet: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:19:51.790206 11128 ts_tablet_manager.cc:1434] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:19:51.790321 11125 tablet_bootstrap.cc:654] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.792699 11126 tablet_bootstrap.cc:654] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.764542 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:51.810631 10923 tablet_service.cc:1511] Processing CreateTablet for tablet 0774d95f5c1b4bdb990e50f5d858b600 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 12:19:51.811419 10882 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:51.812372 10923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0774d95f5c1b4bdb990e50f5d858b600. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:51.815534 10974 leader_election.cc:343] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.820919 10994 tablet_service.cc:1511] Processing CreateTablet for tablet 0774d95f5c1b4bdb990e50f5d858b600 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:19:51.822330 10994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0774d95f5c1b4bdb990e50f5d858b600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.829149 11128 tablet_bootstrap.cc:492] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:51.847047 11128 tablet_bootstrap.cc:654] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.846460 10935 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:19:51.851138 10977 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:51.852705 11188 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:51.853274 11188 raft_consensus.cc:697] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:19:51.854171 11188 consensus_queue.cc:237] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.889309 11071 tablet_service.cc:1511] Processing CreateTablet for tablet 0774d95f5c1b4bdb990e50f5d858b600 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:19:51.890650 11071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0774d95f5c1b4bdb990e50f5d858b600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.900759 10920 tablet_service.cc:1511] Processing CreateTablet for tablet 5e9e7be3e0bf4a1fa43f868eaf3e2c80 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:19:51.902084 10920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e9e7be3e0bf4a1fa43f868eaf3e2c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.902134 10998 tablet_service.cc:1511] Processing CreateTablet for tablet 5e9e7be3e0bf4a1fa43f868eaf3e2c80 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:19:51.903447 10998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e9e7be3e0bf4a1fa43f868eaf3e2c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.908157 11125 tablet_bootstrap.cc:492] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:51.908653 11125 ts_tablet_manager.cc:1403] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.315s	user 0.010s	sys 0.030s
I20260709 12:19:51.912391 10995 tablet_service.cc:1511] Processing CreateTablet for tablet 11f1b75a0edb45d493bb20e8a0f34156 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:19:51.913810 10995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11f1b75a0edb45d493bb20e8a0f34156. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.913908 11125 raft_consensus.cc:359] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.914311 11069 tablet_service.cc:1511] Processing CreateTablet for tablet 5e9e7be3e0bf4a1fa43f868eaf3e2c80 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:19:51.915583 11069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e9e7be3e0bf4a1fa43f868eaf3e2c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.922770 10923 tablet_service.cc:1511] Processing CreateTablet for tablet 11f1b75a0edb45d493bb20e8a0f34156 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:19:51.914724 11125 raft_consensus.cc:385] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.924129 11125 raft_consensus.cc:740] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.924937 10923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11f1b75a0edb45d493bb20e8a0f34156. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.924904 11125 consensus_queue.cc:260] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.929205 11125 ts_tablet_manager.cc:1434] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.020s	user 0.001s	sys 0.005s
I20260709 12:19:51.931499 11068 tablet_service.cc:1511] Processing CreateTablet for tablet 11f1b75a0edb45d493bb20e8a0f34156 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:19:51.932726 11126 tablet_bootstrap.cc:492] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:51.933312 11126 ts_tablet_manager.cc:1403] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.147s	user 0.015s	sys 0.020s
I20260709 12:19:51.932803 11068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11f1b75a0edb45d493bb20e8a0f34156. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.939383 11126 raft_consensus.cc:359] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.940896 11126 raft_consensus.cc:385] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.941404 11126 raft_consensus.cc:740] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.941926 11173 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.942119 11126 consensus_queue.cc:260] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.942440 11173 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.943054 11128 tablet_bootstrap.cc:492] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:51.943539 11128 ts_tablet_manager.cc:1403] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.115s	user 0.019s	sys 0.021s
I20260709 12:19:51.943652 11085 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.944676 11173 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:51.946573 11126 ts_tablet_manager.cc:1434] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:19:51.946485 11128 raft_consensus.cc:359] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.947371 11128 raft_consensus.cc:385] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.947795 11126 tablet_bootstrap.cc:492] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:51.947714 11128 raft_consensus.cc:740] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.950289 11128 consensus_queue.cc:260] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.951108 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:19:51.952796 10899 leader_election.cc:343] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.953146 11128 ts_tablet_manager.cc:1434] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 12:19:51.954295 11125 tablet_bootstrap.cc:492] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:51.954726 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:19:51.956171 10901 leader_election.cc:343] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.956637 10901 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:51.960108 11173 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:51.960722 11130 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:51.963683 11126 tablet_bootstrap.cc:654] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.959717 11125 tablet_bootstrap.cc:654] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.965621 11128 tablet_bootstrap.cc:492] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:51.973630 11188 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.974189 11188 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:51.975809 11128 tablet_bootstrap.cc:654] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.977195 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:51.977983 10936 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 1: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:19:51.980052 11188 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:51.981163 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:51.981477 10926 tablet_service.cc:1511] Processing CreateTablet for tablet 07467552f78d410bb9e5774f3340f134 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:19:51.982673 10926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07467552f78d410bb9e5774f3340f134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.982774 10974 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:51.983992 11188 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.994143 11188 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:51.998896 11194 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.999799 11194 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.002609 10834 catalog_manager.cc:5697] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:52.007956 11194 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:52.008201 11146 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:19:52.015730 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:52.020154 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:52.021688 10923 tablet_service.cc:1511] Processing CreateTablet for tablet ba629b94057b4c4e9085289ea50b42f1 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:19:52.023115 10923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba629b94057b4c4e9085289ea50b42f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.025945 10998 tablet_service.cc:1511] Processing CreateTablet for tablet ba629b94057b4c4e9085289ea50b42f1 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:19:52.027176 10998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba629b94057b4c4e9085289ea50b42f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.027204 10995 tablet_service.cc:1511] Processing CreateTablet for tablet 07467552f78d410bb9e5774f3340f134 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:19:52.026000 11051 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:52.028527 10995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07467552f78d410bb9e5774f3340f134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.023051 11069 tablet_service.cc:1511] Processing CreateTablet for tablet 07467552f78d410bb9e5774f3340f134 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:19:52.030470 11069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07467552f78d410bb9e5774f3340f134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.032717 11126 tablet_bootstrap.cc:492] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:52.033219 11126 ts_tablet_manager.cc:1403] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.086s	user 0.012s	sys 0.000s
I20260709 12:19:52.035842 11126 raft_consensus.cc:359] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.036553 11126 raft_consensus.cc:385] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.036818 11126 raft_consensus.cc:740] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.037446 11126 consensus_queue.cc:260] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.039810 11126 ts_tablet_manager.cc:1434] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:19:52.040709 11126 tablet_bootstrap.cc:492] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:52.041335 11071 tablet_service.cc:1511] Processing CreateTablet for tablet ba629b94057b4c4e9085289ea50b42f1 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:19:52.042569 11071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba629b94057b4c4e9085289ea50b42f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.046255 11126 tablet_bootstrap.cc:654] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.048666 10926 tablet_service.cc:1511] Processing CreateTablet for tablet edeb14680d6b4c7b95eed2b196750242 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:19:52.049839 10926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edeb14680d6b4c7b95eed2b196750242. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.051120 10994 tablet_service.cc:1511] Processing CreateTablet for tablet edeb14680d6b4c7b95eed2b196750242 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:19:52.060949 10994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edeb14680d6b4c7b95eed2b196750242. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.063539 11142 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:52.067723 11037 tablet.cc:2406] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:19:52.082407 11125 tablet_bootstrap.cc:492] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:52.083014 11125 ts_tablet_manager.cc:1403] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.129s	user 0.008s	sys 0.021s
I20260709 12:19:52.085973 11125 raft_consensus.cc:359] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.086776 11125 raft_consensus.cc:385] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.087078 11125 raft_consensus.cc:740] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.092034 11125 consensus_queue.cc:260] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.098067 10923 tablet_service.cc:1511] Processing CreateTablet for tablet c1b75831227444d382e9c0fc5b367564 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:19:52.098645 11074 tablet_service.cc:1511] Processing CreateTablet for tablet edeb14680d6b4c7b95eed2b196750242 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:19:52.099378 10923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b75831227444d382e9c0fc5b367564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.099967 11074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edeb14680d6b4c7b95eed2b196750242. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.099454 10995 tablet_service.cc:1511] Processing CreateTablet for tablet c1b75831227444d382e9c0fc5b367564 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:19:52.102092 11125 ts_tablet_manager.cc:1434] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 12:19:52.103154 11125 tablet_bootstrap.cc:492] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:52.103786 11194 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:52.111737 10995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b75831227444d382e9c0fc5b367564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.116142 11146 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.116822 11146 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.119068 11146 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:52.120958 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:52.123689 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:52.124228 10926 tablet_service.cc:1511] Processing CreateTablet for tablet 9b6c427f0a234dbab806dced4d3ba0fb (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:19:52.125439 10926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b6c427f0a234dbab806dced4d3ba0fb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:52.125684 10901 leader_election.cc:343] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:52.127425 10899 leader_election.cc:343] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.127948 10899 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:52.137612 11188 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.138183 11188 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.140466 11188 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:52.142835 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:52.143976 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:19:52.144331 10974 leader_election.cc:343] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.145020 11130 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.145555 11130 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.147846 11130 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:52.158766 11146 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:52.148303 11194 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:19:52.148542 10936 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 0.
I20260709 12:19:52.166213 10977 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:52.166559 11128 tablet_bootstrap.cc:492] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:52.167208 11128 ts_tablet_manager.cc:1403] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.202s	user 0.008s	sys 0.016s
I20260709 12:19:52.167888 11188 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:52.168335 11188 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.168700 11188 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.171458 11128 raft_consensus.cc:359] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.172276 11128 raft_consensus.cc:385] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.172608 11128 raft_consensus.cc:740] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.168794 11125 tablet_bootstrap.cc:654] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.173463 11128 consensus_queue.cc:260] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.157061 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:52.177260 11011 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:52.177433 10994 tablet_service.cc:1511] Processing CreateTablet for tablet 9b6c427f0a234dbab806dced4d3ba0fb (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:19:52.176760 11126 tablet_bootstrap.cc:492] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:52.178800 10994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b6c427f0a234dbab806dced4d3ba0fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.154410 11068 tablet_service.cc:1511] Processing CreateTablet for tablet c1b75831227444d382e9c0fc5b367564 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:19:52.179272 11126 ts_tablet_manager.cc:1403] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.139s	user 0.012s	sys 0.014s
I20260709 12:19:52.179724 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:52.180233 10901 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:52.182263 11146 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:52.182086 11126 raft_consensus.cc:359] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.182657 11146 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.183048 11146 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.184458 11128 ts_tablet_manager.cc:1434] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:19:52.187566 11126 raft_consensus.cc:385] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.188141 11126 raft_consensus.cc:740] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.191133 11128 tablet_bootstrap.cc:492] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:52.196372 11069 tablet_service.cc:1511] Processing CreateTablet for tablet 9b6c427f0a234dbab806dced4d3ba0fb (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:19:52.198087 11068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b75831227444d382e9c0fc5b367564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.198676 11069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b6c427f0a234dbab806dced4d3ba0fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.200742 11188 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:19:52.182096 10899 leader_election.cc:343] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.205359 11126 consensus_queue.cc:260] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.208326 10998 tablet_service.cc:1511] Processing CreateTablet for tablet 097e40d4693b49118b91e7a4fd8e8eb1 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:19:52.209416 10998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 097e40d4693b49118b91e7a4fd8e8eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.210469 10926 tablet_service.cc:1511] Processing CreateTablet for tablet 097e40d4693b49118b91e7a4fd8e8eb1 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:19:52.211414 10926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 097e40d4693b49118b91e7a4fd8e8eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.215400 11126 ts_tablet_manager.cc:1434] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.036s	user 0.002s	sys 0.004s
I20260709 12:19:52.216572 11126 tablet_bootstrap.cc:492] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:52.221658 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:52.222314 10936 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.229305 11000 tablet_service.cc:1511] Processing CreateTablet for tablet c88db1b2c7304a19a16c4f9b17c02e8e (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:19:52.229668 10999 tablet_service.cc:1511] Processing CreateTablet for tablet 80db8b3fbfd046e8a5535ff4a7380107 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:19:52.230628 11000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c88db1b2c7304a19a16c4f9b17c02e8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.235190 10999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80db8b3fbfd046e8a5535ff4a7380107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.235388 11071 tablet_service.cc:1511] Processing CreateTablet for tablet c88db1b2c7304a19a16c4f9b17c02e8e (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:19:52.235940 10920 tablet_service.cc:1511] Processing CreateTablet for tablet 6aa58b8bde194f658aced897744b4d35 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:19:52.236718 11071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c88db1b2c7304a19a16c4f9b17c02e8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.237239 10920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aa58b8bde194f658aced897744b4d35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.238656 11074 tablet_service.cc:1511] Processing CreateTablet for tablet 80db8b3fbfd046e8a5535ff4a7380107 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:19:52.240015 11074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80db8b3fbfd046e8a5535ff4a7380107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.243053 11194 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.243589 11194 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.245754 11194 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:52.246281 10936 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:19:52.246810 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:52.247423 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:52.247635 10934 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:52.247893 10923 tablet_service.cc:1511] Processing CreateTablet for tablet 80db8b3fbfd046e8a5535ff4a7380107 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:19:52.249754 10977 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:19:52.252177 11050 leader_election.cc:343] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.252962 11051 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:52.254149 11186 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:52.254655 11186 raft_consensus.cc:697] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:19:52.255131 11128 tablet_bootstrap.cc:654] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.255019 11194 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:52.255479 11186 consensus_queue.cc:237] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.257925 11125 tablet_bootstrap.cc:492] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:52.258442 11125 ts_tablet_manager.cc:1403] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.155s	user 0.027s	sys 0.046s
I20260709 12:19:52.259164 10923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80db8b3fbfd046e8a5535ff4a7380107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.261622 11125 raft_consensus.cc:359] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.262470 11125 raft_consensus.cc:385] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.262809 11125 raft_consensus.cc:740] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.263162 11069 tablet_service.cc:1511] Processing CreateTablet for tablet 097e40d4693b49118b91e7a4fd8e8eb1 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:19:52.253283 11146 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.255482 11194 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.265300 11194 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.262151 11126 tablet_bootstrap.cc:654] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.263576 11125 consensus_queue.cc:260] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.268428 11125 ts_tablet_manager.cc:1434] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 12:19:52.268227 11001 tablet_service.cc:1511] Processing CreateTablet for tablet 6aa58b8bde194f658aced897744b4d35 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:19:52.264305 11069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 097e40d4693b49118b91e7a4fd8e8eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.269416 11001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aa58b8bde194f658aced897744b4d35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.269735 11073 tablet_service.cc:1511] Processing CreateTablet for tablet 6aa58b8bde194f658aced897744b4d35 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:19:52.270865 11073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aa58b8bde194f658aced897744b4d35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.269407 11125 tablet_bootstrap.cc:492] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:52.274080 11181 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:52.275971 10921 tablet_service.cc:1511] Processing CreateTablet for tablet f56f49dc9fb94be0bc1eba5a2b97049c (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:19:52.277360 10921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56f49dc9fb94be0bc1eba5a2b97049c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.278096 10997 tablet_service.cc:1511] Processing CreateTablet for tablet f56f49dc9fb94be0bc1eba5a2b97049c (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:19:52.276095 10926 tablet_service.cc:1511] Processing CreateTablet for tablet c88db1b2c7304a19a16c4f9b17c02e8e (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:19:52.279421 10997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56f49dc9fb94be0bc1eba5a2b97049c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.279986 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:52.273097 11188 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:52.281366 10926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c88db1b2c7304a19a16c4f9b17c02e8e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:52.283836 10974 leader_election.cc:343] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.287657 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:52.288436 11011 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.307816 11075 tablet_service.cc:1511] Processing CreateTablet for tablet f56f49dc9fb94be0bc1eba5a2b97049c (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:19:52.309160 11075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56f49dc9fb94be0bc1eba5a2b97049c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.314327 10920 tablet_service.cc:1511] Processing CreateTablet for tablet 8151fe64a0a84d44a837cc6abf316707 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:19:52.315733 10920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8151fe64a0a84d44a837cc6abf316707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.315335 10999 tablet_service.cc:1511] Processing CreateTablet for tablet 8151fe64a0a84d44a837cc6abf316707 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:19:52.316789 10999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8151fe64a0a84d44a837cc6abf316707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.316869 11072 tablet_service.cc:1511] Processing CreateTablet for tablet 8151fe64a0a84d44a837cc6abf316707 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:19:52.318375 11072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8151fe64a0a84d44a837cc6abf316707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.358930 11146 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:52.363752 11128 tablet_bootstrap.cc:492] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:52.364259 11128 ts_tablet_manager.cc:1403] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.173s	user 0.023s	sys 0.013s
I20260709 12:19:52.364718 11085 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.366868 10925 tablet_service.cc:1511] Processing CreateTablet for tablet 62cfdf78af4046beba4a418e904e80b1 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:19:52.367286 10922 tablet_service.cc:1511] Processing CreateTablet for tablet c4e2dd59ef5642098b4166c9da8d596d (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:19:52.367435 10998 tablet_service.cc:1511] Processing CreateTablet for tablet 62cfdf78af4046beba4a418e904e80b1 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:19:52.368652 10998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62cfdf78af4046beba4a418e904e80b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.368711 10922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4e2dd59ef5642098b4166c9da8d596d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.370414 10925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62cfdf78af4046beba4a418e904e80b1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:52.401973 11203 log.cc:927] Time spent T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:19:52.403028 11126 tablet_bootstrap.cc:492] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:52.403528 11126 ts_tablet_manager.cc:1403] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.187s	user 0.012s	sys 0.019s
I20260709 12:19:52.400490 11194 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.408049 11194 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:52.413421 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:52.414048 10934 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.416695 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:19:52.428066 10899 leader_election.cc:343] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.425372 10924 tablet_service.cc:1511] Processing CreateTablet for tablet 597a004d154c4012ba8a1037b80c0109 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:19:52.430572 10924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 597a004d154c4012ba8a1037b80c0109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.439523 11125 tablet_bootstrap.cc:654] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.417722 11011 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:52.431202 10834 catalog_manager.cc:5697] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:52.447000 11146 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.447513 11146 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.449031 11070 tablet_service.cc:1511] Processing CreateTablet for tablet 62cfdf78af4046beba4a418e904e80b1 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:19:52.449577 11146 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:52.450374 11070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62cfdf78af4046beba4a418e904e80b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.451145 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:19:52.460163 10901 leader_election.cc:343] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.454847 11128 raft_consensus.cc:359] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.468609 11128 raft_consensus.cc:385] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.468854 11128 raft_consensus.cc:740] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.468839 11001 tablet_service.cc:1511] Processing CreateTablet for tablet 597a004d154c4012ba8a1037b80c0109 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:19:52.470084 11001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 597a004d154c4012ba8a1037b80c0109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.469740 11128 consensus_queue.cc:260] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.472034 10923 tablet_service.cc:1511] Processing CreateTablet for tablet 970339bba6a8454e8c722b4367924db8 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:19:52.472635 10901 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:52.475612 11146 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:52.476354 11146 raft_consensus.cc:697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:19:52.477205 11146 consensus_queue.cc:237] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.478302 10995 tablet_service.cc:1511] Processing CreateTablet for tablet e4d1425ae0d743b7be813705b92d4e15 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:19:52.480374 10919 tablet_service.cc:1511] Processing CreateTablet for tablet e6f7148e567a4f6da2aa56002e55b027 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:19:52.481833 11128 ts_tablet_manager.cc:1434] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.117s	user 0.007s	sys 0.005s
I20260709 12:19:52.482106 10996 tablet_service.cc:1511] Processing CreateTablet for tablet e6f7148e567a4f6da2aa56002e55b027 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:19:52.482781 11128 tablet_bootstrap.cc:492] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:52.484681 10926 tablet_service.cc:1511] Processing CreateTablet for tablet e4d1425ae0d743b7be813705b92d4e15 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:19:52.478242 10999 tablet_service.cc:1511] Processing CreateTablet for tablet 970339bba6a8454e8c722b4367924db8 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:19:52.487955 10996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f7148e567a4f6da2aa56002e55b027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.489233 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:52.489481 10999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 970339bba6a8454e8c722b4367924db8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.489892 11009 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.490311 11072 tablet_service.cc:1511] Processing CreateTablet for tablet c4e2dd59ef5642098b4166c9da8d596d (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:19:52.491415 11072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4e2dd59ef5642098b4166c9da8d596d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.491910 10995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4d1425ae0d743b7be813705b92d4e15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.494621 11068 tablet_service.cc:1511] Processing CreateTablet for tablet 970339bba6a8454e8c722b4367924db8 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:19:52.496058 11068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 970339bba6a8454e8c722b4367924db8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.469813 10997 tablet_service.cc:1511] Processing CreateTablet for tablet c4e2dd59ef5642098b4166c9da8d596d (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:19:52.499696 10997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4e2dd59ef5642098b4166c9da8d596d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.501156 11073 tablet_service.cc:1511] Processing CreateTablet for tablet e4d1425ae0d743b7be813705b92d4e15 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:19:52.502388 11073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4d1425ae0d743b7be813705b92d4e15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.496074 11069 tablet_service.cc:1511] Processing CreateTablet for tablet 597a004d154c4012ba8a1037b80c0109 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:19:52.507077 11069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 597a004d154c4012ba8a1037b80c0109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.509212 11067 tablet_service.cc:1511] Processing CreateTablet for tablet e6f7148e567a4f6da2aa56002e55b027 (DEFAULT_TABLE table=test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:19:52.510577 11067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f7148e567a4f6da2aa56002e55b027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.467743 10934 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:52.527652 11051 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:52.529176 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:52.530331 11142 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:52.530840 11142 raft_consensus.cc:697] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:19:52.537460 11142 consensus_queue.cc:237] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:19:52.548430 10899 leader_election.cc:343] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.548967 10899 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:52.549813 11130 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:52.549191 10923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 970339bba6a8454e8c722b4367924db8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.552322 10919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f7148e567a4f6da2aa56002e55b027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.556154 10926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4d1425ae0d743b7be813705b92d4e15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:52.667078 11126 raft_consensus.cc:359] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.667793 11126 raft_consensus.cc:385] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.668080 11126 raft_consensus.cc:740] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.674010 11128 tablet_bootstrap.cc:654] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.675597 11130 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.679016 11130 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.681078 11130 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:52.684623 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:19:52.686157 10901 leader_election.cc:343] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.676440 11126 consensus_queue.cc:260] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:19:52.683739 10820 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 118268us
W20260709 12:19:52.676934 10821 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 94232.9us
I20260709 12:19:52.701074 11126 ts_tablet_manager.cc:1434] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.297s	user 0.001s	sys 0.014s
I20260709 12:19:52.701921 11126 tablet_bootstrap.cc:492] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:52.703532 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:19:52.707680 10899 leader_election.cc:343] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.707527 11009 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:52.708452 10899 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:52.710568 11125 tablet_bootstrap.cc:492] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:52.710958 11125 ts_tablet_manager.cc:1403] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.442s	user 0.035s	sys 0.016s
I20260709 12:19:52.720801 10834 catalog_manager.cc:5697] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:52.729211 11165 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.729774 11165 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.730715 11194 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.731211 11194 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.731846 11165 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:52.733229 11186 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:52.734767 11194 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:52.737267 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:52.737550 11126 tablet_bootstrap.cc:654] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.738092 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:52.738121 10936 raft_consensus.cc:2393] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 1: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:19:52.715132 11130 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:52.752002 10818 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 126262us
I20260709 12:19:52.753502 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:52.764899 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:52.765486 11050 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:52.770486 11194 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.785238 11050 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:52.786052 11128 tablet_bootstrap.cc:492] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:52.786540 11128 ts_tablet_manager.cc:1403] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.304s	user 0.011s	sys 0.027s
I20260709 12:19:52.792173 11128 raft_consensus.cc:359] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.792856 11128 raft_consensus.cc:385] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.793154 11128 raft_consensus.cc:740] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.793097 11186 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:52.793938 11128 consensus_queue.cc:260] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.797029 11128 ts_tablet_manager.cc:1434] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:19:52.797963 11128 tablet_bootstrap.cc:492] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:52.794229 11125 raft_consensus.cc:359] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.801281 11125 raft_consensus.cc:385] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.801880 11125 raft_consensus.cc:740] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.792644 11194 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:52.803287 10832 catalog_manager.cc:5697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:52.803200 11125 consensus_queue.cc:260] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.810513 11125 ts_tablet_manager.cc:1434] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.099s	user 0.007s	sys 0.000s
I20260709 12:19:52.816329 11125 tablet_bootstrap.cc:492] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:52.824846 11125 tablet_bootstrap.cc:654] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.827459 11128 tablet_bootstrap.cc:654] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.835541 11165 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:19:52.839465 10882 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:52.843116 11126 tablet_bootstrap.cc:492] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:52.844384 11125 tablet_bootstrap.cc:492] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:52.845041 11126 ts_tablet_manager.cc:1403] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.143s	user 0.024s	sys 0.006s
I20260709 12:19:52.845214 11125 ts_tablet_manager.cc:1403] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.011s
I20260709 12:19:52.847651 11126 raft_consensus.cc:359] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.848393 11126 raft_consensus.cc:385] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.848680 11126 raft_consensus.cc:740] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.848130 11125 raft_consensus.cc:359] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.849391 11125 raft_consensus.cc:385] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.849713 11125 raft_consensus.cc:740] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.850435 11126 consensus_queue.cc:260] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.850392 11125 consensus_queue.cc:260] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.854257 11125 ts_tablet_manager.cc:1434] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:19:52.856889 11128 tablet_bootstrap.cc:492] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:52.857362 11128 ts_tablet_manager.cc:1403] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.060s	user 0.006s	sys 0.009s
I20260709 12:19:52.852674 11186 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:19:52.860126 11128 raft_consensus.cc:359] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.860870 11128 raft_consensus.cc:385] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.861248 11128 raft_consensus.cc:740] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.852654 11126 ts_tablet_manager.cc:1434] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:19:52.855377 11125 tablet_bootstrap.cc:492] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:52.861969 11128 consensus_queue.cc:260] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.864233 11128 ts_tablet_manager.cc:1434] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:19:52.865127 11128 tablet_bootstrap.cc:492] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:52.870617 11125 tablet_bootstrap.cc:654] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.875010 11128 tablet_bootstrap.cc:654] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.885725 11126 tablet_bootstrap.cc:492] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:52.887379 11125 tablet_bootstrap.cc:492] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:52.887918 11125 ts_tablet_manager.cc:1403] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.004s
I20260709 12:19:52.889894 11128 tablet_bootstrap.cc:492] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:52.890323 11128 ts_tablet_manager.cc:1403] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.025s	user 0.002s	sys 0.014s
I20260709 12:19:52.890771 11125 raft_consensus.cc:359] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.891482 11125 raft_consensus.cc:385] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.891844 11125 raft_consensus.cc:740] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.893260 11126 tablet_bootstrap.cc:654] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.893184 11125 consensus_queue.cc:260] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.895267 11125 ts_tablet_manager.cc:1434] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:19:52.896770 11125 tablet_bootstrap.cc:492] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:52.899430 11128 raft_consensus.cc:359] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.900137 11128 raft_consensus.cc:385] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.900398 11128 raft_consensus.cc:740] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.901178 11128 consensus_queue.cc:260] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.903394 11128 ts_tablet_manager.cc:1434] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:19:52.903540 11125 tablet_bootstrap.cc:654] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.904333 11128 tablet_bootstrap.cc:492] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:52.911769 11128 tablet_bootstrap.cc:654] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.912097 11130 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:52.915633 11126 tablet_bootstrap.cc:492] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:52.916145 11126 ts_tablet_manager.cc:1403] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.018s
I20260709 12:19:52.918902 11126 raft_consensus.cc:359] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.919572 11126 raft_consensus.cc:385] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.919839 11126 raft_consensus.cc:740] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.920610 11126 consensus_queue.cc:260] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.922710 11126 ts_tablet_manager.cc:1434] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:19:52.923969 11126 tablet_bootstrap.cc:492] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:52.930332 11126 tablet_bootstrap.cc:654] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.932854 11165 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:52.946929 11165 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.947544 11165 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.952111 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:52.952937 10935 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:52.953650 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:52.954489 11011 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:52.954699 11051 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:52.950840 11165 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:52.956110 11165 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:52.956554 11165 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.956979 11165 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.979493 11165 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.981742 11165 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:52.984747 11126 tablet_bootstrap.cc:492] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:52.985157 11126 ts_tablet_manager.cc:1403] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.061s	user 0.025s	sys 0.024s
I20260709 12:19:52.987049 11126 raft_consensus.cc:359] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.987556 11126 raft_consensus.cc:385] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.987818 11126 raft_consensus.cc:740] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.988634 11126 consensus_queue.cc:260] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:52.990934 11126 ts_tablet_manager.cc:1434] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:19:52.991300 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:52.992028 11011 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.992246 11126 tablet_bootstrap.cc:492] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:52.992229 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:52.992882 10935 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.996536 11142 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:53.000869 11011 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:53.002305 11050 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:53.003319 11142 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:53.004062 11142 raft_consensus.cc:697] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:19:53.004165 10935 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:53.005054 11142 consensus_queue.cc:237] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.007081 11128 tablet_bootstrap.cc:492] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:53.007551 11128 ts_tablet_manager.cc:1403] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.103s	user 0.014s	sys 0.004s
I20260709 12:19:53.008728 11146 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.009223 11146 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.010701 11128 raft_consensus.cc:359] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.011973 11128 raft_consensus.cc:385] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.012297 11128 raft_consensus.cc:740] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.013058 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:53.013127 11128 consensus_queue.cc:260] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:19:53.014688 10899 leader_election.cc:343] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.011504 11146 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:53.015234 11128 ts_tablet_manager.cc:1434] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:19:53.018883 11128 tablet_bootstrap.cc:492] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:53.019285 11085 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.022370 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:53.024302 11125 tablet_bootstrap.cc:492] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:53.024915 11125 ts_tablet_manager.cc:1403] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.128s	user 0.051s	sys 0.065s
I20260709 12:19:53.027814 11125 raft_consensus.cc:359] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.028785 11125 raft_consensus.cc:385] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.029194 11125 raft_consensus.cc:740] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.028424 11128 tablet_bootstrap.cc:654] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.031610 10834 catalog_manager.cc:5697] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:53.029901 11125 consensus_queue.cc:260] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.034418 11125 ts_tablet_manager.cc:1434] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.005s
I20260709 12:19:53.036468 11125 tablet_bootstrap.cc:492] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
W20260709 12:19:53.039597 10901 leader_election.cc:343] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.040805 10901 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:53.041946 11130 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:53.039796 11234 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.044369 11142 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.044904 11142 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.045495 11146 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:53.047073 11125 tablet_bootstrap.cc:654] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.049100 11142 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:53.050009 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:53.051666 11126 tablet_bootstrap.cc:654] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.052150 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:53.054396 11142 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.054984 11142 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.059056 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:53.059794 11010 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:53.061393 11050 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:53.062362 11165 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:53.062772 11165 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.063113 11165 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.071002 11165 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.072839 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:53.073613 10935 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:53.077009 11142 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:53.077193 11128 tablet_bootstrap.cc:492] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:53.077818 11128 ts_tablet_manager.cc:1403] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.059s	user 0.025s	sys 0.004s
I20260709 12:19:53.079074 11126 tablet_bootstrap.cc:492] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:53.079124 11050 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:53.079686 11126 ts_tablet_manager.cc:1403] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.088s	user 0.018s	sys 0.015s
I20260709 12:19:53.080773 11128 raft_consensus.cc:359] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.081456 11128 raft_consensus.cc:385] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.081730 11128 raft_consensus.cc:740] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.082422 11128 consensus_queue.cc:260] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.082496 11126 raft_consensus.cc:359] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.083081 11194 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:53.083256 11126 raft_consensus.cc:385] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.083602 11126 raft_consensus.cc:740] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.084317 11126 consensus_queue.cc:260] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.085649 11125 tablet_bootstrap.cc:492] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:53.085855 11165 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:53.086118 11125 ts_tablet_manager.cc:1403] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.050s	user 0.007s	sys 0.014s
I20260709 12:19:53.042951 11234 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.086913 11126 ts_tablet_manager.cc:1434] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:19:53.087939 11126 tablet_bootstrap.cc:492] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:53.088778 11125 raft_consensus.cc:359] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.089447 11125 raft_consensus.cc:385] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.089500 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:53.089766 11125 raft_consensus.cc:740] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.090269 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:53.090448 11125 consensus_queue.cc:260] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:19:53.090998 10899 leader_election.cc:343] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.090844 10935 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.092955 11234 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:53.094103 11126 tablet_bootstrap.cc:654] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.095798 11128 ts_tablet_manager.cc:1434] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:19:53.096813 11128 tablet_bootstrap.cc:492] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:53.092032 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:53.102425 11010 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.102906 11128 tablet_bootstrap.cc:654] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.112337 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:19:53.114203 10901 leader_election.cc:343] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.114703 10901 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:53.115818 11235 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:53.116581 11128 tablet_bootstrap.cc:492] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:53.117046 11128 ts_tablet_manager.cc:1403] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.005s
I20260709 12:19:53.119647 11128 raft_consensus.cc:359] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.120471 11128 raft_consensus.cc:385] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.120747 11128 raft_consensus.cc:740] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.121408 11128 consensus_queue.cc:260] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.122644 11010 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:53.123159 11128 ts_tablet_manager.cc:1434] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:19:53.124116 11128 tablet_bootstrap.cc:492] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:53.123924 11050 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:53.124814 11240 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:53.125272 11240 raft_consensus.cc:697] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:19:53.126098 11240 consensus_queue.cc:237] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.112787 11125 ts_tablet_manager.cc:1434] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 12:19:53.128619 11125 tablet_bootstrap.cc:492] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:53.126546 10935 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:53.144505 11128 tablet_bootstrap.cc:654] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.148138 11126 tablet_bootstrap.cc:492] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:53.149237 11125 tablet_bootstrap.cc:654] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.149377 11126 ts_tablet_manager.cc:1403] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.062s	user 0.023s	sys 0.031s
I20260709 12:19:53.153097 11126 raft_consensus.cc:359] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.153879 11126 raft_consensus.cc:385] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.154066 11126 raft_consensus.cc:740] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.154584 11126 consensus_queue.cc:260] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.154503 10832 catalog_manager.cc:5697] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:53.156463 11126 ts_tablet_manager.cc:1434] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:53.157667 11126 tablet_bootstrap.cc:492] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:53.163340 11126 tablet_bootstrap.cc:654] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.169625 11234 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.170511 11240 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.170266 11234 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.171011 11240 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.171821 11128 tablet_bootstrap.cc:492] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:53.172317 11128 ts_tablet_manager.cc:1403] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.002s
I20260709 12:19:53.173247 11240 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:53.174832 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:53.174986 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:53.175524 11085 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:53.175814 10935 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:53.176684 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:53.177196 11128 raft_consensus.cc:359] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.177321 11009 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:53.177443 10899 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:53.178246 11235 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:53.178505 11234 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:53.178647 11050 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:53.178591 11235 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.179262 11235 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.179381 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:53.179774 11240 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:53.180084 11010 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:53.180240 11240 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.180589 11240 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.177687 11128 raft_consensus.cc:385] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.182308 11128 raft_consensus.cc:740] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.183059 11128 consensus_queue.cc:260] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.185236 11128 ts_tablet_manager.cc:1434] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:19:53.186177 11128 tablet_bootstrap.cc:492] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:53.186373 11235 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.189366 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:53.189934 11010 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.190124 11240 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.191982 11128 tablet_bootstrap.cc:654] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.193486 11126 tablet_bootstrap.cc:492] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:53.193959 11126 ts_tablet_manager.cc:1403] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.003s
I20260709 12:19:53.196799 11126 raft_consensus.cc:359] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.197574 11126 raft_consensus.cc:385] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.197834 11126 raft_consensus.cc:740] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.198468 11126 consensus_queue.cc:260] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.200650 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:53.200848 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:53.201254 10935 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.201520 11011 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.207070 10935 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:53.208287 11010 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:53.208307 11051 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:53.209422 11165 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:53.209887 11165 raft_consensus.cc:697] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:19:53.209971 10901 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:53.210739 11165 consensus_queue.cc:237] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.211962 11011 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:53.212872 11240 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:53.215047 11125 tablet_bootstrap.cc:492] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:53.215574 11125 ts_tablet_manager.cc:1403] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.007s
I20260709 12:19:53.216312 11235 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:53.218838 11126 ts_tablet_manager.cc:1434] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 12:19:53.219369 11146 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:53.219956 11146 raft_consensus.cc:697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:19:53.220010 11126 tablet_bootstrap.cc:492] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:53.220854 11146 consensus_queue.cc:237] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.224058 11128 tablet_bootstrap.cc:492] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:53.224550 11128 ts_tablet_manager.cc:1403] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.020s
I20260709 12:19:53.224740 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:53.225363 11085 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.220557 10832 catalog_manager.cc:5697] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:53.227488 11128 raft_consensus.cc:359] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.228223 11128 raft_consensus.cc:385] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.228493 11128 raft_consensus.cc:740] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.229069 11126 tablet_bootstrap.cc:654] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.229198 11128 consensus_queue.cc:260] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.231679 11128 ts_tablet_manager.cc:1434] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:19:53.232643 11128 tablet_bootstrap.cc:492] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:53.236083 11085 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:53.238950 11125 raft_consensus.cc:359] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.239701 11125 raft_consensus.cc:385] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.240017 11125 raft_consensus.cc:740] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.243741 11125 consensus_queue.cc:260] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.245841 11125 ts_tablet_manager.cc:1434] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 12:19:53.246857 11125 tablet_bootstrap.cc:492] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:53.258242 11128 tablet_bootstrap.cc:654] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.259785 11126 tablet_bootstrap.cc:492] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:53.260499 11126 ts_tablet_manager.cc:1403] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.022s
I20260709 12:19:53.259753 10832 catalog_manager.cc:5697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:53.263330 11126 raft_consensus.cc:359] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.264164 11126 raft_consensus.cc:385] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.264487 11126 raft_consensus.cc:740] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.264855 11125 tablet_bootstrap.cc:654] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.265273 11126 consensus_queue.cc:260] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.267370 11126 ts_tablet_manager.cc:1434] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:19:53.268380 11126 tablet_bootstrap.cc:492] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:53.277890 11128 tablet_bootstrap.cc:492] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:53.278035 11126 tablet_bootstrap.cc:654] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.278472 11125 tablet_bootstrap.cc:492] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:53.278918 11125 ts_tablet_manager.cc:1403] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.000s
I20260709 12:19:53.279042 11128 ts_tablet_manager.cc:1403] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.014s
I20260709 12:19:53.280771 11186 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.281257 11186 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.281734 11128 raft_consensus.cc:359] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.281910 11125 raft_consensus.cc:359] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.282514 11128 raft_consensus.cc:385] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.282727 11125 raft_consensus.cc:385] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.282939 11128 raft_consensus.cc:740] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.283064 11125 raft_consensus.cc:740] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.283354 11186 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:53.283998 11128 consensus_queue.cc:260] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.285065 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:53.284133 11125 consensus_queue.cc:260] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.288412 11085 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 0.
I20260709 12:19:53.289373 11128 ts_tablet_manager.cc:1434] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:19:53.289732 11125 ts_tablet_manager.cc:1434] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:19:53.290874 11128 tablet_bootstrap.cc:492] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:53.291028 10974 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:53.291752 11126 tablet_bootstrap.cc:492] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:53.292299 11126 ts_tablet_manager.cc:1403] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.000s
I20260709 12:19:53.293218 11186 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:53.293592 11186 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.293654 11165 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.293970 11186 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.294205 11165 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.285481 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:53.295418 10935 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 0.
I20260709 12:19:53.296475 11165 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:53.297806 11128 tablet_bootstrap.cc:654] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.292184 11235 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.298540 11235 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.300596 11235 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:53.300793 11126 raft_consensus.cc:359] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.301604 11126 raft_consensus.cc:385] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.301915 11126 raft_consensus.cc:740] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.302021 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:53.303999 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:53.303591 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:19:53.303622 10899 leader_election.cc:343] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.305274 11011 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:53.302922 11126 consensus_queue.cc:260] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.306507 11050 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:19:53.306772 10901 leader_election.cc:343] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.307230 10901 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:53.307504 11126 ts_tablet_manager.cc:1434] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:19:53.309091 11126 tablet_bootstrap.cc:492] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:53.309873 11146 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:53.310825 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:53.311487 10935 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:53.315176 11126 tablet_bootstrap.cc:654] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.307440 11165 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:53.317435 11165 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.317824 11165 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.327164 11126 tablet_bootstrap.cc:492] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:53.331229 11165 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.332307 11186 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.327723 11126 ts_tablet_manager.cc:1403] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 12:19:53.334286 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:53.335772 11125 tablet_bootstrap.cc:492] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:53.336076 11126 raft_consensus.cc:359] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.336845 11126 raft_consensus.cc:385] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.337131 11126 raft_consensus.cc:740] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.338079 11126 consensus_queue.cc:260] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.334914 10935 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.342936 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:53.354912 11011 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.355659 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:53.356410 11085 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.344254 11126 ts_tablet_manager.cc:1434] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:19:53.357920 11126 tablet_bootstrap.cc:492] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:53.349925 11165 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:53.356817 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:53.358811 10934 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.363489 11126 tablet_bootstrap.cc:654] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.367098 10934 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:19:53.368480 10977 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:53.369375 11181 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:53.369896 11181 raft_consensus.cc:697] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:19:53.370765 11181 consensus_queue.cc:237] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.373294 11125 tablet_bootstrap.cc:654] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.381130 11011 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:53.382567 11050 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:53.383667 11165 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:53.384173 11165 raft_consensus.cc:697] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:19:53.385023 11165 consensus_queue.cc:237] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.388082 11085 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:19:53.392305 11125 tablet_bootstrap.cc:492] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:53.392908 11125 ts_tablet_manager.cc:1403] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.000s
I20260709 12:19:53.404452 11186 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:53.408900 10935 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:53.408596 10834 catalog_manager.cc:5697] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:53.414363 11128 tablet_bootstrap.cc:492] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:53.414883 11128 ts_tablet_manager.cc:1403] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.124s	user 0.064s	sys 0.050s
I20260709 12:19:53.414666 11125 raft_consensus.cc:359] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.415416 11125 raft_consensus.cc:385] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.415692 11125 raft_consensus.cc:740] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.416460 11125 consensus_queue.cc:260] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.417659 11128 raft_consensus.cc:359] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.418366 11128 raft_consensus.cc:385] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.418622 11128 raft_consensus.cc:740] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.419198 11128 consensus_queue.cc:260] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.420352 10832 catalog_manager.cc:5697] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:53.421219 11128 ts_tablet_manager.cc:1434] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:19:53.421702 11126 tablet_bootstrap.cc:492] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:53.422115 11128 tablet_bootstrap.cc:492] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:53.422158 11126 ts_tablet_manager.cc:1403] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.035s
I20260709 12:19:53.422042 11165 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:53.425941 11126 raft_consensus.cc:359] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.426631 11126 raft_consensus.cc:385] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.426900 11126 raft_consensus.cc:740] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.427742 11126 consensus_queue.cc:260] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.428781 11128 tablet_bootstrap.cc:654] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.431708 11126 ts_tablet_manager.cc:1434] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:19:53.432732 11126 tablet_bootstrap.cc:492] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:53.438447 11126 tablet_bootstrap.cc:654] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.441151 11142 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.441735 11142 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.443849 11142 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:53.441732 11125 ts_tablet_manager.cc:1434] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 12:19:53.445310 11125 tablet_bootstrap.cc:492] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:53.449512 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:53.450222 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:53.450223 11010 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:53.450893 10935 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:53.452108 11050 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:53.453274 11128 tablet_bootstrap.cc:492] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:53.453794 11128 ts_tablet_manager.cc:1403] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.012s
I20260709 12:19:53.456684 11128 raft_consensus.cc:359] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.457440 11128 raft_consensus.cc:385] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.457726 11128 raft_consensus.cc:740] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.458225 11235 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.458417 11128 consensus_queue.cc:260] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.458734 11235 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.460718 11240 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:53.461153 11240 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.461472 11240 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.462321 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:19:53.463914 10901 leader_election.cc:343] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.465191 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:19:53.466390 10899 leader_election.cc:343] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.466796 10899 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:53.467576 11146 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:53.468677 11240 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.470957 11240 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:53.472211 11235 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:53.460745 11128 ts_tablet_manager.cc:1434] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:19:53.472132 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:53.473229 11010 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.474257 11128 tablet_bootstrap.cc:492] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:53.476583 11125 tablet_bootstrap.cc:654] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.478638 11010 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:53.479780 11050 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:53.481353 11128 tablet_bootstrap.cc:654] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.481348 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:53.482097 10934 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.483887 11142 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:53.484419 11142 raft_consensus.cc:697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:19:53.485241 11142 consensus_queue.cc:237] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.489574 11126 tablet_bootstrap.cc:492] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:53.489658 10934 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:53.490271 11126 ts_tablet_manager.cc:1403] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.009s
I20260709 12:19:53.491155 11240 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:53.492894 11240 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.493257 11126 raft_consensus.cc:359] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.493345 11240 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.494112 11126 raft_consensus.cc:385] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.494433 11126 raft_consensus.cc:740] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.496003 11240 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:53.497215 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:53.497574 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:53.497922 11010 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:53.498260 10935 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:53.498450 11126 consensus_queue.cc:260] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.499233 11050 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:53.500147 11240 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:53.500509 11240 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.500846 11240 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.501020 11126 ts_tablet_manager.cc:1434] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:19:53.503027 11126 tablet_bootstrap.cc:492] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:53.508607 11240 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.513782 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:53.514496 11010 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.516371 11126 tablet_bootstrap.cc:654] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.516662 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:53.517292 10935 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.523384 11240 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:53.525624 11010 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:53.527941 11125 tablet_bootstrap.cc:492] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:53.528726 11125 ts_tablet_manager.cc:1403] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.084s	user 0.006s	sys 0.006s
I20260709 12:19:53.528879 11050 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:53.529846 11240 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:53.530506 11240 raft_consensus.cc:697] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:19:53.531637 10935 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:53.533324 10832 catalog_manager.cc:5697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:53.534567 11125 raft_consensus.cc:359] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.535256 11125 raft_consensus.cc:385] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.535383 11128 tablet_bootstrap.cc:492] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:53.535552 11125 raft_consensus.cc:740] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.535923 11128 ts_tablet_manager.cc:1403] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.002s
I20260709 12:19:53.531474 11240 consensus_queue.cc:237] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.538529 11128 raft_consensus.cc:359] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.539194 11128 raft_consensus.cc:385] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.539470 11128 raft_consensus.cc:740] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.540190 11128 consensus_queue.cc:260] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.542307 11128 ts_tablet_manager.cc:1434] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:19:53.543164 11128 tablet_bootstrap.cc:492] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:53.540592 11125 consensus_queue.cc:260] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.548385 11125 ts_tablet_manager.cc:1434] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 12:19:53.551301 11128 tablet_bootstrap.cc:654] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.551329 11125 tablet_bootstrap.cc:492] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:53.556248 10831 catalog_manager.cc:5697] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:53.562309 11126 tablet_bootstrap.cc:492] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:53.565579 11126 ts_tablet_manager.cc:1403] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.063s	user 0.020s	sys 0.004s
I20260709 12:19:53.572801 11125 tablet_bootstrap.cc:654] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.572671 11142 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:53.573256 11126 raft_consensus.cc:359] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.573983 11126 raft_consensus.cc:385] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.574319 11126 raft_consensus.cc:740] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.575073 11126 consensus_queue.cc:260] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.579214 11126 ts_tablet_manager.cc:1434] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.002s
I20260709 12:19:53.580380 11126 tablet_bootstrap.cc:492] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:53.583446 11128 tablet_bootstrap.cc:492] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:53.583947 11128 ts_tablet_manager.cc:1403] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.007s
I20260709 12:19:53.586599 11128 raft_consensus.cc:359] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.587271 11128 raft_consensus.cc:385] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.587546 11128 raft_consensus.cc:740] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.589421 11126 tablet_bootstrap.cc:654] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.595517 11128 consensus_queue.cc:260] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.596606 11125 tablet_bootstrap.cc:492] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:53.597066 11125 ts_tablet_manager.cc:1403] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.046s	user 0.025s	sys 0.003s
I20260709 12:19:53.597819 11128 ts_tablet_manager.cc:1434] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:19:53.599680 11125 raft_consensus.cc:359] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.600594 11126 tablet_bootstrap.cc:492] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:53.600690 11125 raft_consensus.cc:385] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.600919 11128 tablet_bootstrap.cc:492] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:53.601092 11126 ts_tablet_manager.cc:1403] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 12:19:53.601054 11125 raft_consensus.cc:740] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.601886 11125 consensus_queue.cc:260] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.604130 11125 ts_tablet_manager.cc:1434] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:19:53.603991 11126 raft_consensus.cc:359] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.604674 11126 raft_consensus.cc:385] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.604928 11235 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.605398 11235 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.607416 11235 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:53.609097 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:53.609429 11125 tablet_bootstrap.cc:492] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:53.609726 11142 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:53.610479 11128 tablet_bootstrap.cc:654] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.611048 11142 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:53.613559 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:53.614198 11085 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:53.616127 11010 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:53.619544 11125 tablet_bootstrap.cc:654] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.620643 10899 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:53.625555 11235 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:53.626925 11235 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.627492 11235 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.604939 11126 raft_consensus.cc:740] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.645514 11126 consensus_queue.cc:260] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.648078 11126 ts_tablet_manager.cc:1434] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 12:19:53.635823 11235 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.649238 11130 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.649782 11130 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.652326 11235 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:53.653498 11130 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:53.654351 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:53.655148 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:53.656489 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:53.657217 11008 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.658219 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:53.658836 11085 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:53.657131 10899 leader_election.cc:343] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:53.664503 10901 leader_election.cc:343] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.666831 10901 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:53.667050 11008 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:53.669268 10901 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:53.670239 11130 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:53.670768 11085 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:53.670974 11130 raft_consensus.cc:697] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:19:53.672077 11130 consensus_queue.cc:237] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.673368 11126 tablet_bootstrap.cc:492] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:53.667847 11235 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:53.684768 11125 tablet_bootstrap.cc:492] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:53.685431 11125 ts_tablet_manager.cc:1403] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.076s	user 0.019s	sys 0.008s
I20260709 12:19:53.688354 11125 raft_consensus.cc:359] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.689087 11125 raft_consensus.cc:385] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.689389 11125 raft_consensus.cc:740] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.690016 11125 consensus_queue.cc:260] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.692085 11125 ts_tablet_manager.cc:1434] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:19:53.695804 11128 tablet_bootstrap.cc:492] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:53.696316 11128 ts_tablet_manager.cc:1403] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.096s	user 0.047s	sys 0.039s
I20260709 12:19:53.697757 11165 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:53.698875 11128 raft_consensus.cc:359] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.699450 11128 raft_consensus.cc:385] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.699991 11125 tablet_bootstrap.cc:492] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:53.702559 11126 tablet_bootstrap.cc:654] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.699733 11128 raft_consensus.cc:740] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.705767 11128 consensus_queue.cc:260] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.706171 10834 catalog_manager.cc:5697] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:53.707253 11125 tablet_bootstrap.cc:654] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.707928 11128 ts_tablet_manager.cc:1434] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:19:53.708842 11128 tablet_bootstrap.cc:492] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:53.714354 11128 tablet_bootstrap.cc:654] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.718000 11234 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.718510 11234 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.720705 11234 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:53.723641 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:19:53.725770 10901 leader_election.cc:343] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.727214 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:53.728318 11130 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:53.730208 10899 leader_election.cc:343] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.730683 10899 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:53.731899 11234 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:53.733474 11126 tablet_bootstrap.cc:492] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:53.733950 11126 ts_tablet_manager.cc:1403] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.001s
I20260709 12:19:53.733585 11130 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.736956 11234 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:53.739773 11130 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:53.740191 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:53.742118 11126 raft_consensus.cc:359] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.742729 11125 tablet_bootstrap.cc:492] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:53.744724 11125 ts_tablet_manager.cc:1403] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.000s
I20260709 12:19:53.744916 11128 tablet_bootstrap.cc:492] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:53.745345 11128 ts_tablet_manager.cc:1403] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.011s
W20260709 12:19:53.745455 10901 leader_election.cc:343] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.746973 11235 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.747416 11125 raft_consensus.cc:359] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.748203 11125 raft_consensus.cc:385] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.747927 11128 raft_consensus.cc:359] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.747511 11235 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.748580 11126 raft_consensus.cc:385] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.748937 11125 raft_consensus.cc:740] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.749694 11125 consensus_queue.cc:260] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.748991 11126 raft_consensus.cc:740] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.751942 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:53.752120 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:53.752554 11008 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:53.751669 11125 ts_tablet_manager.cc:1434] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:19:53.752734 11085 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:53.748612 11128 raft_consensus.cc:385] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.753204 11128 raft_consensus.cc:740] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.753779 10901 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:53.750295 11235 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:53.754613 11125 tablet_bootstrap.cc:492] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:53.754669 11130 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:53.755228 11130 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.755772 11130 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.755254 11235 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:53.756507 10899 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:53.758869 11235 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:53.764183 11234 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.764545 11235 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.764699 11234 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.765154 11235 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.767701 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:19:53.769215 10901 leader_election.cc:343] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.770182 11234 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:53.771752 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:53.772334 11235 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.774420 11235 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:53.752372 11126 consensus_queue.cc:260] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.776314 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:53.777338 11008 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.777571 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:53.777870 11126 ts_tablet_manager.cc:1434] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.043s	user 0.001s	sys 0.004s
I20260709 12:19:53.778182 11082 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.778832 11126 tablet_bootstrap.cc:492] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:53.761708 11125 tablet_bootstrap.cc:654] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.785080 11082 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:53.789039 11126 tablet_bootstrap.cc:654] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.790774 10899 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:53.792073 11146 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:53.792558 11146 raft_consensus.cc:697] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:19:53.793514 11146 consensus_queue.cc:237] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.794346 11125 tablet_bootstrap.cc:492] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:53.795042 11125 ts_tablet_manager.cc:1403] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.004s
I20260709 12:19:53.798682 11125 raft_consensus.cc:359] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.799576 11125 raft_consensus.cc:385] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.799849 11125 raft_consensus.cc:740] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.755788 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:53.753866 11128 consensus_queue.cc:260] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.810051 11084 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:53.810890 11008 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:53.762756 11130 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.801198 11165 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.812088 11165 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.813220 11130 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:53.800673 11125 consensus_queue.cc:260] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.814042 11165 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:53.815325 11125 ts_tablet_manager.cc:1434] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.005s
I20260709 12:19:53.815881 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:53.816339 11125 tablet_bootstrap.cc:492] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:53.816534 11008 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:53.817718 11050 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:53.818645 11165 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:53.819020 11165 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.819360 11165 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.808810 11126 tablet_bootstrap.cc:492] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:53.809409 11146 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.820297 11126 ts_tablet_manager.cc:1403] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.011s
I20260709 12:19:53.820233 11146 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.821942 11128 ts_tablet_manager.cc:1434] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.000s
I20260709 12:19:53.822958 11128 tablet_bootstrap.cc:492] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:53.822374 11146 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:53.801762 11186 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:53.827437 10899 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:53.828758 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:53.829380 11082 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:53.830389 10899 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:53.830626 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:53.831848 11126 raft_consensus.cc:359] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.831565 11234 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:53.832577 11126 raft_consensus.cc:385] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.832701 11234 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.832901 11126 raft_consensus.cc:740] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.833082 11234 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.834502 11126 consensus_queue.cc:260] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.832580 11235 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:53.837990 11235 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.838368 11235 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.842051 11194 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:53.835687 10832 catalog_manager.cc:5697] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:53.848696 11126 ts_tablet_manager.cc:1434] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 12:19:53.849529 11126 tablet_bootstrap.cc:492] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:53.858346 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:53.858990 11008 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.862203 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:53.863108 10936 raft_consensus.cc:2393] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 1: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:19:53.866156 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:53.881558 11194 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:53.882565 11186 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:53.884634 11234 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.886853 11234 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:53.890301 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:53.889562 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:53.891798 11082 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.893740 11194 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.894218 11194 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:19:53.896879 10901 leader_election.cc:343] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.897445 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:53.898186 11011 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:53.899017 11128 tablet_bootstrap.cc:654] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.899681 11050 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:53.900574 11142 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:53.900951 11142 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.901281 11142 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.902475 11125 tablet_bootstrap.cc:654] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:53.910272 10901 leader_election.cc:343] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.911535 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:53.905726 11194 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:53.918124 11165 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.926172 11142 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.927177 11085 raft_consensus.cc:2393] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 1: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:19:53.927407 11165 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:53.928158 11142 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:53.915643 10935 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:53.935580 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:53.936451 10935 raft_consensus.cc:2393] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 1: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:19:53.936236 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:53.936892 10936 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.940915 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:53.942029 11008 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:53.943318 10901 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:53.944121 11082 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:53.918061 11235 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.950225 11234 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:53.953083 11234 raft_consensus.cc:697] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:19:53.953907 11234 consensus_queue.cc:237] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.965049 11051 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:53.965675 11235 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:53.965885 11165 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:53.969602 11128 tablet_bootstrap.cc:492] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:53.961411 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:53.970089 11128 ts_tablet_manager.cc:1403] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.147s	user 0.019s	sys 0.000s
I20260709 12:19:53.970340 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:53.973933 10899 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:19:53.974480 10901 leader_election.cc:343] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.975337 11235 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:53.976068 11235 raft_consensus.cc:697] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:19:53.975839 11240 consensus_queue.cc:1048] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:53.976848 11194 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:53.978689 11126 tablet_bootstrap.cc:654] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.979472 10936 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:53.978725 11235 consensus_queue.cc:237] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.970130 11008 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.988441 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:53.988973 11084 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.989023 11051 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:53.989916 11194 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:53.990404 11194 raft_consensus.cc:697] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:19:53.991200 11194 consensus_queue.cc:237] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.994421 11125 tablet_bootstrap.cc:492] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:53.994964 11125 ts_tablet_manager.cc:1403] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.179s	user 0.012s	sys 0.011s
I20260709 12:19:53.997741 11128 raft_consensus.cc:359] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:53.999313 11128 raft_consensus.cc:385] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.999598 11128 raft_consensus.cc:740] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.003950 11128 consensus_queue.cc:260] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.004386 11130 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.011507 11130 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.012743 11128 ts_tablet_manager.cc:1434] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 12:19:54.013301 11125 raft_consensus.cc:359] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.013651 11130 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:54.014176 11125 raft_consensus.cc:385] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:54.014475 11125 raft_consensus.cc:740] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.014572 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:54.015223 11125 consensus_queue.cc:260] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.016923 11128 tablet_bootstrap.cc:492] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:53.999792 11084 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:54.024080 11125 ts_tablet_manager.cc:1434] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.001s
I20260709 12:19:54.025110 11125 tablet_bootstrap.cc:492] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
W20260709 12:19:54.023624 10882 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:19:54.029186 10901 leader_election.cc:343] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:54.041741 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:54.043090 10899 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:54.044077 11130 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:54.044587 11130 raft_consensus.cc:697] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:19:54.051116 11235 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.052577 11235 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.045434 11130 consensus_queue.cc:237] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.062084 11142 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:54.064463 11235 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:19:54.066036 10899 leader_election.cc:343] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:54.066588 10899 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:54.068531 11288 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:54.068894 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:19:54.074141 10901 leader_election.cc:343] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:54.076417 11125 tablet_bootstrap.cc:654] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:54.079447 11240 consensus_queue.cc:1048] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:54.079435 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:19:54.083490 10899 leader_election.cc:343] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:54.083995 10899 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:54.085170 11128 tablet_bootstrap.cc:654] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:54.085994 11235 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:54.088095 11288 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:54.097136 11008 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:54.106956 11125 tablet_bootstrap.cc:492] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:54.107667 11125 ts_tablet_manager.cc:1403] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.006s
I20260709 12:19:54.110920 11125 raft_consensus.cc:359] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.111569 11125 raft_consensus.cc:385] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:54.111820 11125 raft_consensus.cc:740] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.112634 11125 consensus_queue.cc:260] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.116659 11125 ts_tablet_manager.cc:1434] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:19:54.119813 11125 tablet_bootstrap.cc:492] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:54.508256 11188 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.508819 11188 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.510818 11188 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:54.520987 11125 tablet_bootstrap.cc:654] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:54.534897 11125 tablet_bootstrap.cc:492] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:54.535392 11125 ts_tablet_manager.cc:1403] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.417s	user 0.008s	sys 0.016s
I20260709 12:19:54.538113 11125 raft_consensus.cc:359] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.539220 11125 raft_consensus.cc:385] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:54.539525 11125 raft_consensus.cc:740] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.540410 11125 consensus_queue.cc:260] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.542464 11125 ts_tablet_manager.cc:1434] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:54.543435 11125 tablet_bootstrap.cc:492] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:54.549352 11125 tablet_bootstrap.cc:654] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:54.554183 11125 tablet_bootstrap.cc:492] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:54.554867 11125 ts_tablet_manager.cc:1403] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 12:19:54.557483 11142 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.557499 11125 raft_consensus.cc:359] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.558111 11142 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.557683 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:54.558364 11125 raft_consensus.cc:385] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:54.559844 11125 raft_consensus.cc:740] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
W20260709 12:19:54.560099 10974 leader_election.cc:343] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:54.560271 11142 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:54.560531 11125 consensus_queue.cc:260] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.563140 11125 ts_tablet_manager.cc:1434] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:19:54.564141 11125 tablet_bootstrap.cc:492] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:54.565174 11128 tablet_bootstrap.cc:492] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:54.565570 11128 ts_tablet_manager.cc:1403] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.550s	user 0.016s	sys 0.008s
I20260709 12:19:54.567747 11128 raft_consensus.cc:359] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.568408 11128 raft_consensus.cc:385] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:54.568627 11128 raft_consensus.cc:740] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.568789 11125 tablet_bootstrap.cc:654] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:54.569217 11128 consensus_queue.cc:260] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.570945 11128 ts_tablet_manager.cc:1434] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:19:54.571640 11128 tablet_bootstrap.cc:492] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:54.573225 11125 tablet_bootstrap.cc:492] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:54.573647 11125 ts_tablet_manager.cc:1403] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:19:54.573709 11188 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.574167 11188 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.583101 11125 raft_consensus.cc:359] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.583931 11125 raft_consensus.cc:385] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:54.584223 11125 raft_consensus.cc:740] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.584367 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:54.585052 11084 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 0.
I20260709 12:19:54.585034 11125 consensus_queue.cc:260] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.587265 11125 ts_tablet_manager.cc:1434] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:19:54.588229 11125 tablet_bootstrap.cc:492] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:54.588081 10974 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:54.588851 11181 raft_consensus.cc:2804] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:54.589215 11181 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:54.589612 11181 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:54.587539 11188 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:54.594969 11125 tablet_bootstrap.cc:654] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:54.617497 10833 catalog_manager.cc:5697] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:54.631451 11188 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.632090 11188 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.634222 11188 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:54.644114 11288 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:54.647821 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:54.660231 11188 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.660733 11188 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.662755 11188 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:54.670753 11128 tablet_bootstrap.cc:654] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:54.659162 11181 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.751976 11188 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.752760 11188 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.755134 11188 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:19:54.760053 11316 log.cc:927] Time spent T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:19:54.693136 11318 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.076s
I20260709 12:19:54.765895 11309 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.766359 11309 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.768383 11309 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:54.769706 11010 raft_consensus.cc:2393] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 1: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:19:54.788415 11007 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:54.789561 10901 consensus_peers.cc:597] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:54.789592 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:54.785934 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:54.791646 11084 raft_consensus.cc:2393] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 1: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:19:54.778012 11181 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:54.771798 11126 tablet_bootstrap.cc:492] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:54.793344 11126 ts_tablet_manager.cc:1403] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.944s	user 0.009s	sys 0.015s
I20260709 12:19:54.794152 11165 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:19:54.822083 11125 tablet_bootstrap.cc:492] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:54.822602 11125 ts_tablet_manager.cc:1403] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.235s	user 0.042s	sys 0.079s
I20260709 12:19:54.813832 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:54.827838 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:54.840919 11084 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 0.
I20260709 12:19:54.841897 11312 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.869298 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:54.870010 10934 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:54.828706 11009 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:54.884797 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:54.886989 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:54.887799 10932 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 0.
W20260709 12:19:54.868341 10974 leader_election.cc:343] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:54.888505 11125 raft_consensus.cc:359] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.889744 11125 raft_consensus.cc:385] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:54.890059 11125 raft_consensus.cc:740] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.921111 11125 consensus_queue.cc:260] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.923278 11125 ts_tablet_manager.cc:1434] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.100s	user 0.006s	sys 0.007s
W20260709 12:19:54.915886 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 123398us
I20260709 12:19:54.866739 11312 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.928438 11312 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:54.931329 11125 tablet_bootstrap.cc:492] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:54.932665 10974 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:54.923523 11126 raft_consensus.cc:359] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.935204 11126 raft_consensus.cc:385] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:54.935503 11126 raft_consensus.cc:740] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.936128 11126 consensus_queue.cc:260] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:54.945752 11128 tablet_bootstrap.cc:492] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:54.945858 11126 ts_tablet_manager.cc:1434] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.152s	user 0.007s	sys 0.000s
I20260709 12:19:54.941450 11312 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:54.948509 11126 tablet_bootstrap.cc:492] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:54.949680 11312 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:54.950147 11312 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:54.951432 11050 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:19:55.005838 11324 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.103s	user 0.011s	sys 0.028s
I20260709 12:19:55.007812 11128 ts_tablet_manager.cc:1403] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.436s	user 0.013s	sys 0.008s
I20260709 12:19:55.016568 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:19:55.020285 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 68925.3us
I20260709 12:19:55.021934 11309 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:55.201900 11309 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.202316 11309 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.204421 11125 tablet_bootstrap.cc:700] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: Time spent opening tablet: real 0.104s	user 0.005s	sys 0.004s
I20260709 12:19:55.205119 11125 tablet_bootstrap.cc:654] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.210199 11309 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.210741 11126 tablet_bootstrap.cc:700] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent opening tablet: real 0.101s	user 0.000s	sys 0.006s
I20260709 12:19:55.211428 11126 tablet_bootstrap.cc:654] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.212406 11309 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:19:55.216419 11322 log.cc:927] Time spent T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.299s	user 0.002s	sys 0.002s
I20260709 12:19:55.194535 11051 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:55.197010 11312 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:19:55.220482 10974 leader_election.cc:343] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:55.221190 11051 leader_election.cc:343] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.221606 11312 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:55.222071 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:55.221472 11326 raft_consensus.cc:2804] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:55.223160 11326 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.223555 11326 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.224763 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:55.225466 10935 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 0.
I20260709 12:19:55.226305 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:55.227106 11009 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 1: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:19:55.227514 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:55.222745 10932 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 0.
I20260709 12:19:55.230064 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:55.230221 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:55.230340 11312 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.230667 10936 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.231338 11312 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.232435 11234 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:55.233397 11312 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:55.235019 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:55.235770 11084 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 1: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:19:55.237751 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:55.241700 11128 raft_consensus.cc:359] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.242427 11128 raft_consensus.cc:385] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.242710 11128 raft_consensus.cc:740] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.243010 10936 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:19:55.247761 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:55.248476 10834 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35614 (request call id 53) took 1168 ms. Trace:
I20260709 12:19:55.251152 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:55.250819 10834 rpcz_store.cc:276] 0709 12:19:54.079802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.237988 (+158186us) service_pool.cc:224] Handling call
0709 12:19:55.248398 (+1010410us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3}
I20260709 12:19:55.254256 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:55.255897 11126 tablet_bootstrap.cc:492] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:55.255772 10977 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:55.256392 11126 ts_tablet_manager.cc:1403] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.310s	user 0.009s	sys 0.008s
I20260709 12:19:55.256649 11312 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:55.257090 11312 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.256778 10831 catalog_manager.cc:5697] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:55.257503 11312 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.258402 10831 catalog_manager.cc:5697] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:55.259338 11234 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:55.260694 11234 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:55.262966 10831 catalog_manager.cc:5697] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:55.264039 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:55.264810 11083 raft_consensus.cc:2393] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 1: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:19:55.251003 10833 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35620 (request call id 52) took 1204 ms. Trace:
I20260709 12:19:55.267400 11318 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:55.268777 11312 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.270291 11318 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:55.270704 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:55.270866 11312 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:55.264532 11234 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:55.235725 11326 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.275746 11082 raft_consensus.cc:2393] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 1: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:19:55.276731 11125 tablet_bootstrap.cc:492] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:55.277225 11125 ts_tablet_manager.cc:1403] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.346s	user 0.018s	sys 0.007s
I20260709 12:19:55.243378 11128 consensus_queue.cc:260] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.259368 11126 raft_consensus.cc:359] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.284791 11126 raft_consensus.cc:385] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.285499 10977 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:55.286857 11125 raft_consensus.cc:359] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.287600 11125 raft_consensus.cc:385] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.287897 11125 raft_consensus.cc:740] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.285079 11126 raft_consensus.cc:740] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.290270 11126 consensus_queue.cc:260] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.293022 11128 ts_tablet_manager.cc:1434] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.285s	user 0.024s	sys 0.010s
I20260709 12:19:55.294099 11128 tablet_bootstrap.cc:492] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:55.300861 11126 ts_tablet_manager.cc:1434] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.002s
I20260709 12:19:55.302094 11126 tablet_bootstrap.cc:492] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:55.286208 11326 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:55.304152 11125 consensus_queue.cc:260] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.299825 11312 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:55.311219 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:55.311949 10932 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.315258 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:55.316118 11008 raft_consensus.cc:2393] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 1: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:19:55.267686 10833 rpcz_store.cc:276] 0709 12:19:54.050895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.069859 (+ 18964us) service_pool.cc:224] Handling call
0709 12:19:55.250935 (+1181076us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:54.687936 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:54.688564 (+   628us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:54.688604 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:19:54.688623 (+    19us) tablet.cc:662] Decoding operations
0709 12:19:54.688984 (+   361us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:54.689061 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:54.689095 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:54.689279 (+   184us) tablet.cc:701] Row locks acquired
0709 12:19:54.689298 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:19:54.689446 (+   148us) write_op.cc:270] Start()
0709 12:19:54.689556 (+   110us) write_op.cc:276] Timestamp: P: 1783599594689401 usec, L: 0
0709 12:19:54.689577 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:19:54.690295 (+   718us) log.cc:844] Serialized 537 byte log entry
0709 12:19:54.766807 (+ 76512us) op_driver.cc:464] REPLICATION: finished
0709 12:19:54.949240 (+182433us) write_op.cc:301] APPLY: starting
0709 12:19:54.992092 (+ 42852us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:54.992224 (+   132us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:54.992349 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:54.992558 (+   209us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:54.992717 (+   159us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:19:54.992760 (+    43us) write_op.cc:312] APPLY: finished
0709 12:19:54.992972 (+   212us) log.cc:844] Serialized 22 byte log entry
0709 12:19:54.993169 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:54.993247 (+    78us) write_op.cc:454] Released schema lock
0709 12:19:54.993282 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:54.993581 (+   299us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:54.993610 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":35038,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":176634,"apply.run_cpu_time_us":1698,"apply.run_wall_time_us":46419,"num_ops":1,"prepare.queue_time_us":24104,"prepare.run_cpu_time_us":2706,"prepare.run_wall_time_us":10365,"replication_time_us":77102,"thread_start_us":85476,"threads_started":2}]]}
I20260709 12:19:55.307926 11326 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.331384 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:55.331912 11326 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.323096 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:55.332247 11181 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.357173 11181 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.324230 11125 ts_tablet_manager.cc:1434] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 12:19:55.367185 11125 tablet_bootstrap.cc:492] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:55.307763 11312 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.356534 10935 raft_consensus.cc:2393] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 1: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:19:55.395149 11318 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.406976 10932 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:19:55.407032 11318 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.404822 11312 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.404564 11181 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:55.423372 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:19:55.408409 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 75974.9us
W20260709 12:19:55.414330 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 104524us
I20260709 12:19:55.432878 11128 tablet_bootstrap.cc:654] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.433537 11126 tablet_bootstrap.cc:654] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.422295 11318 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:55.437184 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:55.441277 11125 tablet_bootstrap.cc:654] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.441972 11181 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:55.443616 11326 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:19:55.444891 10977 leader_election.cc:343] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.446470 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:19:55.448240 10882 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:55.448526 11165 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:19:55.449983 11051 leader_election.cc:343] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.453449 11051 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:55.453877 10977 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:55.454092 11326 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:19:55.442685 10974 leader_election.cc:343] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:55.454955 10974 leader_election.cc:343] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:55.456656 10865 debug-util.cc:398] Leaking SignalData structure 0x7b0800034340 after lost signal to thread 9744
W20260709 12:19:55.457620 10865 debug-util.cc:398] Leaking SignalData structure 0x7b08000349e0 after lost signal to thread 10868
W20260709 12:19:55.458674 10865 debug-util.cc:398] Leaking SignalData structure 0x7b0800193560 after lost signal to thread 10960
I20260709 12:19:55.460239 11005 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:55.460812 10865 debug-util.cc:398] Leaking SignalData structure 0x7b08001415a0 after lost signal to thread 11035
W20260709 12:19:55.461608 10865 debug-util.cc:398] Leaking SignalData structure 0x7b0800224ce0 after lost signal to thread 11109
W20260709 12:19:55.465006 10977 leader_election.cc:343] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.469249 10977 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:55.472429 11340 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:55.463984 11181 raft_consensus.cc:2804] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:55.473402 11181 raft_consensus.cc:697] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:19:55.474324 11181 consensus_queue.cc:237] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.477865 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:19:55.479220 10899 leader_election.cc:343] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.479416 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:55.480034 11008 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:55.484347 11317 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.484426 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:55.485075 10935 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:55.484874 11317 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:19:55.486748 10977 leader_election.cc:343] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.487300 11317 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:55.488431 11312 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.490826 11009 raft_consensus.cc:2393] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 1: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:19:55.491676 11312 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:55.497915 10901 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:55.503445 11125 tablet_bootstrap.cc:492] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:55.486231 11051 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:55.503969 11125 ts_tablet_manager.cc:1403] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.137s	user 0.012s	sys 0.001s
I20260709 12:19:55.488415 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:55.505458 10977 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:55.506249 11340 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:55.504063 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:55.509894 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:55.510083 11081 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.506639 10977 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:55.515547 11128 tablet_bootstrap.cc:492] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:55.515473 11326 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:55.506778 11317 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:55.525695 11128 ts_tablet_manager.cc:1403] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.232s	user 0.005s	sys 0.010s
I20260709 12:19:55.506670 11125 raft_consensus.cc:359] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.528537 11125 raft_consensus.cc:385] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.525161 11317 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.529309 11317 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.529654 11312 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:55.530164 11312 raft_consensus.cc:697] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:19:55.528824 11125 raft_consensus.cc:740] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.534600 11125 consensus_queue.cc:260] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.530459 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:55.536355 10934 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.537811 11125 ts_tablet_manager.cc:1434] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:19:55.538740 11125 tablet_bootstrap.cc:492] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
W20260709 12:19:55.539069 10901 leader_election.cc:343] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:55.532877 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 46737.4us
I20260709 12:19:55.539453 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:55.540126 10936 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 0.
I20260709 12:19:55.540684 11312 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.541813 11051 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:55.543766 10977 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:55.545186 11186 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:55.545056 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:55.545574 11186 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.519843 11081 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:19:55.545914 11186 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.547255 11326 raft_consensus.cc:2764] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:19:55.557621 10974 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:55.558493 11188 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:55.560760 11126 tablet_bootstrap.cc:492] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:55.561225 11126 ts_tablet_manager.cc:1403] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.260s	user 0.014s	sys 0.010s
W20260709 12:19:55.561203 10899 leader_election.cc:343] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.561764 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:55.563740 11288 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:55.565003 11317 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.565862 10934 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:19:55.568998 11340 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:55.571311 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:55.571987 11008 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.576555 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:19:55.578053 10899 leader_election.cc:343] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.581173 11317 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:55.581336 11186 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.579737 11008 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:55.582715 11126 raft_consensus.cc:359] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.586542 11126 raft_consensus.cc:385] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.586869 11126 raft_consensus.cc:740] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.587728 11126 consensus_queue.cc:260] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.593148 11186 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:55.595211 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:55.598963 10932 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.599594 10901 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:55.600528 11288 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:55.601044 11288 raft_consensus.cc:697] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:19:55.601840 11288 consensus_queue.cc:237] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.604485 11126 ts_tablet_manager.cc:1434] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.001s
I20260709 12:19:55.605357 11126 tablet_bootstrap.cc:492] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:55.610011 11125 tablet_bootstrap.cc:654] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.610661 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:55.591840 11188 raft_consensus.cc:697] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:19:55.614825 11128 raft_consensus.cc:359] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.615513 11128 raft_consensus.cc:385] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.615765 11128 raft_consensus.cc:740] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
W20260709 12:19:55.627849 10974 leader_election.cc:343] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.645602 10932 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:19:55.646852 10977 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:55.647683 11312 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:55.648159 11312 raft_consensus.cc:697] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:19:55.648942 11312 consensus_queue.cc:237] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.649092 11188 consensus_queue.cc:237] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.652969 11128 consensus_queue.cc:260] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.658385 11128 ts_tablet_manager.cc:1434] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.131s	user 0.008s	sys 0.000s
I20260709 12:19:55.659359 11128 tablet_bootstrap.cc:492] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:55.659834 11126 tablet_bootstrap.cc:654] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.682176 11126 tablet_bootstrap.cc:492] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:55.682555 11126 ts_tablet_manager.cc:1403] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.077s	user 0.021s	sys 0.004s
I20260709 12:19:55.688720 11126 raft_consensus.cc:359] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.689467 11126 raft_consensus.cc:385] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.689785 11126 raft_consensus.cc:740] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.690321 11126 consensus_queue.cc:260] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.706298 11126 ts_tablet_manager.cc:1434] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.010s
I20260709 12:19:55.706755 11128 tablet_bootstrap.cc:654] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.707463 11126 tablet_bootstrap.cc:492] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:55.714934 11288 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.715562 11288 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.717993 11288 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:55.718875 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:55.719780 11005 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 1: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:19:55.719787 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:55.721127 11082 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 1: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:19:55.722911 10899 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:55.725772 11125 tablet_bootstrap.cc:492] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:55.725930 11318 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.726341 11125 ts_tablet_manager.cc:1403] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.188s	user 0.013s	sys 0.015s
I20260709 12:19:55.727702 11126 tablet_bootstrap.cc:654] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.729401 11125 raft_consensus.cc:359] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.730218 11125 raft_consensus.cc:385] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.730545 11125 raft_consensus.cc:740] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.731415 11125 consensus_queue.cc:260] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.734042 11125 ts_tablet_manager.cc:1434] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:55.735357 11125 tablet_bootstrap.cc:492] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:55.739481 10834 catalog_manager.cc:5697] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:55.741312 10834 catalog_manager.cc:5697] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:55.742871 10834 catalog_manager.cc:5697] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:55.747361 11125 tablet_bootstrap.cc:654] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.752156 11126 tablet_bootstrap.cc:492] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:55.752736 11126 ts_tablet_manager.cc:1403] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.015s
I20260709 12:19:55.761015 11318 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:55.764046 11125 tablet_bootstrap.cc:492] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:55.764540 11125 ts_tablet_manager.cc:1403] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.001s
I20260709 12:19:55.767073 11125 raft_consensus.cc:359] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.767724 11125 raft_consensus.cc:385] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.767997 11125 raft_consensus.cc:740] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.768649 11125 consensus_queue.cc:260] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.771154 11125 ts_tablet_manager.cc:1434] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 12:19:55.771607 11126 raft_consensus.cc:359] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.772061 11125 tablet_bootstrap.cc:492] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:55.772308 11126 raft_consensus.cc:385] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.772581 11126 raft_consensus.cc:740] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.773268 11126 consensus_queue.cc:260] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.775278 11126 ts_tablet_manager.cc:1434] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 12:19:55.776185 11126 tablet_bootstrap.cc:492] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:55.778599 11125 tablet_bootstrap.cc:654] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.790814 11128 tablet_bootstrap.cc:492] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:55.791903 11128 ts_tablet_manager.cc:1403] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.133s	user 0.014s	sys 0.011s
I20260709 12:19:55.793066 11126 tablet_bootstrap.cc:654] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.795115 10832 catalog_manager.cc:5697] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:55.800894 11128 raft_consensus.cc:359] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.801504 11128 raft_consensus.cc:385] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.801745 11128 raft_consensus.cc:740] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.802302 11128 consensus_queue.cc:260] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.804811 11128 ts_tablet_manager.cc:1434] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.003s
I20260709 12:19:55.805691 11128 tablet_bootstrap.cc:492] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:55.824496 11125 tablet_bootstrap.cc:492] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:55.824608 11126 tablet_bootstrap.cc:492] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:55.825070 11125 ts_tablet_manager.cc:1403] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.022s
I20260709 12:19:55.825130 11126 ts_tablet_manager.cc:1403] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.004s
I20260709 12:19:55.828140 11125 raft_consensus.cc:359] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.828881 11125 raft_consensus.cc:385] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.829149 11125 raft_consensus.cc:740] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.830852 11318 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.831202 11309 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.831336 11318 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.831650 11309 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.834786 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:19:55.836158 10901 leader_election.cc:343] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.837102 11318 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:55.837704 11125 consensus_queue.cc:260] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.839823 11125 ts_tablet_manager.cc:1434] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:19:55.839951 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:55.840758 11125 tablet_bootstrap.cc:492] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:55.840636 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:19:55.845438 10899 leader_election.cc:343] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.845899 10899 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:55.846361 11125 tablet_bootstrap.cc:654] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.846940 11318 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:55.847719 11309 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:55.848407 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:55.849277 11005 raft_consensus.cc:2393] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 1: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:19:55.850485 11050 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:55.853295 11309 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.859393 11352 consensus_queue.cc:1048] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:55.860308 11309 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:55.860710 11125 tablet_bootstrap.cc:492] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:55.861159 11125 ts_tablet_manager.cc:1403] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.010s
I20260709 12:19:55.848383 11126 raft_consensus.cc:359] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.861531 11126 raft_consensus.cc:385] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.861811 11126 raft_consensus.cc:740] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.862627 11126 consensus_queue.cc:260] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.863886 11125 raft_consensus.cc:359] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.864547 11125 raft_consensus.cc:385] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.864682 11126 ts_tablet_manager.cc:1434] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.004s
I20260709 12:19:55.864854 11125 raft_consensus.cc:740] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.865646 11126 tablet_bootstrap.cc:492] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:55.865732 11125 consensus_queue.cc:260] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.867798 11125 ts_tablet_manager.cc:1434] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:19:55.868723 11125 tablet_bootstrap.cc:492] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:55.872099 11126 tablet_bootstrap.cc:654] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.874209 11125 tablet_bootstrap.cc:654] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.874413 10833 catalog_manager.cc:5697] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:55.881438 11186 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.881990 11186 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.884200 11128 tablet_bootstrap.cc:654] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.886837 11186 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:55.888394 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:55.889163 11188 consensus_queue.cc:1048] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:55.891096 10974 leader_election.cc:343] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.892936 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:55.893664 10932 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 0.
I20260709 12:19:55.894965 10977 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:55.896181 11186 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:55.896543 11186 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.896893 11186 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.911628 11188 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.912288 11188 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.914539 11188 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:55.916728 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:55.918728 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:55.919422 10934 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 0.
W20260709 12:19:55.918787 10974 leader_election.cc:343] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.928314 11186 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.935808 11317 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.936445 11317 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.939064 11317 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:55.940236 11125 tablet_bootstrap.cc:492] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:55.940706 11125 ts_tablet_manager.cc:1403] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.072s	user 0.012s	sys 0.001s
I20260709 12:19:55.940533 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:55.940918 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:55.941212 11005 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:55.942616 10901 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:55.943367 11125 raft_consensus.cc:359] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.944285 11125 raft_consensus.cc:385] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.944561 11125 raft_consensus.cc:740] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.945322 11125 consensus_queue.cc:260] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:19:55.946964 10899 leader_election.cc:343] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.948279 11317 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:55.949239 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:55.947528 11186 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:55.949724 11317 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:55.951285 10974 leader_election.cc:343] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.950510 11317 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.952725 11126 tablet_bootstrap.cc:492] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:55.953215 11126 ts_tablet_manager.cc:1403] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.088s	user 0.029s	sys 0.027s
I20260709 12:19:55.956198 11126 raft_consensus.cc:359] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.956897 11126 raft_consensus.cc:385] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.957394 11126 raft_consensus.cc:740] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.957456 11188 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.957986 11188 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.958242 11126 consensus_queue.cc:260] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.945598 10977 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:55.962906 11126 ts_tablet_manager.cc:1434] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 12:19:55.963915 11126 tablet_bootstrap.cc:492] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:55.964088 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:55.964344 11188 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:55.964743 10934 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.963932 11186 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:55.968343 11186 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.968645 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:55.969648 11186 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:55.970374 10974 leader_election.cc:343] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:55.971681 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:55.968022 11125 ts_tablet_manager.cc:1434] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:19:55.972577 10932 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 0.
I20260709 12:19:55.974269 10934 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:19:55.975502 11125 tablet_bootstrap.cc:492] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:55.985863 11128 tablet_bootstrap.cc:492] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:55.986357 11128 ts_tablet_manager.cc:1403] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.181s	user 0.013s	sys 0.025s
I20260709 12:19:55.985878 10977 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:55.988030 11352 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:55.988418 11352 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.988446 10977 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:55.988921 11128 raft_consensus.cc:359] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.989428 11312 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:55.989651 11128 raft_consensus.cc:385] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.990033 11128 raft_consensus.cc:740] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.990430 11126 tablet_bootstrap.cc:654] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.989881 11328 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.990089 11312 raft_consensus.cc:697] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:19:55.988886 11352 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.991997 11312 consensus_queue.cc:237] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.994360 11128 consensus_queue.cc:260] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.991437 11328 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:55.999929 11081 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.000712 11128 ts_tablet_manager.cc:1434] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.002s
I20260709 12:19:56.000903 11188 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.001389 11188 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.003480 11128 tablet_bootstrap.cc:492] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:56.005414 11188 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:56.003136 11317 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.007061 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:19:56.008303 10974 leader_election.cc:343] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.009055 11317 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:56.009008 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:56.009686 11005 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.010089 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:56.010195 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:56.010842 10934 raft_consensus.cc:2393] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 1: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:19:56.011691 10899 leader_election.cc:343] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.015516 11328 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:56.016861 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:56.019266 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:56.020843 11050 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:56.021891 11240 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:56.022023 11005 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:56.022881 10934 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 0.
I20260709 12:19:56.031348 10977 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:56.023264 11188 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:56.021273 11186 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.032593 11312 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:56.032958 11312 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.026765 11125 tablet_bootstrap.cc:654] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.033282 11312 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.008531 11352 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.029814 10901 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:56.036029 11288 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:56.036499 11288 raft_consensus.cc:697] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:19:56.037303 11288 consensus_queue.cc:237] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.038086 11352 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:56.039044 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:56.037429 11186 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:56.040237 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:19:56.040400 10974 leader_election.cc:343] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:56.041585 10974 leader_election.cc:343] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.045085 11312 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.047798 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:56.048456 10932 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.052685 11128 tablet_bootstrap.cc:654] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.066437 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:56.066725 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:56.067114 10934 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:56.068917 10974 leader_election.cc:343] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.076321 11317 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:56.077936 10833 catalog_manager.cc:5697] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:56.063545 11312 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:56.098847 11125 tablet_bootstrap.cc:492] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:56.099351 11125 ts_tablet_manager.cc:1403] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.126s	user 0.021s	sys 0.009s
I20260709 12:19:56.103207 11125 raft_consensus.cc:359] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.105540 11125 raft_consensus.cc:385] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.105772 11125 raft_consensus.cc:740] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.107347 11125 consensus_queue.cc:260] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.109382 11125 ts_tablet_manager.cc:1434] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:19:56.110477 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:56.111135 10935 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.113426 10932 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:19:56.114091 11125 tablet_bootstrap.cc:492] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:56.121115 11126 tablet_bootstrap.cc:492] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:56.121557 11126 ts_tablet_manager.cc:1403] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.158s	user 0.024s	sys 0.024s
I20260709 12:19:56.127159 10833 catalog_manager.cc:5697] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:56.138118 11312 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:56.148224 10977 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:56.151122 11188 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:56.151706 11188 raft_consensus.cc:697] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:19:56.152547 11188 consensus_queue.cc:237] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.143441 10934 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:19:56.151142 11312 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:19:56.162147 11125 tablet_bootstrap.cc:654] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:56.166399 10974 consensus_peers.cc:597] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Couldn't send request to peer 1abf4b385a2b493ab83f593a1f8c9cd1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:56.169817 11128 tablet_bootstrap.cc:492] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:56.170301 11128 ts_tablet_manager.cc:1403] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.169s	user 0.021s	sys 0.015s
I20260709 12:19:56.170588 11126 raft_consensus.cc:359] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.167589 10935 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:19:56.253221 11126 raft_consensus.cc:385] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.265367 11126 raft_consensus.cc:740] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.266268 11126 consensus_queue.cc:260] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.268160 11126 ts_tablet_manager.cc:1434] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.146s	user 0.029s	sys 0.057s
W20260709 12:19:56.250373 11376 log.cc:927] Time spent T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:19:56.269807 11126 tablet_bootstrap.cc:492] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:56.169466 11317 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.102s
I20260709 12:19:56.175113 10977 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:56.277777 11188 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:56.285590 11188 raft_consensus.cc:697] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:19:56.287020 11188 consensus_queue.cc:237] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:19:56.282369 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 111369us
I20260709 12:19:56.295771 11312 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.296307 11312 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.298360 11312 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:56.299959 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:19:56.301474 10974 leader_election.cc:343] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.304311 11125 tablet_bootstrap.cc:492] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:56.304158 11128 raft_consensus.cc:359] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.304809 11125 ts_tablet_manager.cc:1403] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.191s	user 0.009s	sys 0.022s
I20260709 12:19:56.304877 11128 raft_consensus.cc:385] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.305261 11128 raft_consensus.cc:740] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.305922 11128 consensus_queue.cc:260] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.313506 11165 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.319940 11128 ts_tablet_manager.cc:1434] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.000s
I20260709 12:19:56.320889 11128 tablet_bootstrap.cc:492] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:56.317960 11165 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.324391 11126 tablet_bootstrap.cc:654] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.328555 10833 catalog_manager.cc:5697] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:56.325201 11165 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:56.342455 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:56.339818 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:56.344820 10932 raft_consensus.cc:2393] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 1: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:19:56.348376 11125 raft_consensus.cc:359] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.349099 11125 raft_consensus.cc:385] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.349357 11125 raft_consensus.cc:740] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.349228 11050 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:56.356019 11328 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.365096 11312 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:56.378933 11328 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:56.400136 11125 consensus_queue.cc:260] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.401851 11125 ts_tablet_manager.cc:1434] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.097s	user 0.008s	sys 0.006s
I20260709 12:19:56.402845 11125 tablet_bootstrap.cc:492] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:56.430188 10977 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:56.431087 11385 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:56.431742 11385 raft_consensus.cc:697] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:19:56.432585 11385 consensus_queue.cc:237] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.439071 11128 tablet_bootstrap.cc:654] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.445137 11312 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:56.451520 11328 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.460041 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:56.460749 10930 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 0.
I20260709 12:19:56.458389 11328 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.464160 11328 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:56.465969 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:56.469245 11312 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:56.473243 11126 tablet_bootstrap.cc:492] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:56.473634 11126 ts_tablet_manager.cc:1403] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.204s	user 0.030s	sys 0.025s
I20260709 12:19:56.471948 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:56.480413 11312 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.471938 11381 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.482363 11051 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:56.483918 11125 tablet_bootstrap.cc:654] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.480950 11312 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.485845 11328 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:56.485205 11381 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.487890 11312 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:56.492887 11128 tablet_bootstrap.cc:492] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:56.493312 11128 ts_tablet_manager.cc:1403] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.173s	user 0.010s	sys 0.018s
I20260709 12:19:56.498155 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:19:56.502463 10974 leader_election.cc:343] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.506007 11128 raft_consensus.cc:359] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.506667 11128 raft_consensus.cc:385] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.506871 11128 raft_consensus.cc:740] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.509025 11128 consensus_queue.cc:260] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.509675 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:19:56.511188 10901 leader_election.cc:343] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.515087 11128 ts_tablet_manager.cc:1434] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.003s
I20260709 12:19:56.515937 11128 tablet_bootstrap.cc:492] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:56.517360 11381 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:56.517753 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:56.519559 10977 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:56.520422 11186 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:56.520787 11186 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.521137 11186 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.530773 11186 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.533722 11186 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:56.531754 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:19:56.537279 10899 leader_election.cc:343] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.537496 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:56.537806 10899 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:56.538661 11381 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:56.544615 10974 leader_election.cc:343] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:56.547752 10899 consensus_peers.cc:597] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 -> Peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Couldn't send request to peer 1abf4b385a2b493ab83f593a1f8c9cd1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:56.547125 10833 catalog_manager.cc:5697] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:56.548906 11165 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.549374 11165 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.554524 10833 catalog_manager.cc:5697] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:56.552947 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:56.559962 10929 raft_consensus.cc:2393] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 1: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:19:56.552724 11352 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:19:56.561298 11125 tablet_bootstrap.cc:492] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:56.560077 11126 raft_consensus.cc:359] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.561861 11126 raft_consensus.cc:385] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.561867 11125 ts_tablet_manager.cc:1403] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.159s	user 0.010s	sys 0.011s
I20260709 12:19:56.565147 11126 raft_consensus.cc:740] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.565940 11126 consensus_queue.cc:260] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:19:56.568401 10882 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:56.568275 11125 raft_consensus.cc:359] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.569034 11125 raft_consensus.cc:385] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.569319 11125 raft_consensus.cc:740] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.569964 11125 consensus_queue.cc:260] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.572970 11126 ts_tablet_manager.cc:1434] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.099s	user 0.002s	sys 0.005s
I20260709 12:19:56.555353 11165 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:19:56.552237 10977 leader_election.cc:343] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.582381 11125 ts_tablet_manager.cc:1434] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:19:56.582988 11126 tablet_bootstrap.cc:492] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:56.583374 11125 tablet_bootstrap.cc:492] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:56.581139 10977 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:56.585932 11352 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:56.590129 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:56.590734 10929 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.601033 11352 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:56.597313 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 43609.9us
I20260709 12:19:56.611187 11352 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.620965 10929 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:19:56.622756 11352 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:56.625200 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:56.625866 10931 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 0.
I20260709 12:19:56.639789 10977 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:56.649492 11382 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:56.650190 11352 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:56.650597 11352 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.650928 11352 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.656277 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:56.660763 10977 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:56.662588 11385 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:56.663085 11385 raft_consensus.cc:697] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:19:56.663956 11385 consensus_queue.cc:237] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.663903 11050 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:56.673389 11309 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.682776 11125 tablet_bootstrap.cc:654] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.684157 11128 tablet_bootstrap.cc:654] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.686975 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:56.705780 11126 tablet_bootstrap.cc:654] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.679898 11352 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.718492 11385 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.723105 11385 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.725389 10832 catalog_manager.cc:5697] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:56.730995 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:56.725364 11385 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:19:56.733958 10977 leader_election.cc:343] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.736689 11084 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.740193 11309 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:56.748454 10974 leader_election.cc:343] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.761852 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:56.765268 11312 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:19:56.766119 10974 leader_election.cc:343] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.766578 10974 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:56.768270 11312 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:56.771503 11398 log.cc:927] Time spent T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:19:56.791219 11128 tablet_bootstrap.cc:492] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:56.791690 11128 ts_tablet_manager.cc:1403] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.276s	user 0.015s	sys 0.007s
I20260709 12:19:56.794962 11128 raft_consensus.cc:359] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.795606 11128 raft_consensus.cc:385] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.795742 11126 tablet_bootstrap.cc:492] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:56.795990 11128 raft_consensus.cc:740] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.796255 11126 ts_tablet_manager.cc:1403] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.214s	user 0.013s	sys 0.026s
I20260709 12:19:56.796664 11128 consensus_queue.cc:260] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:19:56.797348 10974 consensus_peers.cc:597] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 -> Peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Couldn't send request to peer 1abf4b385a2b493ab83f593a1f8c9cd1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:56.798204 11128 ts_tablet_manager.cc:1434] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:19:56.799027 11128 tablet_bootstrap.cc:492] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:56.798810 11126 raft_consensus.cc:359] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.799525 11126 raft_consensus.cc:385] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.799799 11126 raft_consensus.cc:740] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.803002 11352 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:56.803485 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:56.804793 10930 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.806948 11126 consensus_queue.cc:260] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.810686 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:19:56.815532 10974 leader_election.cc:343] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.818037 11126 ts_tablet_manager.cc:1434] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.002s
I20260709 12:19:56.818991 11126 tablet_bootstrap.cc:492] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:56.819144 11128 tablet_bootstrap.cc:654] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.826525 11125 tablet_bootstrap.cc:492] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:56.827036 11125 ts_tablet_manager.cc:1403] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.244s	user 0.003s	sys 0.010s
I20260709 12:19:56.828603 11126 tablet_bootstrap.cc:654] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.830425 11125 raft_consensus.cc:359] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.831135 11125 raft_consensus.cc:385] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.831400 11125 raft_consensus.cc:740] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.832063 11125 consensus_queue.cc:260] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.834054 10930 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:19:56.837046 10977 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:56.840298 11186 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:56.834074 11125 ts_tablet_manager.cc:1434] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:19:56.840922 11186 raft_consensus.cc:697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:19:56.841552 11125 tablet_bootstrap.cc:492] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:56.843080 11186 consensus_queue.cc:237] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.848223 11385 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:56.849133 11125 tablet_bootstrap.cc:654] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.887907 11352 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:56.900104 11128 tablet_bootstrap.cc:492] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:56.900501 11128 ts_tablet_manager.cc:1403] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.102s	user 0.029s	sys 0.040s
I20260709 12:19:56.903522 11128 raft_consensus.cc:359] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.904182 11128 raft_consensus.cc:385] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.904436 11128 raft_consensus.cc:740] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.905077 11128 consensus_queue.cc:260] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.911665 11128 ts_tablet_manager.cc:1434] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:19:56.912648 11128 tablet_bootstrap.cc:492] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:56.918206 11128 tablet_bootstrap.cc:654] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.929311 11128 tablet_bootstrap.cc:492] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:56.929759 11128 ts_tablet_manager.cc:1403] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 12:19:56.932405 11128 raft_consensus.cc:359] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.933034 11128 raft_consensus.cc:385] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.933305 11128 raft_consensus.cc:740] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.933954 11128 consensus_queue.cc:260] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.934353 10833 catalog_manager.cc:5697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:56.936601 11128 ts_tablet_manager.cc:1434] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:19:56.937479 11128 tablet_bootstrap.cc:492] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:56.940115 11186 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:56.943141 11126 tablet_bootstrap.cc:492] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:56.943287 11128 tablet_bootstrap.cc:654] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.943763 11126 ts_tablet_manager.cc:1403] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.125s	user 0.025s	sys 0.011s
I20260709 12:19:56.946604 11126 raft_consensus.cc:359] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.949870 11125 tablet_bootstrap.cc:492] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:56.950203 11084 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.959609 11126 raft_consensus.cc:385] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.960310 11126 raft_consensus.cc:740] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.961463 11128 tablet_bootstrap.cc:492] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:56.961063 11126 consensus_queue.cc:260] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.961948 11128 ts_tablet_manager.cc:1403] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.007s
I20260709 12:19:56.963302 11126 ts_tablet_manager.cc:1434] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 12:19:56.964077 11128 raft_consensus.cc:359] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.964625 11128 raft_consensus.cc:385] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.964850 11128 raft_consensus.cc:740] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.965530 11128 consensus_queue.cc:260] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.964323 11126 tablet_bootstrap.cc:492] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:56.959779 11125 ts_tablet_manager.cc:1403] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.118s	user 0.022s	sys 0.011s
I20260709 12:19:56.967545 11128 ts_tablet_manager.cc:1434] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:19:56.969112 11128 tablet_bootstrap.cc:492] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:56.969936 11125 raft_consensus.cc:359] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.970656 11125 raft_consensus.cc:385] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.970913 11125 raft_consensus.cc:740] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.971678 11125 consensus_queue.cc:260] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:56.979817 11126 tablet_bootstrap.cc:654] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.981825 11128 tablet_bootstrap.cc:654] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.982874 11125 ts_tablet_manager.cc:1434] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 12:19:56.983899 11125 tablet_bootstrap.cc:492] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
W20260709 12:19:56.989809 10974 consensus_peers.cc:597] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Couldn't send request to peer 1abf4b385a2b493ab83f593a1f8c9cd1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:56.996829 11125 tablet_bootstrap.cc:654] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.997458 11402 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:19:56.997970 11402 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.009541 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:57.012240 11125 tablet_bootstrap.cc:492] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:57.012835 11125 ts_tablet_manager.cc:1403] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.010s
I20260709 12:19:57.013475 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:57.015334 11050 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:57.012257 11128 tablet_bootstrap.cc:492] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:57.016292 11128 ts_tablet_manager.cc:1403] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.003s
I20260709 12:19:57.017079 11309 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:57.018821 11128 raft_consensus.cc:359] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.019124 11402 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:57.019999 11128 raft_consensus.cc:385] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.020345 11128 raft_consensus.cc:740] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.021098 11128 consensus_queue.cc:260] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.015507 11125 raft_consensus.cc:359] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.022107 11125 raft_consensus.cc:385] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.022415 11125 raft_consensus.cc:740] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.023119 11125 consensus_queue.cc:260] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.025504 11125 ts_tablet_manager.cc:1434] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:19:57.020360 11126 tablet_bootstrap.cc:492] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:57.027343 11126 ts_tablet_manager.cc:1403] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.063s	user 0.009s	sys 0.012s
I20260709 12:19:57.031224 11125 tablet_bootstrap.cc:492] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:57.032627 11128 ts_tablet_manager.cc:1434] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:19:57.037691 11128 tablet_bootstrap.cc:492] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:57.043326 11128 tablet_bootstrap.cc:654] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.030054 11126 raft_consensus.cc:359] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.047024 11126 raft_consensus.cc:385] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.047345 11126 raft_consensus.cc:740] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.050431 11126 consensus_queue.cc:260] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.053345 11125 tablet_bootstrap.cc:654] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.055032 11128 tablet_bootstrap.cc:492] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:57.055583 11128 ts_tablet_manager.cc:1403] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:19:57.058148 11128 raft_consensus.cc:359] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.058956 11318 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.058970 11128 raft_consensus.cc:385] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.059540 11318 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.059551 11128 raft_consensus.cc:740] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.060818 11128 consensus_queue.cc:260] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.061774 11318 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:57.062484 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:57.063066 11128 ts_tablet_manager.cc:1434] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:57.063119 11009 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:57.063519 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:57.064266 11128 tablet_bootstrap.cc:492] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:57.064167 11084 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:57.064497 10901 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:57.065282 11318 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:57.065639 11318 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.065951 11318 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.071990 11128 tablet_bootstrap.cc:654] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.074333 11318 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.076664 11126 ts_tablet_manager.cc:1434] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.002s
I20260709 12:19:57.077785 11126 tablet_bootstrap.cc:492] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:57.105152 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:57.105790 11084 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.112213 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:57.112857 11009 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.123409 11083 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.128461 11084 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:57.130614 11402 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.131218 10899 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:57.110018 11318 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:57.132572 11382 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:57.131256 11402 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.134739 11125 tablet_bootstrap.cc:492] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:57.136052 11125 ts_tablet_manager.cc:1403] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.105s	user 0.017s	sys 0.006s
I20260709 12:19:57.138523 11126 tablet_bootstrap.cc:654] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.136034 11382 raft_consensus.cc:697] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:19:57.140839 11128 tablet_bootstrap.cc:492] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:57.141212 11128 ts_tablet_manager.cc:1403] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.077s	user 0.020s	sys 0.023s
I20260709 12:19:57.139882 11382 consensus_queue.cc:237] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.142696 11125 raft_consensus.cc:359] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.145007 11125 raft_consensus.cc:385] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.145295 11125 raft_consensus.cc:740] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.145603 11009 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:57.146066 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:57.143635 11128 raft_consensus.cc:359] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.143937 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:57.145928 11125 consensus_queue.cc:260] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.142617 11402 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:57.148926 11352 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:57.149775 11125 ts_tablet_manager.cc:1434] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:19:57.150533 11050 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:57.151233 11125 tablet_bootstrap.cc:492] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:57.151654 11402 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:57.153236 11128 raft_consensus.cc:385] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.153585 11128 raft_consensus.cc:740] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.154331 11128 consensus_queue.cc:260] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.156594 11128 ts_tablet_manager.cc:1434] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:19:57.159657 11128 tablet_bootstrap.cc:492] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:57.174168 11128 tablet_bootstrap.cc:654] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.183640 11084 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.191572 11125 tablet_bootstrap.cc:654] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.204159 11128 tablet_bootstrap.cc:492] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:57.204967 11128 ts_tablet_manager.cc:1403] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.046s	user 0.019s	sys 0.014s
I20260709 12:19:57.202540 11382 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.207347 10832 catalog_manager.cc:5697] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:57.209643 11382 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.210037 11128 raft_consensus.cc:359] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.210858 11128 raft_consensus.cc:385] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.211189 11128 raft_consensus.cc:740] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.212927 11352 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.213398 11352 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.215288 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:57.216064 11009 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:57.217660 10901 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:57.217756 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:57.219384 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:57.219944 11317 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:57.220389 11317 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.220731 11317 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:57.222085 10974 leader_election.cc:343] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.224987 11318 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.225497 11318 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.215507 11352 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:57.228868 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:57.229524 11081 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:57.227643 11318 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:57.212162 11128 consensus_queue.cc:260] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.233150 10899 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:57.233570 11382 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:57.235177 11318 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:57.235572 11165 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.236327 11128 ts_tablet_manager.cc:1434] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:19:57.236145 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:57.236101 11165 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.237834 11128 tablet_bootstrap.cc:492] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
W20260709 12:19:57.237963 10899 leader_election.cc:343] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.238508 11165 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:57.239660 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:57.235607 11318 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.240522 11318 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.244951 11125 tablet_bootstrap.cc:492] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:57.245461 11125 ts_tablet_manager.cc:1403] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.094s	user 0.013s	sys 0.002s
I20260709 12:19:57.245249 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:57.246124 11009 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:57.248548 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:57.249306 10930 raft_consensus.cc:2393] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 1: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:19:57.248926 11125 raft_consensus.cc:359] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.249697 11128 tablet_bootstrap.cc:654] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.249698 11125 raft_consensus.cc:385] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.250197 11125 raft_consensus.cc:740] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.250608 11051 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:57.251277 11125 consensus_queue.cc:260] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.251603 11165 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.253440 11125 ts_tablet_manager.cc:1434] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:19:57.254361 11125 tablet_bootstrap.cc:492] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:57.254379 11352 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:19:57.261691 11318 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.262466 11125 tablet_bootstrap.cc:654] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.264580 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:57.265220 11005 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.268978 11165 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:57.272645 11128 tablet_bootstrap.cc:492] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:57.273350 11128 ts_tablet_manager.cc:1403] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.001s
I20260709 12:19:57.276163 11352 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:57.276386 11128 raft_consensus.cc:359] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.277424 11128 raft_consensus.cc:385] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.277805 11128 raft_consensus.cc:740] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.278677 11128 consensus_queue.cc:260] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.281078 11128 ts_tablet_manager.cc:1434] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:19:57.283440 11128 tablet_bootstrap.cc:492] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:57.280989 11317 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.284950 10932 raft_consensus.cc:2393] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 1: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:19:57.285983 11317 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:57.288226 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:57.288726 11125 tablet_bootstrap.cc:492] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:57.289726 11125 ts_tablet_manager.cc:1403] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.016s
I20260709 12:19:57.288839 11082 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.283506 11126 tablet_bootstrap.cc:492] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:57.293286 11126 ts_tablet_manager.cc:1403] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.216s	user 0.024s	sys 0.014s
I20260709 12:19:57.297010 11125 raft_consensus.cc:359] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.297832 11125 raft_consensus.cc:385] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.298105 11125 raft_consensus.cc:740] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.298746 11125 consensus_queue.cc:260] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.300261 10977 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:57.321990 11125 ts_tablet_manager.cc:1434] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:19:57.324061 11125 tablet_bootstrap.cc:492] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:57.326210 11126 raft_consensus.cc:359] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.321962 11385 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.328378 11126 raft_consensus.cc:385] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.329475 11126 raft_consensus.cc:740] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.331317 11126 consensus_queue.cc:260] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.336076 11126 ts_tablet_manager.cc:1434] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.001s
I20260709 12:19:57.336925 11126 tablet_bootstrap.cc:492] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:57.341089 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:57.341727 11081 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.332783 11186 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:57.347661 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 50681.1us
I20260709 12:19:57.334234 11318 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:57.339902 11393 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.357702 11435 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.335171 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:57.361349 11128 tablet_bootstrap.cc:654] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.334713 11005 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:57.398797 11125 tablet_bootstrap.cc:654] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.356637 11186 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.384984 11435 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.370639 11393 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.422698 11393 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:57.424803 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:57.429245 11186 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:57.436213 11165 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:57.436854 10974 leader_election.cc:343] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.436786 11165 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.438792 11165 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:57.438971 11435 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:57.440723 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:19:57.442368 10899 leader_election.cc:343] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.444082 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:57.444751 11084 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 0.
I20260709 12:19:57.445756 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:57.446401 11005 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:57.446887 10974 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:57.448858 11050 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:57.454028 11165 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:57.454414 11165 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.456153 11165 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.448426 11186 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:57.448604 10901 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:57.461380 11318 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:57.461659 11081 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:57.461891 11318 raft_consensus.cc:697] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:19:57.462845 11186 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.482425 11186 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:57.489127 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 188961us
I20260709 12:19:57.473217 11082 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:57.494477 11126 tablet_bootstrap.cc:654] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.485181 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:57.490216 11317 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.497483 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:57.482234 11318 consensus_queue.cc:237] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.504259 11385 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:57.506697 11165 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.512099 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:57.510315 11402 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.513523 11402 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.514709 10899 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:57.515323 11437 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:57.508315 11005 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:57.515774 11437 raft_consensus.cc:697] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:19:57.530334 11437 consensus_queue.cc:237] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.531428 11393 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.531950 11393 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.532452 11402 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:57.533499 11165 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:57.516467 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:57.533859 11393 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:57.506749 11317 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.545886 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:57.546023 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:57.547644 10901 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:57.524643 11385 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:19:57.554097 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:57.549959 11436 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:57.553401 11447 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.569211 11440 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.572808 11125 tablet_bootstrap.cc:492] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:57.573346 11125 ts_tablet_manager.cc:1403] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.250s	user 0.012s	sys 0.009s
I20260709 12:19:57.563619 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:57.577250 11128 tablet_bootstrap.cc:492] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:57.557173 10930 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:57.581424 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:57.587387 11009 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:57.564744 11436 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.589178 11128 ts_tablet_manager.cc:1403] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.306s	user 0.028s	sys 0.028s
I20260709 12:19:57.594610 11125 raft_consensus.cc:359] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.596223 11125 raft_consensus.cc:385] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.596491 11125 raft_consensus.cc:740] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
W20260709 12:19:57.588608 10977 leader_election.cc:343] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.569824 11440 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.596895 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:57.597705 11125 consensus_queue.cc:260] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.591710 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:57.599606 11317 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:57.605924 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:57.606410 11393 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:57.595929 11436 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.625067 11083 raft_consensus.cc:2393] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 1: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:19:57.631106 11317 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.636636 11317 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.568002 11447 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:19:57.654371 10977 leader_election.cc:343] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.635622 11186 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.664311 11125 ts_tablet_manager.cc:1434] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.001s
I20260709 12:19:57.664536 11050 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:19:57.666184 10882 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:57.671047 11126 tablet_bootstrap.cc:492] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:57.671541 11126 ts_tablet_manager.cc:1403] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.335s	user 0.033s	sys 0.029s
I20260709 12:19:57.667202 11317 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:57.679301 11128 raft_consensus.cc:359] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.679874 11128 raft_consensus.cc:385] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.680088 11128 raft_consensus.cc:740] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.681929 11128 consensus_queue.cc:260] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.680938 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:57.687541 11442 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:57.680861 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:57.692561 11440 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:57.703919 11128 ts_tablet_manager.cc:1434] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.108s	user 0.005s	sys 0.000s
I20260709 12:19:57.689225 11443 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.713861 11007 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:57.724220 11126 raft_consensus.cc:359] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.724936 11126 raft_consensus.cc:385] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.725215 11126 raft_consensus.cc:740] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.725752 11126 consensus_queue.cc:260] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.718990 11008 raft_consensus.cc:2393] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 1: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:19:57.738193 11126 ts_tablet_manager.cc:1434] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 12:19:57.740249 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:57.740958 10932 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:19:57.743139 10901 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:57.743254 10977 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:57.756284 11447 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:57.748476 11435 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:57.757076 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:57.733530 11443 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.770073 11430 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:19:57.774740 11443 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:57.776265 11447 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.776808 11451 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:57.776767 11447 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.777246 11451 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.777594 11451 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:57.761580 11435 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.786216 11125 tablet_bootstrap.cc:492] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:57.791045 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:57.792196 11318 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:57.786114 11435 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:57.782562 10932 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.799839 11128 tablet_bootstrap.cc:492] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:57.781656 11083 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:57.790418 11186 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:57.813303 11084 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.822925 11125 tablet_bootstrap.cc:654] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.822397 11436 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.826418 11447 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:19:57.827984 10974 leader_election.cc:343] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.828624 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:57.829800 10974 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:57.836741 11444 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:57.832262 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:57.852054 11443 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.852591 11443 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.850028 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:57.856617 10901 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:57.846102 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:57.861671 11076 raft_consensus.cc:2393] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 1: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:19:57.862424 11443 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:57.862659 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:19:57.862957 10977 leader_election.cc:343] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.865880 11081 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:19:57.872913 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:57.881507 11436 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:57.882701 10834 catalog_manager.cc:5697] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:57.884688 10834 catalog_manager.cc:5697] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:57.886865 11128 tablet_bootstrap.cc:654] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.874164 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:19:57.889881 10977 leader_election.cc:343] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.890035 11126 tablet_bootstrap.cc:492] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:57.896399 11050 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:57.834426 11451 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:19:57.902482 10974 leader_election.cc:343] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.903179 10974 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:57.895432 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:57.909719 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:57.911409 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:57.898298 11402 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:57.891309 11435 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.906808 11444 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:57.922370 11005 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 2: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:19:57.936363 10930 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 2: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:19:57.925316 11006 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:57.927593 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:19:57.939154 10974 leader_election.cc:343] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.924564 10931 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:57.942289 10974 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:57.940433 11451 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:57.941506 11009 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.945662 11435 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:57.943274 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:57.949419 11050 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:57.951515 11126 tablet_bootstrap.cc:654] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.951457 11050 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:57.952178 11451 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:57.952064 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:57.952945 10927 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 2: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:19:57.953279 11442 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:57.953656 11442 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.953966 11442 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:57.958674 10899 leader_election.cc:343] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.958385 11443 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:57.966562 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:57.967367 11008 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 2: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:19:57.968174 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:57.968441 10932 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:19:57.969187 11437 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:57.971091 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:57.972882 10974 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:57.977653 11444 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:57.981832 10977 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:57.986899 11446 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:57.988131 11128 tablet_bootstrap.cc:492] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:57.988526 11128 ts_tablet_manager.cc:1403] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.189s	user 0.011s	sys 0.005s
I20260709 12:19:57.987682 11446 raft_consensus.cc:697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:19:58.005894 11125 tablet_bootstrap.cc:492] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:58.006398 11125 ts_tablet_manager.cc:1403] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.221s	user 0.011s	sys 0.012s
I20260709 12:19:57.990408 11009 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:57.996299 11446 consensus_queue.cc:237] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.017653 11435 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:58.021369 11128 raft_consensus.cc:359] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.022181 11128 raft_consensus.cc:385] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.022416 11128 raft_consensus.cc:740] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.022986 11128 consensus_queue.cc:260] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:57.996269 11442 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.028733 11125 raft_consensus.cc:359] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.029480 11125 raft_consensus.cc:385] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.029765 11125 raft_consensus.cc:740] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.028733 10901 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:58.030606 11125 consensus_queue.cc:260] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.031157 11435 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:58.032200 11435 raft_consensus.cc:697] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:19:58.032829 11125 ts_tablet_manager.cc:1434] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 12:19:58.033766 11125 tablet_bootstrap.cc:492] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:58.034732 11443 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:58.036568 11435 consensus_queue.cc:237] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.046684 11128 ts_tablet_manager.cc:1434] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.002s
I20260709 12:19:58.047870 11128 tablet_bootstrap.cc:492] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:58.094115 11435 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:58.096383 11080 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:19:58.089593 11447 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.100543 11447 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.102447 11447 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:58.104609 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:58.105198 10932 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.105831 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:19:58.107522 10977 leader_election.cc:343] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:58.110077 11402 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.110584 11402 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.110951 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:58.113889 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:19:58.115404 10974 leader_election.cc:343] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:58.115919 10974 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:58.116852 11447 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:58.118139 10899 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:19:58.118547 11051 leader_election.cc:343] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:58.107236 11435 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:58.125295 10834 catalog_manager.cc:5697] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:58.126680 11436 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:58.136673 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:58.123095 11402 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:58.171761 11126 tablet_bootstrap.cc:492] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:58.172334 11126 ts_tablet_manager.cc:1403] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.283s	user 0.028s	sys 0.013s
I20260709 12:19:58.181593 10832 catalog_manager.cc:5697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:58.198441 11128 tablet_bootstrap.cc:654] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.193226 11007 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:58.202718 11050 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:58.203460 11165 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:58.203796 11165 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.204136 11165 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.206286 11125 tablet_bootstrap.cc:654] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.197160 11438 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:19:58.213076 11165 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.192996 11436 raft_consensus.cc:697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:19:58.203073 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:58.198858 11442 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:58.228780 11007 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.236056 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:58.244105 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:58.244786 11004 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.256093 11165 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:19:58.270206 11465 log.cc:927] Time spent T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:19:58.278487 11436 consensus_queue.cc:237] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.299355 10932 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:58.302939 11007 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:58.304427 11050 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:19:58.319667 11051 leader_election.cc:343] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:58.314224 11471 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:58.324666 11471 raft_consensus.cc:697] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:19:58.325511 11471 consensus_queue.cc:237] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.336009 11126 raft_consensus.cc:359] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.336686 11126 raft_consensus.cc:385] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.336937 11126 raft_consensus.cc:740] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.338629 11126 consensus_queue.cc:260] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.351564 11126 ts_tablet_manager.cc:1434] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.179s	user 0.007s	sys 0.000s
W20260709 12:19:58.340281 11469 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:19:58.360610 11125 tablet_bootstrap.cc:492] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:58.361070 11125 ts_tablet_manager.cc:1403] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.327s	user 0.012s	sys 0.012s
W20260709 12:19:58.369611 11470 log.cc:927] Time spent T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:19:58.377769 11126 tablet_bootstrap.cc:492] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:58.383370 11125 raft_consensus.cc:359] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.386495 11125 raft_consensus.cc:385] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.386860 11125 raft_consensus.cc:740] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.386103 10832 catalog_manager.cc:5697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 2, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:58.388146 11125 consensus_queue.cc:260] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.396407 11125 ts_tablet_manager.cc:1434] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.004s
I20260709 12:19:58.397359 11125 tablet_bootstrap.cc:492] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:58.403321 11128 tablet_bootstrap.cc:492] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:58.416620 11128 ts_tablet_manager.cc:1403] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.369s	user 0.026s	sys 0.001s
I20260709 12:19:58.419521 11128 raft_consensus.cc:359] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.404160 11004 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:58.428102 11128 raft_consensus.cc:385] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.423125 11126 tablet_bootstrap.cc:654] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.428432 11128 raft_consensus.cc:740] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.428962 11050 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:58.429139 11128 consensus_queue.cc:260] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.422503 10831 catalog_manager.cc:5697] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:58.430256 11165 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:58.430716 11165 raft_consensus.cc:697] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:19:58.431841 11128 ts_tablet_manager.cc:1434] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:19:58.431502 11165 consensus_queue.cc:237] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.432966 11128 tablet_bootstrap.cc:492] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:58.412792 11125 tablet_bootstrap.cc:654] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.448063 11128 tablet_bootstrap.cc:654] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.451529 11126 tablet_bootstrap.cc:492] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:58.452826 11126 ts_tablet_manager.cc:1403] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.075s	user 0.009s	sys 0.012s
I20260709 12:19:58.455341 11126 raft_consensus.cc:359] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.456029 11126 raft_consensus.cc:385] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.456312 11126 raft_consensus.cc:740] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.456624 11447 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:58.456912 11126 consensus_queue.cc:260] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.459043 11126 ts_tablet_manager.cc:1434] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:19:58.465842 11126 tablet_bootstrap.cc:492] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:58.470008 11128 tablet_bootstrap.cc:492] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:58.470543 11128 ts_tablet_manager.cc:1403] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.038s	user 0.005s	sys 0.006s
I20260709 12:19:58.471553 11126 tablet_bootstrap.cc:654] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.472819 11125 tablet_bootstrap.cc:492] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:58.473348 11125 ts_tablet_manager.cc:1403] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.001s
I20260709 12:19:58.473554 11128 raft_consensus.cc:359] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.474241 11128 raft_consensus.cc:385] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.474511 11128 raft_consensus.cc:740] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.475145 11128 consensus_queue.cc:260] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.480829 11446 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:58.481853 11128 ts_tablet_manager.cc:1434] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 12:19:58.482836 11128 tablet_bootstrap.cc:492] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:58.488518 11128 tablet_bootstrap.cc:654] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.492130 11125 raft_consensus.cc:359] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.492866 11125 raft_consensus.cc:385] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.493152 11125 raft_consensus.cc:740] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.493726 11125 consensus_queue.cc:260] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.503324 11125 ts_tablet_manager.cc:1434] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 12:19:58.506104 10831 catalog_manager.cc:5697] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:58.510223 11435 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.535504 11435 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.537771 11435 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:58.538659 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:58.518947 11125 tablet_bootstrap.cc:492] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:58.539484 11007 raft_consensus.cc:2393] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 1: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:19:58.525096 11451 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.544101 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:58.544533 11451 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.509935 11126 tablet_bootstrap.cc:492] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:58.546013 11126 ts_tablet_manager.cc:1403] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.006s
I20260709 12:19:58.546598 11451 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:58.547269 10899 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:58.559083 11435 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.550180 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:58.528003 11080 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.548648 11126 raft_consensus.cc:359] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.560600 11126 raft_consensus.cc:385] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.552320 11438 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260709 12:19:58.564612 10974 leader_election.cc:343] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:58.565037 11126 raft_consensus.cc:740] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.565793 11126 consensus_queue.cc:260] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.552359 11125 tablet_bootstrap.cc:654] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.521137 11128 tablet_bootstrap.cc:492] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:58.573011 11128 ts_tablet_manager.cc:1403] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.090s	user 0.015s	sys 0.001s
I20260709 12:19:58.559211 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:58.574051 11126 ts_tablet_manager.cc:1434] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 12:19:58.575148 11126 tablet_bootstrap.cc:492] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:58.576500 11128 raft_consensus.cc:359] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.586879 11128 raft_consensus.cc:385] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.587239 11128 raft_consensus.cc:740] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.588042 11128 consensus_queue.cc:260] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:19:58.591573 10977 leader_election.cc:343] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:58.592041 10977 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:58.593263 11447 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:58.595189 11471 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.596074 11128 ts_tablet_manager.cc:1434] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:19:58.595678 11471 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.598307 11471 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:58.598783 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:58.601969 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:58.605223 11318 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:58.606091 11471 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.606719 11051 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:58.606647 11471 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.607429 11165 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:58.610090 11471 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:58.611334 11318 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.611889 11318 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.614461 11128 tablet_bootstrap.cc:492] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:58.627174 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:58.627926 11004 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:58.629069 11050 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:58.631371 11471 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:58.631732 11471 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.632108 11471 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.632402 11318 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:58.637687 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:19:58.639276 10901 leader_election.cc:343] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:58.571568 11435 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:58.642740 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:58.643386 10929 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:58.681488 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:58.682211 11080 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:58.725219 11126 tablet_bootstrap.cc:654] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:58.730844 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 59261.4us
I20260709 12:19:58.732824 11128 tablet_bootstrap.cc:654] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:58.733170 10882 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:58.737272 10899 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:58.741112 11318 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:58.742913 11318 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.743258 11318 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.747713 11471 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.755079 11125 tablet_bootstrap.cc:492] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:58.755571 11125 ts_tablet_manager.cc:1403] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.237s	user 0.012s	sys 0.008s
I20260709 12:19:58.763527 11318 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.766535 11318 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:58.768540 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:58.769181 11084 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.772225 11471 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:58.775545 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:58.776209 11008 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.777374 11125 raft_consensus.cc:359] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.778085 11125 raft_consensus.cc:385] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.778360 11125 raft_consensus.cc:740] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.779048 11125 consensus_queue.cc:260] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.781734 11128 tablet_bootstrap.cc:492] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:58.782231 11128 ts_tablet_manager.cc:1403] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.181s	user 0.012s	sys 0.000s
I20260709 12:19:58.783420 11084 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:58.786007 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:58.786616 10936 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.787263 11125 ts_tablet_manager.cc:1434] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 12:19:58.788303 11125 tablet_bootstrap.cc:492] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:58.792184 11446 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.792711 11446 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.794663 11446 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:58.796316 10936 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:58.801769 11125 tablet_bootstrap.cc:654] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.803057 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:58.805105 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:19:58.810293 10901 leader_election.cc:343] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:58.811010 10974 leader_election.cc:343] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:58.812531 11008 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:58.813643 11050 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:58.814388 11471 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:58.814949 11471 raft_consensus.cc:697] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:19:58.815891 11471 consensus_queue.cc:237] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.827612 11125 tablet_bootstrap.cc:492] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:58.830269 11126 tablet_bootstrap.cc:492] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:58.831368 11126 ts_tablet_manager.cc:1403] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.256s	user 0.007s	sys 0.006s
I20260709 12:19:58.833146 11125 ts_tablet_manager.cc:1403] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.001s
I20260709 12:19:58.835237 11128 raft_consensus.cc:359] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.851366 11128 raft_consensus.cc:385] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.851725 11128 raft_consensus.cc:740] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.852739 11128 consensus_queue.cc:260] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.852921 10831 catalog_manager.cc:5697] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:58.854321 11128 ts_tablet_manager.cc:1434] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.072s	user 0.004s	sys 0.001s
I20260709 12:19:58.835623 11125 raft_consensus.cc:359] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.836162 11008 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:19:58.836301 10899 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:58.855526 11446 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.856935 11317 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:58.857424 11317 raft_consensus.cc:697] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:19:58.858220 11317 consensus_queue.cc:237] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.837064 11126 raft_consensus.cc:359] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.837956 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:58.861649 11436 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:58.861936 11126 raft_consensus.cc:385] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.862309 11126 raft_consensus.cc:740] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.864972 11165 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:58.866403 10977 leader_election.cc:343] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:58.866830 10977 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:58.867518 11447 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:58.856112 11446 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.871584 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:19:58.872936 10977 leader_election.cc:343] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:58.864837 11126 consensus_queue.cc:260] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.874056 11446 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:58.875964 11126 ts_tablet_manager.cc:1434] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.044s	user 0.002s	sys 0.004s
I20260709 12:19:58.876752 11402 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.876974 11126 tablet_bootstrap.cc:492] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:58.877307 11402 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:58.855423 11125 raft_consensus.cc:385] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.881533 11125 raft_consensus.cc:740] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.881410 11471 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:58.882783 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:19:58.885815 11051 leader_election.cc:343] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:58.886955 11128 tablet_bootstrap.cc:492] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:58.890506 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:19:58.895351 10974 leader_election.cc:343] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:58.897313 10974 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:19:58.948048 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 52742.2us
I20260709 12:19:58.949267 11125 consensus_queue.cc:260] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:19:58.952061 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 63015.5us
I20260709 12:19:58.915974 11447 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:58.958266 11077 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:19:58.959635 11125 ts_tablet_manager.cc:1434] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.126s	user 0.029s	sys 0.027s
I20260709 12:19:58.963160 11126 tablet_bootstrap.cc:654] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.964759 11125 tablet_bootstrap.cc:492] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:58.965682 11402 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:59.019009 11186 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.020442 11186 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.023833 11186 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:59.043921 11317 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:59.053179 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:59.069756 11125 tablet_bootstrap.cc:654] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.072222 11126 tablet_bootstrap.cc:492] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:59.085686 11128 tablet_bootstrap.cc:654] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:59.112124 10977 leader_election.cc:343] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:59.116200 11126 ts_tablet_manager.cc:1403] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.239s	user 0.012s	sys 0.010s
I20260709 12:19:59.117136 10831 catalog_manager.cc:5697] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:59.119517 11459 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.124269 11165 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:59.124930 11459 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.127676 11459 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:19:59.138859 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 152302us
I20260709 12:19:59.143693 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:59.144529 11009 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:59.134001 11126 raft_consensus.cc:359] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.148358 11126 raft_consensus.cc:385] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.148782 11126 raft_consensus.cc:740] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.149313 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:59.149628 11126 consensus_queue.cc:260] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.151831 11126 ts_tablet_manager.cc:1434] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.002s
I20260709 12:19:59.155081 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:59.155326 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:59.179015 11004 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:59.180199 11050 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:59.181900 11402 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:59.182327 11402 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:59.182643 11402 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.189949 10901 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:59.200668 11499 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:59.201103 11499 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:59.201452 11499 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.201694 11125 tablet_bootstrap.cc:492] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:59.202299 11126 tablet_bootstrap.cc:492] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:59.202441 11125 ts_tablet_manager.cc:1403] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.238s	user 0.016s	sys 0.013s
I20260709 12:19:59.203217 11471 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
W20260709 12:19:59.212630 10899 leader_election.cc:343] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:59.216107 10974 leader_election.cc:343] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:59.216552 10974 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:59.217272 11186 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:59.215484 11125 raft_consensus.cc:359] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.240075 11125 raft_consensus.cc:385] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.240490 11125 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.238713 11402 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.243439 11402 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:59.245450 11125 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.238272 11499 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.249035 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:59.250429 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:59.252727 11007 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.254343 11128 tablet_bootstrap.cc:492] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
W20260709 12:19:59.255744 10901 consensus_peers.cc:597] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:59.255999 11128 ts_tablet_manager.cc:1403] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.401s	user 0.008s	sys 0.013s
I20260709 12:19:59.259142 11128 raft_consensus.cc:359] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.262935 11128 raft_consensus.cc:385] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.271158 11128 raft_consensus.cc:740] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
W20260709 12:19:59.262537 11051 leader_election.cc:343] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:59.262956 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:59.272153 11004 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.261148 11438 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.276155 11438 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.278330 11438 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:59.280223 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:59.284374 11128 consensus_queue.cc:260] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.286044 11083 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.267627 11499 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:59.270793 11125 ts_tablet_manager.cc:1434] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
I20260709 12:19:59.262164 11126 tablet_bootstrap.cc:654] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.289558 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:59.290515 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:59.291706 11007 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:59.295902 10901 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:59.296052 11009 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:59.297189 11438 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:59.297607 10901 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:59.298450 11437 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:59.298812 11437 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:59.299204 11437 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.299844 11004 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:59.300902 11050 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:59.306424 11508 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:59.306931 11508 raft_consensus.cc:697] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:19:59.307834 11508 consensus_queue.cc:237] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.309747 11438 raft_consensus.cc:697] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:19:59.311067 11125 tablet_bootstrap.cc:492] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:59.310818 11438 consensus_queue.cc:237] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.318789 11083 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
W20260709 12:19:59.329255 10899 leader_election.cc:343] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:59.348439 11128 ts_tablet_manager.cc:1434] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.004s
I20260709 12:19:59.307718 11437 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.349531 11128 tablet_bootstrap.cc:492] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:59.349923 11499 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:59.330526 11125 tablet_bootstrap.cc:654] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.352389 11437 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:59.357910 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:59.361581 11126 tablet_bootstrap.cc:492] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
W20260709 12:19:59.361542 10899 leader_election.cc:343] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:59.362228 11126 ts_tablet_manager.cc:1403] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.160s	user 0.021s	sys 0.020s
I20260709 12:19:59.363255 10832 catalog_manager.cc:5697] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:59.365903 11126 raft_consensus.cc:359] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.366438 11126 raft_consensus.cc:385] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.366657 11126 raft_consensus.cc:740] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.367239 11126 consensus_queue.cc:260] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.369913 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:59.370700 11004 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.376842 11128 tablet_bootstrap.cc:654] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.383386 11126 ts_tablet_manager.cc:1434] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:19:59.386976 11126 tablet_bootstrap.cc:492] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:59.388742 11004 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:19:59.392010 10901 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:59.393236 11437 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:59.393980 11437 raft_consensus.cc:697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:19:59.394852 11437 consensus_queue.cc:237] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.410540 10833 catalog_manager.cc:5697] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:59.414842 11128 tablet_bootstrap.cc:492] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:59.415339 11128 ts_tablet_manager.cc:1403] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.014s
I20260709 12:19:59.423319 11128 raft_consensus.cc:359] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.424047 11128 raft_consensus.cc:385] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.424525 11128 raft_consensus.cc:740] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.425165 11128 consensus_queue.cc:260] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.430755 11128 ts_tablet_manager.cc:1434] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 12:19:59.431779 11128 tablet_bootstrap.cc:492] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:59.433351 11501 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:59.438189 11128 tablet_bootstrap.cc:654] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.441485 11501 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:59.443478 10833 catalog_manager.cc:5697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:59.448232 11125 tablet_bootstrap.cc:492] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:59.453604 11125 ts_tablet_manager.cc:1403] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.143s	user 0.013s	sys 0.007s
I20260709 12:19:59.467535 11125 raft_consensus.cc:359] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.470839 11125 raft_consensus.cc:385] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.471285 11125 raft_consensus.cc:740] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.472245 11125 consensus_queue.cc:260] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.467739 11126 tablet_bootstrap.cc:654] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.474797 11125 ts_tablet_manager.cc:1434] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:19:59.479051 11125 tablet_bootstrap.cc:492] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:59.486580 11128 tablet_bootstrap.cc:492] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:59.487095 11128 ts_tablet_manager.cc:1403] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.056s	user 0.022s	sys 0.018s
I20260709 12:19:59.490284 11128 raft_consensus.cc:359] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.490988 11128 raft_consensus.cc:385] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.491243 11128 raft_consensus.cc:740] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.491842 11128 consensus_queue.cc:260] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.494002 11128 ts_tablet_manager.cc:1434] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:19:59.495088 11128 tablet_bootstrap.cc:492] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:59.501155 11128 tablet_bootstrap.cc:654] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.542399 11126 tablet_bootstrap.cc:492] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:59.543128 11126 ts_tablet_manager.cc:1403] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.159s	user 0.013s	sys 0.000s
I20260709 12:19:59.547122 11126 raft_consensus.cc:359] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.549134 11126 raft_consensus.cc:385] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.549547 11126 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.550455 11126 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.548738 11125 tablet_bootstrap.cc:654] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.554746 11128 tablet_bootstrap.cc:492] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:59.555267 11128 ts_tablet_manager.cc:1403] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.060s	user 0.016s	sys 0.035s
I20260709 12:19:59.558468 11128 raft_consensus.cc:359] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.559149 11128 raft_consensus.cc:385] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.559396 11128 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.560091 11128 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.561655 11128 ts_tablet_manager.cc:1434] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.007s
I20260709 12:19:59.563036 11128 tablet_bootstrap.cc:492] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:59.569380 11128 tablet_bootstrap.cc:654] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.573318 11126 ts_tablet_manager.cc:1434] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:19:59.574082 11186 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.574530 11186 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.576411 11186 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:59.577868 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:59.578267 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:59.578492 11084 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 0.
I20260709 12:19:59.578840 10932 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 0.
I20260709 12:19:59.579813 11165 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.579902 10974 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:59.580349 11165 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.580657 11186 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:59.581043 11186 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:59.581346 11186 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.584615 11126 tablet_bootstrap.cc:492] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:59.584836 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:59.587071 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:59.587736 10932 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:59.588135 11186 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.589298 11007 raft_consensus.cc:2393] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 1: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:19:59.591105 11051 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:59.591111 11126 tablet_bootstrap.cc:654] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.592118 11501 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:59.592404 11186 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:59.592746 11165 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:59.592509 11501 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:59.594076 11501 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.596009 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:19:59.602859 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:59.603096 11128 tablet_bootstrap.cc:492] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:59.603549 10932 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.603772 11128 ts_tablet_manager.cc:1403] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.008s
I20260709 12:19:59.608722 11128 raft_consensus.cc:359] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.609480 11128 raft_consensus.cc:385] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.609750 11128 raft_consensus.cc:740] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.610460 11128 consensus_queue.cc:260] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.613135 11128 ts_tablet_manager.cc:1434] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:19:59.614424 11128 tablet_bootstrap.cc:492] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:59.618920 11501 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.622630 11125 tablet_bootstrap.cc:492] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:59.623078 11125 ts_tablet_manager.cc:1403] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.144s	user 0.010s	sys 0.001s
I20260709 12:19:59.623688 11084 raft_consensus.cc:2393] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 1: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:19:59.631572 11125 raft_consensus.cc:359] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.632928 11125 raft_consensus.cc:385] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.633231 11125 raft_consensus.cc:740] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.632369 11499 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.635766 10932 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:19:59.636477 11125 consensus_queue.cc:260] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.639227 11499 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.644654 11499 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:59.647197 11126 tablet_bootstrap.cc:492] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:59.646497 10977 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:19:59.648150 11501 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:59.649349 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:59.649783 11186 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:59.656034 11186 raft_consensus.cc:697] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:19:59.656761 11186 consensus_queue.cc:237] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.647667 11126 ts_tablet_manager.cc:1403] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.017s
I20260709 12:19:59.650003 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:59.652810 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:19:59.661132 10932 raft_consensus.cc:2393] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 1: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:19:59.662325 11126 raft_consensus.cc:359] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.663002 11126 raft_consensus.cc:385] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.643893 11125 ts_tablet_manager.cc:1434] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.003s
I20260709 12:19:59.653452 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:59.654363 11128 tablet_bootstrap.cc:654] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.663285 11126 raft_consensus.cc:740] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.668102 11004 raft_consensus.cc:2393] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 1: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:19:59.668299 11126 consensus_queue.cc:260] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.669819 11126 ts_tablet_manager.cc:1434] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:19:59.670832 10901 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:19:59.671837 11437 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.675808 11447 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.676340 11447 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.675833 11125 tablet_bootstrap.cc:492] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:59.680734 11126 tablet_bootstrap.cc:492] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:59.684393 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:59.687383 11126 tablet_bootstrap.cc:654] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.695122 11126 tablet_bootstrap.cc:492] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:59.695449 11050 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:59.696269 11447 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:59.696587 11501 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:59.700302 11128 tablet_bootstrap.cc:492] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:59.697400 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:59.700771 11128 ts_tablet_manager.cc:1403] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.087s	user 0.013s	sys 0.001s
I20260709 12:19:59.699205 10833 catalog_manager.cc:5697] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:59.703583 11128 raft_consensus.cc:359] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.704541 10977 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:19:59.705531 11186 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:59.704541 11128 raft_consensus.cc:385] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.706414 11128 raft_consensus.cc:740] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.696024 11126 ts_tablet_manager.cc:1403] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 12:19:59.709676 11126 raft_consensus.cc:359] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.712231 11126 raft_consensus.cc:385] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.712628 11126 raft_consensus.cc:740] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.707007 11128 consensus_queue.cc:260] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.713343 11126 consensus_queue.cc:260] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.715602 11126 ts_tablet_manager.cc:1434] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:19:59.716285 11128 ts_tablet_manager.cc:1434] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:19:59.717304 11128 tablet_bootstrap.cc:492] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:59.717317 11126 tablet_bootstrap.cc:492] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:59.724335 11126 tablet_bootstrap.cc:654] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.735598 11128 tablet_bootstrap.cc:654] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.739358 11126 tablet_bootstrap.cc:492] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:59.739842 11126 ts_tablet_manager.cc:1403] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.009s
I20260709 12:19:59.740128 11128 tablet_bootstrap.cc:492] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:59.740578 11128 ts_tablet_manager.cc:1403] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.002s
I20260709 12:19:59.743067 11126 raft_consensus.cc:359] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.743801 11126 raft_consensus.cc:385] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.744225 11126 raft_consensus.cc:740] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.744829 11126 consensus_queue.cc:260] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.748808 11126 ts_tablet_manager.cc:1434] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 12:19:59.749378 11499 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:59.751529 11126 tablet_bootstrap.cc:492] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:19:59.743770 11128 raft_consensus.cc:359] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.752461 11128 raft_consensus.cc:385] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.752728 11128 raft_consensus.cc:740] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.753355 11128 consensus_queue.cc:260] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.755429 11128 ts_tablet_manager.cc:1434] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:19:59.756497 11128 tablet_bootstrap.cc:492] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:59.758185 11126 tablet_bootstrap.cc:654] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.765441 11128 tablet_bootstrap.cc:654] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.770777 11437 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:59.777640 11508 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.778158 11508 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.780755 11508 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:59.782364 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:59.783747 11007 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:19:59.785306 11050 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:59.786271 11508 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:59.786707 11508 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:59.787106 11508 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.800149 11082 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.828864 11533 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.829398 11533 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.830925 11165 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:59.831610 11533 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:59.832945 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:19:59.835780 11050 leader_election.cc:343] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:59.825834 11499 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.843158 11499 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.853259 11508 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.869064 11501 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.869766 11501 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:19:59.870091 10882 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:59.873164 11125 tablet_bootstrap.cc:654] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.871569 11501 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:59.874711 11128 tablet_bootstrap.cc:492] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:19:59.875191 11128 ts_tablet_manager.cc:1403] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.119s	user 0.023s	sys 0.015s
I20260709 12:19:59.875550 11165 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.875926 11165 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.877244 11165 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:59.881202 11499 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:59.881743 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:59.883126 11459 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:59.884550 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:59.885208 11004 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:59.886009 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:59.886641 11009 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:59.883296 11508 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:59.879940 11534 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:19:59.892350 11126 tablet_bootstrap.cc:492] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:19:59.924619 11499 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.925757 11499 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.929379 11499 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:19:59.930773 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:59.932513 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:59.933902 11128 raft_consensus.cc:359] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.934682 11128 raft_consensus.cc:385] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.934955 11128 raft_consensus.cc:740] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.937661 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:19:59.939106 11009 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.937983 11125 tablet_bootstrap.cc:492] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:19:59.938357 11126 ts_tablet_manager.cc:1403] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.187s	user 0.050s	sys 0.029s
I20260709 12:19:59.939083 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:19:59.940237 11125 ts_tablet_manager.cc:1403] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.265s	user 0.017s	sys 0.026s
I20260709 12:19:59.941431 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:19:59.948113 11050 leader_election.cc:343] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:59.948830 11050 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:19:59.950630 11508 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:59.951017 11508 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:19:59.951396 11508 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:59.954392 11004 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.954732 11128 consensus_queue.cc:260] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.956496 11125 raft_consensus.cc:359] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.957341 11125 raft_consensus.cc:385] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.957681 11125 raft_consensus.cc:740] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.958390 11125 consensus_queue.cc:260] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.961100 11128 ts_tablet_manager.cc:1434] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.086s	user 0.010s	sys 0.002s
I20260709 12:19:59.962145 11126 raft_consensus.cc:359] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.965569 11126 raft_consensus.cc:385] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.965948 11126 raft_consensus.cc:740] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.966168 11125 ts_tablet_manager.cc:1434] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:19:59.975878 11125 tablet_bootstrap.cc:492] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:19:59.977288 11009 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:19:59.967468 11126 consensus_queue.cc:260] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.964078 11508 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:19:59.968197 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:19:59.985352 11006 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:19:59.972245 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:19:59.978433 11499 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:59.986400 11126 ts_tablet_manager.cc:1434] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.046s	user 0.003s	sys 0.002s
I20260709 12:19:59.966511 11128 tablet_bootstrap.cc:492] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:19:59.979318 10901 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:19:59.981108 11535 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:59.989017 10901 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:19:59.989523 10899 leader_election.cc:343] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:59.991205 11500 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:59.991627 11500 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:59.991994 11500 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.993721 11459 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:59.994423 11459 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:59.994778 11459 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.995954 11508 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:19:59.997094 11125 tablet_bootstrap.cc:654] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.999933 11126 tablet_bootstrap.cc:492] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:20:00.005437 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:00.005705 11050 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:00.006140 11008 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:00.022905 11128 tablet_bootstrap.cc:654] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:00.013403 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:00.040091 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:00.035871 11500 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.024258 11508 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:20:00.051626 11051 leader_election.cc:343] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:00.050637 11459 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:00.054646 11051 leader_election.cc:343] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:00.055194 11051 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:00.055915 11165 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:20:00.056341 11051 leader_election.cc:343] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:00.056890 11051 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:00.049125 11008 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
W20260709 12:20:00.059201 11051 leader_election.cc:343] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:00.053624 11508 raft_consensus.cc:697] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:00.067339 11050 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:00.076311 11537 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:00.077100 11004 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:20:00.075824 11508 consensus_queue.cc:237] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:00.108826 10899 leader_election.cc:343] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:00.107622 11501 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:00.115787 11126 tablet_bootstrap.cc:654] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:00.116137 11501 raft_consensus.cc:697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:00.116494 11539 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.118438 11459 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:00.121553 11500 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:00.122920 11437 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.144867 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:00.145506 11009 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:00.150763 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:00.151425 11008 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:00.152204 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:00.134810 11437 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.164242 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:00.141477 11539 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.165973 11437 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:00.167586 11186 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.168092 11186 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:00.176100 10899 leader_election.cc:343] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:00.157058 11501 consensus_queue.cc:237] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.193351 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:00.197456 11535 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.198290 11125 tablet_bootstrap.cc:492] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:20:00.198869 11125 ts_tablet_manager.cc:1403] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.223s	user 0.024s	sys 0.025s
I20260709 12:20:00.199400 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:00.200860 11128 tablet_bootstrap.cc:492] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:20:00.201299 11128 ts_tablet_manager.cc:1403] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.239s	user 0.006s	sys 0.021s
I20260709 12:20:00.200105 11084 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:20:00.209306 11009 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:00.218451 11125 raft_consensus.cc:359] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.219319 11125 raft_consensus.cc:385] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:00.219600 11125 raft_consensus.cc:740] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:20:00.223845 11125 consensus_queue.cc:260] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:00.229347 10899 leader_election.cc:343] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:00.232627 10899 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:00.197968 11535 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.284562 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:00.281308 11500 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:00.304762 11125 ts_tablet_manager.cc:1434] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.106s	user 0.007s	sys 0.000s
I20260709 12:20:00.287935 11539 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:00.314630 11126 tablet_bootstrap.cc:492] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:20:00.315212 11126 ts_tablet_manager.cc:1403] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.316s	user 0.009s	sys 0.023s
I20260709 12:20:00.301774 11500 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:00.325013 11125 tablet_bootstrap.cc:492] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:20:00.284512 11550 consensus_queue.cc:1059] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.080s
I20260709 12:20:00.332203 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:00.331135 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:00.334228 11004 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:20:00.319988 11548 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.350895 11008 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:00.353353 11186 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:00.325209 11500 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:00.372848 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 45677.1us
I20260709 12:20:00.374964 10901 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:00.383214 11085 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:00.389760 11128 raft_consensus.cc:359] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.390792 11128 raft_consensus.cc:385] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:00.391104 11128 raft_consensus.cc:740] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:20:00.388947 11126 raft_consensus.cc:359] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.391319 10901 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:00.392638 11552 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:00.393169 11552 raft_consensus.cc:697] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:00.393443 11554 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:00.393931 11554 raft_consensus.cc:697] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:00.391503 11126 raft_consensus.cc:385] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:00.395361 11126 raft_consensus.cc:740] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:20:00.359071 11548 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.393987 11552 consensus_queue.cc:237] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.412937 11535 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:00.386059 11547 raft_consensus.cc:3055] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:00.413614 11547 raft_consensus.cc:740] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:00.414399 11547 consensus_queue.cc:260] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.415364 11547 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:00.415446 11500 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.416769 10927 raft_consensus.cc:2393] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 1: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:00.419777 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:00.420506 11010 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 0.
I20260709 12:20:00.427076 11050 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:00.434873 11539 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:00.435417 11563 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:00.394794 11554 consensus_queue.cc:237] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.435890 11563 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:00.438283 11563 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:00.436951 11125 tablet_bootstrap.cc:654] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:00.443259 11500 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:00.443459 11548 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:00.444074 11128 consensus_queue.cc:260] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:00.447896 11555 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.244s	user 0.002s	sys 0.000s
I20260709 12:20:00.439929 10933 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 0.
I20260709 12:20:00.459522 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:00.462823 11128 ts_tablet_manager.cc:1434] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.261s	user 0.010s	sys 0.011s
I20260709 12:20:00.456261 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:00.470696 11003 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:00.457528 11563 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.510605 11003 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:00.519562 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:00.520215 11085 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:00.522557 10974 leader_election.cc:343] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:00.525678 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:20:00.527626 10899 leader_election.cc:343] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:00.528330 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:00.528656 11126 consensus_queue.cc:260] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.538743 11125 tablet_bootstrap.cc:492] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:20:00.531821 11126 ts_tablet_manager.cc:1434] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.216s	user 0.022s	sys 0.014s
I20260709 12:20:00.543892 10977 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:00.544782 11186 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:00.545190 11186 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:00.548420 11186 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:00.544807 11125 ts_tablet_manager.cc:1403] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.224s	user 0.020s	sys 0.021s
I20260709 12:20:00.550724 10901 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:00.553309 11125 raft_consensus.cc:359] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.555151 11125 raft_consensus.cc:385] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:00.555460 11125 raft_consensus.cc:740] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:20:00.556107 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:00.556212 11125 consensus_queue.cc:260] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.556823 11554 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:00.557317 11554 raft_consensus.cc:697] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:00.558322 11125 ts_tablet_manager.cc:1434] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:20:00.558136 11554 consensus_queue.cc:237] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.559063 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:00.559367 11125 tablet_bootstrap.cc:492] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:20:00.540221 11447 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:20:00.534518 11085 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:00.576968 11563 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:00.577720 11128 tablet_bootstrap.cc:492] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:20:00.582038 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:00.582722 11003 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:00.585956 10831 catalog_manager.cc:5697] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
W20260709 12:20:00.591809 11051 leader_election.cc:343] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:00.601969 11128 tablet_bootstrap.cc:654] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:00.612149 11125 tablet_bootstrap.cc:654] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:00.606443 11051 consensus_peers.cc:597] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:00.613830 11126 tablet_bootstrap.cc:492] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:20:00.619099 11186 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.624440 11009 raft_consensus.cc:2393] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 1: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:00.627624 10901 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:00.629120 11003 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:20:00.650938 11186 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:00.656997 11050 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:00.663003 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:00.663892 11536 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:00.660142 11537 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:00.670574 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:00.670243 11547 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.675210 11547 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.687520 10974 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:00.689348 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:00.673693 11537 raft_consensus.cc:697] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:00.691654 11125 tablet_bootstrap.cc:492] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
W20260709 12:20:00.691327 11051 leader_election.cc:343] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:00.692159 11125 ts_tablet_manager.cc:1403] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.133s	user 0.010s	sys 0.017s
I20260709 12:20:00.694545 11128 tablet_bootstrap.cc:492] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:20:00.695039 11128 ts_tablet_manager.cc:1403] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.149s	user 0.005s	sys 0.012s
I20260709 12:20:00.695068 11562 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:00.692684 10928 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:20:00.701524 10974 leader_election.cc:343] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:00.692483 11537 consensus_queue.cc:237] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.710016 11559 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:20:00.710850 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:20:00.716264 10901 leader_election.cc:343] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:00.719594 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:00.720428 11081 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 0.
I20260709 12:20:00.723626 11126 tablet_bootstrap.cc:654] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:00.723495 10899 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:00.724255 11459 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:00.724619 11459 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:00.724927 11459 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:00.723450 11547 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:00.734877 11536 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:00.738960 11125 raft_consensus.cc:359] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.741051 11125 raft_consensus.cc:385] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:00.741282 11125 raft_consensus.cc:740] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:20:00.742641 11125 consensus_queue.cc:260] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.756754 11128 raft_consensus.cc:359] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.760586 11128 raft_consensus.cc:385] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:00.761617 11128 raft_consensus.cc:740] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:20:00.763180 11128 consensus_queue.cc:260] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.768291 11125 ts_tablet_manager.cc:1434] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.075s	user 0.013s	sys 0.004s
I20260709 12:20:00.785871 11459 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.799590 11125 tablet_bootstrap.cc:492] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3: Bootstrap starting.
I20260709 12:20:00.799139 11128 ts_tablet_manager.cc:1434] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.104s	user 0.007s	sys 0.002s
I20260709 12:20:00.802603 11447 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.806190 11447 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.801314 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:00.809083 11003 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:00.806398 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:00.813056 11085 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:00.816948 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:00.818641 11128 tablet_bootstrap.cc:492] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:20:00.815347 11535 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.824322 11535 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.827461 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:00.828542 11009 raft_consensus.cc:2393] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 1: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:20:00.828867 10977 leader_election.cc:343] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:00.830293 11126 tablet_bootstrap.cc:492] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:20:00.830883 11126 ts_tablet_manager.cc:1403] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.237s	user 0.019s	sys 0.000s
I20260709 12:20:00.835789 11004 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:00.812595 11459 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:00.838259 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:00.826496 11535 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:00.845932 11085 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:00.852898 11051 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:00.853901 11508 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:00.846903 10899 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:00.856001 11554 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:00.856503 11554 raft_consensus.cc:697] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:00.857332 11554 consensus_queue.cc:237] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.857604 11559 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:00.858975 10929 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:00.861711 11535 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.862293 11535 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.867336 11003 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:00.867733 11447 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:00.868603 10831 catalog_manager.cc:5697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 1 to 2, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 2 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:00.869979 10977 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:00.874789 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:00.871361 11547 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:00.876365 11562 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:00.876888 11562 raft_consensus.cc:697] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:00.877039 10831 catalog_manager.cc:5697] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:00.883324 10831 catalog_manager.cc:5697] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:00.880883 11559 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:20:00.885623 11508 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:00.890969 11128 tablet_bootstrap.cc:654] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:00.892639 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:00.893334 11081 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 0.
I20260709 12:20:00.894479 10974 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:00.895485 11558 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:00.895828 11558 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:00.896170 11558 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:00.901823 10831 catalog_manager.cc:5697] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:00.919629 10882 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:00.877741 11562 consensus_queue.cc:237] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.881717 11535 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:00.924585 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:00.946728 11003 raft_consensus.cc:2393] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 1: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:00.959057 11050 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:00.960350 11165 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:00.950088 11558 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.980638 11126 raft_consensus.cc:359] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.981371 11126 raft_consensus.cc:385] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:00.981633 11126 raft_consensus.cc:740] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:20:00.985903 11126 consensus_queue.cc:260] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:00.987510 11126 ts_tablet_manager.cc:1434] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.156s	user 0.005s	sys 0.001s
I20260709 12:20:00.990598 11125 tablet_bootstrap.cc:654] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:00.999900 11165 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:01.023571 11126 tablet_bootstrap.cc:492] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:20:01.031402 11558 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:01.048434 11128 tablet_bootstrap.cc:492] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:20:01.048960 11128 ts_tablet_manager.cc:1403] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.231s	user 0.010s	sys 0.039s
I20260709 12:20:01.059298 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:01.063016 11126 tablet_bootstrap.cc:654] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:01.064635 10977 leader_election.cc:343] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:01.067296 11128 raft_consensus.cc:359] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:01.070878 11128 raft_consensus.cc:385] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:01.071174 11128 raft_consensus.cc:740] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:20:01.049867 11546 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:20:01.071779 11128 consensus_queue.cc:260] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:01.070475 11536 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:20:01.084177 11556 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:20:01.088354 11125 tablet_bootstrap.cc:492] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3: No bootstrap required, opened a new log
I20260709 12:20:01.088868 11125 ts_tablet_manager.cc:1403] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3: Time spent bootstrapping tablet: real 0.295s	user 0.017s	sys 0.014s
I20260709 12:20:01.079843 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:01.094895 11079 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:01.095907 11128 ts_tablet_manager.cc:1434] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.002s
I20260709 12:20:01.105301 11128 tablet_bootstrap.cc:492] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1: Bootstrap starting.
I20260709 12:20:01.129756 11125 raft_consensus.cc:359] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:01.130565 11125 raft_consensus.cc:385] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:01.130839 11125 raft_consensus.cc:740] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Initialized, Role: FOLLOWER
I20260709 12:20:01.131498 11125 consensus_queue.cc:260] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:01.131965 11556 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.136340 11556 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:01.120260 11550 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:20:01.140753 11556 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:01.142042 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:01.149237 11125 ts_tablet_manager.cc:1434] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3: Time spent starting tablet: real 0.060s	user 0.003s	sys 0.005s
I20260709 12:20:01.150784 11128 tablet_bootstrap.cc:654] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:01.154982 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:01.160856 10901 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:01.164263 11547 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:01.168593 10831 catalog_manager.cc:5697] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:01.160187 11556 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:20:01.160033 11079 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:01.185938 10974 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:01.187831 11451 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:01.199810 11451 raft_consensus.cc:697] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:01.200752 11451 consensus_queue.cc:237] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:01.201520 11126 tablet_bootstrap.cc:492] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:20:01.202101 11126 ts_tablet_manager.cc:1403] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.194s	user 0.017s	sys 0.022s
I20260709 12:20:01.342824 11128 tablet_bootstrap.cc:492] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1: No bootstrap required, opened a new log
I20260709 12:20:01.343335 11128 ts_tablet_manager.cc:1403] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent bootstrapping tablet: real 0.238s	user 0.013s	sys 0.012s
I20260709 12:20:01.362613 10833 catalog_manager.cc:5697] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:01.370405 11186 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.370924 11186 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:01.372810 11186 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:01.377646 10929 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:01.381976 11128 raft_consensus.cc:359] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:01.382418 11051 consensus_peers.cc:597] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:01.382767 11128 raft_consensus.cc:385] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:01.383098 11128 raft_consensus.cc:740] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Initialized, Role: FOLLOWER
I20260709 12:20:01.393006 11126 raft_consensus.cc:359] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:01.393555 11126 raft_consensus.cc:385] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:01.393787 11126 raft_consensus.cc:740] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:20:01.397292 11508 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.397835 11508 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:01.400010 11508 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:01.400506 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:01.383793 11128 consensus_queue.cc:260] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:01.417665 10831 catalog_manager.cc:5697] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:01.420476 10831 catalog_manager.cc:5697] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:01.421384 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:01.422183 10934 raft_consensus.cc:2393] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 1: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:01.423331 11126 consensus_queue.cc:260] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:01.426105 10977 leader_election.cc:343] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:01.426782 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:01.432103 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:01.432592 11128 ts_tablet_manager.cc:1434] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.001s
I20260709 12:20:01.432844 11081 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 0.
I20260709 12:20:01.436990 11126 ts_tablet_manager.cc:1434] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.235s	user 0.012s	sys 0.004s
I20260709 12:20:01.438511 11126 tablet_bootstrap.cc:492] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:20:01.448828 11050 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:01.449810 11501 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:01.458878 11501 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:01.460282 11598 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:01.463846 10974 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:01.464648 11558 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:01.448866 11126 tablet_bootstrap.cc:654] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:01.465022 11558 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:01.472633 11558 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:01.497756 11126 tablet_bootstrap.cc:492] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:20:01.498553 11126 ts_tablet_manager.cc:1403] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.060s	user 0.014s	sys 0.000s
I20260709 12:20:01.505055 11558 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:01.509213 11558 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:01.507030 11126 raft_consensus.cc:359] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:01.509868 11126 raft_consensus.cc:385] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:01.510241 11126 raft_consensus.cc:740] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:20:01.512118 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:01.511193 11536 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:20:01.512821 11077 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:01.511793 11560 consensus_queue.cc:1048] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:01.512288 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:01.513849 11126 consensus_queue.cc:260] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:01.513157 11552 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:20:01.516168 10977 leader_election.cc:343] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:01.516844 11126 ts_tablet_manager.cc:1434] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:20:01.525532 11126 tablet_bootstrap.cc:492] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697: Bootstrap starting.
I20260709 12:20:01.546975 11126 tablet_bootstrap.cc:654] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:01.570825 11077 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:01.572639 10974 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:01.573537 11447 consensus_queue.cc:1048] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:01.573832 11558 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:01.574388 11558 raft_consensus.cc:697] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:01.575246 11558 consensus_queue.cc:237] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:01.615413 11126 tablet_bootstrap.cc:492] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697: No bootstrap required, opened a new log
I20260709 12:20:01.615919 11126 ts_tablet_manager.cc:1403] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent bootstrapping tablet: real 0.094s	user 0.012s	sys 0.000s
I20260709 12:20:01.626266 11126 raft_consensus.cc:359] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:01.627429 11126 raft_consensus.cc:385] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:01.627713 11126 raft_consensus.cc:740] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Initialized, Role: FOLLOWER
I20260709 12:20:01.628356 11126 consensus_queue.cc:260] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:01.630908 11126 ts_tablet_manager.cc:1434] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:20:01.635048 11560 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:01.637445 10831 catalog_manager.cc:5697] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:01.666821 10929 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:01.677479 11560 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:01.704185 11536 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.704687 11536 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:01.706924 11536 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:01.707824 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:01.708765 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:01.709576 11077 raft_consensus.cc:2393] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 1: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:01.710795 10899 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:01.712119 11536 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:01.720157 11536 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:01.771590 10930 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:02.039496 11558 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:02.058305 11447 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:02.848131  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:02.888360 11614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:02.891333 11613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:02.894773 11616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:02.895970  9741 server_base.cc:1061] running on GCE node
I20260709 12:20:02.897455  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:02.897760  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:02.897977  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599602897962 us; error 0 us; skew 500 ppm
I20260709 12:20:02.898718  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:02.902341  9741 webserver.cc:533] Webserver started at http://127.9.131.68:42205/ using document root <none> and password file <none>
I20260709 12:20:02.902884  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:02.903100  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:02.903432  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:02.904961  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-3-root/instance:
uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
format_stamp: "Formatted at 2026-07-09 12:20:02 on dist-test-slave-r7s7"
I20260709 12:20:02.911281  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 12:20:02.917646 11621 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:02.918618  9741 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:20:02.918954  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-3-root
uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
format_stamp: "Formatted at 2026-07-09 12:20:02 on dist-test-slave-r7s7"
I20260709 12:20:02.919401  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:02.966774  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:02.968753  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:02.970927  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:02.974423  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:02.974793  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
I20260709 12:20:02.975077  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:02.975257  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:03.139755  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.68:41955
I20260709 12:20:03.139894 11683 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.68:41955 every 8 connection(s)
I20260709 12:20:03.146085  9741 auto_leader_rebalancer-test.cc:439] add a tserver: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:03.164517 11684 heartbeater.cc:344] Connected to a master server at 127.9.131.126:46265
I20260709 12:20:03.164965 11684 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:03.165967 11684 heartbeater.cc:507] Master 127.9.131.126:46265 requested a full tablet report, sending...
I20260709 12:20:03.168322 10830 ts_manager.cc:194] Registered new tserver with Master: 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:03.170135 10830 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36824
I20260709 12:20:04.172669 11684 heartbeater.cc:499] Master 127.9.131.126:46265 was elected leader, sending a full tablet report...
W20260709 12:20:04.966284 10899 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.224s	user 0.002s	sys 0.010s
I20260709 12:20:04.968928 11700 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:04.969542 11700 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:04.973944 11700 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:04.985423 11700 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:04.986068 11700 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:04.990224 11697 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:04.990845 11697 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:04.992949 11697 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:04.998915 11692 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:04.999531 11692 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.006348 11690 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.006726 11698 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:05.007529 11694 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:05.007328 11698 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.008102 11694 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.008694 11692 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.035300 11707 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.029767 11704 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.006997 11690 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.039510 11691 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.040874 11693 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.041659 11699 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.042116 11708 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.046075 11697 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.048974 11694 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.011294 11702 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.036909 11696 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.053622 11697 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.105549 11692 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.106201 11692 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.106782 11697 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.107378 11697 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.055152 11693 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.050719 11707 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.059947 11694 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.113435 11695 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.050588 11704 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.052534 11691 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.111536 11705 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.139398 11716 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.055034 11699 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.056614 11708 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.127226 11698 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.127851 11693 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.113961 11697 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.067268 11696 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.062054 11702 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.123325 11694 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.217561 11699 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.221083 11696 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.153864 11700 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.154592 11692 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.132268 11695 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.229590 11692 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:05.258315 11707 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.258939 11707 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:05.259399 11707 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.259668 11695 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.260270 11695 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.260720 11695 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.237185 11703 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.261917 11703 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.262705 11695 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.263334 11695 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.237716 11698 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.230482 11701 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.232159 11691 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.230651 11713 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.267940 11691 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.274963 11713 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.265415 11690 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.276530 11690 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.277092 11690 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.279227 11690 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.280050 11703 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.150390 11716 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.283924 11707 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.286257 11707 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:05.266117 11698 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.295902 11698 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.152753 11705 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.257735 11692 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.314548 11692 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.315006 11705 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.315109 11692 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.266196 11704 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.275065 11691 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.317636 11726 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.318243 11726 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.254801 11708 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.288662 11690 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:05.263836 11695 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.319818 11690 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.322079 11690 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.265892 11701 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.322108 11709 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:05.323493 11709 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.324776 11700 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:05.325317 11700 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.325728 11709 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.327078 11709 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.327723 11700 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.319782 11708 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.324496 11701 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.317675 11704 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:05.324535 11703 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:05.328954 11700 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.329149 11704 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.308651 11718 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.339035 11718 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.340766 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.304107 11714 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.339051 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.342309 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.342924 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.343457 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.341514 10931 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:05.344153 10928 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:05.344635 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.345068 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.345779 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.346395 10930 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:05.343575 10935 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:05.305193 11715 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.305012 11698 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:05.347447 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.347710 11698 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.343534 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.349159 10936 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:05.349350 11704 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.349773 11698 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.305923 11711 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.308127 11712 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.330176 11710 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:05.350263 11723 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.330822 11690 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.350708 11712 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.351586 11690 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.344624 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.353664 11690 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.353916 10927 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:05.327558 11709 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.347494 11715 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.356609 11709 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.357105 11715 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.350781 11710 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.270714 11694 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.330767 11706 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:05.359071 11722 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.358839 11706 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.359784 11710 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.359707 11722 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.328332 11708 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.359541 11721 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.315735 11692 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.341459 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.363432 11721 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.364918 11722 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.350049 11704 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:05.316985 11693 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.366135 11721 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.360749 11711 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.315703 11705 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:05.367146 11705 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.368171 11711 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.366247 11693 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.369333 11705 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.329551 11700 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.371403 11700 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.361380 11706 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.365159 11692 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.346275 11714 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.373706 11726 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.374239 11726 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.374704 11726 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.375818 11714 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.376188 11718 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.376329 11714 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.376799 11714 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.377422 11726 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.329159 11703 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.371901 11724 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.378648 11714 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.301474 11707 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.372630 11697 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.372008 11708 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.379890 11713 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.380060 11712 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.350824 11723 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.372918 11693 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.378644 11716 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.382068 11703 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.379108 11724 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.382577 11723 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.384217 11724 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.385040 11695 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.382231 11702 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.379338 11691 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.385720 11706 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.333815 11701 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.386278 11706 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.386565 11704 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.389468 11704 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.387447 11701 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.391184 11691 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.392133 11691 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.392618 11720 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.393221 11720 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.393764 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.394352 10929 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:05.394788 11702 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.395489 11720 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.395385 11702 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.391507 11695 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.397403 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.398056 10932 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:05.398114 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.396893 11691 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.399396 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.400010 10929 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:05.400647 11695 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.402843 11695 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.396868 11725 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.403491 11725 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.405727 11725 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.409602 11706 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.410326 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.410776 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.411332 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.411589 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.411840 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.412019 10936 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:05.412799 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.412935 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.381319 11707 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.413565 10934 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:05.413702 11719 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:05.414211 11719 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.414688 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.415352 10929 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:05.414086 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.391924 11701 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.413986 11704 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.416460 10933 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:05.416554 11719 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.417097 11704 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.419937 11694 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:05.397549 11702 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.420140 11690 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.420529 11704 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.420815 11715 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.420747 11690 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.421367 11715 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.422976 11690 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.423199 11715 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.423596 11690 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:05.420495 11694 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.424242 11690 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.425664 11694 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.426259 11690 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.428012 11705 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:05.430114 11705 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.431437 11691 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.432219 11729 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.432330 11732 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.432714 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.433398 11003 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:05.433231 11732 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.434121 11730 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.434652 11730 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.436904 11730 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.432881 11716 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.437727 11716 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.435644 11732 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.440145 11691 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.440546 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.441707 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.442174 11691 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.442324 11009 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:05.443364 11708 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.447999 11695 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.448112 11708 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.448527 11695 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.448813 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.450198 11708 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.450488 11693 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.450615 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.450743 11708 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.456391 11708 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.447716 11699 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.457281 11699 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.458328 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.458822 11708 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.458969 11009 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:05.459281 11699 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.459486 11708 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.459975 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.460111 11708 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.432751 11729 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.462482 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.462728 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.463881 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.464128 11729 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.450276 11695 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.464608 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.465296 11708 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.473240 11692 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.473779 11692 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.475889 11692 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.439709 11716 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.466177 11693 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.478715 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.479439 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.479981 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.480340 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.481200 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.481359 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.481267 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.482470 11694 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.482695 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.483024 11694 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.484236 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.484480 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.484891 11079 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:05.485375 11694 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.485700 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.486613 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.486918 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.487540 11085 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:05.480019 11693 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.489172 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.490064 11004 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:05.467115 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.468983 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:20:05.465104 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 55683.3us
I20260709 12:20:05.470024 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.470577 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.471300 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.495187 11080 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:05.496260 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.498278 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.477864 11692 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:05.477957 11690 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:05.499478 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.499325 11690 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.500129 11080 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:05.500183 10977 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:05.500918 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.501446 11690 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.501631 10977 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:05.500228 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.502758 11011 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:05.503209 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.503391 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.503713 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.504593 11005 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:05.504227 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.505501 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.505676 11006 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:05.506443 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.506558 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.502187 11691 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:05.507445 11691 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.499259 11692 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.507660 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.509572 11691 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.515496 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.516377 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.516901 11723 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:05.517320 11723 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.517724 11723 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.518777 10901 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:05.519574 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.519748 11720 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:05.520344 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.520695 11720 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.492988 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.521135 11720 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.521461 11004 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:05.504904 11010 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:05.525735 11723 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.527588 11720 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.511373 11692 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.527827 11723 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.529462 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.534238 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:05.527915 11085 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:05.529033 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.517691 10977 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:05.532913 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.527484 11705 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:05.532262 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.531558 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.528726 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.530663 11720 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.527954 10901 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:05.538828 10977 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:05.540582 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.540804 11708 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:05.540870 11721 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:05.541240 11708 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.541384 11721 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.541653 11708 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.541810 11721 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.542168 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.543751 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.545679 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.546779 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.546959 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.548471 10977 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:05.529595 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.551111 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.551757 11724 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:05.552208 11724 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.552567 11724 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.546883 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.554745 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.558238 10901 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:05.560191 10977 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:05.561311 11693 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:05.561473 11716 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:05.561797 11693 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.561952 11709 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:05.561862 11716 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.562609 11693 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.562481 11709 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.563289 11709 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.564630 10977 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:05.562681 11716 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.565559 11702 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:05.565975 11702 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.566334 11702 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.569624 11708 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.569648 11693 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.574352 11004 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:05.576300 10901 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:05.577376 11716 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.578248 11693 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.578349 11724 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.579500 11010 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:05.579969 11731 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:05.580379 11731 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.580740 11731 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.581096 11004 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:05.582213 11724 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.583117 11004 raft_consensus.cc:1240] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:05.583295 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:05.583560 10901 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:05.585471 10977 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:05.586391 11693 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:05.561112 11721 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.586781 11693 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.586930 11723 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:05.587209 11693 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.587479 11723 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.587996 11723 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.588794 11721 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.589150 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.606761 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.591207 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.591351 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.591795 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.592732 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.575719 11702 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.610219 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.610776 11702 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.537348 11691 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.597375 11709 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.598047 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.598227 11710 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:05.612277 11710 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.612684 11710 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.598618 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.612954 11709 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.613579 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.613754 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.599826 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.600159 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.606498 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.600786 10901 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:05.602331 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.600857 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.603103 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.612576 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.590617 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.649030 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.628911 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.614727 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.637718 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.615411 10899 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:05.614964 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.579420 11716 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.649820 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.606992 11708 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.608217 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.658061 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.604947 10977 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:05.651441 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.659080 11702 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:20:05.658986 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 54102.2us
I20260709 12:20:05.659629 11702 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.660092 11702 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.660274 10977 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:05.627717 11691 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.658713 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.652529 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.652585 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.652859 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.611507 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.654430 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.654757 11005 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:05.655364 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.661510 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.676358 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.676805 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.676993 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.677533 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.655180 11693 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.651841 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.674305 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.678915 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.679559 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.656019 11709 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:05.638697 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.664300 11724 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:05.679935 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.680449 11724 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.680886 11724 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.657009 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:20:05.656437 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 55731.1us
I20260709 12:20:05.681524 11709 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:05.681943 11709 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.682024 10901 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:05.661149 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.651472 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.660866 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.678676 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.685636 11703 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:05.686079 11703 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.686462 11703 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.657028 11700 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:05.681068 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.595584 11731 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.667625 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.684319 10901 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:05.695245 10901 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:05.695385 11731 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.693876 11690 consensus_queue.cc:1059] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:20:05.696331 11721 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:05.696763 11721 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.696877 11692 raft_consensus.cc:3055] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:05.661224 10977 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:05.691996 11011 raft_consensus.cc:1240] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:05.690460 11700 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.697446 11692 raft_consensus.cc:740] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:05.697846 11700 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.696020 11731 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:05.689623 11710 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.697283 11721 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.661926 10899 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:05.698532 11692 consensus_queue.cc:260] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.695472 11693 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.716387 11694 consensus_queue.cc:1059] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:20:05.710393 11709 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.710634 11716 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:05.761952 11716 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.710947 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.762826 11716 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.708616 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:05.708525 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.764611 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:05.709065 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:05.699957 10977 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:05.712633 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.716647 11050 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:05.704592 11731 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.709739 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.715628 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:05.766597 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 50034.3us
W20260709 12:20:05.767711 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 67855.2us
I20260709 12:20:05.677973 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:05.614799 11723 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.860956 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.861011 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.795584 11008 raft_consensus.cc:2393] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 2: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:05.798792 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:05.861088 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.866665 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.759788 11700 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:05.868360 11106 debug-util.cc:398] Leaking SignalData structure 0x7b080014af80 after lost signal to thread 9744
I20260709 12:20:05.864893 11050 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:05.871604 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.872222 11050 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:05.716535 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.712385 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.716756 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.870788 11692 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.868952 11702 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.717049 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.843421 11693 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:05.760449 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:05.876756 11050 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:05.873453 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:05.833511 11719 raft_consensus.cc:3055] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:05.856164 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:05.807401 11694 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:05.739382 11710 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.800099 11731 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.893767 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.894212 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:05.894754 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.895287 10933 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:05.896145 10935 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:05.896647 10933 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:05.897370 10935 raft_consensus.cc:1240] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:05.897886 10933 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:05.863435 11709 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:05.846915 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.880904 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.847735 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:05.903649 11731 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.716063 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.884049 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.887156 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.887574 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.716271 11715 consensus_queue.cc:1059] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.160s
W20260709 12:20:05.883349 11106 debug-util.cc:398] Leaking SignalData structure 0x7b08001a4a80 after lost signal to thread 10868
I20260709 12:20:05.873541 11725 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:05.888731 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:05.890645 11050 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:05.712574 11705 consensus_queue.cc:1059] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.162s
I20260709 12:20:05.749893 11703 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.883153 11707 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:05.904850 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:05.907584 11731 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:05.919435 11106 debug-util.cc:398] Leaking SignalData structure 0x7b0800265c60 after lost signal to thread 10960
I20260709 12:20:05.887161 11693 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:05.890724 11701 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:05.946013 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 55447.5us
I20260709 12:20:05.892148 11719 raft_consensus.cc:740] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:05.948755 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:05.950810 11711 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:05.954185 11693 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.955209 11050 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:20:05.988276 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 326397us
I20260709 12:20:05.993624 11719 consensus_queue.cc:260] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:05.995801 11719 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.997321 11050 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.000082 11050 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.000291 10899 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:05.999424 11705 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.001312 11711 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.005326 11050 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.001857 11723 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:06.009091 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:20:05.996680 11106 debug-util.cc:398] Leaking SignalData structure 0x7b08002aca40 after lost signal to thread 11035
I20260709 12:20:05.992375 11717 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.016987 11050 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.019433 11050 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.020879 11050 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:05.998996 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:06.023501 11050 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.014535 11715 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.036389 11704 raft_consensus.cc:3055] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.036840 11704 raft_consensus.cc:740] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:20:06.037364 11106 debug-util.cc:398] Leaking SignalData structure 0x7b08002dbde0 after lost signal to thread 11109
I20260709 12:20:06.037825 11704 consensus_queue.cc:260] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:06.038682 11106 debug-util.cc:398] Leaking SignalData structure 0x7b08002dc760 after lost signal to thread 11683
I20260709 12:20:06.039358 11704 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.020471 11707 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.017736 11706 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.031580 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:06.033900 11711 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.020277 11694 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.034849 11716 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.046293 11716 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:06.035619 11690 raft_consensus.cc:3055] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.047287 11690 raft_consensus.cc:740] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:06.017793 11705 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.024252 11725 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.035846 11703 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:06.048318 11690 consensus_queue.cc:260] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.056689 11702 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:06.064604 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 48926.2us
I20260709 12:20:06.066407 10899 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:06.072141 11710 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.074640 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:06.075505 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:06.076270 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:06.076884 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:06.077419 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:06.080662 10899 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:06.082458 11717 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.086208 10899 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:06.086982 11734 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:06.087356 11734 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:06.087713 11734 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.024729 11700 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:06.091820 10974 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.092473 10901 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:06.095356 10899 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:06.097728 10974 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.099325 10974 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:20:06.100190 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 76727.8us
I20260709 12:20:06.100921 11050 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.096887 11708 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.102046 11050 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.103682 10974 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.104112 11705 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.104506 11691 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:06.104341 11050 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.103124 11735 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.103412 11701 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.105026 11691 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:06.105340 11705 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.106195 11691 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.103278 11716 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:06.106877 11716 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:06.107231 11716 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.113188 11691 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.113469 11716 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.106197 11050 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.115607 11705 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.115409 11716 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:06.116258 11725 consensus_queue.cc:1059] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:06.116993 11050 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.117367 11725 raft_consensus.cc:3055] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.117759 11725 raft_consensus.cc:740] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:06.117713 11701 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.118641 11690 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.120395 11050 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.121703 11705 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.123370 11050 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.124078 11701 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.127372 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:06.128036 10974 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.128783 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:06.125648 11701 consensus_queue.cc:1059] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:06.130424 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:06.131187 11728 raft_consensus.cc:3055] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.131281 11708 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:06.131592 11728 raft_consensus.cc:740] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:06.132454 11728 consensus_queue.cc:260] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.118690 11725 consensus_queue.cc:260] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.131490 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:06.133558 11728 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.133667 11739 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.064981 11724 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.136114 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:06.134330 11708 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:06.138710 11725 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.139139 11708 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.117714 11691 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:06.141858 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:06.142321 10974 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.146742 11011 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:06.142534 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:06.148137 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:06.148980 11702 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.152035 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:06.143221 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:06.143887 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:06.144498 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:06.153754 10974 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.145131 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:06.145689 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:06.152194 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:06.156244 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:06.157228 11702 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.142819 11736 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:06.157478 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:06.157619 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:06.158398 11011 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 2: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:06.158798 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:06.158792 10974 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.160145 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:06.160698 11702 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.161324 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:06.162600 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:06.163153 11721 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.163897 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:06.165184 11724 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:06.165771 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:06.163187 10974 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.171645 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:06.156992 11693 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.175097 11081 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:06.174996 11007 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 2: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:06.180428 11051 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.181492 11705 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.183184 11051 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.177524 11693 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:06.178300 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.184162 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:06.184866 11694 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.179423 11724 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.174216 10974 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.189177 10974 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.189747 11693 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.189669 11051 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.194155 10974 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.196190 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:06.198962 11704 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:06.201061 11708 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.202248 11011 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:06.203336 11708 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:06.203234 11051 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.204506 11051 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.191480 11080 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:06.211030 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:06.222762 11006 raft_consensus.cc:1240] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:06.223219 10929 raft_consensus.cc:2393] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 2: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:06.225383 11079 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:06.226257 10930 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:06.228792 11708 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.229856 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:06.230994 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:06.232206 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:06.234304 10974 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:06.231776 10927 raft_consensus.cc:2393] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 2: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:06.214075 11725 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.215030 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:06.216996 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:06.237648 11692 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.239539 10899 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:06.240465 11739 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.241046 11076 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:06.235189 10974 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:06.242508 10899 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:06.243119 11708 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:06.243752 11708 raft_consensus.cc:697] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:06.244716 11708 consensus_queue.cc:237] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.245661 11717 consensus_queue.cc:1059] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:06.219944 11693 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.221014 11721 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:06.247363 11732 raft_consensus.cc:3055] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.222306 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:06.243748 11720 consensus_queue.cc:1059] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:20:06.235189 11724 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:06.247757 11732 raft_consensus.cc:740] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:06.248921 10933 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:06.249431 11724 raft_consensus.cc:697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:06.249785 11732 consensus_queue.cc:260] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.250288 11724 consensus_queue.cc:237] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.251098 11732 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.232174 10977 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.221632 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:06.253522 10931 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 2: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:06.253847 10977 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.255017 10977 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.255136 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:06.255920 11736 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.256637 11736 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.213536 11051 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.257226 11736 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:06.257651 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 44210.5us
I20260709 12:20:06.258457 11051 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.248499 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:06.259023 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:06.259645 11725 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.260398 11725 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.261688 11051 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.249044 11710 raft_consensus.cc:3055] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.264241 11710 raft_consensus.cc:740] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:06.265156 11710 consensus_queue.cc:260] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.266348 11710 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.266294 10899 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:06.268081 11739 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.268158 10977 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.268775 11739 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.269009 11691 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.270184 10977 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.243086 11734 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.270881 11691 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.271998 10977 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.271592 10899 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:06.272804 11734 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:06.273413 11739 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.276278 11691 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.280524 10977 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.281452 11693 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.243423 10974 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:06.283653 10977 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.284821 11693 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:06.285661 11693 raft_consensus.cc:697] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:06.286530 11693 consensus_queue.cc:237] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:06.291671 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 48324.1us
I20260709 12:20:06.294230 11691 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.294487 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:20:06.295008 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 50033.7us
I20260709 12:20:06.296350 10977 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.297408 11085 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:06.298656 11051 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.301123 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:06.301656 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:06.303149 10936 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:06.304561 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:06.306613 11691 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.264079 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:06.306710 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:06.308816 11739 consensus_queue.cc:1059] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:06.308754 11692 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.310146 11051 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.314709 11011 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:06.311051 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:06.318488 11005 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:06.315073 11007 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:06.310827 11004 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:06.320451 11690 consensus_queue.cc:1059] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:06.321162 11003 raft_consensus.cc:1240] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:06.317572 10977 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.318142 11725 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.322631 10901 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:06.322907 10977 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.326025 10977 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.323189 10936 raft_consensus.cc:1240] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:06.321648 11738 raft_consensus.cc:3055] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.327272 10977 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.328677 11051 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.329866 11051 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.330610 11736 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.331702 11722 raft_consensus.cc:3055] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.332129 11722 raft_consensus.cc:740] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:06.332340 11694 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.332887 11704 consensus_queue.cc:1059] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:06.332998 11722 consensus_queue.cc:260] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.326743 11708 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.334411 11722 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.350009 10977 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.315968 11728 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.351291 10977 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.353657 11009 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:06.356806 11051 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.327114 11702 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.351986 11736 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.354574 11708 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:06.352283 11733 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.350600 11701 raft_consensus.cc:3055] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.352187 11707 consensus_queue.cc:1059] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:20:06.349160 11738 raft_consensus.cc:740] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:06.333925 11704 consensus_queue.cc:1059] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:20:06.380472 10977 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.334697 11690 consensus_queue.cc:1059] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:20:06.362290 11692 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.382740 11051 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.383234 11010 raft_consensus.cc:1240] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:06.379205 11699 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.350764 11711 consensus_queue.cc:1059] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:20:06.389973 11051 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.378937 11701 raft_consensus.cc:740] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:06.380975 11728 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.390779 11694 raft_consensus.cc:3055] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.392359 11694 raft_consensus.cc:740] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:06.392874 11711 raft_consensus.cc:3055] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.393251 11711 raft_consensus.cc:740] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:06.393147 11694 consensus_queue.cc:260] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.394333 11694 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.394130 11711 consensus_queue.cc:260] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.396179 11051 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.391934 11692 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.397351 11701 consensus_queue.cc:260] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.398684 11701 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.386752 11727 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.386656 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:06.401798 11051 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.404340 11715 consensus_queue.cc:1059] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:20:06.406380 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.400218 11707 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.408149 11692 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.409394 11711 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.407651 11704 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.426275 10977 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.427261 10977 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.432718 11738 consensus_queue.cc:260] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.434084 11738 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.437198 11691 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.437896 11708 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.438962 10977 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.440047 10977 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.440198 11723 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.440860 11723 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.441054 10977 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.441823 11693 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.435493 11729 consensus_queue.cc:1059] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:20:06.453922 11729 raft_consensus.cc:3055] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.454532 11729 raft_consensus.cc:740] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:06.455899 11725 raft_consensus.cc:3055] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.456288 11725 raft_consensus.cc:740] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:06.457032 11725 consensus_queue.cc:260] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.458284 11725 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.462613 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.463754 10977 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.465474 11730 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.466138 11730 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.467115 10977 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.430466 10936 consensus_queue.cc:237] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:06.471176 10977 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:06.470609 11727 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.476293 11736 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:06.476893 11736 raft_consensus.cc:697] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:06.478266 11736 consensus_queue.cc:237] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.455420 11729 consensus_queue.cc:260] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.480633 11729 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.483075 10977 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:06.485998 11727 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.495755 11723 consensus_queue.cc:1059] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:06.496981 11723 raft_consensus.cc:3055] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.497356 11723 raft_consensus.cc:740] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:06.498199 11723 consensus_queue.cc:260] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:06.507733 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 173411us
I20260709 12:20:06.499655 11723 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.512452 11690 consensus_queue.cc:1059] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:20:06.516975 11690 raft_consensus.cc:3055] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.517349 11690 raft_consensus.cc:740] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:06.518155 11690 consensus_queue.cc:260] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.519269 11690 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.512993 11715 consensus_queue.cc:1059] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:20:06.527882 11715 raft_consensus.cc:3055] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.528308 11715 raft_consensus.cc:740] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:06.529127 11715 consensus_queue.cc:260] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.530251 11715 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:06.535616 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.512609 11725 consensus_queue.cc:1059] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:20:06.537600 11725 raft_consensus.cc:3055] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.537962 11725 raft_consensus.cc:740] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:06.538825 11725 consensus_queue.cc:260] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.558079 11725 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:06.607370 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 204344us
I20260709 12:20:06.611122 10899 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:06.611792 10929 raft_consensus.cc:1240] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:06.612591 10899 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:06.614434 11734 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:06.614943 11734 raft_consensus.cc:697] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:06.616037 11710 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:06.615805 11734 consensus_queue.cc:237] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.616552 11710 raft_consensus.cc:697] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:06.617408 11710 consensus_queue.cc:237] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.620899 10927 raft_consensus.cc:1240] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:06.633492 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:06.635803 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:06.640508 11085 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:06.645793 10899 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:06.648380 11721 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.651895 10899 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:06.643294 10833 catalog_manager.cc:5697] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 1 to 2, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 2 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:06.657289 11003 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:06.647656 11745 consensus_queue.cc:1059] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:20:06.653527 10833 catalog_manager.cc:5697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 1 to 2, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 2 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:06.658756 11745 raft_consensus.cc:3055] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.659135 11745 raft_consensus.cc:740] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:06.659945 11745 consensus_queue.cc:260] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.660439 10833 catalog_manager.cc:5697] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 1 to 2, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 2 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:06.661247 11745 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.662729 11690 consensus_queue.cc:1059] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:06.662984 11081 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:06.674213 11721 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:06.674765 11705 raft_consensus.cc:3055] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.675174 11705 raft_consensus.cc:740] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:06.676074 11720 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:06.675230 11736 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:20:06.686268 10928 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.676744 10833 catalog_manager.cc:5697] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 1 to 2, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 2 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:06.700133 11705 consensus_queue.cc:260] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:06.696893 11721 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:20:06.718027 11705 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.743613 10927 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.746155 10830 catalog_manager.cc:5697] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 1 to 2, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:06.770746 10928 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:06.772828 11736 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:20:06.778076 11710 raft_consensus.cc:2955] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:06.780354 11003 raft_consensus.cc:2955] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:06.819973 10927 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:06.823355 11736 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:06.827524 11081 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:06.837785 11736 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:06.878960 10900 consensus_peers.cc:597] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0774d95f5c1b4bdb990e50f5d858b600. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:06.871006 11079 raft_consensus.cc:2955] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:06.886054 10936 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.892685 10936 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:06.894301 11724 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:06.903314 11076 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:06.907373 11724 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:06.928467 11076 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:06.923281 11757 log.cc:927] Time spent T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:20:07.009580 11076 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:07.011159 11699 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.035566 10929 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:07.037158 11699 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.070930 11003 consensus_queue.cc:237] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:07.080205 11076 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:07.080551 10928 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:07.082857 11716 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.120428 11003 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:07.122094 11734 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.088431 11699 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
W20260709 12:20:07.156628 10975 consensus_peers.cc:597] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5e9e7be3e0bf4a1fa43f868eaf3e2c80. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:07.152048 10831 catalog_manager.cc:5697] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:07.156965 11079 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:07.176476 11774 ts_tablet_manager.cc:933] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109)
I20260709 12:20:07.177937 11717 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.178448 11079 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:07.180889 11009 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:07.186928 11723 raft_consensus.cc:2955] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:07.188897 11081 raft_consensus.cc:2955] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:07.194641 11732 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:07.206089 10830 catalog_manager.cc:5697] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 1 to 2, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:07.207036 11003 consensus_queue.cc:237] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:07.209353 11732 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.240903 10928 raft_consensus.cc:2955] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:07.257037 10833 catalog_manager.cc:5697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: config changed from index -1 to 2, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
W20260709 12:20:07.284406 10975 consensus_peers.cc:597] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e2bba2f11943899027eb26325e2b6a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:07.289710 11076 raft_consensus.cc:1275] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:07.291369 11716 consensus_queue.cc:1048] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.292171 11774 tablet_copy_client.cc:323] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.65:46109
I20260709 12:20:07.331590 10927 raft_consensus.cc:1275] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:07.334195 11708 consensus_queue.cc:1048] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.346321 11708 raft_consensus.cc:2955] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:07.350090 11079 raft_consensus.cc:2955] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:07.354200 10946 tablet_copy_service.cc:140] P 9e8170bbe8244e40a2b2e5011e69b697: Received BeginTabletCopySession request for tablet 0774d95f5c1b4bdb990e50f5d858b600 from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:53346)
I20260709 12:20:07.354856 10946 tablet_copy_service.cc:161] P 9e8170bbe8244e40a2b2e5011e69b697: Beginning new tablet copy session on tablet 0774d95f5c1b4bdb990e50f5d858b600 from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:53346: session id = 0b171b6aaedc4f809f2753dcfadb14ce-0774d95f5c1b4bdb990e50f5d858b600
I20260709 12:20:07.362923 10946 tablet_copy_source_session.cc:215] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:07.368650 10831 catalog_manager.cc:5697] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: config changed from index -1 to 2, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:07.377092 11774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0774d95f5c1b4bdb990e50f5d858b600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:07.377561 10928 consensus_queue.cc:237] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:07.400851 11774 tablet_copy_client.cc:806] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:07.402493 10927 raft_consensus.cc:2955] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
W20260709 12:20:07.405020 10900 consensus_peers.cc:597] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f1f6166d836f41229df11ee42cd8e4c7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:07.407976 11081 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:07.409699 11010 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:07.401654 11774 tablet_copy_client.cc:670] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:07.412597 11717 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:07.415910 11732 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.425742 11774 tablet_copy_client.cc:538] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:07.441676 11774 tablet_bootstrap.cc:492] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:20:07.452176 11733 raft_consensus.cc:2955] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:07.454247 11010 raft_consensus.cc:2955] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:07.459422 11079 raft_consensus.cc:2955] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:07.474504 10833 catalog_manager.cc:5697] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: config changed from index -1 to 2, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:07.552124 11790 ts_tablet_manager.cc:933] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:07.571986 11774 tablet_bootstrap.cc:492] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:07.573210 11774 tablet_bootstrap.cc:492] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:20:07.573916 11774 ts_tablet_manager.cc:1403] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 0.132s	user 0.018s	sys 0.013s
I20260709 12:20:07.584981 11774 raft_consensus.cc:359] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:07.585470 11790 tablet_copy_client.cc:323] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.66:41383
I20260709 12:20:07.585949 11774 raft_consensus.cc:740] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:20:07.586727 11774 consensus_queue.cc:260] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:07.636415 11774 ts_tablet_manager.cc:1434] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.062s	user 0.012s	sys 0.000s
I20260709 12:20:07.644555 10946 tablet_copy_service.cc:342] P 9e8170bbe8244e40a2b2e5011e69b697: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-0774d95f5c1b4bdb990e50f5d858b600 received from {username='slave'} at 127.0.0.1:53346
I20260709 12:20:07.645089 10946 tablet_copy_service.cc:434] P 9e8170bbe8244e40a2b2e5011e69b697: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-0774d95f5c1b4bdb990e50f5d858b600 on tablet 0774d95f5c1b4bdb990e50f5d858b600 with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:07.659883 11021 tablet_copy_service.cc:140] P 2201bad9e18849b09cf82de29dd032d3: Received BeginTabletCopySession request for tablet 5e9e7be3e0bf4a1fa43f868eaf3e2c80 from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:41098)
I20260709 12:20:07.660477 11021 tablet_copy_service.cc:161] P 2201bad9e18849b09cf82de29dd032d3: Beginning new tablet copy session on tablet 5e9e7be3e0bf4a1fa43f868eaf3e2c80 from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:41098: session id = 0b171b6aaedc4f809f2753dcfadb14ce-5e9e7be3e0bf4a1fa43f868eaf3e2c80
I20260709 12:20:07.667843 11021 tablet_copy_source_session.cc:215] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:07.673885 11790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e9e7be3e0bf4a1fa43f868eaf3e2c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:07.680806 11745 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:07.681449 11745 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:07.685997 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:07.686682 11745 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:07.686995 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:07.687983 11010 raft_consensus.cc:2393] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 2: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:07.686702 10927 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:07.689838 11051 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:07.690964 11745 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:07.691354 11745 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:07.691731 11745 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:07.711323 11745 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:07.724730 11794 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.725340 11794 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:07.726747 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:07.728360 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:07.729048 10927 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:07.730338 11051 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:07.734202 10928 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:07.738164 11745 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:07.739352 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:07.739647 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:07.740437 11003 raft_consensus.cc:2393] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 2: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:07.741391 11745 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:07.741807 11745 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.742142 11745 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:07.744511 11790 tablet_copy_client.cc:806] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:07.745141 11790 tablet_copy_client.cc:670] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:07.740068 11010 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:07.748804 11708 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.749318 11708 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:07.751338 11794 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:07.753329 11732 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:07.751420 11708 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:07.753896 11732 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:07.754467 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:07.755146 10928 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:07.756237 10977 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:07.757000 11708 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:07.757366 11708 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.757725 11708 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:07.758078 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:07.758787 11003 raft_consensus.cc:2393] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 2: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:07.764180 11733 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:07.757520 11732 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:07.764762 11733 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:07.767043 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:07.770532 11733 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:07.772691 11774 ts_tablet_manager.cc:933] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:07.773581 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:07.776854 11003 raft_consensus.cc:2393] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 2: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:07.779014 11794 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.779588 11794 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:07.780398 11790 tablet_copy_client.cc:538] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:07.782344 11794 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:07.782819 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:07.783432 11003 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:07.784480 11050 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:20:07.791306 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 61045.8us
I20260709 12:20:07.795626 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:07.796571 11051 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:07.798986 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:07.796324 11081 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:07.799696 11079 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:07.802577 11796 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:07.803517 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:07.806406 10928 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:07.802114 11795 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:07.809736 11795 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.813591 10899 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:07.817472 10899 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:07.819542 11795 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:07.801754 11794 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.821681 11716 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:07.822885 11716 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:07.823185 11717 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:07.824023 11717 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:07.824414 11717 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:07.825749 11794 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:07.827652 11716 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:07.828824 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:07.829459 11081 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:07.830412 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:07.830921 10974 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:07.831044 11003 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:20:07.832254 11699 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:07.832633 11699 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:07.833007 11699 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:07.821704 11732 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:07.836282 11732 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:07.836680 11732 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:07.836581 11745 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:07.811199 11708 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:07.840785 11708 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:07.841614 11050 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:07.827821 11794 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:07.845027 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:07.840854 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:07.846720 11003 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:07.843753 11794 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.852617 11794 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:07.839682 11717 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:07.880612 11003 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:07.857918 11745 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:07.866375 11774 tablet_copy_client.cc:323] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.66:41383
W20260709 12:20:07.882535 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 60194.6us
I20260709 12:20:07.880079 11796 raft_consensus.cc:697] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:07.885035 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:07.884680 11796 consensus_queue.cc:237] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:07.891806 11804 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.892357 11804 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:07.888095 11745 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:07.894483 11804 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:07.898808 11699 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:07.899890 10928 raft_consensus.cc:2393] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 2: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:07.900170 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:07.900772 10927 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:07.901292 11745 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.901690 11745 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:07.904326 11794 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:07.906407 11717 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:07.910846 11790 tablet_bootstrap.cc:492] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:20:07.921096 11699 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:07.934962 11801 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.935649 11801 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:07.940793 11801 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:07.946466 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 104917us
I20260709 12:20:07.947994 11050 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:07.949786 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:07.950471 11010 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:08.010687 11798 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.010983 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:08.019224 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:08.019243 11008 raft_consensus.cc:2393] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 2: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:08.009694 11801 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.927839 10927 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:07.916064 11745 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.040481 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:08.041340 11745 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:08.041905 11745 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:08.042331 11745 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.022921 11798 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.019315 11802 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.060262 11802 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.038079 11803 ts_tablet_manager.cc:933] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109)
I20260709 12:20:08.010701 11021 tablet_copy_service.cc:140] P 2201bad9e18849b09cf82de29dd032d3: Received BeginTabletCopySession request for tablet 38e2bba2f11943899027eb26325e2b6a from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:41098)
I20260709 12:20:08.036543 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:08.038193 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:08.019816 11794 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:08.018729 11795 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.059523 11081 raft_consensus.cc:2368] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:08.067536 11082 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:08.070240 11021 tablet_copy_service.cc:161] P 2201bad9e18849b09cf82de29dd032d3: Beginning new tablet copy session on tablet 38e2bba2f11943899027eb26325e2b6a from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:41098: session id = 0b171b6aaedc4f809f2753dcfadb14ce-38e2bba2f11943899027eb26325e2b6a
I20260709 12:20:08.070966 11659 raft_consensus.cc:1217] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:08.074743 11794 raft_consensus.cc:697] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:08.080380 11021 tablet_copy_source_session.cc:215] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:08.083516 11076 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:08.020577 11732 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.075809 11794 consensus_queue.cc:237] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.085955 11732 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.092160 11077 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:08.064695 11801 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.131613 11799 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.131919 11807 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:08.132256 11799 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.134451 11799 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.135007 11799 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:08.139421 11745 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:08.155092 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:08.135568 11799 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.158838 11009 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:08.158269 11736 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.171152 11811 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:08.171411 11801 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.140419 11807 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.175798 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:08.177623 10936 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.186954 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:08.187155 10833 catalog_manager.cc:5697] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 1 to 2, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 2 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:08.188938 10929 raft_consensus.cc:2393] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 2: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:08.179530 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:08.192193 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:08.193202 11009 raft_consensus.cc:2393] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 2: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:08.172446 11736 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.205842 10901 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:08.206401 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:08.207131 11077 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:08.195329 10936 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:08.174611 11811 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.198410 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:08.210014 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:08.210628 11003 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:08.202744 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:08.203508 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:08.187983 11798 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109)
I20260709 12:20:08.209200 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:08.198776 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:08.211503 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:08.212462 10932 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:08.212769 11010 raft_consensus.cc:2368] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3.
I20260709 12:20:08.215243 11009 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:08.212101 11085 raft_consensus.cc:2393] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 3: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:08.219938 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:08.222247 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:08.222658 10931 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:08.225157 11774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38e2bba2f11943899027eb26325e2b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:08.227208 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:08.215471 10935 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.204123 10927 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:08.208222 11745 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.230325 11745 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.232685 11745 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:08.234436 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:08.235253 10929 raft_consensus.cc:2368] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3.
I20260709 12:20:08.238448 11706 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:08.238917 11706 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.239254 11706 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.239944 11799 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.244593 11708 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:08.245150 11708 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.247112 11708 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.222795 11008 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.251876 11082 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:08.256388 10899 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:08.213973 11803 tablet_copy_client.cc:323] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.65:46109
I20260709 12:20:08.227954 10934 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:20:08.262125 10899 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:08.267746 11008 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:08.265734 10899 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:08.263250 11732 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:08.279062 11811 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.279567 11814 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:08.279995 11814 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.280087 11736 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.280366 11814 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.281070 10935 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:08.265196 11804 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:08.283133 10899 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:08.274639 11795 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:08.288502 11733 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:08.277256 11802 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:08.272742 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:08.289111 11733 raft_consensus.cc:697] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:08.281049 11807 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.289459 10928 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.290156 11733 consensus_queue.cc:237] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.296787 11804 raft_consensus.cc:697] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:08.297778 11804 consensus_queue.cc:237] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.281625 11732 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.304039 11732 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.305675 11814 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.310277 11790 tablet_bootstrap.cc:492] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:08.311249 11790 tablet_bootstrap.cc:492] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:20:08.312906 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:08.313753 11008 raft_consensus.cc:2393] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 3: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:08.318497 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:08.319267 11079 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:08.322402 11706 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.323143 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:08.324035 11008 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:08.327584 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:08.328358 11079 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:08.328444 11732 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.330587 11732 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.332975 10946 tablet_copy_service.cc:140] P 9e8170bbe8244e40a2b2e5011e69b697: Received BeginTabletCopySession request for tablet f1f6166d836f41229df11ee42cd8e4c7 from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:53346)
I20260709 12:20:08.333561 10946 tablet_copy_service.cc:161] P 9e8170bbe8244e40a2b2e5011e69b697: Beginning new tablet copy session on tablet f1f6166d836f41229df11ee42cd8e4c7 from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:53346: session id = 0b171b6aaedc4f809f2753dcfadb14ce-f1f6166d836f41229df11ee42cd8e4c7
I20260709 12:20:08.334600 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:08.335407 11008 raft_consensus.cc:2393] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 2: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:08.338999 10928 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:08.340910 10946 tablet_copy_source_session.cc:215] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:08.341375 11051 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:08.342254 11802 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:08.342505 11795 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.342649 11802 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.343089 11802 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.343060 11795 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.345512 11795 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:08.346836 11790 ts_tablet_manager.cc:1403] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 0.436s	user 0.034s	sys 0.007s
I20260709 12:20:08.349928 11790 raft_consensus.cc:359] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:08.353627 11706 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.354518 11814 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.355579 10899 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:08.356009 11051 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:08.356437 10899 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:08.356904 11795 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:08.357342 11795 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.357714 11795 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.362085 11733 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:08.362571 11733 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:08.362922 11733 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:08.364535 11051 leader_election.cc:400] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3.
I20260709 12:20:08.364910 11051 leader_election.cc:403] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:08.365149 11815 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:08.365577 11815 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:08.365972 11815 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:08.363520 11802 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.368072 11745 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.370712 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:08.371376 11079 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.373128 11803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f6166d836f41229df11ee42cd8e4c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:08.375944 11733 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.378041 11733 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.381584 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:08.382228 11080 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.384548 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:08.388321 11079 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:08.389335 11821 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.392235 11821 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.392562 11051 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:08.393584 11794 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:08.393989 11794 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.394323 11794 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.394407 11821 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.398488 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:08.399736 11008 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 2: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:08.404690 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:08.404968 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:08.405702 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:08.405874 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:08.408638 10933 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:08.409255 11008 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.410778 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:08.411348 11009 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.411767 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:08.412395 11006 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.418737 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:08.406316 11802 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:08.403424 11821 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.419987 11821 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.419339 10831 catalog_manager.cc:5697] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 1 to 2, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:08.422070 11821 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.407301 11795 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.408565 11051 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:08.408682 10928 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.350801 11790 raft_consensus.cc:740] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:20:08.419497 11003 raft_consensus.cc:2393] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 2: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:08.424141 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:08.425581 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:08.426280 11076 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:08.426839 11080 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:08.425601 11736 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.428450 11736 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.432982 10977 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:08.433961 11818 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:08.434468 11818 raft_consensus.cc:697] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:08.435389 11818 consensus_queue.cc:237] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.425606 11745 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3.
I20260709 12:20:08.441027 11802 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:08.441630 11802 raft_consensus.cc:697] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:08.442610 11802 consensus_queue.cc:237] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.443993 11078 raft_consensus.cc:2393] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 3: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:08.445540 11051 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:08.446205 11815 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.447372 10935 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:08.447669 11798 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:08.419317 11006 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:08.448271 11798 raft_consensus.cc:697] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:08.449111 11798 consensus_queue.cc:237] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.451623 11774 tablet_copy_client.cc:806] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:08.452358 11774 tablet_copy_client.cc:670] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:08.455940 11790 consensus_queue.cc:260] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:08.458668 11790 ts_tablet_manager.cc:1434] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.111s	user 0.008s	sys 0.000s
I20260709 12:20:08.463699 11736 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.468593 10928 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:08.471840 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:08.472662 11006 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:08.473322 11794 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.471884 11795 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:08.474541 11077 raft_consensus.cc:2368] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 2. Current term is 3.
I20260709 12:20:08.475921 11009 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:08.479799 11808 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.480336 11808 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.482405 11008 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
W20260709 12:20:08.482182 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 68056.1us
I20260709 12:20:08.475610 11794 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109)
I20260709 12:20:08.497015 10901 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:08.497846 10974 leader_election.cc:400] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:08.498287 10974 leader_election.cc:403] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:20:08.502650 11811 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:08.509660 10899 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:08.505963 11812 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:08.513693 11807 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:08.503932 11803 tablet_copy_client.cc:806] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:08.511747 11815 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.526948 10899 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:08.525246 11794 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.529572 10899 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:08.518003 11807 raft_consensus.cc:697] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:08.527449 11803 tablet_copy_client.cc:670] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:08.534308 11807 consensus_queue.cc:237] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.542333 11774 tablet_copy_client.cc:538] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:08.531961 11808 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.548465 11717 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:08.548998 11717 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.549361 11717 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.553066 11021 tablet_copy_service.cc:342] P 2201bad9e18849b09cf82de29dd032d3: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-5e9e7be3e0bf4a1fa43f868eaf3e2c80 received from {username='slave'} at 127.0.0.1:41098
I20260709 12:20:08.553565 11021 tablet_copy_service.cc:434] P 2201bad9e18849b09cf82de29dd032d3: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-5e9e7be3e0bf4a1fa43f868eaf3e2c80 on tablet 5e9e7be3e0bf4a1fa43f868eaf3e2c80 with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:08.540746 11794 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.556476 11794 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:08.565683 11050 leader_election.cc:400] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3.
I20260709 12:20:08.571102 11801 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:08.571671 11801 raft_consensus.cc:697] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:08.573407 11801 consensus_queue.cc:237] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.580684 11717 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.582720 11717 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.588634 10899 leader_election.cc:400] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 2. Current term is 3.
I20260709 12:20:08.589861 11774 tablet_bootstrap.cc:492] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:20:08.591442 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:08.592746 11077 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:08.592324 10899 leader_election.cc:403] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:20:08.594719 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:08.595404 11077 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:08.597958 11801 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.605170 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:08.605989 11077 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:08.606678 10832 catalog_manager.cc:5697] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:08.609498 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:08.625247 11077 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:08.637115 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:08.652837 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:08.653524 11080 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:08.655455 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:08.655905 11078 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:08.655937 10831 catalog_manager.cc:5697] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 1 to 2, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:08.657716 10831 catalog_manager.cc:5697] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 1 to 3, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 3 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:08.659446 11801 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 2. Current term is 3.
I20260709 12:20:08.659363 10831 catalog_manager.cc:5697] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:08.675689 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:08.676364 11083 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.714071 11003 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:08.711896 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:08.728416 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:08.741189 11004 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.743279 11003 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:08.744614 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:08.745286 10933 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:08.747567 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:08.748257 10931 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:08.752785 11794 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:08.754212 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:08.700091 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:08.757676 11006 raft_consensus.cc:2393] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 3: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:08.762013 10974 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:08.734730 10832 catalog_manager.cc:5697] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:08.687794 11083 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:08.696108 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:08.763675 11008 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:08.726646 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:08.763942 10832 catalog_manager.cc:5697] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:08.765103 11007 raft_consensus.cc:2393] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 3: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:08.739322 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:08.691241 11818 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.740315 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:08.766295 10928 raft_consensus.cc:2393] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 2: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:08.740312 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:08.766448 10935 raft_consensus.cc:2368] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:08.762871 11828 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:08.766224 11818 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.728873 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:08.767637 11005 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.768675 11818 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.762953 10974 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:08.696525 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:08.765030 11803 tablet_copy_client.cc:538] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:08.769553 11009 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.770535 10974 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:08.771999 10832 catalog_manager.cc:5697] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:08.777088 11774 tablet_bootstrap.cc:492] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:08.767119 11828 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:08.789986 11828 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:08.777400 11009 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:08.778103 11818 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:08.736893 11010 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:20:08.780879 10974 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:08.810920 11818 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.811359 11818 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.811414 11716 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:08.812238 11810 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:08.812691 11810 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.813035 11810 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.813126 11716 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:08.814217 11716 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:08.783666 10977 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:08.784014 10899 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:08.801433 11774 tablet_bootstrap.cc:492] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:20:08.816058 11774 ts_tablet_manager.cc:1403] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 0.226s	user 0.031s	sys 0.012s
I20260709 12:20:08.816903 11717 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:08.817327 11717 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.817692 11717 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.803680 11828 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.817695 10899 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:08.819571 11774 raft_consensus.cc:359] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:08.821751 11821 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:08.822271 11821 raft_consensus.cc:697] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:08.823184 11821 consensus_queue.cc:237] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.824628 11716 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.808830 11659 raft_consensus.cc:1217] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:08.828050 11002 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:08.825053 11717 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.832465 11717 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.825922 11803 tablet_bootstrap.cc:492] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:20:08.783459 11004 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:08.826292 10899 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:20:08.738377 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 211404us
I20260709 12:20:08.836568 11812 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:08.837153 11812 raft_consensus.cc:697] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:20:08.846040 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 62444.9us
I20260709 12:20:08.857961 11808 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:08.858096 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:08.873528 11808 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.857255 11812 consensus_queue.cc:237] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.814134 11005 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:08.866801 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:08.874986 11077 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.873235 10901 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:08.821750 11774 raft_consensus.cc:740] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:20:08.867911 11829 raft_consensus.cc:1064] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:20:08.868763 11083 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:08.881677 11716 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.873963 11808 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.883646 11829 consensus_queue.cc:237] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:08.888079 11830 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:08.888818 11830 raft_consensus.cc:697] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:08.889688 11830 consensus_queue.cc:237] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.888478 11774 consensus_queue.cc:260] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:08.892097 11077 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:08.898890 11083 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:08.896338 11794 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:08.906800 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:08.908305 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:08.908987 11004 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:08.910198 10977 leader_election.cc:400] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:08.912711 11051 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:08.913622 11051 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:08.914876 11051 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:08.911365 11801 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:20:08.895964 11810 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.884261 11828 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.919291 11794 raft_consensus.cc:2764] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:20:08.897662 11774 ts_tablet_manager.cc:1434] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.001s
I20260709 12:20:08.921851 11050 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:08.919497 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:08.928994 11810 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.920612 11798 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:08.929720 11808 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.930048 11802 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:08.931646 10899 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:08.942137 10932 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:08.942499 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:08.943300 10927 raft_consensus.cc:2393] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 3: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:08.941425 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:08.943833 11808 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:08.941313 11083 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:08.939744 10936 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:08.941434 11798 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.945452 10928 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:08.942039 11802 raft_consensus.cc:697] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:08.946607 11802 consensus_queue.cc:237] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:08.941857 11794 raft_consensus.cc:2764] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:20:08.952328 11009 raft_consensus.cc:1240] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:20:08.954576 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:08.958310 11008 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:08.960114 11050 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:08.965812 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:08.966816 10934 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:08.941999 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:08.974745 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:08.975379 11008 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.945588 11798 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.949589 11021 tablet_copy_service.cc:342] P 2201bad9e18849b09cf82de29dd032d3: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-38e2bba2f11943899027eb26325e2b6a received from {username='slave'} at 127.0.0.1:41098
I20260709 12:20:08.980885 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:08.984010 11081 raft_consensus.cc:2368] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:08.987843 11008 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:08.966977 11820 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:09.001914 11008 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:08.991612 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:09.006002 11079 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:09.003703 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:09.007632 11084 raft_consensus.cc:2368] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:08.997624 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:09.008478 11002 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:09.021242 10974 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:08.967279 11801 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:20:08.990057 11021 tablet_copy_service.cc:434] P 2201bad9e18849b09cf82de29dd032d3: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-38e2bba2f11943899027eb26325e2b6a on tablet 38e2bba2f11943899027eb26325e2b6a with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:08.967481 11795 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
W20260709 12:20:09.037601 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 82901.6us
I20260709 12:20:08.980950 11818 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:09.025206 11004 raft_consensus.cc:1240] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:09.022255 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:09.025832 11820 raft_consensus.cc:697] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:09.063776 11010 raft_consensus.cc:2368] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 2. Current term is 3.
I20260709 12:20:09.061913 11811 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:09.066075 11794 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:09.065850 11002 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:09.141359 11818 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:09.091361 11811 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.143697 11811 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:09.145403 11794 raft_consensus.cc:697] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:09.146261 11081 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:09.146404 11794 consensus_queue.cc:237] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:09.149515 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:09.150169 10933 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:09.155270 11079 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
W20260709 12:20:09.172698 11841 log.cc:927] Time spent T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:20:09.183182 10974 leader_election.cc:400] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:09.183624 10974 leader_election.cc:403] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:20:09.185336 10974 leader_election.cc:400] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:09.185638 10974 leader_election.cc:403] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:20:09.186173 11699 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:09.187469 11808 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:09.186901 11699 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:09.186851 10974 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:09.190950 11808 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:09.191450 11808 raft_consensus.cc:697] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:09.192353 11808 consensus_queue.cc:237] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:09.196450 11820 consensus_queue.cc:237] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:09.208055 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 205869us
I20260709 12:20:09.211972 11821 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:09.213630 11821 consensus_queue.cc:1059] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:09.214592 11821 raft_consensus.cc:3055] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:09.215019 11821 raft_consensus.cc:740] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:20:09.216171 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 256148us
W20260709 12:20:09.218441 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 194075us
I20260709 12:20:09.219473 11002 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:09.221475 11051 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:09.223815 11843 consensus_queue.cc:1059] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:09.224783 11659 raft_consensus.cc:1217] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:09.225132 11821 consensus_queue.cc:260] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:09.226334 11821 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:09.140057 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:09.233676 11795 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:09.256146 10901 leader_election.cc:400] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 2. Current term is 3.
I20260709 12:20:09.261720 11002 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:09.262641 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:09.265332 11802 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:20:09.268704 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 47289.5us
I20260709 12:20:09.273800 11799 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:09.274247 10932 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:09.274672 11084 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:20:09.279915 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 58421.2us
I20260709 12:20:09.281962 11794 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:20:09.280723 11699 raft_consensus.cc:1064] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:20:09.268784 11854 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:20:09.300817 11854 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
W20260709 12:20:09.355077 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 84696.5us
I20260709 12:20:09.279300 10933 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:09.373970 11076 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:09.392495 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:09.394748 11083 raft_consensus.cc:1240] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:20:09.397447 11084 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:09.312675 11658 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 LEARNER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:09.316011 11795 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.098s
I20260709 12:20:09.423189 11699 consensus_queue.cc:237] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:09.440514 11798 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:09.470767 11082 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 3: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:09.481071 11814 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:20:09.485711 11849 log.cc:927] Time spent T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.213s	user 0.001s	sys 0.006s
W20260709 12:20:09.510695 11857 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.183s	user 0.003s	sys 0.000s
I20260709 12:20:09.493134 11802 raft_consensus.cc:3055] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:09.531981 10832 catalog_manager.cc:5697] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 1 to 2, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:09.538654 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.526422 11802 raft_consensus.cc:740] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:09.544377 11802 consensus_queue.cc:260] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:09.544927 11798 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:09.545650 11802 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:09.567274 11803 tablet_bootstrap.cc:492] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:09.571341 11803 tablet_bootstrap.cc:492] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:20:09.572467 11803 ts_tablet_manager.cc:1403] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 0.756s	user 0.024s	sys 0.012s
I20260709 12:20:09.583560 10833 catalog_manager.cc:5697] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:09.541872 11811 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:09.587630 11003 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:20:09.606957 11811 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:09.640628 11803 raft_consensus.cc:359] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:09.641719 11803 raft_consensus.cc:740] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:20:09.678915 11803 consensus_queue.cc:260] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:09.682212 11803 ts_tablet_manager.cc:1434] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.109s	user 0.005s	sys 0.004s
W20260709 12:20:09.690346 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 241697us
I20260709 12:20:09.713609 11871 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:09.716764 11829 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:09.717639 11659 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 LEARNER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:09.731490 10830 catalog_manager.cc:5697] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 2 to 3, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 3 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:09.725499 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:09.737211 11821 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:09.747766 11082 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:09.747951 10977 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:09.753665 11846 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:09.754287 11846 raft_consensus.cc:697] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:09.751070 11874 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:20:09.755347 11846 consensus_queue.cc:237] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:09.783097 11874 raft_consensus.cc:1064] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:20:09.795763 11003 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:09.797523 11874 consensus_queue.cc:237] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:09.812060 10946 tablet_copy_service.cc:342] P 9e8170bbe8244e40a2b2e5011e69b697: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-f1f6166d836f41229df11ee42cd8e4c7 received from {username='slave'} at 127.0.0.1:53346
I20260709 12:20:09.812777 10946 tablet_copy_service.cc:434] P 9e8170bbe8244e40a2b2e5011e69b697: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-f1f6166d836f41229df11ee42cd8e4c7 on tablet f1f6166d836f41229df11ee42cd8e4c7 with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:09.813935 11084 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:09.826884 11003 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:09.833913 10932 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:09.844849 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:20:09.887903 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:09.888514 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.893404 11004 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:09.895016 11009 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 3: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:09.896618 11002 raft_consensus.cc:1240] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:20:09.897745 11008 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:20:09.902544 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.903698 11077 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:09.926287 11008 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:09.927578 11658 raft_consensus.cc:1275] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 LEARNER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:09.939780 11006 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:09.942921 11011 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:09.949836 11699 consensus_queue.cc:1048] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:20:09.952438 11852 consensus_queue.cc:1059] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:09.961735 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:09.962345 10927 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:09.964560 10930 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:09.965850 10934 raft_consensus.cc:1240] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:20:09.954710 11872 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:20:09.964414 11799 raft_consensus.cc:3055] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:09.976409 11799 raft_consensus.cc:740] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:09.975447 11821 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:20:09.988489 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:09.985373 10974 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:10.015997 11799 consensus_queue.cc:260] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:10.022078 11799 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:10.023967 11873 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:10.029482 11077 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:10.043463 11798 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:20:10.093281 11859 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:20:10.091648 11852 consensus_queue.cc:1059] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:20:10.095882 11818 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:10.096654 11818 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:10.100929 11708 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:20:10.103116 11706 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:20:10.103951 11079 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:20:10.109833 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 61145.4us
I20260709 12:20:10.128578 11659 raft_consensus.cc:1217] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:10.130134 10935 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:20:10.130591 10935 pending_rounds.cc:85] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 1
I20260709 12:20:10.130905 10935 pending_rounds.cc:107] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:20:10.131189 10935 raft_consensus.cc:2889] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:10.133519 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.125560 11706 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:20:10.136130 10929 raft_consensus.cc:1275] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:10.136919 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:10.137576 11082 raft_consensus.cc:1275] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:10.108999 11874 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:20:10.151599 10928 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:10.156766 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:10.162109 11818 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:10.172199 10832 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35608 (request call id 135) took 1175 ms. Trace:
I20260709 12:20:10.183743 11051 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:10.218739 10934 raft_consensus.cc:2410] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:20:10.184638 11872 raft_consensus.cc:3055] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:20:10.224614 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 51786.2us
W20260709 12:20:10.227540 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 53177.8us
W20260709 12:20:10.228528 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 53184.5us
I20260709 12:20:10.218474 11859 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:10.221239 11872 raft_consensus.cc:740] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:10.172806 10832 rpcz_store.cc:276] 0709 12:20:08.997155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:08.998136 (+   981us) service_pool.cc:224] Handling call
0709 12:20:10.172088 (+1173952us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:09.713564 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:09.714252 (+   688us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:09.714312 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:20:09.714342 (+    30us) tablet.cc:662] Decoding operations
0709 12:20:09.714840 (+   498us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:09.714923 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:09.714950 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:09.715268 (+   318us) tablet.cc:701] Row locks acquired
0709 12:20:09.715317 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:20:09.715516 (+   199us) write_op.cc:270] Start()
0709 12:20:09.715667 (+   151us) write_op.cc:276] Timestamp: P: 1783599609715438 usec, L: 0
0709 12:20:09.715713 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 12:20:09.736394 (+ 20681us) log.cc:844] Serialized 537 byte log entry
0709 12:20:09.909351 (+172957us) op_driver.cc:464] REPLICATION: finished
0709 12:20:10.107731 (+198380us) write_op.cc:301] APPLY: starting
0709 12:20:10.111537 (+  3806us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:10.122804 (+ 11267us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:10.144975 (+ 22171us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:10.145299 (+   324us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:10.145549 (+   250us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:20:10.145607 (+    58us) write_op.cc:312] APPLY: finished
0709 12:20:10.145868 (+   261us) log.cc:844] Serialized 22 byte log entry
0709 12:20:10.146688 (+   820us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:10.146762 (+    74us) write_op.cc:454] Released schema lock
0709 12:20:10.146825 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:10.148159 (+  1334us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:10.148190 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":13184,"child_traces":[["op",{"apply.queue_time_us":189855,"apply.run_cpu_time_us":2259,"apply.run_wall_time_us":40402,"num_ops":1,"prepare.queue_time_us":149270,"prepare.run_cpu_time_us":3775,"prepare.run_wall_time_us":36803,"replication_time_us":188084,"thread_start_us":150097,"threads_started":2}]]}
I20260709 12:20:10.263427 11821 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:20:10.280975 11870 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.281553 11870 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:10.283977 11900 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:20:10.288002 11901 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:20:10.235554 11902 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:20:10.296205 11810 consensus_queue.cc:1048] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:20:10.296744 11872 consensus_queue.cc:260] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:10.298041 11872 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:10.283768 11870 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:10.309134 10831 catalog_manager.cc:5697] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 1 to 3, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 3 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:10.310974 10831 catalog_manager.cc:5697] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 1 to 3, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 3 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:10.316975 10831 catalog_manager.cc:5697] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 1 to 3, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 3 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:10.331056 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 113323us
W20260709 12:20:10.338375 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 82672.1us
W20260709 12:20:10.341434 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 72688.7us
I20260709 12:20:10.355481 11706 raft_consensus.cc:2955] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:10.365782 11900 raft_consensus.cc:2955] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:20:10.375823 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 71585.6us
I20260709 12:20:10.399192 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:10.411130 11084 raft_consensus.cc:1275] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:10.453218 11004 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:20:10.457988 11875 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.450942 11852 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
W20260709 12:20:10.493572 11880 log.cc:927] Time spent T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:20:10.470755 11085 raft_consensus.cc:2955] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:10.488651 11875 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:10.494817 11011 raft_consensus.cc:2955] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:10.511224 11080 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:20:10.511701 11080 pending_rounds.cc:85] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 1
I20260709 12:20:10.511978 11080 pending_rounds.cc:107] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:20:10.512243 11080 raft_consensus.cc:2889] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:10.524410 11912 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:20:10.618347 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 223036us
I20260709 12:20:10.654233 11848 consensus_queue.cc:1048] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:10.638711 11875 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:10.762042 11658 raft_consensus.cc:2955] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:20:10.764436 11927 log.cc:927] Time spent T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:20:10.732411 11901 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:10.766148 11920 log.cc:927] Time spent T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:20:10.789291 11870 raft_consensus.cc:1064] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:20:10.794103 11901 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:10.806612 11870 consensus_queue.cc:237] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:10.807430 11901 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:20:10.816429 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 173144us
W20260709 12:20:10.857908 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 294017us
I20260709 12:20:10.823818 11901 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:10.881182 11852 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.972704 10977 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:10.884810 11902 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:10.958179 11811 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.958856 11901 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.009626 11902 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.021922 11911 consensus_queue.cc:1048] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
W20260709 12:20:11.119120 11913 log.cc:927] Time spent T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:20:11.120023 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:11.020606 11852 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.088776 11811 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.106087 11912 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:11.144084 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:11.144460 11811 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:11.145044 11765 log.cc:927] Time spent T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:20:11.140269 11802 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.144990 11005 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
W20260709 12:20:11.244206 11906 log.cc:927] Time spent T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:20:11.255980 11942 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:11.257210 11933 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.192981 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:11.257413 11942 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:11.242515 11795 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:11.358172 11944 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:20:11.373880 11908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.030s	sys 0.074s
W20260709 12:20:11.374327 11908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.030s	sys 0.074s
I20260709 12:20:11.374861 11908 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:11.375375 11908 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.377705 11908 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:11.378247 11908 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:11.378736 11908 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.243415 11802 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.257980 11933 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.359545 11795 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.451175 11948 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:11.469350 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 496693us
W20260709 12:20:11.472762 11945 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:20:11.473312 11933 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:11.473785 11802 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:20:11.475620 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:11.358822 11944 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.453137 11942 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:11.460836 11901 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:11.464840 11902 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:11.481391 11852 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:11.490432 11909 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.493489 11802 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:11.490690 11933 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:11.540832 10977 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:11.533586 11908 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:11.486064 11948 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.535658 11798 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:11.543233 11901 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:11.545217 11902 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:11.536372 11929 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 12:20:11.540608 11933 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.543996 11811 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:20:11.566746 11917 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:11.545634 11802 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.572835 11950 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.576167 11941 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.606150 11951 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.606946 11951 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.572157 11798 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.697599 11964 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.698262 11964 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.574915 11902 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.703672 11902 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:11.704422 11933 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:11.705448 11941 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.542083 11909 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.704816 11658 raft_consensus.cc:2955] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:11.624653 11795 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:11.755327 11963 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.706524 11966 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.587144 11901 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.759922 11970 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:11.760533 11970 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.764434 11962 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.765170 11962 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.670379 11852 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.764561 11941 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:11.769727 11947 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.707142 11950 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.794891 11950 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:11.756235 11966 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:11.798738 11795 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.799358 11795 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.799985 11733 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.800508 11733 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.802649 11733 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:11.803112 11830 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:20:11.814363 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 273585us
I20260709 12:20:11.786226 11862 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.828452 11932 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.829116 11932 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.831405 11960 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.832103 11960 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.795742 11917 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:11.804035 11933 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.842603 11966 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:11.796010 11956 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.847553 11976 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.792477 11902 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.839510 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:11.826604 11941 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.803635 11830 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.834923 11733 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:20:11.848263 11959 log.cc:927] Time spent T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 12:20:11.847803 11971 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.826560 11967 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.821276 11852 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:11.851966 11802 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:11.857020 11964 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:11.790352 11963 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.849318 11933 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.854074 11862 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.845116 11917 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.804912 11947 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.045389 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:11.856120 11956 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.053035 11956 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.092475 11955 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:20:12.034137 11943 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 1.128s	user 0.007s	sys 0.022s
W20260709 12:20:11.989740 11923 log.cc:927] Time spent T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 1.372s	user 0.024s	sys 0.032s
I20260709 12:20:11.861981 11941 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.040019 11936 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:11.867939 11962 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:11.935554 10933 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:11.979717 11973 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.857784 11902 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.898300 11798 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:12.093178 11955 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:12.109762 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:11.867590 11951 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:12.049642 11901 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:11.933568 11944 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:12.099466 11975 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:11.910419 11970 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:12.049301 11802 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:12.048382 11948 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:11.972139 11974 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:12.054010 11900 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:12.143275 11862 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.144156 11979 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.870294 11733 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.034364 11969 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:11.985157 11971 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.863978 11976 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.948894 11967 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:11.898953 11968 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:20:12.186748 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 92453.9us
I20260709 12:20:12.160265 11962 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:12.211519 11988 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:12.212033 11988 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:12.168951 11798 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:12.189671 11951 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:12.174136 11970 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:12.189198 11901 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:12.189412 11802 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.195153 11900 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.188977 11977 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:12.167925 11974 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.244290 11980 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:12.231595 11944 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.216342 11962 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.217945 11798 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.215031 11968 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.166162 11936 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.182673 11973 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.225399 11951 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.230284 11970 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.230926 11901 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.162962 11975 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.280274 11917 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.248787 11830 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.218086 11969 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:12.284080 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 51955.9us
I20260709 12:20:12.271661 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 590) took 1904 ms. Trace:
I20260709 12:20:12.213666 11979 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.278263 11862 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:12.271389 11944 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.352309 11989 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:12.317668 11933 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:12.282012 11929 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:20:12.309084 11982 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.282446 11980 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.359378 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:12.360025 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:12.385950 11085 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:12.270172 11977 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.384327 11978 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:12.359304 11933 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:12.351755 11862 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.333632 11983 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:12.418200 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:12.390928 11974 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.393394 11988 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.357888 11981 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:12.386122 11989 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:12.540226 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:12.329092 11083 rpcz_store.cc:276] 0709 12:20:10.360148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.362407 (+  2259us) service_pool.cc:224] Handling call
0709 12:20:10.365336 (+  2929us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:10.365733 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:10.365759 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:10.366818 (+  1059us) log.cc:844] Serialized 556 byte log entry
0709 12:20:10.475278 (+108460us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:10.477005 (+  1727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:10.481768 (+  4763us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:11.979848 (+1498080us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:20:12.229946 (+250098us) raft_consensus.cc:1685] finished
0709 12:20:12.231382 (+  1436us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:12.264801 (+ 33419us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6485888,"thread_start_us":90769,"threads_started":1,"wal-append.queue_time_us":190571}
W20260709 12:20:12.438747 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 85055.5us
I20260709 12:20:12.430621 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:12.419175 11802 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:20:12.559482 11987 log.cc:927] Time spent T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:20:12.585165 11050 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:12.493527 11936 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.500293 11941 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.420053 11933 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.450234 11951 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:12.446979 11852 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.562950 11862 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.448868 11976 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.590840 11625 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:12.531536 11970 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:12.445129 11955 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.490849 11944 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:12.559522 11901 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:12.601064 11936 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:12.475415 11967 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.551101 11979 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.455283 11988 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:12.581559 11874 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:12.518852 11994 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:12.614918 11977 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.613699 11968 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:12.622198 11973 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:12.587275 11798 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:12.591719 11975 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.500941 11900 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:12.606914 11949 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.106s	user 0.009s	sys 0.017s
I20260709 12:20:12.429205 11982 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.586055 11981 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.621547 11955 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:12.506381 11971 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.613912 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:12.618350 11970 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.622615 11994 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:12.612716 11951 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:12.626480 12001 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:12.616696 11859 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:12.449577 11978 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.622112 11874 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.444670 11983 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.652385 11900 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:20:12.634863 11949 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.137s	user 0.009s	sys 0.018s
I20260709 12:20:12.644811 11859 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.631435 11980 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:12.669199 11997 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:12.628551 11936 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.645313 11989 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:12.678028 11978 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.644449 11083 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:12.630179 11988 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:12.669973 11859 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:12.673504 11658 consensus_meta.cc:287] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.824s	user 0.011s	sys 0.000s
I20260709 12:20:12.643186 11970 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.666416 11951 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:12.685961 11994 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:12.683624 11936 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.671008 11997 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.665917 11900 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.636683 11955 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.689026 11933 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:12.711761 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:12.668570 12001 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.719111 11970 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:12.722419 11988 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.724295 11947 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.728154 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:12.724428 11981 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:12.711934 11991 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:12.734429 11982 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.730649 11900 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.743494 11963 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.748261 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:12.744369 11902 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:12.841727 11983 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.843551 11995 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:12.814254 11874 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.731047 11859 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.857800 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:12.748775 11991 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.864562 11951 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:12.848582 11912 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:12.865447 11912 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.869469 11997 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.870105 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:12.873092 11912 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.858739 11874 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:12.866124 11955 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:12.863996 11658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59384 (request call id 13) took 1231 ms. Trace:
I20260709 12:20:12.879578 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:12.889858 10929 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
W20260709 12:20:12.880512 11946 log.cc:927] Time spent T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 1.383s	user 0.013s	sys 0.006s
I20260709 12:20:12.896971 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:12.872002 11900 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:12.878183 11940 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:12.889633 11658 rpcz_store.cc:276] 0709 12:20:11.625734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.699496 (+ 73762us) service_pool.cc:224] Handling call
0709 12:20:11.704483 (+  4987us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:11.704706 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:20:12.693566 (+988860us) log.cc:844] Serialized 14 byte log entry
0709 12:20:12.843123 (+149557us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:12.843188 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:12.843236 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:12.844092 (+   856us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:12.857333 (+ 13241us) inbound_call.cc:177] Queueing success response
0709 12:20:12.865056 (+  7723us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
Metrics: {"raft.queue_time_us":80,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":99,"spinlock_wait_cycles":4151168,"thread_start_us":140592,"threads_started":1,"wal-append.queue_time_us":142818}
I20260709 12:20:12.939544 11859 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:12.933990 12004 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:12.940659 12004 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:12.986825 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:12.904968 11908 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:12.896102 11874 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.916500 11912 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:12.989696 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:12.907927 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 592) took 1044 ms. Trace:
W20260709 12:20:13.016707 11622 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.9.131.67:40209 for RPC RequestConsensusVote timed out after 1.515s (ON_OUTBOUND_QUEUE) [suppressed 5 similar messages]
I20260709 12:20:12.907114 11818 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:12.948868 11936 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:20:12.916249 11937 log.cc:927] Time spent T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 1.548s	user 0.003s	sys 0.021s
I20260709 12:20:13.007666 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:12.916667 11997 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:13.016779 10928 rpcz_store.cc:276] 0709 12:20:11.860998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.861902 (+   904us) service_pool.cc:224] Handling call
0709 12:20:11.934152 (+ 72250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:11.934592 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:11.934623 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:12.144161 (+209538us) log.cc:844] Serialized 26 byte log entry
0709 12:20:12.231078 (+ 86917us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:12.642957 (+411879us) log.cc:844] Serialized 14 byte log entry
0709 12:20:12.670742 (+ 27785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:12.672650 (+  1908us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:12.886087 (+213437us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b240013b098. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badcf99c4 00007f9badcf7acb 00007f9badeb2dc9 00007f9badeb2a55 00007f9badeb1fb0 00007f9bb0b28488 00007f9bb0b28be8 00007f9bb0b00398 00007f9bb0afb76a 00007f9bb0afabb6
0709 12:20:12.888696 (+  2609us) raft_consensus.cc:1685] finished
0709 12:20:12.897877 (+  9181us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:12.905774 (+  7897us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2110,"prepare.queue_time_us":462698,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":1745,"raft.queue_time_us":179540,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":42262,"spinlock_wait_cycles":3136768,"thread_start_us":436708,"threads_started":2,"wal-append.queue_time_us":237511}
I20260709 12:20:13.021334 11011 raft_consensus.cc:1275] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:12.904382 12005 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:12.905552 11900 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:12.988862 11970 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:12.919713 11940 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.052357 12004 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.052704 11874 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.037197 11969 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.041512 11962 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.026196 11955 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:13.012775 11951 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:13.006970 11908 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.019762 11912 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.067724 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:13.068220 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:13.024302 11936 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.069759 11953 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:13.078274 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 597) took 2549 ms. Trace:
I20260709 12:20:13.078886 11874 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:13.079596 11874 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.032364 11997 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.024089 11818 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.078016 11953 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.057928 11935 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:13.058260 11802 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:20:13.051065 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 44537.4us
I20260709 12:20:13.056556 12009 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:13.088563 11874 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.068725 11981 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:13.079761 12004 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:13.083745 11859 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:13.061810 11970 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.066661 11955 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.068404 11951 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.107082 11795 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:13.121549 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:13.104779 11933 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:13.055816 12005 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.127614 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:13.112632 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:13.133374 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:13.094385 11802 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:13.103684 11981 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.107514 11859 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.105470 12009 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.149772 11900 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.150519 11658 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 LEARNER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:13.152122 11870 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:13.153192 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:13.154491 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:13.155417 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:13.116019 12004 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.101976 11935 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:13.143692 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:13.156153 11940 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.171408 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:13.172943 11085 raft_consensus.cc:1240] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:20:13.138536 11933 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.182781 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:13.078775 11080 rpcz_store.cc:276] 0709 12:20:10.529148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.530009 (+   861us) service_pool.cc:224] Handling call
0709 12:20:10.558643 (+ 28634us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:10.559090 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:10.559119 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:10.559610 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 12:20:10.901957 (+342347us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:10.930087 (+ 28130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:10.973271 (+ 43184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:12.868027 (+1894756us) spinlock_profiling.cc:243] Waited 8.45 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:20:13.077905 (+209878us) raft_consensus.cc:1685] finished
0709 12:20:13.077936 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.078183 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5370,"raft.queue_time_us":1320,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":5850,"spinlock_wait_cycles":19446016,"thread_start_us":326781,"threads_started":1,"wal-append.queue_time_us":712591}
I20260709 12:20:13.185956 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:13.180085 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 595) took 1311 ms. Trace:
W20260709 12:20:13.181166 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 65957.8us
I20260709 12:20:13.181277 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 594) took 1313 ms. Trace:
I20260709 12:20:13.190306 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:13.191283 10974 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:13.184984 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:13.193178 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:13.194427 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:13.195823 11911 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:13.187744 10935 rpcz_store.cc:276] 0709 12:20:11.861626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.861845 (+   219us) service_pool.cc:224] Handling call
0709 12:20:12.045717 (+183872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:12.223071 (+177354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:12.223099 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:12.223141 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:12.223167 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.174375 (+951208us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54002049d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:20:13.174414 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.174530 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":407450496}
I20260709 12:20:13.187503 10934 rpcz_store.cc:276] 0709 12:20:11.861932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.862029 (+    97us) service_pool.cc:224] Handling call
0709 12:20:13.172821 (+1310792us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b5800002d98. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f39fc0 00007f9bb5f24929 00007f9bb5f243d2 00007f9baf49bbd4
0709 12:20:13.173011 (+   190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:13.173177 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:13.173200 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:13.173235 (+    35us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:13.173273 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.173328 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.173437 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2614656}
I20260709 12:20:13.185724 11733 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.187974 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:13.267686 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:20:13.308048 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 276704us
I20260709 12:20:13.316684 12005 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.318420 11960 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:13.320201 11970 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:13.321595 11932 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.209379 11859 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:13.202201 11912 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.285847 11818 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.208400 12009 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.325871 11933 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:13.326496 11955 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.327371 11981 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:13.266495 11802 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:13.202342 11997 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.288426 11908 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:13.333128 10931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 600) took 1469 ms. Trace:
I20260709 12:20:13.333572 10931 rpcz_store.cc:276] 0709 12:20:11.863148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.864578 (+  1430us) service_pool.cc:224] Handling call
0709 12:20:11.870131 (+  5553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:12.228264 (+358133us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:12.229230 (+   966us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:12.232595 (+  3365us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:12.235082 (+  2487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.332798 (+1097716us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54002053d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:20:13.332848 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.332975 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":808893696}
I20260709 12:20:13.208616 11081 raft_consensus.cc:2955] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:13.359354 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.351691 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.337239 11994 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:13.371018 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.370846 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.391279 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.388583 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.393699 10936 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 1.
I20260709 12:20:13.196326 11911 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.368476 11950 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:20:13.406769 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 206745us
I20260709 12:20:13.406687 11940 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:13.446138 11940 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.446775 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.449373 12005 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:13.449890 12005 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.452566 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:13.593211 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 51684.9us
I20260709 12:20:13.389191 11951 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:13.621491 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:13.633399 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 194228us
I20260709 12:20:13.643136 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.634302 10974 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:13.404570 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.622491 10936 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:13.398104 11994 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.719668 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 604) took 1855 ms. Trace:
I20260709 12:20:13.720296 10927 rpcz_store.cc:276] 0709 12:20:11.864178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.093951 (+229773us) service_pool.cc:224] Handling call
0709 12:20:12.217863 (+123912us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:12.245152 (+ 27289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:12.259804 (+ 14652us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:13.062045 (+802241us) spinlock_profiling.cc:243] Waited 74.1 ms on lock 0x7b4c001f9180. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9baf22ca20 00007f9baf23da29 00007f9baf203644 00007f9baf22af2d 00007f9baf22ab93 00007f9bb0f5b18b 00007f9bb0f5bcb5 00007f9bb0f5d004 00007f9bb0f5c729 00007f9bb0f61d96 00007f9bb0f56adb
0709 12:20:13.134998 (+ 72953us) log.cc:844] Serialized 556 byte log entry
0709 12:20:13.592985 (+457987us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:13.610965 (+ 17980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.644457 (+ 33492us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:13.719353 (+ 74896us) raft_consensus.cc:1685] finished
0709 12:20:13.719380 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.719599 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170533632,"thread_start_us":203530,"threads_started":1,"wal-append.queue_time_us":487843}
I20260709 12:20:13.677976 12015 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:13.594512 11912 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:13.406148 11911 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:13.615636 11950 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.633322 11900 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.766722 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:13.731707 11940 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.744684 12015 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:13.756522 12005 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.745802 11935 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.308152 12010 raft_consensus.cc:2955] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:13.785776 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:20:13.797360 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 348345us
I20260709 12:20:13.759552 11912 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.781157 12015 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:13.800009 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.804641 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.816381 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:13.770684 11900 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.829414 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.830097 10929 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:13.831012 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.799556 11909 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.795648 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.851810 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.841296 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.869994 11991 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.872915 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.874316 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.886174 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:13.889223 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.890100 11951 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:13.891924 11951 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:13.894294 11951 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:20:13.898212 11081 consensus_meta.cc:287] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.548s	user 0.008s	sys 0.000s
I20260709 12:20:13.902071 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:13.896324 11950 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.912901 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:13.914530 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.916559 10929 raft_consensus.cc:2410] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:20:13.885438 11625 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:13.911053 11994 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:13.924157 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:13.918020 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:13.926743 12020 log.cc:927] Time spent T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:20:13.942040 11936 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.943959 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.932080 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:13.951438 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.962702 11900 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.967533 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.968956 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.969606 10934 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:20:13.970564 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.972539 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.973830 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.974501 10931 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:13.975445 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.971155 10934 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:20:13.950382 11912 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:13.962740 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:13.980798 11079 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:13.982812 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:13.980156 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 138453us
I20260709 12:20:13.951139 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.984910 10931 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:14.002969 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.004359 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.001264 10930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 596) took 2135 ms. Trace:
I20260709 12:20:14.008641 10930 rpcz_store.cc:276] 0709 12:20:11.862180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.862289 (+   109us) service_pool.cc:224] Handling call
0709 12:20:11.862599 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:12.223567 (+360968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:12.223597 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:12.223634 (+    37us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:12.223659 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.997016 (+1773357us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b5400399c54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:20:13.997051 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.997162 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":825642240}
I20260709 12:20:13.991591 11871 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:14.010106 11871 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:14.012531 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.013576 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 705) took 1021 ms. Trace:
I20260709 12:20:14.013955 11008 rpcz_store.cc:276] 0709 12:20:12.992337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.009374 (+ 17037us) service_pool.cc:224] Handling call
0709 12:20:13.009649 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:13.095357 (+ 85708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:13.095386 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:13.095429 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:13.095454 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:14.013381 (+917927us) spinlock_profiling.cc:243] Waited 85.5 ms on lock 0x7b54002d9454. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:20:14.013421 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:14.013526 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196666752}
I20260709 12:20:14.015127 12015 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:14.016687 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.017307 11085 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:14.019367 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.020849 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.021540 11076 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:14.021682 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.022002 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.022635 11080 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:14.022655 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.022848 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.021610 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.023567 11085 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:14.023972 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.024214 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.025051 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.025173 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.025311 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.025983 11079 raft_consensus.cc:2410] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:20:14.026475 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.026767 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.010166 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 700) took 1019 ms. Trace:
I20260709 12:20:14.027760 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.028666 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.029039 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.054282 11080 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:14.053298 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.028206 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.056071 11085 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:14.027415 11079 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:14.028141 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.056535 11082 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:14.064282 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.064934 11085 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:14.065727 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.068717 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:13.996834 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.078089 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.072952 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.073122 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.073251 12032 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:14.053509 12015 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:14.078090 11953 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:14.075300 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.067298 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.105443 11003 raft_consensus.cc:2410] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:20:14.105894 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.106446 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.107299 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.046432 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.079125 11081 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:14.079754 11085 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:14.080567 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.108726 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.108958 11079 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:14.109359 11081 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:14.109941 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.081568 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.110253 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.110944 11081 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:14.111374 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.067936 11078 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:14.083217 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:14.088930 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.090073 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.091432 11911 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:14.092749 11076 raft_consensus.cc:2410] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:20:14.095638 11658 raft_consensus.cc:2955] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:14.095556 11875 consensus_queue.cc:1059] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:20:14.107657 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.111809 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.113603 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.126387 11085 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:14.113793 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.127767 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.115371 11008 raft_consensus.cc:2393] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 4: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:14.115661 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.112022 11082 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:14.113786 11079 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:14.129742 11081 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:14.132022 11051 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:14.112739 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.138273 11994 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:14.136276 11875 raft_consensus.cc:3055] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:20:14.066372 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 198837us
I20260709 12:20:14.143926 11079 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:14.144567 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.113914 11871 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:14.113098 11007 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:20:14.146739 11078 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:14.146993 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:14.136552 11005 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:14.151705 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.147714 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.146245 11875 raft_consensus.cc:740] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:14.027391 11002 rpcz_store.cc:276] 0709 12:20:12.990929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.007788 (+ 16859us) service_pool.cc:224] Handling call
0709 12:20:13.986374 (+978586us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b5800223598. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f39fc0 00007f9bb5f24929 00007f9bb5f243d2 00007f9baf49bbd4
0709 12:20:14.001957 (+ 15583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:14.009810 (+  7853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:14.009838 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:14.009891 (+    53us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:14.009920 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:14.009991 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:14.010111 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4729600}
I20260709 12:20:14.153831 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.154029 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.155090 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.155269 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.156538 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.157480 11005 raft_consensus.cc:2410] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:20:14.161545 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.146360 11994 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:14.175154 11994 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:14.176141 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:14.176869 11656 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:20:14.174984 11875 consensus_queue.cc:260] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:14.179343 11875 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:14.180339 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:14.181083 11657 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:20:14.176025 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.183504 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.184399 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.184657 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.185623 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.185731 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.186825 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:20:14.148919 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 53746.6us
I20260709 12:20:14.152945 11911 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:14.148177 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.188832 11003 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:14.153065 11010 raft_consensus.cc:2393] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 3: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:14.189692 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.190227 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.190769 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.191244 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.191792 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.194070 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:20:14.194542 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 550307us
I20260709 12:20:14.194718 11007 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:20:14.200107 11994 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:14.193228 11006 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:20:14.191814 11010 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:20:14.209419 11994 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:14.219842 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.214866 11051 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:14.220667 10931 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:14.220942 11994 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:14.221216 12004 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:14.221393 11994 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:14.221814 11994 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:14.220013 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.213470 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.226490 10936 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:20:14.226895 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.229974 11051 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:14.216759 10977 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:14.232162 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.233340 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.233806 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.234395 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.232548 10831 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35608 (request call id 136) took 3931 ms. Trace:
I20260709 12:20:14.236176 11051 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:14.234984 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.233340 10830 catalog_manager.cc:5697] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:14.234347 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.240258 11011 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:14.241508 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.242714 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.249557 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.249867 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.251984 11933 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:14.252305 11994 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:14.252655 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.252840 10833 catalog_manager.cc:5697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:14.256229 10977 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:14.249469 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.257262 10929 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:20:14.260332 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.264331 11051 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:14.266234 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:14.227820 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.272650 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.235455 10831 rpcz_store.cc:276] 0709 12:20:10.300336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.300471 (+   135us) service_pool.cc:224] Handling call
0709 12:20:14.231494 (+3931023us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:10.858581 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:10.859172 (+   591us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:10.859212 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:20:10.859226 (+    14us) tablet.cc:662] Decoding operations
0709 12:20:10.859827 (+   601us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:10.859915 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:10.859944 (+    29us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:20:10.860277 (+   333us) tablet.cc:701] Row locks acquired
0709 12:20:10.860292 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:20:10.860478 (+   186us) write_op.cc:270] Start()
0709 12:20:10.860593 (+   115us) write_op.cc:276] Timestamp: P: 1783599610860427 usec, L: 0
0709 12:20:10.860611 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:20:11.023839 (+163228us) log.cc:844] Serialized 1307 byte log entry
0709 12:20:11.566852 (+543013us) op_driver.cc:464] REPLICATION: finished
0709 12:20:11.852189 (+285337us) write_op.cc:301] APPLY: starting
0709 12:20:11.856646 (+  4457us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:11.865326 (+  8680us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:11.910510 (+ 45184us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:11.992975 (+ 82465us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:11.993182 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:20:11.993226 (+    44us) write_op.cc:312] APPLY: finished
0709 12:20:11.993475 (+   249us) log.cc:844] Serialized 34 byte log entry
0709 12:20:11.993649 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:11.993752 (+   103us) write_op.cc:454] Released schema lock
0709 12:20:11.993795 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:12.281298 (+287503us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b5400096d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5be28 00007f9bb4996581 00007f9bb4995d58 00007f9bb499a9f1 00007f9bb499a9a9 00007f9bb499a939 00007f9bb499a901 00007f9bb4999b2d 0000000000388634 0000000000388479
0709 12:20:12.316570 (+ 35272us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:12.329480 (+ 12910us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":268726,"apply.run_cpu_time_us":3572,"apply.run_wall_time_us":149203,"num_ops":3,"prepare.queue_time_us":487278,"prepare.run_cpu_time_us":63361,"prepare.run_wall_time_us":1422924,"replication_time_us":682942,"spinlock_wait_cycles":37025152,"thread_start_us":362155,"threads_started":2}]]}
I20260709 12:20:14.245178 11949 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:14.254268 11873 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:14.295533 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.296221 11004 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:14.296875 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.257285 11933 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:14.268404 11818 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:14.270100 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.302911 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.312565 11994 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:14.298010 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.313920 12001 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:14.283490 11951 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:14.314524 11933 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:14.315243 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.330585 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.293802 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.258694 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.293615 11949 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:14.315138 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.338507 11011 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:20:14.298365 11873 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:14.344585 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.345225 11011 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:14.315730 11818 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:14.329280 11951 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:14.360351 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.341882 11949 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:14.367576 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:14.343585 11873 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:14.370754 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.357199 11818 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:14.379699 10932 raft_consensus.cc:2410] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:20:14.381527 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.382678 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.383677 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.386123 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.387719 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.365579 11951 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:14.407557 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 659) took 1260 ms. Trace:
I20260709 12:20:14.396170 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.408001 11084 rpcz_store.cc:276] 0709 12:20:13.147395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.147599 (+   204us) service_pool.cc:224] Handling call
0709 12:20:14.212381 (+1064782us) spinlock_profiling.cc:243] Waited 8.71 ms on lock 0x7b5800017d98. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f39fc0 00007f9bb5f24929 00007f9bb5f243d2 00007f9baf49bbd4
0709 12:20:14.212554 (+   173us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:14.212917 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:14.212946 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:14.213420 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:20:14.316671 (+103251us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:14.316707 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:14.316782 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:14.407237 (+ 90455us) raft_consensus.cc:1685] finished
0709 12:20:14.407257 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:14.407487 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7326,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":20038912,"thread_start_us":71487,"threads_started":1,"wal-append.queue_time_us":191145}
I20260709 12:20:14.424373 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.445860 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 613) took 1058 ms. Trace:
I20260709 12:20:14.446310 10928 rpcz_store.cc:276] 0709 12:20:13.387672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.387781 (+   109us) service_pool.cc:224] Handling call
0709 12:20:14.210764 (+822983us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b5800002d98. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f39fc0 00007f9bb5f24929 00007f9bb5f243d2 00007f9baf49bbd4
0709 12:20:14.210954 (+   190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:14.235360 (+ 24406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:14.235387 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:14.261395 (+ 26008us) log.cc:844] Serialized 26 byte log entry
0709 12:20:14.366328 (+104933us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:14.366366 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:14.366446 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:14.428105 (+ 61659us) raft_consensus.cc:1685] finished
0709 12:20:14.428137 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:14.445796 (+ 17659us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11462,"raft.queue_time_us":17394,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":23445,"spinlock_wait_cycles":9575168,"thread_start_us":54201,"threads_started":1,"wal-append.queue_time_us":131305}
I20260709 12:20:14.389470 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.450374 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.458123 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.460012 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.465669 11873 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:14.459510 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.466661 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:20:14.468528 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 138313us
I20260709 12:20:14.471371 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:20:14.448186 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 174950us
I20260709 12:20:14.480199 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.480435 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.479597 11051 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:14.481612 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.483386 11010 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:14.485998 11994 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:14.486406 11994 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:14.486438 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.482412 11051 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:14.489949 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.479146 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:14.492142 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.501719 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.502961 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.504035 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.508056 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.510581 10899 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:14.489321 11994 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:14.522013 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.540202 11079 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:14.542038 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.519833 11926 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:14.544343 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.546736 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.549612 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.552713 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.552304 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.557013 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.559036 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.563611 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:14.564815 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 82463.8us
I20260709 12:20:14.565107 12049 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:14.565937 12049 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:14.566277 12049 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:14.575007 11051 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:20:14.543790 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 290155us
I20260709 12:20:14.580852 12049 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:14.583348 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.584928 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.593565 10936 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:14.548878 11926 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:14.586095 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.587046 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.590518 11949 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:14.592473 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 57402.9us
I20260709 12:20:14.596388 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.597450 10974 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:14.598731 10974 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:14.601684 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.602411 11004 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:20:14.610019 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.595443 11926 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:14.616202 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.617579 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.621635 11951 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:14.607638 11933 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:14.627959 11933 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:14.628666 11933 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:14.629050 11933 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:14.556877 11818 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:14.631359 11818 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:14.633536 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.634807 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.636037 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.637118 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.637362 11949 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:14.638474 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.640763 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.643957 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.645670 11084 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:14.646988 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.629415 11933 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:14.658738 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.604552 12019 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:14.604424 12001 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:14.666688 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:14.666833 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 71495.1us
W20260709 12:20:14.662372 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 85402.4us
I20260709 12:20:14.664224 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:20:14.665738 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 101475us
I20260709 12:20:14.667783 11050 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:14.672789 11050 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:14.674480 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.662026 11951 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:14.676947 11050 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:14.666707 11005 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:14.675225 12052 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:14.695061 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.696183 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.680383 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.681880 11078 raft_consensus.cc:1240] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:14.686595 11873 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:14.687181 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.687425 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.688194 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.688524 11085 raft_consensus.cc:1240] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:14.688797 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.676467 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.690996 10974 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:14.725797 10901 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:14.726722 10901 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:14.727033 10974 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:14.692124 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.734633 10974 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:14.736001 10974 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:14.738194 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.733384 10901 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:14.738865 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.742656 10974 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:14.746603 11083 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:14.759155 10901 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:14.763681 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.739454 11875 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:14.739503 11953 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:14.739470 11871 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:14.746876 11949 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:14.736891 12044 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:14.770184 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.771036 11083 raft_consensus.cc:2393] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 2: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:14.746176 11818 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:14.764878 11875 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.741185 12009 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:14.748000 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.768322 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.779269 11077 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 1.
I20260709 12:20:14.740298 11810 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:14.740087 12050 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:14.749097 11699 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:14.767951 11871 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:14.787747 11871 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:14.778307 11875 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:14.771145 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.771392 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:14.793517 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.772542 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:14.795912 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:14.797125 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:14.797669 10934 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:14.747503 11076 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:14.800585 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.802256 10833 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 19) took 1886 ms. Trace:
I20260709 12:20:14.756760 12035 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:14.774068 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.804955 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.802639 10833 rpcz_store.cc:276] 0709 12:20:12.916399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.916568 (+   169us) service_pool.cc:224] Handling call
0709 12:20:14.802194 (+1885626us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:14.334387 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:14.335031 (+   644us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:14.335071 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:20:14.335091 (+    20us) tablet.cc:662] Decoding operations
0709 12:20:14.335461 (+   370us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:14.335547 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:14.335578 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:14.335781 (+   203us) tablet.cc:701] Row locks acquired
0709 12:20:14.335801 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:20:14.335990 (+   189us) write_op.cc:270] Start()
0709 12:20:14.336110 (+   120us) write_op.cc:276] Timestamp: P: 1783599614335932 usec, L: 0
0709 12:20:14.336133 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:20:14.336843 (+   710us) log.cc:844] Serialized 594 byte log entry
0709 12:20:14.686049 (+349206us) op_driver.cc:464] REPLICATION: finished
0709 12:20:14.797348 (+111299us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b18001cbe80. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:20:14.797466 (+   118us) write_op.cc:301] APPLY: starting
0709 12:20:14.797540 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:14.797639 (+    99us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:14.797659 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:14.797891 (+   232us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:14.798040 (+   149us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:20:14.798082 (+    42us) write_op.cc:312] APPLY: finished
0709 12:20:14.798260 (+   178us) log.cc:844] Serialized 22 byte log entry
0709 12:20:14.799208 (+   948us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:14.799297 (+    89us) write_op.cc:454] Released schema lock
0709 12:20:14.799336 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:14.799679 (+   343us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:14.799712 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1312382,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":81688,"apply.run_cpu_time_us":1418,"apply.run_wall_time_us":2170,"num_ops":1,"prepare.queue_time_us":67631,"prepare.run_cpu_time_us":12562,"prepare.run_wall_time_us":38873,"raft.queue_time_us":363779,"raft.run_cpu_time_us":32991,"raft.run_wall_time_us":84137,"replication_time_us":349778,"spinlock_wait_cycles":2809600,"thread_start_us":295070,"threads_started":4,"wal-append.queue_time_us":127562}]]}
W20260709 12:20:14.774840 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 97970.2us
I20260709 12:20:14.806388 11050 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:14.770761 12001 consensus_queue.cc:1059] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:20:14.808599 11050 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:14.775687 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:14.773849 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.809588 11871 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:14.810094 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:14.810214 12035 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.810786 11949 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:14.811561 11949 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:14.812716 11050 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:14.814067 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.814707 11081 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:14.775460 11870 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:14.782858 11926 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:14.816488 10929 raft_consensus.cc:2393] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 4: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:14.816538 10932 raft_consensus.cc:2955] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:14.818137 11926 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:14.818394 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:14.819067 12052 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:14.819386 10931 raft_consensus.cc:2410] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:20:14.822196 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.821594 11050 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:14.822851 11077 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:14.778280 12044 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:14.774595 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:14.827950 11084 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 1.
I20260709 12:20:14.780107 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.828488 12052 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:14.828933 11080 raft_consensus.cc:2393] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 2: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:14.765092 11873 consensus_queue.cc:1059] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:20:14.815660 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.810735 12035 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:14.832104 11081 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:14.805572 11085 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
W20260709 12:20:14.833405 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 59485.4us
I20260709 12:20:14.823784 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:20:14.759531 11622 leader_election.cc:336] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Timed out: RequestConsensusVote RPC to 127.9.131.67:40209 timed out after 1.515s (SENT)
I20260709 12:20:14.826776 11050 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:14.837325 11050 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:14.834718 10901 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:14.809062 12001 raft_consensus.cc:3055] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:14.911911 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.921293 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:14.922058 11079 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
W20260709 12:20:14.922132 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 84960.8us
I20260709 12:20:14.923022 11050 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:14.922099 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:14.925060 11082 raft_consensus.cc:2393] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 4: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:14.926307 11050 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:20:14.928755 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 94105.4us
I20260709 12:20:14.939510 10901 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:14.940852 10901 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:14.943847 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:14.947796 10977 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:14.949435 10977 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:14.950538 10977 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:14.920492 11085 raft_consensus.cc:2955] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:20:14.954877 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 206276us
I20260709 12:20:14.915946 12001 raft_consensus.cc:740] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:14.956523 12044 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:14.956772 12001 consensus_queue.cc:260] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:14.802616 11994 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:14.978449 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 201443us
I20260709 12:20:14.915784 11949 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:14.984385 10974 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:20:14.984853 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.915418 11873 raft_consensus.cc:3055] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:14.973994 10830 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35620 (request call id 128) took 4332 ms. Trace:
I20260709 12:20:15.005360 10899 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:14.958076 12001 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:14.992056 10974 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:14.986678 10830 rpcz_store.cc:276] 0709 12:20:10.641349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.642042 (+   693us) service_pool.cc:224] Handling call
0709 12:20:11.522921 (+880879us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b5400096d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0eca090 00007f9bb0f68f3a 00007f9bb6d1ee9c 00007f9bb6e1d04e 00007f9bb52de2a4 00007f9bb52de232 00007f9bb52de161 00007f9bb52de0dc 00007f9bb52dd392 00007f9baf29b48c 00007f9baf29a8c6
0709 12:20:14.973898 (+3450977us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:14.429485 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:14.441739 (+ 12254us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:14.441780 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:20:14.441800 (+    20us) tablet.cc:662] Decoding operations
0709 12:20:14.442161 (+   361us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:14.442211 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:14.442240 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:14.442469 (+   229us) tablet.cc:701] Row locks acquired
0709 12:20:14.442491 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:20:14.442642 (+   151us) write_op.cc:270] Start()
0709 12:20:14.442764 (+   122us) write_op.cc:276] Timestamp: P: 1783599614442588 usec, L: 0
0709 12:20:14.442786 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:20:14.443492 (+   706us) log.cc:844] Serialized 533 byte log entry
0709 12:20:14.780516 (+337024us) op_driver.cc:464] REPLICATION: finished
0709 12:20:14.827287 (+ 46771us) write_op.cc:301] APPLY: starting
0709 12:20:14.829521 (+  2234us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:14.914075 (+ 84554us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:14.922262 (+  8187us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:14.967954 (+ 45692us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:14.968107 (+   153us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:20:14.968154 (+    47us) write_op.cc:312] APPLY: finished
0709 12:20:14.968373 (+   219us) log.cc:844] Serialized 22 byte log entry
0709 12:20:14.968542 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:14.968620 (+    78us) write_op.cc:454] Released schema lock
0709 12:20:14.968657 (+    37us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":116437,"reported_tablets":9,"spinlock_wait_cycles":79747840,"child_traces":[["op",{"apply.queue_time_us":46518,"apply.run_cpu_time_us":1999,"apply.run_wall_time_us":141686,"num_ops":1,"prepare.queue_time_us":70315,"prepare.run_cpu_time_us":2750,"prepare.run_wall_time_us":35543,"replication_time_us":332051,"threads_started":1}]]}
I20260709 12:20:14.975178 10934 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:14.986364 11873 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:14.947220 12040 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:14.973222 11875 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:14.964763 11953 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:14.984163 11949 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:14.958004 10927 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:14.928260 11951 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.051894 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.961894 11958 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:14.946938 12053 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:20:15.054059 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 127832us
I20260709 12:20:15.018143 12009 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:20:15.056453 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 63886us
I20260709 12:20:15.092187 10899 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:14.975015 11933 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:14.966343 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.975548 11818 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:15.062258 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.960374 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:15.063297 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:14.961436 11733 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:14.965008 11699 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:14.976934 12054 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:14.975399 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:14.986572 10935 raft_consensus.cc:2955] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:15.081269 11050 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:14.969947 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:15.067974 12051 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:15.080902 12053 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:15.087342 11871 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:15.072548 11622 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:15.073235 11949 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.089912 10930 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 4: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:15.097496 10899 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:20:15.114395 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 122402us
I20260709 12:20:15.095672 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:15.098767 11926 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:15.096000 12009 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:15.104444 11078 raft_consensus.cc:2393] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 4: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:15.108458 11810 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:20:15.115613 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 163635us
I20260709 12:20:15.104853 12049 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:15.128876 10974 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:15.117089 11050 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.137430 10899 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:15.121387 12051 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:15.124461 12053 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:15.136294 10977 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.123541 11951 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:15.093811 12065 consensus_queue.cc:1059] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:20:15.138652 10899 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:15.153534 11050 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.161753 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:15.162022 11050 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.106287 11873 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:15.154515 10974 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.155118 10930 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:15.132863 11699 consensus_queue.cc:1059] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:20:15.156558 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:15.165196 12044 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:15.163120 10899 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:15.166208 11994 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:15.157297 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:15.166694 12059 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:15.167091 12059 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:15.167207 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:15.167466 12059 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:15.168359 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:15.141153 11733 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:15.142043 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:15.169953 10899 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:15.185688 10899 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:15.163298 11050 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.188681 11050 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.189867 11050 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.190672 11050 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.133555 10831 catalog_manager.cc:5697] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 2 to 3, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 3 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:15.140026 12040 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:15.156001 12051 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.147420 12063 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.192102 10831 catalog_manager.cc:5697] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:15.197551 10977 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:15.134516 12009 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.169505 11926 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:15.205838 10977 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.196825 10974 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:15.200587 11733 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:20:15.211942 12068 raft_consensus.cc:3055] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:15.212386 12068 raft_consensus.cc:740] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:15.213176 12068 consensus_queue.cc:260] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:15.214651 12068 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:15.217065 10931 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:15.219667 12069 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.202673 12054 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:15.220535 12054 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:15.220968 12054 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:15.196238 12044 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.196384 11951 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.196023 11952 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:15.225320 11952 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:15.225768 11952 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:15.194866 11810 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.195043 11950 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:15.231459 11950 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:15.232024 11950 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.231000 12004 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:15.232720 12004 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:15.173780 12049 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:15.196103 12019 raft_consensus.cc:3055] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:15.229027 10977 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.230062 11935 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:15.201799 11873 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.230449 10974 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:15.205595 11926 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:15.257529 11810 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:15.257980 11810 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:15.258299 11810 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:15.262632 11926 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:15.231070 12066 log.cc:927] Time spent T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.087s	user 0.004s	sys 0.000s
I20260709 12:20:15.195698 11994 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:15.196475 12040 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:15.203555 11050 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.235733 10977 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.200073 12067 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.239773 12035 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:15.247892 12065 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.250243 11875 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:15.228794 11818 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:15.281452 11818 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:15.281929 11818 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:15.234906 12019 raft_consensus.cc:740] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:15.233075 12004 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:15.219946 11933 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:15.291606 12019 consensus_queue.cc:260] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:15.292867 12019 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:15.273972 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 70499.8us
I20260709 12:20:15.271756 12040 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.278038 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:15.278592 11699 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.280238 11994 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:15.288980 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 53323us
I20260709 12:20:15.299840 10928 raft_consensus.cc:2368] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4.
I20260709 12:20:15.281368 11078 raft_consensus.cc:1240] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:15.295020 11050 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.295656 11084 raft_consensus.cc:1240] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 1. Current term is 2. Ops: []
W20260709 12:20:15.300637 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 102224us
I20260709 12:20:15.299896 10977 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.301455 10899 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:15.302520 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:15.304169 10899 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:15.305117 11085 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:15.305191 11050 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.306356 10977 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.306409 11050 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.293498 11926 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:15.247545 11949 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:20:15.269539 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 184347us
I20260709 12:20:15.309710 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:15.310002 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.308358 10899 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:15.330534 10899 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:15.332113 10977 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.311719 11050 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.314642 11699 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:15.309115 11933 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.333328 10977 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.334182 11050 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.302273 11994 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.310966 11875 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:15.313939 12049 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:15.337404 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:15.347185 10932 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:15.312191 11909 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:15.307920 12001 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.308302 12070 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.344776 11050 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.345603 12075 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:15.348043 11951 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:15.349660 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:15.370456 10928 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.363385 11051 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.338325 12063 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.338124 12067 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.336624 11941 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:15.369127 11050 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.338070 11870 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:15.353103 11875 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:15.353621 11953 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:15.352029 11909 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:15.404464 11941 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:15.409804 11909 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:15.405545 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 72294.9us
I20260709 12:20:15.352833 12049 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:15.411339 10977 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.373137 12065 consensus_queue.cc:1059] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:20:15.410167 11950 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:15.374255 11994 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.373440 12074 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.375917 11933 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.371338 11951 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:15.471169 10932 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:20:15.412503 12049 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.349195 11810 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:15.464622 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 53367.4us
I20260709 12:20:15.407092 11875 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.465775 10928 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:15.412371 11941 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.364665 12044 consensus_queue.cc:1059] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:20:15.366348 12054 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:15.475847 11950 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:15.470001 12073 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.368335 12057 consensus_queue.cc:1059] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:20:15.481449 11818 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:15.417027 12050 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:15.489494 11810 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:15.491003 11949 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:15.469565 11951 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.493247 12035 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:15.495649 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 126611us
I20260709 12:20:15.496423 10901 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:15.457301 12053 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:15.467336 12067 raft_consensus.cc:3055] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:15.503283 10977 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.480283 11909 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:15.516857 12057 raft_consensus.cc:3055] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:15.518921 12059 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:15.520867 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:20:15.531021 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 158293us
I20260709 12:20:15.522212 12040 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:15.502985 12054 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:15.525821 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:15.526239 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:15.537566 11004 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 4: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:15.514698 11050 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.539490 11050 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.506454 12004 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:15.548880 10977 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.527143 11953 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:20:15.552613 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 216498us
I20260709 12:20:15.553181 11051 leader_election.cc:400] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4.
I20260709 12:20:15.553731 11051 leader_election.cc:403] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:20:15.523583 12009 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:15.554752 11050 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.529754 12057 raft_consensus.cc:740] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:15.588165 11051 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.531533 12075 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:15.589418 12050 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:15.589847 12019 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:15.528842 12067 raft_consensus.cc:740] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:15.531322 11733 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:15.600718 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 46024.3us
W20260709 12:20:15.601715 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 47890.3us
I20260709 12:20:15.604226 11008 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:15.604846 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 229328us
I20260709 12:20:15.548732 11949 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:15.553859 11953 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.608727 10977 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.553287 11926 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:15.607180 11050 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.611665 11011 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:15.613687 11952 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:15.614157 11933 raft_consensus.cc:3055] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:15.622363 10977 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.647804 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:15.605631 12069 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.604647 12044 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.643505 11951 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:15.617154 12053 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:15.617210 11909 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:15.645403 11810 consensus_queue.cc:1059] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:20:15.654182 11951 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:15.618136 11050 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.655803 11050 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.656596 12053 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.657053 11050 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.657333 12053 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.658041 12053 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:15.645288 11994 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:15.664389 11050 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.642181 12009 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:15.640529 11733 raft_consensus.cc:2955] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:15.640434 12057 consensus_queue.cc:260] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:15.677008 12057 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:15.670825 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:15.672245 11050 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.677582 11951 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:15.684506 11083 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 4: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:15.663638 11818 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:15.686091 11952 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:15.592295 12054 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.689659 11050 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.690656 11050 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.664309 11994 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:15.642055 12040 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:15.655639 12059 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:15.692480 11050 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:15.649506 12076 consensus_queue.cc:1059] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:20:15.688194 11810 raft_consensus.cc:3055] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:15.693274 12044 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.697343 11810 raft_consensus.cc:740] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:15.691434 11941 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:15.698305 11810 consensus_queue.cc:260] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:15.699517 11810 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.699797 11941 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:15.694396 11994 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.665251 12004 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:15.687539 11659 raft_consensus.cc:1240] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:15.645592 12078 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.606520 12082 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.696803 11949 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.703954 12080 consensus_queue.cc:1059] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:15.691483 11951 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.688467 11933 raft_consensus.cc:740] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:15.705796 11949 raft_consensus.cc:3055] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:15.694865 12053 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:15.643325 12067 consensus_queue.cc:260] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:15.710120 12053 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:15.725107 12053 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.710191 11949 raft_consensus.cc:740] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:15.729574 11949 consensus_queue.cc:260] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:15.731005 11949 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:15.761610 11875 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:15.778513 11875 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:15.791580 11933 consensus_queue.cc:260] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:15.805159 11933 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:15.795807 11994 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:15.774637 12051 consensus_meta.cc:287] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.572s	user 0.002s	sys 0.015s
I20260709 12:20:15.807020 12051 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:15.783699 12049 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:15.802407 12053 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:15.810436 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.810958 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:15.811502 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:15.804081 12050 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4.
I20260709 12:20:15.792840 12067 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.811544 11081 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:15.842231 11081 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:15.844218 11994 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:15.846679 11953 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:15.849228 11953 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:15.863425 12051 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:15.851613 12049 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:15.864087 12053 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:20:15.882856 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 276514us
I20260709 12:20:15.885641 10899 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:15.886430 11875 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:15.888479 10899 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:15.889302 12051 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:15.890621 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:15.891208 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:15.896261 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:15.897004 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:15.897045 11077 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 2: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:15.898090 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:15.898931 11078 raft_consensus.cc:2393] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 2: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:15.900753 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:15.901378 11078 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:15.903439 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:15.904206 11078 raft_consensus.cc:2393] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 2: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:15.905984 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:15.908259 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:15.910482 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:15.912513 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:15.913254 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:15.915156 10833 catalog_manager.cc:5697] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:15.913203 11077 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 3: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:15.920691 11082 raft_consensus.cc:1240] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 12:20:15.926241 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:15.927042 11080 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 4: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:15.928514 11077 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:15.948340 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 345423us
I20260709 12:20:16.276742 10899 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:16.277894 10899 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:16.279460 10899 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:16.280512 10899 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:16.281528 10899 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:16.282945 10899 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:16.283972 10899 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:16.284971 10899 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:16.284968 12084 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:16.287102 12084 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:16.285580 12051 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:16.287354 12085 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:16.288054 12051 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.288497 10899 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:16.288839 12084 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:16.289666 10899 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:16.291579 10899 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:16.289661 12084 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:16.293033 12084 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:16.296411 12084 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:16.298900 12077 consensus_queue.cc:1059] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:16.300293 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:16.302562 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:16.301468 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:16.303309 10935 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 4: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:16.304894 10935 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:16.305509 12077 consensus_queue.cc:1059] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:16.306401 12077 raft_consensus.cc:3055] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:16.306638 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:16.306917 12077 raft_consensus.cc:740] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:20:16.308422 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.309711 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:16.307915 12077 consensus_queue.cc:260] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:16.311743 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:16.312018 12077 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.316082 11958 raft_consensus.cc:3055] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:16.316524 11958 raft_consensus.cc:740] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:16.317414 12084 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:16.304839 11733 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:16.318406 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:16.317341 11958 consensus_queue.cc:260] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.320277 11958 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:16.322875 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:16.301679 12051 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:16.323920 11733 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.324478 11733 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.288089 12085 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.327250 11733 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:16.335824 12085 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:16.376787 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:16.377986 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.386699 11659 raft_consensus.cc:2955] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:20:16.388587 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 766235us
I20260709 12:20:16.389396 10977 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:16.407408 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:16.408337 11084 raft_consensus.cc:2393] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 2: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:16.420593 12094 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:16.423288 12094 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:16.426781 10977 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:16.427726 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:16.430385 12094 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:16.440599 12053 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:16.441224 12053 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.442839 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:16.443384 12053 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:16.444077 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:16.444619 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:16.444878 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:16.445276 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:16.445545 11081 raft_consensus.cc:2393] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 2: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:16.445914 11076 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.446538 11081 raft_consensus.cc:1240] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:16.446673 11082 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:16.447670 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:16.448773 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:16.452950 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:20:16.455895 11078 consensus_meta.cc:287] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.001s
I20260709 12:20:16.456266 11078 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:16.454263 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:16.461591 11810 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:16.462802 11818 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:16.464715 11076 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:16.465814 10831 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35614 (request call id 136) took 2099 ms. Trace:
I20260709 12:20:16.466974 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:16.467693 11085 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:16.444446 11079 raft_consensus.cc:1240] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:16.471524 11078 raft_consensus.cc:1240] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:16.479104 11080 raft_consensus.cc:1240] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:16.479557 12076 raft_consensus.cc:3055] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:16.488109 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:16.489250 11084 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:16.466173 10831 rpcz_store.cc:276] 0709 12:20:14.384868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.391102 (+  6234us) service_pool.cc:224] Handling call
0709 12:20:16.465754 (+2074652us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:15.286274 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:15.286833 (+   559us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:15.286867 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:20:15.286883 (+    16us) tablet.cc:662] Decoding operations
0709 12:20:15.287358 (+   475us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:15.287430 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:15.287455 (+    25us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:20:15.287720 (+   265us) tablet.cc:701] Row locks acquired
0709 12:20:15.287737 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:20:15.287877 (+   140us) write_op.cc:270] Start()
0709 12:20:15.287990 (+   113us) write_op.cc:276] Timestamp: P: 1783599615287818 usec, L: 0
0709 12:20:15.288012 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:20:15.288726 (+   714us) log.cc:844] Serialized 979 byte log entry
0709 12:20:15.316613 (+ 27887us) op_driver.cc:464] REPLICATION: finished
0709 12:20:15.330537 (+ 13924us) write_op.cc:301] APPLY: starting
0709 12:20:15.330637 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:15.330773 (+   136us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:15.367753 (+ 36980us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:15.468842 (+101089us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:15.491352 (+ 22510us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:20:15.491410 (+    58us) write_op.cc:312] APPLY: finished
0709 12:20:15.491623 (+   213us) log.cc:844] Serialized 28 byte log entry
0709 12:20:15.491824 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:15.491932 (+   108us) write_op.cc:454] Released schema lock
0709 12:20:15.491971 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:15.492316 (+   345us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:15.492353 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8806,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":316,"apply.run_cpu_time_us":2729,"apply.run_wall_time_us":161799,"num_ops":2,"prepare.queue_time_us":83479,"prepare.run_cpu_time_us":2802,"prepare.run_wall_time_us":17647,"replication_time_us":19201,"thread_start_us":98350,"threads_started":1}]]}
I20260709 12:20:16.492019 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.494822 10899 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:16.493917 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:20:16.498099 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.500830 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.501647 11007 raft_consensus.cc:2393] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 3: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:16.501777 10833 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 20) took 1532 ms. Trace:
I20260709 12:20:16.495290 12040 consensus_queue.cc:1059] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:20:16.503981 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.504666 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.502622 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:20:16.505909 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 79215.2us
I20260709 12:20:16.488926 11699 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:16.488031 12076 raft_consensus.cc:740] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:16.502127 10833 rpcz_store.cc:276] 0709 12:20:14.969796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.969950 (+   154us) service_pool.cc:224] Handling call
0709 12:20:15.118527 (+148577us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5400096d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0eca090 00007f9bb0f68f3a 00007f9bb6d1ee9c 00007f9bb6e1d04e 00007f9bb52de2a4 00007f9bb52de232 00007f9bb52de161 00007f9bb52de0dc 00007f9bb52dd392 00007f9baf29b48c 00007f9baf29a8c6
0709 12:20:16.501711 (+1383184us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:15.926724 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:15.927250 (+   526us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:15.927285 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:20:15.927301 (+    16us) tablet.cc:662] Decoding operations
0709 12:20:15.927612 (+   311us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:15.930215 (+  2603us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:15.930267 (+    52us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:15.930584 (+   317us) tablet.cc:701] Row locks acquired
0709 12:20:15.930607 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:20:15.930759 (+   152us) write_op.cc:270] Start()
0709 12:20:15.930869 (+   110us) write_op.cc:276] Timestamp: P: 1783599615930715 usec, L: 0
0709 12:20:15.930889 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:20:15.931566 (+   677us) log.cc:844] Serialized 594 byte log entry
0709 12:20:15.933447 (+  1881us) op_driver.cc:464] REPLICATION: finished
0709 12:20:15.933899 (+   452us) write_op.cc:301] APPLY: starting
0709 12:20:15.933983 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:15.934085 (+   102us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:15.934169 (+    84us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:15.934394 (+   225us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:15.934557 (+   163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:20:15.934598 (+    41us) write_op.cc:312] APPLY: finished
0709 12:20:15.934783 (+   185us) log.cc:844] Serialized 22 byte log entry
0709 12:20:15.934956 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:15.935037 (+    81us) write_op.cc:454] Released schema lock
0709 12:20:15.935073 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:15.935446 (+   373us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:15.935474 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":561293,"reported_tablets":2,"spinlock_wait_cycles":282470144,"child_traces":[["op",{"apply.queue_time_us":237,"apply.run_cpu_time_us":1487,"apply.run_wall_time_us":1485,"num_ops":1,"prepare.queue_time_us":8678,"prepare.run_cpu_time_us":2500,"prepare.run_wall_time_us":5123,"replication_time_us":2417,"thread_start_us":12111,"threads_started":1}]]}
I20260709 12:20:16.508643 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.520107 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.520262 12076 consensus_queue.cc:260] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.509438 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.511494 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:16.521526 11003 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:16.493279 11002 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:16.512288 12053 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:16.521790 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.522224 12053 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.522753 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.512791 11938 consensus_queue.cc:1059] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:20:16.523129 12065 consensus_queue.cc:1059] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:16.512795 11699 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:16.524103 12065 raft_consensus.cc:3055] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:16.524462 12065 raft_consensus.cc:740] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:16.525215 12065 consensus_queue.cc:260] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.521423 12076 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:16.526456 11699 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:16.526782 12065 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.515041 11958 raft_consensus.cc:3055] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:16.514093 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:16.527273 11008 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:16.521070 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.508540 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.529161 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.529340 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.530453 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.531004 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.510453 12078 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:16.502589 12083 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.517869 10901 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:16.504088 11871 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:16.527930 12092 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.532891 12040 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:16.533093 10901 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:16.532604 12092 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.534255 12053 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:16.534552 12040 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:16.523797 11938 raft_consensus.cc:3055] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:16.532553 11871 raft_consensus.cc:697] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:16.509285 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.536396 11871 consensus_queue.cc:237] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.538007 12092 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:16.538920 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.535360 11938 raft_consensus.cc:740] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:16.543898 11938 consensus_queue.cc:260] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.544414 10833 catalog_manager.cc:5697] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:16.532061 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:16.499930 12081 consensus_queue.cc:1059] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:20:16.530480 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.545766 11003 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:20:16.546145 12081 raft_consensus.cc:3055] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:16.546533 12081 raft_consensus.cc:740] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:16.546692 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.547322 12081 consensus_queue.cc:260] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.547901 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.548570 12081 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.519470 11011 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:20:16.549219 11010 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:16.535140 12083 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.564131 12083 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:16.564667 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 45050.1us
I20260709 12:20:16.511708 10899 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:16.541198 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.570068 11008 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:16.541759 11002 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:16.534935 11958 raft_consensus.cc:740] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:16.531833 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.576713 11958 consensus_queue.cc:260] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:16.520725 11007 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:16.534222 10901 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:16.556208 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:16.556468 11051 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:16.557029 11818 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:16.558892 11011 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:16.548730 11009 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 4: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:16.559478 12078 raft_consensus.cc:697] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:16.561321 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:16.545204 11938 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.582319 12078 consensus_queue.cc:237] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.584124 10832 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35608 (request call id 137) took 1922 ms. Trace:
I20260709 12:20:16.584492 10832 rpcz_store.cc:276] 0709 12:20:14.661493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.666255 (+  4762us) service_pool.cc:224] Handling call
0709 12:20:14.777301 (+111046us) spinlock_profiling.cc:243] Waited 72.9 ms on lock 0x7b5400096d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0eca090 00007f9bb0f68f3a 00007f9bb6d1ee9c 00007f9bb6e1d04e 00007f9bb52de2a4 00007f9bb52de232 00007f9bb52de161 00007f9bb52de0dc 00007f9bb52dd392 00007f9baf29b48c 00007f9baf29a8c6
0709 12:20:16.584067 (+1806766us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24700,"reported_tablets":14,"spinlock_wait_cycles":167675264}
I20260709 12:20:16.578735 11958 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.589944 10974 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:20:16.590683 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 79049.8us
I20260709 12:20:16.591847 12070 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:16.592394 12070 raft_consensus.cc:697] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:20:16.593092 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 58952.2us
I20260709 12:20:16.593886 10901 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:16.593683 12070 consensus_queue.cc:237] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.594637 11799 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:16.595232 11799 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:16.595781 11799 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:16.596228 11799 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.597077 11007 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:16.580806 11051 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:16.597715 11004 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:20:16.598110 11799 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:16.598462 11051 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:16.599200 10901 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:16.599416 12050 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:16.581359 12053 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:16.600440 12040 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:16.610854 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:16.612041 12053 raft_consensus.cc:697] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:16.612603 12065 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:16.613023 12053 consensus_queue.cc:237] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.614434 10974 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:16.613523 12065 raft_consensus.cc:697] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:16.615964 12065 consensus_queue.cc:237] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.616871 12074 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:16.619012 12050 raft_consensus.cc:697] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:16.582496 11084 raft_consensus.cc:2393] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 2: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:16.625483 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:16.626482 11084 raft_consensus.cc:2393] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 2: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:16.631575 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:16.632296 11078 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:16.629484 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:16.633029 11084 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:16.591899 10899 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:16.636698 11084 raft_consensus.cc:1240] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:16.620666 11624 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:16.638903 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:16.639842 10901 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:16.640413 11050 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:16.643936 12081 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:16.661171 12050 consensus_queue.cc:237] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.668857 11002 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
W20260709 12:20:16.672081 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 51514.6us
I20260709 12:20:16.674528 12069 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:16.632676 12098 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:16.679750 10901 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:16.678499 12085 consensus_queue.cc:1059] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:20:16.685271 12099 consensus_queue.cc:1059] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:16.679286 12081 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:16.693477 12081 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:16.679526 10974 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:16.692265 11003 raft_consensus.cc:1240] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:16.695569 10974 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:20:16.696637 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 76373.9us
I20260709 12:20:16.698194 10974 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:16.676146 12040 consensus_queue.cc:1059] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
W20260709 12:20:16.701208 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 60850.3us
I20260709 12:20:16.688831 12070 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:16.704365 11050 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:16.700573 12103 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:16.700083 12076 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.697676 11938 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:16.701062 11818 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:16.715354 11818 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:16.705065 11810 consensus_queue.cc:1059] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
W20260709 12:20:16.712844 10821 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0774d95f5c1b4bdb990e50f5d858b600 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9e8170bbe8244e40a2b2e5011e69b697 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:16.717790 11810 raft_consensus.cc:3055] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:16.718158 11810 raft_consensus.cc:740] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:16.723793 11810 consensus_queue.cc:260] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.705013 12035 consensus_queue.cc:1059] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:20:16.714566 12059 raft_consensus.cc:3055] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:16.725025 12053 raft_consensus.cc:3055] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:16.718344 11818 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:16.725452 12035 raft_consensus.cc:3055] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:16.725564 12053 raft_consensus.cc:740] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:16.725104 12059 raft_consensus.cc:740] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:16.725921 12035 raft_consensus.cc:740] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:16.726606 12059 consensus_queue.cc:260] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.701802 12078 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:16.728226 12078 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:16.728734 12078 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:16.728013 12059 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:16.730136 10901 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:16.734269 11799 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:16.728003 11810 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.726732 12035 consensus_queue.cc:260] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.738005 12035 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.738045 12053 consensus_queue.cc:260] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.724263 11958 raft_consensus.cc:3055] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:16.736413 11050 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:16.736940 12098 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:16.744424 12103 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:16.742516 11958 raft_consensus.cc:740] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:16.759078 12103 raft_consensus.cc:697] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:16.760121 12103 consensus_queue.cc:237] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.760948 12076 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:16.761963 11050 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:16.762945 12098 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:16.762758 11958 consensus_queue.cc:260] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.763957 11958 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.764338 11050 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:16.765127 12098 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:16.766371 11050 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:16.767130 12098 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:16.767650 12098 raft_consensus.cc:697] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:16.768720 12081 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.768791 12098 consensus_queue.cc:237] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.769670 11050 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:16.770429 12105 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:16.770809 12105 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:16.771122 12081 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:16.771137 12105 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.777053 11050 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:16.777875 12100 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:20:16.780143 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 74628us
W20260709 12:20:16.782557 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:16.783198 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.741456 12053 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:16.784816 11050 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:16.785383 10899 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:16.789054 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:16.788771 12100 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:16.790094 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:16.790506 12100 raft_consensus.cc:697] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:16.790686 11084 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:16.791464 12100 consensus_queue.cc:237] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.789213 11799 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:20:16.797263 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.798871 11799 raft_consensus.cc:697] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:16.799918 11799 consensus_queue.cc:237] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.803892 11084 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:16.807206 12105 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.808411 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:16.809149 11003 raft_consensus.cc:2393] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 4: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:16.808970 11926 consensus_queue.cc:1059] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:16.809500 12105 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:16.810035 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.810606 11002 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:16.811220 11926 raft_consensus.cc:3055] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:16.812978 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:16.783744 11818 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.811583 11926 raft_consensus.cc:740] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:16.821029 10830 catalog_manager.cc:5697] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 3 to 4, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 4 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:16.824072 10830 catalog_manager.cc:5697] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 1 to 2, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 2 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:16.830039 11926 consensus_queue.cc:260] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.836181 10935 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:16.836349 10932 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:16.836575 10928 raft_consensus.cc:1240] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:16.840914 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:16.841133 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:16.841941 10928 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 4: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:16.842521 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:16.842743 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:16.846608 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:16.850366 12078 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:16.962968 11926 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:16.965394 10932 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:16.970064 11818 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:16.973076 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:16.976265 11002 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:16.980917 12078 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:16.982731 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:16.983817 11084 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:16.989573 10927 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:16.994591 11084 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:17.002008 10928 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:16.998077 10974 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:17.008312 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:17.009122 10935 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:17.006699 12078 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:17.015460 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:17.019768 10935 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
W20260709 12:20:17.012049 12112 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:20:17.022397 10935 raft_consensus.cc:1240] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:17.022943 10927 raft_consensus.cc:1240] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:17.025888 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:17.026607 10932 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:17.025784 10931 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:17.028025 10929 raft_consensus.cc:1240] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:17.028221 10933 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:17.028578 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:17.037464 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:17.031032 10930 raft_consensus.cc:1240] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:17.037719 10901 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:17.038081 10929 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:17.037176 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:17.039150 10932 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:17.030256 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:17.045496 10932 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:17.033526 12078 raft_consensus.cc:697] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:17.048013 11810 consensus_queue.cc:1059] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:20:17.049139 11810 raft_consensus.cc:3055] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:17.049950 10977 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:17.049513 11810 raft_consensus.cc:740] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:17.052724 11810 consensus_queue.cc:260] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.054800 12076 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:17.048511 12078 consensus_queue.cc:237] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.054126 11810 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:17.061177 11051 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:17.063367 11051 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:17.069005 10929 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:17.064364 12105 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:17.045356 11941 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:17.073050 10977 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:17.093916 12076 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:17.097862 11002 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:20:17.099663 12111 log.cc:927] Time spent T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.138s	user 0.006s	sys 0.007s
W20260709 12:20:17.099794 11032 debug-util.cc:398] Leaking SignalData structure 0x7b0800166760 after lost signal to thread 9744
W20260709 12:20:17.100392 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.068745 12103 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:17.092445 11941 raft_consensus.cc:697] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:17.105301 12059 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:17.104341 11010 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:17.108304 11941 consensus_queue.cc:237] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:17.101259 11032 debug-util.cc:398] Leaking SignalData structure 0x7b0800166e40 after lost signal to thread 10868
I20260709 12:20:17.123328 12098 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:20:17.125782 11032 debug-util.cc:398] Leaking SignalData structure 0x7b080034dc20 after lost signal to thread 10960
W20260709 12:20:17.126983 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8fa0 after lost signal to thread 11035
W20260709 12:20:17.128178 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9600 after lost signal to thread 11109
W20260709 12:20:17.129415 11032 debug-util.cc:398] Leaking SignalData structure 0x7b080031ca20 after lost signal to thread 11683
I20260709 12:20:17.129314 11007 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:17.134287 12098 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:17.119503 10832 catalog_manager.cc:5697] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 3 to 4, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 4 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:17.155551 10977 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:17.156508 11810 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:17.161360 11084 raft_consensus.cc:1240] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:17.162743 11818 consensus_queue.cc:1059] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:20:17.166694 11818 raft_consensus.cc:3055] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:17.167241 11818 raft_consensus.cc:740] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:17.171018 11007 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:17.172273 11818 consensus_queue.cc:260] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.172624 11941 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:17.175097 11818 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.184934 12098 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:17.185657 12098 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.189046 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:17.189795 11003 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:17.191180 11050 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:17.192023 12098 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:17.192458 12105 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:17.192884 12105 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:17.193252 12105 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.206277 11079 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:17.206221 11810 raft_consensus.cc:697] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:17.207746 10832 catalog_manager.cc:5697] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 1 to 2, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:17.203563 11084 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:17.209697 12076 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:17.212463 12076 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:17.218307 10899 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:17.220290 11941 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:17.222182 12076 consensus_queue.cc:1059] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:17.223304 12090 raft_consensus.cc:3055] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:17.223716 12090 raft_consensus.cc:740] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:17.224730 12090 consensus_queue.cc:260] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.235798 10932 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:17.237138 11926 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.237740 11926 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.234743 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:17.208101 11810 consensus_queue.cc:237] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.239471 12090 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:17.240475 10930 raft_consensus.cc:2393] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 2: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:17.241103 11926 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:17.211382 12105 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.247820 12105 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:17.248589 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:17.254431 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:17.260165 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:17.260955 10930 raft_consensus.cc:2393] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 2: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:17.263253 11007 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:17.264636 11050 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:17.270958 10930 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:17.271668 10932 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:17.291646 10977 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:17.297611 11076 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:17.302011 11078 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:17.302981 11080 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:17.306856 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:17.308302 11818 consensus_queue.cc:1059] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:20:17.312724 11818 raft_consensus.cc:3055] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:17.313112 11818 raft_consensus.cc:740] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:17.313932 11818 consensus_queue.cc:260] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.315232 11818 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.270437 12076 consensus_queue.cc:1059] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:20:17.316344 11953 consensus_queue.cc:1059] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:17.318063 12009 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:17.318593 12009 raft_consensus.cc:697] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:17.319407 12009 consensus_queue.cc:237] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.322033 11870 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:17.316808 12076 raft_consensus.cc:3055] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:17.324887 12076 raft_consensus.cc:740] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:17.300441 12085 consensus_queue.cc:1059] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:20:17.325753 12076 consensus_queue.cc:260] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.327080 12076 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.328205 12084 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:17.329764 12084 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:17.331270 12085 raft_consensus.cc:3055] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:17.256803 11909 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:17.332185 11909 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.308485 12078 consensus_queue.cc:1059] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:20:17.342525 10929 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:17.300573 12103 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:17.344339 12103 raft_consensus.cc:697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:17.345307 12103 consensus_queue.cc:237] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.346135 11909 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:17.346694 11810 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:17.336313 10932 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:17.331698 12085 raft_consensus.cc:740] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:17.333571 10899 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:17.362478 11941 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:17.272689 10833 catalog_manager.cc:5697] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 1 to 2, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 2 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:17.368961 10833 catalog_manager.cc:5697] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 3 to 4, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 4 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
W20260709 12:20:17.369865 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 77007.5us
I20260709 12:20:17.372382 11002 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:17.370885 10833 catalog_manager.cc:5697] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 3 to 4, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 4 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:17.308576 12050 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:20:17.375115 12053 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:17.385246 11875 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:17.388051 12085 consensus_queue.cc:260] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.390439 10930 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:17.390550 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:17.393613 12085 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.356648 12065 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:20:17.391206 11084 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:17.376772 11810 raft_consensus.cc:3055] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:17.368410 12098 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:20:17.368196 12100 consensus_queue.cc:1059] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:20:17.421118 11007 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:17.394814 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:17.434844 11005 raft_consensus.cc:2393] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 4: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:17.404040 11810 raft_consensus.cc:740] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:17.458021 12090 raft_consensus.cc:3055] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:17.458485 12090 raft_consensus.cc:740] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:17.460886 11950 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:17.469715 10832 catalog_manager.cc:5697] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:17.471328 10832 catalog_manager.cc:5697] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:17.442734 12100 raft_consensus.cc:3055] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:17.476550 12100 raft_consensus.cc:740] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:17.482172 10830 catalog_manager.cc:5697] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 3 to 4, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 4 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:17.426258 12098 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:20:17.459347 12090 consensus_queue.cc:260] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.492647 10830 catalog_manager.cc:5697] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 3 to 4, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 4 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:17.496608 10899 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:17.505844 10830 catalog_manager.cc:5697] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:17.548316 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 51797us
I20260709 12:20:17.491233 11810 consensus_queue.cc:260] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.505887 11871 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.597635 11810 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.491262 12100 consensus_queue.cc:260] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.556066 12081 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:20:17.630020 12119 log.cc:927] Time spent T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:20:17.630239 12081 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:20:17.647239 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 151793us
I20260709 12:20:17.623142 11871 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.652665 11082 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:17.647760 12081 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:17.661836 12142 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.685940 12142 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.687345 11871 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:17.653741 12132 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.734915 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:17.731715 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:17.758265 10931 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:17.764775 10927 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:17.744411 12142 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:17.792553 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 71536.5us
I20260709 12:20:17.794863 10927 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:17.808147 10977 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:20:17.808498 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 66879.8us
I20260709 12:20:17.733029 12132 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:20:17.816015 12139 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:20:17.813316 12142 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.812045 12128 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
W20260709 12:20:17.828388 12149 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 12:20:17.829128 12133 log.cc:927] Time spent T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:20:17.830145 12145 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:20:17.831494 12148 log.cc:927] Time spent T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:20:17.838371 12132 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:17.839116 12150 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:17.841476 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:20:17.856156 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 73326us
I20260709 12:20:17.853344 12145 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:17.851773 12140 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.859259 11659 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:17.859894 12145 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:17.865069 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 55902.2us
I20260709 12:20:17.866914 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:17.867774 10933 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:17.852701 12142 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.876535 12142 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:17.877882 10821 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0774d95f5c1b4bdb990e50f5d858b600 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9e8170bbe8244e40a2b2e5011e69b697 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:17.865877 12140 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.890076 12090 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.896245 12145 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.898217 12130 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.898767 12130 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.900832 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:17.901546 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:17.902123 11078 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.904115 11002 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:17.905503 12130 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:17.906610 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:17.907253 11010 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:17.908581 12140 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:17.901497 11084 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:17.912194 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:17.912849 11004 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:17.914831 11005 raft_consensus.cc:1275] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:17.920300 11078 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:17.922206 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:17.922812 11077 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:17.923741 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:17.925381 11050 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:20:17.942317 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 126538us
I20260709 12:20:17.943567 11003 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 4: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:17.949451 10974 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:17.955972 12130 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:17.906523 12081 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.961867 10901 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:17.942718 12040 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:17.927256 12053 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:20:17.961989 12165 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.962095 12076 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:17.968039 12076 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:17.966099 11938 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:17.968464 12076 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:17.968739 11938 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:17.968899 12100 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:17.966226 12081 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:17.966464 12084 consensus_queue.cc:1048] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:17.943814 12166 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:17.970682 12040 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:17.970135 12165 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:17.969126 12171 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:17.984438 12170 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:17.985999 12040 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:17.986359 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:17.977520 12166 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:17.991043 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:18.021363 11011 raft_consensus.cc:2393] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 4: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:17.991595 10936 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:17.993197 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:18.023321 10930 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:17.995005 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:17.969143 11938 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:18.056449 12142 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:20:18.024163 10929 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:18.061353 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:18.062008 11080 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:18.046550 10977 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:18.065950 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:18.066717 11011 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 2.
I20260709 12:20:18.018535 12084 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.053318 12145 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:18.055004 12098 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:18.072569 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:18.022921 12166 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:18.050294 12165 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:18.068899 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:18.086153 10929 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:18.056192 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:18.079461 10932 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:18.080730 11081 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:18.083036 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:18.087365 10936 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 2.
I20260709 12:20:18.072430 12150 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:18.078389 12053 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.095467 11085 raft_consensus.cc:1275] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:18.086035 12085 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.074666 12084 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.096788 12076 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:18.132819 12135 log.cc:927] Time spent T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.273s	user 0.003s	sys 0.003s
I20260709 12:20:18.133340 12084 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:18.084184 12065 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:18.075589 12098 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.018332 12171 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:18.116498 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:18.077857 11953 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:18.128372 11008 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:18.138051 12085 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.138940 11005 raft_consensus.cc:2368] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5.
I20260709 12:20:18.140784 12076 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:18.149628 12140 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:18.150625 12098 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:18.139405 12065 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.118278 12150 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.155716 12150 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:18.130512 12130 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:18.169234 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:20:18.174957 12173 log.cc:927] Time spent T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:20:18.183342 12085 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:18.185053 10929 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:18.186031 12130 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.187319 11938 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.146449 11953 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.193938 11080 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:18.142168 12053 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.203279 11079 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:18.199920 12130 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:18.210851 12150 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.216883 12150 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:18.207707 11938 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:18.219291 12130 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.219820 12130 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.224840 11953 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:18.209021 12065 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:18.228695 12053 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:18.228446 12166 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:18.232504 12171 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:18.234886 11083 raft_consensus.cc:2393] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 3: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:18.233779 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:18.234748 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:18.236629 11082 raft_consensus.cc:2393] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 2: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:18.236829 11081 raft_consensus.cc:2393] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 2: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:18.238740 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:18.239373 11079 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:18.241460 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:18.241878 10936 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:18.242848 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:18.243409 10936 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:20:18.243664 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:18.244251 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:18.244370 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:18.244916 10936 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:18.245362 11007 raft_consensus.cc:2368] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 4. Current term is 5.
I20260709 12:20:18.244984 11003 raft_consensus.cc:2393] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 2: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:18.244395 10927 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:18.255579 11624 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:18.256060 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:18.256770 11011 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:20:18.259275 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:18.259967 11659 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:18.256852 10933 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 4: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:18.263278 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:18.264078 11080 raft_consensus.cc:2393] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 2: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:18.263962 10936 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:18.267239 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:18.234105 12059 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.267935 11080 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:20:18.272281 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:18.268874 10974 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:18.274863 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:18.276139 11009 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:18.279933 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:18.285876 11079 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:18.271792 11799 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.294528 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:18.295739 10974 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:18.297079 11085 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 2: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:18.298194 11080 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:18.300056 11084 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:20:18.299988 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:18.300473 11084 pending_rounds.cc:85] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 1
I20260709 12:20:18.300717 11084 pending_rounds.cc:107] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:20:18.300673 11005 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:18.301095 11084 raft_consensus.cc:2889] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:18.301535 10974 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:18.294382 11799 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.305702 11799 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:18.305740 12145 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:18.306847 12145 raft_consensus.cc:697] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:18.276012 12171 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:18.226683 12130 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:18.312590 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 57806us
I20260709 12:20:18.314122 11050 leader_election.cc:400] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 4. Current term is 5.
I20260709 12:20:18.314467 11050 leader_election.cc:403] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:18.308130 10833 catalog_manager.cc:5697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 1 to 2, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 2 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:18.318181 11050 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:18.319185 10901 leader_election.cc:400] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5.
I20260709 12:20:18.319571 10901 leader_election.cc:403] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:20:18.325150 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:18.325825 11008 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:18.307178 11659 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
W20260709 12:20:18.327410 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 54500.2us
I20260709 12:20:18.264400 12166 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:18.296684 12090 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:18.295569 11938 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.299851 12079 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:18.336313 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 250275us
I20260709 12:20:18.287910 12059 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.333405 10901 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:18.341873 10901 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:18.342638 12070 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:18.327526 11870 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:18.343048 12070 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.343510 12070 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:18.344043 12145 consensus_queue.cc:237] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.345993 12059 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:18.349129 11625 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:18.350055 12165 raft_consensus.cc:2764] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:20:18.351308 11008 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:18.345786 11799 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:18.351925 11799 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.352270 11799 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:18.329324 12170 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:18.355811 11050 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:18.399755 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:18.399912 11051 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:18.409891 11008 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:18.402201 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:20:18.391039 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 49817.7us
I20260709 12:20:18.410988 11007 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:18.334299 12100 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 4. Current term is 5.
I20260709 12:20:18.356168 12166 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:18.346525 12090 raft_consensus.cc:697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:18.421720 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:18.422269 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:18.335492 12053 consensus_queue.cc:1059] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 12:20:18.422876 11084 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:18.337291 11953 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 12:20:18.354689 12070 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:18.425664 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 67273.9us
I20260709 12:20:18.434875 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:18.426507 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 70780us
I20260709 12:20:18.357784 12050 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:18.427495 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:18.422392 11080 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:18.436170 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:18.434023 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:18.437450 10930 raft_consensus.cc:2393] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 2: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:18.346707 11938 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.433763 11005 consensus_queue.cc:237] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:18.420893 12166 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.431294 12169 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:18.355537 12079 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.430369 12100 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:18.437286 12059 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.475905 11938 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:18.476811 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:18.477397 12079 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:18.480010 12070 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:18.480834 12059 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.482944 12059 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:18.477530 10931 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:18.451490 12166 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:18.444720 12170 raft_consensus.cc:697] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:18.444892 12050 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.460014 12167 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:20:18.496310 12100 raft_consensus.cc:697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:20:18.540729 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 90191.2us
I20260709 12:20:18.491544 12090 consensus_queue.cc:237] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.526911 12103 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:18.536746 12142 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:18.517506 11799 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.537456 12169 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:18.555897 11659 raft_consensus.cc:1275] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:18.557849 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:18.559074 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:18.570323 10930 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:18.570967 11870 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5.
I20260709 12:20:18.571400 10934 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:18.573184 11953 consensus_queue.cc:1048] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:20:18.573849 12182 log.cc:927] Time spent T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:20:18.577392 12128 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:18.577922 12128 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.578951 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:18.579596 10936 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:18.581758 12050 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:18.545035 12129 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:18.584311 10901 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:20:18.573105 12177 log.cc:927] Time spent T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:20:18.587987 10901 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:18.589366 10935 raft_consensus.cc:2368] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:18.590126 12128 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:18.591180 10936 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:18.595974 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:18.596771 11008 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:18.601470 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:18.602109 11008 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:18.606001 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:18.606762 11010 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:18.629384 11008 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:18.586971 12078 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.630937 12129 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.591092 12070 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:18.561650 12103 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.568874 12142 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.641523 12174 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:18.667949 12190 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.668519 12190 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.670853 12190 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:18.656270 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:18.676596 11002 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:18.660614 12070 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.677798 12070 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:18.548121 12170 consensus_queue.cc:237] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.570042 12169 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.667361 12174 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.691579 10899 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:20:18.692870 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 130872us
I20260709 12:20:18.695247 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:18.695829 11005 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:18.698648 11050 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:18.699438 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:18.700170 11007 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:20:18.702471 11050 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:18.686174 12178 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.659688 12078 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:18.705596 11926 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:18.625648 12100 consensus_queue.cc:237] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:20:18.717787 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 83574.9us
I20260709 12:20:18.698961 12174 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:18.702196 12190 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.728528 12193 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:18.718010 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:18.710757 12115 consensus_queue.cc:1048] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:20:18.721175 11926 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:20:18.753139 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.771911 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:18.773047 11082 raft_consensus.cc:2393] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 2: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:18.737300 12193 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.777967 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:18.736676 12194 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:20:18.746963 12186 log.cc:927] Time spent T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:20:18.730154 12178 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.780468 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:18.783123 10936 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:18.780402 10901 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:18.767607 11926 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:18.748991 12103 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:18.749634 12142 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:18.747314 11799 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:18.748672 12169 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:18.742084 12190 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:20:18.811257 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 77409.3us
I20260709 12:20:18.741511 12166 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:18.817255 10901 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:18.767262 11002 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:18.820268 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:18.829488 11007 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:18.829756 10928 raft_consensus.cc:2393] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 2: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:18.821988 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:18.830637 11008 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:18.831722 11050 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:18.838027 10901 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:18.781139 12193 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:18.781584 12194 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:18.788266 12165 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:20:18.876997 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 45372.9us
I20260709 12:20:18.877862 11050 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:18.819311 12103 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:18.841596 12171 consensus_meta.cc:287] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.524s	user 0.004s	sys 0.006s
I20260709 12:20:18.827620 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:18.890305 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 153797us
I20260709 12:20:18.851301 12202 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:18.850502 12190 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:18.853560 11909 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:18.918967 10899 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:18.839610 12169 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.851223 12194 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:18.945813 10977 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:18.901153 12115 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:20:18.949543 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 111578us
I20260709 12:20:18.951077 12197 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:18.900981 12129 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:18.924767 12171 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:18.928941 12053 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:18.953306 12150 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:18.981181 10977 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:20:18.947765 12192 log.cc:927] Time spent T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 12:20:18.930459 11909 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.926057 12202 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.937747 11871 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.937865 12190 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:20:18.973268 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 95473.4us
I20260709 12:20:19.019608 11050 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:18.888806 12165 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:18.989907 10977 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:18.988026 11909 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:18.990574 12078 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:18.991214 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:18.983537 12150 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:20:18.993880 12203 log.cc:927] Time spent T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:20:18.994234 12050 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.994658 12076 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.990373 12090 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.996858 11926 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.004925 12065 raft_consensus.cc:2955] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:19.007478 12162 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:18.965711 12140 raft_consensus.cc:3055] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:19.022245 12100 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:19.028467 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:18.930383 12103 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.032990 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:19.034122 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:19.034806 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:19.035009 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:19.107329 11082 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:18.982324 12053 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:19.029462 11871 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.029605 12190 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.008474 12176 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:19.071904 12191 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:19.018548 12202 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:19.063398 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 101020us
I20260709 12:20:19.017768 12129 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:19.063419 12150 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:18.971047 12197 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.036077 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:19.107913 11083 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:19.128880 11077 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:19.037019 12209 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:18.955952 12169 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:19.057932 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 68109.8us
I20260709 12:20:19.110873 12090 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:19.122081 12178 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:19.123356 12200 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.101562 12213 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:19.119194 10901 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:19.110725 12100 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.124403 11926 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:19.156392 11926 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.111362 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:19.118181 12191 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.124747 11950 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.073593 11659 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:20:19.126367 12190 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:19.104689 12140 raft_consensus.cc:740] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:19.101428 12162 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:19.127398 12218 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.111362 12053 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:19.072158 12050 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.074779 12076 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.147320 10977 leader_election.cc:400] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:19.153574 12200 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.160835 11077 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
W20260709 12:20:19.164147 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 45041.6us
W20260709 12:20:19.178035 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 64120.1us
I20260709 12:20:19.145790 12115 raft_consensus.cc:697] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:19.148200 12166 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:19.133215 12209 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:19.176734 10977 leader_election.cc:403] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:19.149394 12213 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:19.190093 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:20:19.192111 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 44943.9us
I20260709 12:20:19.132866 12129 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.164362 12191 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:19.187804 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:19.196261 10899 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:19.196676 10936 raft_consensus.cc:1275] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:19.131616 12193 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.169159 12162 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.198187 11011 raft_consensus.cc:2393] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 4: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:19.167750 11952 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:19.194461 11009 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:19.202123 11079 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:19.210422 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:19.169447 11658 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:19.165237 11950 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.215437 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:19.219435 10929 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:19.215173 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:19.220561 10936 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:19.201310 12145 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:19.163185 11926 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:19.199361 12213 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.190171 12209 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.226748 11084 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 3: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:19.205973 11952 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.184139 11909 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.236145 12090 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:19.218878 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:19.247610 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:19.176661 12218 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:19.257647 11082 raft_consensus.cc:2368] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5.
I20260709 12:20:19.234265 11952 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:19.296723 12193 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:19.297715 12197 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:19.271610 12178 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.300222 12178 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:20:19.285640 12211 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:20:19.224783 12140 consensus_queue.cc:260] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.284453 11799 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:19.289117 12078 consensus_queue.cc:1048] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:20:19.291095 12103 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:19.327688 11950 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:19.322351 12140 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:19.329850 12145 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:19.320624 12169 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:19.333176 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:19.248896 12115 consensus_queue.cc:237] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.358476 12129 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:19.343562 12100 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:19.348076 12165 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:19.347507 12050 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:19.355667 12076 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:19.358959 11799 raft_consensus.cc:697] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:20:19.368939 12174 consensus_meta.cc:287] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.630s	user 0.008s	sys 0.003s
I20260709 12:20:19.402637 12174 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.384724 11799 consensus_queue.cc:237] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.404678 10833 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35620 (request call id 132) took 1249 ms. Trace:
W20260709 12:20:19.394001 12070 consensus_meta.cc:287] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.716s	user 0.012s	sys 0.000s
I20260709 12:20:19.416720 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:19.409713 10833 rpcz_store.cc:276] 0709 12:20:18.154892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.155074 (+   182us) service_pool.cc:224] Handling call
0709 12:20:19.404609 (+1249535us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:18.520905 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:18.521433 (+   528us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:18.521468 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:20:18.521488 (+    20us) tablet.cc:662] Decoding operations
0709 12:20:18.521838 (+   350us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:18.521918 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:18.521947 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:18.522134 (+   187us) tablet.cc:701] Row locks acquired
0709 12:20:18.522151 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:20:18.522301 (+   150us) write_op.cc:270] Start()
0709 12:20:18.522416 (+   115us) write_op.cc:276] Timestamp: P: 1783599618522254 usec, L: 0
0709 12:20:18.522440 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:20:18.523168 (+   728us) log.cc:844] Serialized 537 byte log entry
0709 12:20:18.741883 (+218715us) op_driver.cc:464] REPLICATION: finished
0709 12:20:18.968885 (+227002us) write_op.cc:301] APPLY: starting
0709 12:20:18.973797 (+  4912us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:18.988460 (+ 14663us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:19.030341 (+ 41881us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:19.065140 (+ 34799us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:19.105767 (+ 40627us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:20:19.110319 (+  4552us) write_op.cc:312] APPLY: finished
0709 12:20:19.113037 (+  2718us) log.cc:844] Serialized 22 byte log entry
0709 12:20:19.113217 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:19.113297 (+    80us) write_op.cc:454] Released schema lock
0709 12:20:19.113336 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:19.113677 (+   341us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:19.113702 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":59885,"reported_tablets":6,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":192816,"apply.run_cpu_time_us":2373,"apply.run_wall_time_us":166380,"num_ops":1,"prepare.queue_time_us":197528,"prepare.run_cpu_time_us":2648,"prepare.run_wall_time_us":2649,"replication_time_us":198430,"spinlock_wait_cycles":2304,"thread_start_us":205099,"threads_started":2}]]}
I20260709 12:20:19.417481 11011 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 2.
I20260709 12:20:19.398213 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:19.422966 11083 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:19.405437 11909 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:19.379771 12218 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:19.430485 10820 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 38e2bba2f11943899027eb26325e2b6a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:19.390697 12191 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.400507 11656 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:19.402071 12162 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.434242 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:19.437060 11083 raft_consensus.cc:2393] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 2: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:19.429716 10931 raft_consensus.cc:2368] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3.
I20260709 12:20:19.432933 12191 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:19.428038 12209 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.441215 12209 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:19.437516 12218 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:20:19.420653 12070 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.444408 11926 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:19.428131 12150 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:19.456660 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 235351us
I20260709 12:20:19.464342 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:19.465047 10932 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 2.
I20260709 12:20:19.465926 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:19.471766 10932 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:20:19.475529 12194 consensus_meta.cc:287] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.001s
I20260709 12:20:19.476123 11657 raft_consensus.cc:2955] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:19.450592 12162 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:19.480350 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:19.481060 10932 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:19.485548 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:19.486186 10934 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:19.486835 10932 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:19.489394 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:19.490047 11083 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:19.490573 11078 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:19.490820 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:19.491405 11083 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:19.491973 11078 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:19.501670 10899 leader_election.cc:400] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5.
I20260709 12:20:19.502064 10899 leader_election.cc:403] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:20:19.502554 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:19.503228 11009 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:19.504344 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:19.506023 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:19.505033 11078 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:19.508931 10974 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:19.514917 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:19.518530 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:19.543000 11011 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:19.462577 12053 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.475970 12194 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.505247 12170 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:19.516266 12236 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:19.571930 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 46542.6us
I20260709 12:20:19.572906 10930 raft_consensus.cc:2955] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:19.577078 11083 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:19.576531 12128 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:19.581287 12128 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.583425 12128 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:19.587075 12098 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:19.588011 12209 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:19.588651 12209 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.590863 12209 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:19.591362 12209 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:19.592346 12174 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:19.575096 12213 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.593847 11077 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:19.594290 12130 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:19.597434 12213 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:19.598083 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:19.598670 12150 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:19.598803 11658 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:19.495819 12202 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.601289 12053 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:19.601501 12202 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:19.602559 12237 log.cc:927] Time spent T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:20:19.603163 12070 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:19.604614 12178 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:19.605297 11002 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:19.607405 11085 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
W20260709 12:20:19.613368 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:19.621498 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.623808 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:19.624553 11084 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:19.615494 11083 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:19.625466 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:19.626302 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:19.626926 11082 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:19.627574 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:19.605753 12235 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:19.630187 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:19.633411 11082 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 3: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:19.608299 12162 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:19.636791 12236 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5.
I20260709 12:20:19.629289 11084 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:19.638154 12162 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.644213 12162 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:19.587751 12098 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.574018 12170 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.591812 12209 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.646705 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:19.649432 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:19.653120 11082 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:20:19.661823 12194 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:19.655328 12209 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:19.657037 12098 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:19.663631 11952 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.665014 11082 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:19.666209 11952 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:19.668558 12170 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:19.674448 12162 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:19.677403 12162 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:20:19.736783 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 142029us
I20260709 12:20:19.735136 10933 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:19.745457 10929 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:19.747232 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:19.748622 11082 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:19.764475 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:19.765764 11656 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:19.766148 10899 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:19.770396 11624 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:19.772312 12081 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:19.773445 12081 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.773507 12165 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:19.777634 12165 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:19.778157 12165 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.782513 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:19.782892 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:19.784112 10936 raft_consensus.cc:2393] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 2: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:20:19.783617 10821 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0774d95f5c1b4bdb990e50f5d858b600 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9e8170bbe8244e40a2b2e5011e69b697 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:19.783753 10935 raft_consensus.cc:2393] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 3: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:19.787529 12162 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:19.784346 12236 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:19.788929 12162 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.789943 12236 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.776516 10933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 724) took 1333 ms. Trace:
I20260709 12:20:19.803594 12236 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:19.809001 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:19.809839 10936 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:19.785188 10899 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:19.810730 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:19.811446 10933 rpcz_store.cc:276] 0709 12:20:18.435224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.437613 (+  2389us) service_pool.cc:224] Handling call
0709 12:20:19.398037 (+960424us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b5800002d98. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f260a0 00007f9bb5f25984 00007f9baf4a06d4 00007f9baf4a0662
0709 12:20:19.766743 (+368706us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12087168}
I20260709 12:20:19.815896 10935 raft_consensus.cc:2368] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3.
I20260709 12:20:19.800076 12081 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:19.830778 12242 log.cc:927] Time spent T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:20:19.836565 11082 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:19.840930 12236 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.843519 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:19.844619 11080 raft_consensus.cc:2368] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:19.846288 11950 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:19.847230 11950 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.842947 12162 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:19.868714 12200 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:19.868283 10977 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:19.874868 11953 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:19.875370 11953 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:19.876745 10899 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:19.877807 12200 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:19.878403 12200 raft_consensus.cc:697] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:19.882053 12200 consensus_queue.cc:237] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.883754 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:19.885152 12243 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:19.857041 12081 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:19.886742 11084 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:19.887214 12081 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.855140 10831 catalog_manager.cc:5697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 1 to 3, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 3 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:19.886469 10977 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:19.890094 11950 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:19.893831 11871 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:19.896711 10977 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:19.898610 12243 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:20:19.898864 12239 log.cc:927] Time spent T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.248s	user 0.002s	sys 0.000s
I20260709 12:20:19.899171 12243 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.899621 12243 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:19.899746 12191 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:19.887740 12081 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:19.901213 12191 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.916267 11656 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:19.917352 10899 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:19.919840 11871 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:19.875783 11953 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.922025 10899 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:19.923808 12165 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:19.900322 12065 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:20:19.920815 12191 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:19.920469 11871 raft_consensus.cc:697] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:19.946429 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:19.948935 11081 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:19.959904 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:19.968533 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 46656.4us
I20260709 12:20:19.960932 10930 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:20:19.940289 12065 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:19.940585 12090 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:19.945585 12170 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:19.970850 12090 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.970536 12178 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:19.950074 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:19.958849 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:19.963280 10832 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35608 (request call id 140) took 1971 ms. Trace:
I20260709 12:20:19.937549 12236 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:19.944437 12132 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:19.983562 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:19.971549 12170 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.975984 12178 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.945395 11871 consensus_queue.cc:237] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.987761 11084 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:19.989544 11953 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.989941 12128 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:19.980707 10832 rpcz_store.cc:276] 0709 12:20:17.991579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.991723 (+   144us) service_pool.cc:224] Handling call
0709 12:20:18.191988 (+200265us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b5400002490. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3c640 00007f9bb6d13846 00007f9bb6e1d90e 00007f9bb52de2a4 00007f9bb52de232 00007f9bb52de161 00007f9bb52de0dc 00007f9bb52dd392 00007f9baf29b48c 00007f9baf29a8c6
0709 12:20:19.963029 (+1771041us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103679,"reported_tablets":7,"spinlock_wait_cycles":5533440}
I20260709 12:20:19.991468 12130 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:19.996806 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.044466 11011 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:20.044235 12130 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.045523 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.046687 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:19.999056 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:20.048373 11010 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:20.049717 12209 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:20.050420 12209 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.999650 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.000466 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:20.052448 10930 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:20.000638 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:20.053599 11004 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:20.000835 11008 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:20.005398 11659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59414 (request call id 7) took 1067 ms. Trace:
I20260709 12:20:20.009105 12170 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.060111 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:20.004074 12178 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:20.064735 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:20.065587 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:20.066439 10934 raft_consensus.cc:2368] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:20.066552 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:20.067175 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:20.011341 12098 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:20.068305 12098 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.069177 11953 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.060134 11006 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:20.070756 12098 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:20.021670 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.023980 12132 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:19.970526 12065 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.026101 12128 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.026400 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.027498 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.032543 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:20.033463 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:20.037477 11083 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:20.038043 12165 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.039269 12090 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.039433 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:20.040474 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:20.043133 11050 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:20.059154 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:20.059170 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:20.057938 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.062433 11084 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:20.087359 11080 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:20.068325 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:20.067876 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:20.073406 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:20.071439 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.060454 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:20.065650 10931 raft_consensus.cc:2368] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:20.091881 10929 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:20.046625 12130 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.097503 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:20.098774 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:20.100620 10928 raft_consensus.cc:2368] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3.
I20260709 12:20:20.095371 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:20.100404 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:20.103199 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 60304.5us
I20260709 12:20:20.106424 11082 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:20.108939 10936 raft_consensus.cc:2393] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 3: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:20.110538 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:20.114532 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:20.115810 11010 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
W20260709 12:20:20.116930 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 112416us
I20260709 12:20:20.124053 11076 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:20.119534 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:20.132303 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:20.132951 11077 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:20.129609 12065 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.140336 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:20.140048 10932 raft_consensus.cc:2393] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 2: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:20.060611 11659 rpcz_store.cc:276] 0709 12:20:18.971316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.990925 (+ 19609us) service_pool.cc:224] Handling call
0709 12:20:19.980109 (+989184us) spinlock_profiling.cc:243] Waited 5.7 ms on lock 0x7b54004ce5d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:20:20.005203 (+ 25094us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13121280}
I20260709 12:20:20.136401 12213 raft_consensus.cc:2764] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:20:20.151469 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.154400 11006 raft_consensus.cc:2393] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 3: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:20.154682 12132 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:20.155462 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:20:20.153028 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 64818.8us
I20260709 12:20:20.135149 11002 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:20.159149 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.159952 11002 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:20:20.154614 11079 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:20.173334 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:20.174820 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:20.174934 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:20.175446 10830 catalog_manager.cc:5697] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 2 to 3, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 3 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:20.183323 11082 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:20.177708 10830 catalog_manager.cc:5697] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 3 to 5, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 5 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:20.187314 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:20.161113 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:20.189524 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:20.193179 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.193853 11007 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:20.194823 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:20.194465 11004 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:20.139564 12243 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:20.197048 11008 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:20.199393 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.202728 11010 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:20:20.181073 11871 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:20.193171 11049 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:20.204666 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:20.207433 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:20.205590 10830 catalog_manager.cc:5697] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 1 to 2, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 2 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:20.191407 12065 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:20.211311 11084 raft_consensus.cc:2393] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 2: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:20.208936 11077 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:20.211155 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:20.212380 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.212981 11010 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:20.213960 10932 raft_consensus.cc:2368] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3.
I20260709 12:20:20.196296 12209 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:20.217541 12128 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:20.217365 12053 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:20.216675 11008 raft_consensus.cc:2368] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 2. Current term is 3.
I20260709 12:20:20.217999 11050 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:20.191294 12191 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.191257 12081 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:20.225685 11004 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:20.215600 12065 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.228576 11050 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:20.229522 12065 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.230332 12132 raft_consensus.cc:2764] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:20:20.227622 11002 raft_consensus.cc:2368] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4.
I20260709 12:20:20.231060 12132 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:20.233134 10974 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:20.231436 12128 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:20.238037 12128 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:20.242944 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:20.243628 11659 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:20.231304 12098 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:20:20.245361 11009 raft_consensus.cc:2368] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3.
I20260709 12:20:20.246477 12191 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.247646 10977 leader_election.cc:400] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:20.248165 10977 leader_election.cc:403] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:20:20.248852 12090 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:20.249781 10977 leader_election.cc:400] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:20.250085 10977 leader_election.cc:403] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:20:20.250932 12170 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:20.252915 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:20.253165 10933 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:20.254717 12065 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:20.253785 12128 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:20.258147 12065 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:20.258782 12065 raft_consensus.cc:697] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:20.259893 12065 consensus_queue.cc:237] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.261543 12090 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:20.261744 11011 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:20.255239 12243 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:20.264191 11659 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:20.218971 11871 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.264792 10936 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 2.
W20260709 12:20:20.262669 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 51112.7us
I20260709 12:20:20.269527 10974 leader_election.cc:400] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:20.270999 10974 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:20.271948 12130 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:20.272444 12130 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:20.272985 12130 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.273073 10830 catalog_manager.cc:5697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:20.231459 12132 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.275192 12132 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:20.279316 10930 raft_consensus.cc:2393] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 3: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:20.216675 12178 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.285866 12178 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.290129 12053 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.290637 12053 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:20.283496 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 76436.2us
I20260709 12:20:20.292047 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:20.292858 10931 raft_consensus.cc:2368] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3.
I20260709 12:20:20.298311 12191 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:20.299090 12191 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.309475 11624 leader_election.cc:400] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 2 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 2. Current term is 3.
I20260709 12:20:20.309903 11624 leader_election.cc:403] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:20:20.310484 12165 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 2. Current term is 3.
I20260709 12:20:20.313414 10929 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:20.315690 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:20.316466 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.316833 10899 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:20.317263 11009 raft_consensus.cc:2393] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 3: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:20.317680 12201 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:20.318101 11950 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:20.318710 11950 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.317211 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:20.317989 10899 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:20.324451 11950 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:20.349754 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.326710 12178 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:20.353878 11009 raft_consensus.cc:2393] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 3: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:20.345307 12201 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:20.372978 12191 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.373787 11006 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:20.373981 12174 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:20.378324 11871 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.378715 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:20.379328 11006 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:20.380632 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.383823 11004 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:20.379347 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:20.384378 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:20.385133 11003 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:20.384758 11002 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 3: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:20.356716 12178 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.405728 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.408219 11009 raft_consensus.cc:2393] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 3: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:20.410116 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:20.410831 11008 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:20.400183 12201 raft_consensus.cc:697] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:20.406597 12178 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:20.437736 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.440284 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.453604 11004 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:20.455983 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:20.456863 11656 raft_consensus.cc:2393] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 3: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:20.451797 11950 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.462353 11950 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.467435 12201 consensus_queue.cc:237] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.477612 11003 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:20.460052 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:20.480028 11005 raft_consensus.cc:2393] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 3: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:20.482394 11008 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:20.448310 12081 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:20.483798 11051 leader_election.cc:400] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3.
W20260709 12:20:20.485579 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 124787us
I20260709 12:20:20.490818 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:20.499240 12243 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:20:20.500275 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 139279us
I20260709 12:20:20.502053 12243 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.502264 12167 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:20.501889 10974 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:20.504315 10974 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:20.506274 12065 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:20.506873 12065 raft_consensus.cc:697] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:20.507233 12243 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.503360 11953 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:20.509343 10974 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:20.511116 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:20.514210 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:20.515236 10974 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:20.512773 12191 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:20.507952 12065 consensus_queue.cc:237] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:20.516412 12191 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:20.516856 12191 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:20.520159 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:20.520390 11953 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:20.521714 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:20.522238 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:20.523219 10927 raft_consensus.cc:2393] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 3: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:20.521875 11953 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:20.526031 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:20.526374 11953 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:20.528816 11050 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:20.529141 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:20.515061 11006 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:20.530378 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:20.532680 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:20.534578 11077 raft_consensus.cc:2393] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 3: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:20.534344 12132 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.536567 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:20.543648 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:20.545888 12178 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.547287 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:20.560556 11051 leader_election.cc:400] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3.
I20260709 12:20:20.563894 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.505630 12130 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.562500 12191 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.566011 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.566258 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.567226 11010 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:20.567777 12191 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.568346 11050 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:20.569918 12130 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.566025 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:20.573290 10932 raft_consensus.cc:2368] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:20.574191 10927 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:20.573832 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:20.573885 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.586908 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:20.587622 11077 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:20.588505 11050 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:20.589515 11050 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:20.570297 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.572224 12213 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:20.575491 12132 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:20.596395 10901 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:20.594477 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:20.595286 12098 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:20.582659 11953 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.594969 12209 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:20.567806 12053 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:20.598412 12128 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:20.604105 12098 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:20.614799 11080 raft_consensus.cc:2393] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 3: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:20.609135 12209 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.617805 12053 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:20.620270 12178 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.613091 12098 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.634011 11077 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:20.636025 10974 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:20.628782 12209 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:20.640666 12260 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:20.628513 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:20.643461 10901 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:20.657027 11051 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:20.639269 12167 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:20.663127 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:20.639000 12213 raft_consensus.cc:697] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:20:20.665130 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 75733.6us
I20260709 12:20:20.662231 10901 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:20.656002 12081 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:20.677456 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:20.653800 12260 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:20.679843 12212 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:20.688336 12212 raft_consensus.cc:697] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:20.674908 11050 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:20.690162 10901 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:20.691792 12212 consensus_queue.cc:237] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.693912 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:20.695909 12090 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:20.697592 12090 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.691676 11953 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.696492 12243 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:20.696816 12162 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:20.704882 12065 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:20.696746 12262 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:20.703795 12243 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.716305 12191 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:20.716857 11953 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:20.677047 11659 raft_consensus.cc:2393] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 3: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:20.673273 12167 raft_consensus.cc:697] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:20:20.700549 12266 log.cc:927] Time spent T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:20:20.676003 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:20.735194 11080 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:20.736003 10927 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:20.737464 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:20:20.727242 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 61076.8us
I20260709 12:20:20.728598 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:20.732267 12142 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:20.732506 11953 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.732843 12272 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:20.738153 11950 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:20.716902 12260 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:20.728610 12262 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.727442 12065 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:20.742972 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 52909.3us
I20260709 12:20:20.789878 10901 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:20.736891 12162 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.729014 12191 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.737222 10974 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:20.725667 12130 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:20.796742 12200 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:20.797326 12130 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.798803 12065 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.798972 12272 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:20.799412 12130 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.737360 12261 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:20.721246 12170 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:20.800508 12170 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.801091 11953 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.801178 12262 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:20.727388 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 70479.5us
I20260709 12:20:20.784514 11050 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:20.791050 12142 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.774962 12128 raft_consensus.cc:697] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:20.796631 12174 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:20.799569 12272 raft_consensus.cc:697] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:20.808988 11051 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:20.809599 12272 consensus_queue.cc:237] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.810248 12142 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.798731 12191 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:20.802508 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 65388.9us
I20260709 12:20:20.803916 12170 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.814729 12243 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.816080 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:20.820544 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:20.821100 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:20.828548 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:20.828694 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:20.818676 12262 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:20.830456 12262 raft_consensus.cc:697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:20.832302 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:20.832306 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:20.833443 11082 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:20.833236 12262 consensus_queue.cc:237] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.834707 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:20.832508 10901 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:20.832593 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:20:20.843478 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 125939us
W20260709 12:20:20.839706 12264 log.cc:927] Time spent T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:20:20.842708 12213 consensus_queue.cc:237] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.845664 11051 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:20.847070 10974 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:20:20.846555 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 66151us
I20260709 12:20:20.813351 12162 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.862327 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:20.862941 11007 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:20.850844 12229 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:20.865551 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:20.866046 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:20.866986 12274 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:20.864445 12162 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:20.868088 12098 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.869185 12162 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:20.869733 12162 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:20.870426 12098 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:20.861110 12090 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:20.869302 11051 leader_election.cc:400] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3.
I20260709 12:20:20.871421 11051 leader_election.cc:403] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:20.874945 11007 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:20.849210 12272 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:20.883170 12272 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3.
I20260709 12:20:20.877327 12270 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:20.884094 12270 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:20.884559 12270 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.883875 11051 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:20.885640 12276 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:20.877770 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:20.878448 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:20.879434 11009 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:20.881100 11050 leader_election.cc:400] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4.
I20260709 12:20:20.889191 11003 raft_consensus.cc:1275] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:20.889748 10831 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 24) took 1074 ms. Trace:
I20260709 12:20:20.890197 12229 raft_consensus.cc:697] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:20.863821 12167 consensus_queue.cc:237] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.892833 12229 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.896232 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:20.891168 11010 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:20.891417 11050 leader_election.cc:403] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:20:20.906924 11050 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:20.908200 11050 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:20.909152 11050 leader_election.cc:400] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3.
I20260709 12:20:20.909638 12053 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4.
I20260709 12:20:20.900517 11002 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:20.910456 12053 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:20.914332 11010 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:20.868234 12128 consensus_queue.cc:237] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.895977 10831 rpcz_store.cc:276] 0709 12:20:19.815275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.815620 (+   345us) service_pool.cc:224] Handling call
0709 12:20:20.889684 (+1074064us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:20.156826 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:20.159118 (+  2292us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:20.159173 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:20:20.159208 (+    35us) tablet.cc:662] Decoding operations
0709 12:20:20.159666 (+   458us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:20.159790 (+   124us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:20.159828 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:20.160319 (+   491us) tablet.cc:701] Row locks acquired
0709 12:20:20.160380 (+    61us) write_op.cc:260] PREPARE: finished
0709 12:20:20.160548 (+   168us) write_op.cc:270] Start()
0709 12:20:20.160717 (+   169us) write_op.cc:276] Timestamp: P: 1783599620160490 usec, L: 0
0709 12:20:20.160753 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:20:20.232436 (+ 71683us) log.cc:844] Serialized 594 byte log entry
0709 12:20:20.464922 (+232486us) spinlock_profiling.cc:243] Waited 8.17 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:20:20.597957 (+133035us) op_driver.cc:464] REPLICATION: finished
0709 12:20:20.803004 (+205047us) write_op.cc:301] APPLY: starting
0709 12:20:20.803918 (+   914us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:20.804043 (+   125us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:20.804077 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:20.804367 (+   290us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:20.804593 (+   226us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:20:20.804663 (+    70us) write_op.cc:312] APPLY: finished
0709 12:20:20.871041 (+ 66378us) log.cc:844] Serialized 22 byte log entry
0709 12:20:20.871261 (+   220us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:20.871344 (+    83us) write_op.cc:454] Released schema lock
0709 12:20:20.871405 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:20.871829 (+   424us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:20.871880 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":68412,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":175593,"apply.run_cpu_time_us":2212,"apply.run_wall_time_us":84936,"num_ops":1,"prepare.queue_time_us":185938,"prepare.run_cpu_time_us":30162,"prepare.run_wall_time_us":214693,"raft.queue_time_us":299022,"raft.run_cpu_time_us":17494,"raft.run_wall_time_us":108161,"replication_time_us":423626,"spinlock_wait_cycles":20263936,"thread_start_us":346247,"threads_started":4,"wal-append.queue_time_us":152394}]]}
I20260709 12:20:20.919814 11083 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:20.915824 12053 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:20.927703 12053 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:20.927508 12283 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:20.929598 11051 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:20.930611 11050 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:20.937275 10977 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:20.938994 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:20.940734 10830 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35614 (request call id 138) took 1726 ms. Trace:
I20260709 12:20:20.865008 12178 consensus_queue.cc:1059] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:20:20.990653 11003 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:20:20.986753 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 49556.9us
I20260709 12:20:20.993388 10927 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:20.993821 10977 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:20.994383 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:20.996100 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 78603.5us
I20260709 12:20:20.992645 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:20.996868 11050 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:20.917001 12209 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:20.942530 12276 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:20.999155 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:20.989245 10901 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:21.028156 10977 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:20:21.060323 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 71160.2us
I20260709 12:20:20.998793 10975 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:20:21.026471 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 96951.9us
I20260709 12:20:21.061571 10977 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:21.000185 12278 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:20.990639 12098 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:21.053377 12209 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:21.054214 11002 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:21.055369 12272 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:21.055790 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 58958.2us
I20260709 12:20:21.068580 10977 leader_election.cc:400] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:21.069216 10977 leader_election.cc:403] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:20:21.026975 12167 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:21.063226 11051 leader_election.cc:400] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3.
I20260709 12:20:20.999279 12274 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:21.071023 10977 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:20:21.071906 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 160492us
I20260709 12:20:21.063094 10901 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:21.000283 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:20.999152 12178 raft_consensus.cc:3055] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:21.075739 12280 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:21.076098 12277 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:20.941125 12270 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:21.079882 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:21.068009 12262 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:21.085546 11008 raft_consensus.cc:2393] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 3: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:21.082406 11870 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:21.064244 12212 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:21.082295 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:21.070098 12170 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:21.091775 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:21.092608 11009 raft_consensus.cc:2393] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 3: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:20.941125 10830 rpcz_store.cc:276] 0709 12:20:19.227753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.235743 (+  7990us) service_pool.cc:224] Handling call
0709 12:20:20.940676 (+1704933us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:20.368144 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:20.369777 (+  1633us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:20.369852 (+    75us) write_op.cc:435] Acquired schema lock
0709 12:20:20.369914 (+    62us) tablet.cc:662] Decoding operations
0709 12:20:20.372127 (+  2213us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:20.399938 (+ 27811us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:20.399984 (+    46us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:20:20.430547 (+ 30563us) tablet.cc:701] Row locks acquired
0709 12:20:20.438535 (+  7988us) write_op.cc:260] PREPARE: finished
0709 12:20:20.444975 (+  6440us) write_op.cc:270] Start()
0709 12:20:20.454215 (+  9240us) write_op.cc:276] Timestamp: P: 1783599620443405 usec, L: 0
0709 12:20:20.477521 (+ 23306us) op_driver.cc:348] REPLICATION: starting
0709 12:20:20.480511 (+  2990us) log.cc:844] Serialized 1693 byte log entry
0709 12:20:20.516568 (+ 36057us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b5400096d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5be28 00007f9bb4996581 00007f9bb4995d58 00007f9bb499a9f1 00007f9bb499a9a9 00007f9bb499a939 00007f9bb499a901 00007f9bb4999b2d 0000000000388634 0000000000388479
0709 12:20:20.736028 (+219460us) op_driver.cc:464] REPLICATION: finished
0709 12:20:20.872249 (+136221us) write_op.cc:301] APPLY: starting
0709 12:20:20.872330 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:20.872481 (+   151us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:20.872507 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:20.873105 (+   598us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:20.873280 (+   175us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:20:20.873328 (+    48us) write_op.cc:312] APPLY: finished
0709 12:20:20.873559 (+   231us) log.cc:844] Serialized 40 byte log entry
0709 12:20:20.873746 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:20.873842 (+    96us) write_op.cc:454] Released schema lock
0709 12:20:20.873890 (+    48us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":250877,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":97220,"apply.run_cpu_time_us":1969,"apply.run_wall_time_us":1964,"mutex_wait_us":5930,"num_ops":4,"prepare.queue_time_us":56908,"prepare.run_cpu_time_us":7908,"prepare.run_wall_time_us":148860,"replication_time_us":248365,"spinlock_wait_cycles":2829056,"thread_start_us":113969,"threads_started":1}]]}
I20260709 12:20:21.098126 11010 raft_consensus.cc:2393] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 3: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:21.105334 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:21.109375 12270 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:21.115394 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:21.115535 10901 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:21.116250 11007 raft_consensus.cc:2393] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 2: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:21.117223 11050 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:21.083441 12278 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:21.076738 12178 raft_consensus.cc:740] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:21.116642 11870 raft_consensus.cc:697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:21.119498 12201 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:20:21.119535 12209 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:21.124332 12212 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:21.126483 12162 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:21.096412 12261 consensus_queue.cc:1048] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:20:21.139396 12212 raft_consensus.cc:697] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:21.142110 12212 consensus_queue.cc:237] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:21.142719 12162 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:21.142494 11870 consensus_queue.cc:237] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:21.133774 12174 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:20:21.137665 12053 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:21.150547 12053 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:20:21.138993 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 54397.9us
I20260709 12:20:21.159389 10977 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:21.172482 11009 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:21.173168 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:21.173859 11084 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:21.174930 12278 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:21.177052 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:21.176934 10834 catalog_manager.cc:5697] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 3 to 4, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New cstate: current_term: 1 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:21.185426 10901 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:20:21.186568 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 113611us
I20260709 12:20:21.189289 12053 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:21.190021 12053 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:21.183826 12132 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:21.191913 12132 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:21.192906 12053 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:21.196010 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:21.195329 12178 consensus_queue.cc:260] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:21.204682 12132 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:21.197723 10833 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35620 (request call id 133) took 1455 ms. Trace:
I20260709 12:20:21.197455 10977 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:21.207243 10833 rpcz_store.cc:276] 0709 12:20:19.715476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.716115 (+   639us) service_pool.cc:224] Handling call
0709 12:20:21.170794 (+1454679us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61,"reported_tablets":14}
I20260709 12:20:21.220552 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:21.224521 11084 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:21.225960 10974 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:21.233723 12142 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:21.234365 12142 raft_consensus.cc:697] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:21.235296 12142 consensus_queue.cc:237] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:21.236357 11051 leader_election.cc:400] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3.
I20260709 12:20:21.237257 11051 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:21.237546 10977 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:21.221764 12174 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:21.208268 12274 raft_consensus.cc:697] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:21.245026 11051 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:21.270027 11051 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:21.271250 11051 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:21.275230 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:21.276130 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:21.277245 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:21.285373 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:21.230077 12178 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:21.288434 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:21.290033 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:21.290730 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:21.293435 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:21.297758 10934 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:21.268934 12065 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:21.304580 11010 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:21.305514 10928 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:21.285528 12130 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:21.287418 12053 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:21.292786 12276 raft_consensus.cc:697] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:21.287083 12132 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:20:21.316924 10935 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:21.303745 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:21.296067 12261 consensus_queue.cc:1059] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:20:21.311435 12212 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.322933 12294 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:21.323042 12287 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:21.314028 12272 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:21.315783 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:21.337967 11080 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:21.320693 12130 raft_consensus.cc:697] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:21.340677 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:21.341770 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:21.342634 11077 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:21.339843 12292 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:21.346678 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:21.348224 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:21.351346 10977 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:21.358547 10977 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:21.359215 11082 raft_consensus.cc:2393] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 3: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:21.393139 10977 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:21.395548 10977 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:21.357264 11659 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:21.397308 11081 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:21.383575 11953 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:21.384199 12174 raft_consensus.cc:697] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:21.392381 12170 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:21.399888 10931 raft_consensus.cc:2393] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 3: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:21.397790 12090 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:21.406057 11081 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:21.354916 12212 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:21.394129 12261 consensus_queue.cc:1243] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:20:21.359803 12272 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:21.412429 10977 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:21.401192 12277 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:21.437188 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:21.447166 12212 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:21.428398 11953 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:21.414476 12174 consensus_queue.cc:237] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:21.449105 12262 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:21.449936 12272 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:21.385066 12274 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:21.456605 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:21.457409 11081 raft_consensus.cc:2393] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 3: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:21.459066 12292 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:21.451048 12130 consensus_queue.cc:237] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:21.459816 12272 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:21.460362 12272 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:21.461771 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:21.462414 12272 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:21.414661 12276 consensus_queue.cc:237] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:21.466847 11079 raft_consensus.cc:1275] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:21.469087 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:21.471807 11082 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:21.459600 12292 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:21.494493 12292 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:21.508610 11084 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:21.513769 11085 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:21.522199 10899 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:21.524739 12212 consensus_queue.cc:1059] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:21.525207 11082 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:21.526250 12212 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:21.526943 12212 consensus_queue.cc:1059] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:21.522224 11085 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:21.527899 12305 raft_consensus.cc:3055] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:21.528301 12305 raft_consensus.cc:740] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:21.529508 12229 raft_consensus.cc:3055] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:21.529922 12229 raft_consensus.cc:740] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:21.530793 12229 consensus_queue.cc:260] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:21.529122 12305 consensus_queue.cc:260] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:21.531642 12212 raft_consensus.cc:3055] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:21.532060 12212 raft_consensus.cc:740] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:21.533888 12212 consensus_queue.cc:260] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:21.532105 12305 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:21.528496 12302 log.cc:927] Time spent T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:20:21.536269 12178 consensus_queue.cc:1059] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:21.546098 12178 raft_consensus.cc:3055] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:21.546507 12178 raft_consensus.cc:740] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:21.546968 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:21.547900 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:21.548803 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:21.547322 12178 consensus_queue.cc:260] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:21.550052 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:21.548731 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:21.550536 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:21.548890 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:21.551157 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:21.551689 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:21.552434 10936 raft_consensus.cc:1240] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:21.550380 12178 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:21.562291 10927 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:21.565361 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:21.567307 11080 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:21.577548 11084 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:21.581079 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:21.588850 11010 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:21.592147 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:21.592962 10935 raft_consensus.cc:2393] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 3: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:20:21.708884 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 77154.1us
W20260709 12:20:21.715466 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 108532us
I20260709 12:20:21.719956 11051 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:21.602305 12229 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:21.723659 11011 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:21.739343 11051 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:21.740325 11953 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:21.596458 11870 consensus_queue.cc:1048] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.126s
I20260709 12:20:21.754091 11051 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:21.596905 12278 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.142s
I20260709 12:20:21.763921 11051 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:21.763939 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:21.767022 11051 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:21.764691 11950 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:20:21.767580 12270 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:21.764279 12287 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:21.776362 12191 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:21.776922 12294 consensus_queue.cc:1059] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:21.777637 12294 consensus_queue.cc:1243] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:20:21.781154 12213 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:21.781755 12213 raft_consensus.cc:697] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:21.782651 12213 consensus_queue.cc:237] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:21.755235 12274 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:20:21.839897 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 121391us
I20260709 12:20:21.768971 12262 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:21.855930 11080 raft_consensus.cc:3055] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:21.819343 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:21.826815 11067 tablet_service.cc:1558] Processing DeleteTablet for tablet 38e2bba2f11943899027eb26325e2b6a with delete_type TABLET_DATA_TOMBSTONED (TS 1abf4b385a2b493ab83f593a1f8c9cd1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60028
W20260709 12:20:21.828538 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 54404.8us
I20260709 12:20:21.830880 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:21.834041 12293 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:20:21.835070 12318 log.cc:927] Time spent T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:20:21.786454 12294 raft_consensus.cc:3055] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:21.801086 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:21.792130 12212 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:21.854055 10977 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:21.856592 11080 raft_consensus.cc:740] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:21.890846 11005 raft_consensus.cc:1240] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3. Ops: []
W20260709 12:20:21.889585 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.866228 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:21.889725 11003 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:21.897471 10932 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:21.880573 11050 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:21.879159 12262 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:21.856216 12174 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:20:21.898664 11080 consensus_queue.cc:260] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:21.905128 10977 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:21.885210 12294 raft_consensus.cc:740] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:21.924471 11080 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:21.898142 12090 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:21.903689 11050 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:21.925501 10929 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:21.931239 10933 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:21.882256 12306 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:20:21.916846 12293 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:21.940999 12322 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:20:21.947999 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.949405 12213 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:21.950867 11050 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:21.933532 12276 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:21.915846 12260 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:20:21.934448 12229 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:21.936398 12283 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:21.926076 12142 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:20:21.956547 12272 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:21.982450 10931 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:20:21.985385 10821 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0774d95f5c1b4bdb990e50f5d858b600 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9e8170bbe8244e40a2b2e5011e69b697 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:21.989588 12262 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:21.990074 12229 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:22.008456 12229 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:22.011693 12229 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:21.964380 12322 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:22.014536 12322 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:21.997177 10977 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:21.972111 12294 consensus_queue.cc:260] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:22.019199 12142 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.030324 11011 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:22.023162 12283 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:22.034272 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:22.023416 12274 consensus_queue.cc:1059] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:20:22.039652 12272 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:20:22.046602 11950 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:22.047210 11950 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:22.049307 11950 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:22.051757 12333 tablet_replica.cc:333] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:20:22.032814 12142 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:22.035171 11953 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:22.057684 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:22.058368 10935 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:22.067585 10935 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:22.060686 12162 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:20:22.084841 12142 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:22.087497 11080 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:20:22.087939 11080 pending_rounds.cc:85] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 1
I20260709 12:20:22.088116 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:22.089593 12236 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:22.088177 11080 pending_rounds.cc:107] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:20:22.091061 11080 raft_consensus.cc:2889] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:22.090619 11006 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:22.101379 10901 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:22.105123 11659 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:22.113837 11084 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:22.116048 12280 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:22.117787 12294 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:22.117918 11006 raft_consensus.cc:1240] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:22.120834 12274 consensus_queue.cc:1059] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:22.122078 11085 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:22.124449 10935 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:22.126266 10936 raft_consensus.cc:1240] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:20:22.124310 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:22.128969 10934 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:22.169170 10928 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:22.126243 12336 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:22.180361 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 49773.2us
I20260709 12:20:22.121062 12142 raft_consensus.cc:2955] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:22.182536 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:20:22.183911 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 55208us
I20260709 12:20:22.186450 11077 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:22.187098 11081 raft_consensus.cc:2955] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:22.202428 12170 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:22.196955 12261 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:20:22.225569 12347 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:22.236011 12295 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:20:22.238018 12323 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:22.238694 12323 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:22.241123 12323 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:22.249393 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 52589.6us
I20260709 12:20:22.262173 10974 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:22.263581 11871 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:22.220255 12130 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:20:22.273952 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:20:22.281934 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 57862.6us
I20260709 12:20:22.282959 11051 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:22.272691 12170 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:22.283784 12170 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.283977 12098 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:22.276975 11006 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:22.284731 12098 raft_consensus.cc:697] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:22.285744 12098 consensus_queue.cc:237] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:22.287032 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:22.288201 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:22.289431 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:22.284210 12170 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:22.298972 10931 raft_consensus.cc:1240] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:22.303459 11004 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:22.317739 12261 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:20:22.317268 12174 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:20:22.346728 11006 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:22.373767 11008 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:22.387764 12294 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:22.393010 12276 raft_consensus.cc:3055] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:22.393483 12276 raft_consensus.cc:740] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:20:22.372045 12327 log.cc:927] Time spent T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.316s	user 0.007s	sys 0.004s
I20260709 12:20:22.384123 12236 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.394290 12276 consensus_queue.cc:260] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:22.395067 12236 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:22.395438 12276 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:22.396988 12340 log.cc:927] Time spent T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 12:20:22.401283 11080 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:22.407296 11082 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:20:22.407621 11082 pending_rounds.cc:85] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 1
I20260709 12:20:22.407802 11082 pending_rounds.cc:107] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:20:22.408044 11082 raft_consensus.cc:2889] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:22.397197 12236 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:22.419024 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:22.403915 12174 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:20:22.428450 12321 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.431538 12333 raft_consensus.cc:2243] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:22.431825 12321 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:22.434314 12321 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:22.448591 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:20:22.431730 12339 log.cc:927] Time spent T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.252s	user 0.000s	sys 0.002s
I20260709 12:20:22.455713 12170 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:22.457966 12170 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:22.458721 11005 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:20:22.432539 12333 raft_consensus.cc:2272] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.481345 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:22.482280 11076 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:22.500875 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:22.503279 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:22.500244 10830 catalog_manager.cc:5697] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 1 to 3, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 3 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:20:22.515703 12359 log.cc:927] Time spent T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 12:20:22.526574 12343 log.cc:927] Time spent T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.324s	user 0.000s	sys 0.002s
I20260709 12:20:22.528575 12333 ts_tablet_manager.cc:1916] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:20:22.531268 12351 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:20:22.552258 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:22.555682 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:22.558332 11076 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:22.559816 10974 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:22.561199 11078 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:20:22.584398 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:22.588755 12081 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:22.592461 10934 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:22.594740 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:22.580688 12142 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:22.605125 10899 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:22.606092 11051 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:22.618955 10899 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:22.618197 12053 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:20:22.653323 10899 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:22.614027 12323 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:20:22.619433 12098 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:22.621047 12174 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:22.685915 12306 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:22.651060 12308 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:22.729650 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 45507.5us
I20260709 12:20:22.732769 10899 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:20:22.695760 12325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.008s	sys 0.029s
W20260709 12:20:22.756979 12325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.008s	sys 0.030s
W20260709 12:20:22.697296 12368 log.cc:927] Time spent T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:20:22.696355 12350 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:22.682137 12142 raft_consensus.cc:697] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:20:22.766422 12366 log.cc:927] Time spent T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
W20260709 12:20:22.767297 12365 log.cc:927] Time spent T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:20:22.702373 12098 raft_consensus.cc:697] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:20:22.777159 12367 log.cc:927] Time spent T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:20:22.756258 12357 log.cc:927] Time spent T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:20:22.791500 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:20:22.792241 12338 log.cc:927] Time spent T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.734s	user 0.003s	sys 0.001s
I20260709 12:20:22.784972 12336 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:22.868611 10901 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:22.830997 12212 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:22.897508 10901 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:22.831319 12350 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:22.899941 12376 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:22.898597 12212 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:23.074999 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 135646us
I20260709 12:20:23.007540 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 642) took 1007 ms. Trace:
W20260709 12:20:23.078356 12276 consensus_meta.cc:287] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.677s	user 0.007s	sys 0.011s
I20260709 12:20:22.941821 12142 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:22.990236 12098 consensus_queue.cc:237] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:23.090920 11082 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:20:23.091321 11082 pending_rounds.cc:85] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 1
I20260709 12:20:23.091535 11082 pending_rounds.cc:107] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:20:23.091784 11082 raft_consensus.cc:2889] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:23.096375 12378 log.cc:927] Time spent T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
W20260709 12:20:23.098423 12380 log.cc:927] Time spent T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:20:23.081881 11002 rpcz_store.cc:276] 0709 12:20:21.998270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.999605 (+  1335us) service_pool.cc:224] Handling call
0709 12:20:22.001154 (+  1549us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:22.001569 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:22.001602 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:22.002111 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 12:20:22.036478 (+ 34367us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:22.038360 (+  1882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:22.053539 (+ 15179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:22.791478 (+737939us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:20:23.003672 (+212194us) raft_consensus.cc:1685] finished
0709 12:20:23.004379 (+   707us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:23.005955 (+  1576us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1173,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":124,"spinlock_wait_cycles":4763904,"thread_start_us":29391,"threads_started":1,"wal-append.queue_time_us":50657}
W20260709 12:20:23.116626 12372 log.cc:927] Time spent T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.263s	user 0.001s	sys 0.001s
I20260709 12:20:23.156886 12212 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:23.160872 12053 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.161484 12053 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:23.166908 12373 log.cc:927] Time spent T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:20:23.169152 11871 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:23.169685 11871 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:23.171701 11871 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:23.176047 12350 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:23.163710 12053 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:23.194777 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:23.196429 10977 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:23.191380 12325 consensus_queue.cc:1059] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:20:23.197618 12385 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:23.198119 12383 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:23.198726 12383 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:23.201000 12383 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:23.195848 12090 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:20:23.204370 12383 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:23.204855 12383 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:23.207180 12325 raft_consensus.cc:3055] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:23.213266 12325 raft_consensus.cc:740] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:23.214105 12325 consensus_queue.cc:260] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:23.215679 12325 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:23.220288 12383 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:23.281632 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 85268.2us
I20260709 12:20:23.287954 12321 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:23.304354 12277 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:20:23.311188 12387 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:23.303896 11871 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.317610 11871 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:23.300557 12276 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:23.341909 12387 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:23.373791 10932 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:23.378813 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:20:23.379359 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 90565us
I20260709 12:20:23.384404 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:23.389359 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:23.396786 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:23.397061 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:23.377889 12305 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.444149 11622 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:23.446213 12305 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:23.448063 12350 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:23.469090 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:23.384222 12276 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:23.479146 12356 log.cc:927] Time spent T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:20:23.496608 12387 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:23.497313 12333 ts_tablet_manager.cc:1929] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:23.498529 12305 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:23.500488 12396 log.cc:927] Time spent T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:20:23.501289 12276 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:23.490851 12392 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:23.506242 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:23.493655 11871 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:23.504271 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:23.497978 12333 log.cc:1199] T 38e2bba2f11943899027eb26325e2b6a P 1abf4b385a2b493ab83f593a1f8c9cd1: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-2-root/wals/38e2bba2f11943899027eb26325e2b6a
I20260709 12:20:23.511927 11871 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:23.519948 11871 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:23.521989 11871 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:23.522555 12370 log.cc:927] Time spent T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.907s	user 0.002s	sys 0.000s
I20260709 12:20:23.540247 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:23.542110 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:23.553278 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:23.554596 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:23.563278 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:23.564165 12347 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:23.571533 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:23.575443 10901 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:23.517400 12236 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:23.509111 12383 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:23.590458 10901 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:23.512595 12392 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:23.602322 12383 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:23.608913 11006 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:23.610141 11011 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:23.611310 12392 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:23.612504 12276 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:23.613063 12276 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:23.618060 11011 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:23.593879 11871 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:23.615024 12212 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:23.620983 10832 catalog_manager.cc:5697] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:23.593205 12236 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:23.652163 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:23.638942 10832 catalog_manager.cc:5697] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 1 to 3, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 3 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:23.678030 10832 catalog_manager.cc:5697] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:23.695789 12293 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:23.695212 10832 catalog_manager.cc:5697] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 1 to 3, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 3 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:23.696390 12293 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:23.701042 12236 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:23.675276 12276 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:23.722571 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 965) took 1216 ms. Trace:
I20260709 12:20:23.721385 10832 catalog_manager.cc:5697] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 2 to 4, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 4 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:23.722311 12236 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:23.725376 12236 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:23.729022 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:23.723006 11082 rpcz_store.cc:276] 0709 12:20:22.502525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.502654 (+   129us) service_pool.cc:224] Handling call
0709 12:20:22.532240 (+ 29586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:23.092752 (+560512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:23.716917 (+624165us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b540011b7d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:20:23.717117 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1283980160}
I20260709 12:20:23.732852 12276 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:23.740852 10832 catalog_manager.cc:5697] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 3 to 5, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 5 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:23.761415 12333 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60028 (request call id 59) took 1964 ms. Trace:
W20260709 12:20:23.778684 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 275207us
W20260709 12:20:23.781060 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 311159us
I20260709 12:20:23.759526 12276 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:23.797400 12262 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:23.804399 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:20:23.819996 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 411001us
I20260709 12:20:23.823027 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:23.848546 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:23.859030 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:23.830258 12293 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:23.859824 11003 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:23.865151 10899 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:23.866039 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:23.830853 12261 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:23.813350 12262 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:23.869071 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:23.838724 12323 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:23.880409 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:23.917304 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 45193.6us
I20260709 12:20:23.877245 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:23.866940 12090 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:23.918622 10932 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 3: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:23.919092 12090 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:23.879036 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:23.921180 12345 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:23.921762 12345 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:23.778198 12333 rpcz_store.cc:276] 0709 12:20:21.821851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.826352 (+  4501us) service_pool.cc:224] Handling call
0709 12:20:22.037082 (+210730us) ts_tablet_manager.cc:1151] Deleting tablet 38e2bba2f11943899027eb26325e2b6a
0709 12:20:22.051323 (+ 14241us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:20:23.234154 (+1182831us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:23.497119 (+262965us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:23.755134 (+258015us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":357120,"tablet-delete.queue_time_us":137526,"thread_start_us":86939,"threads_started":1}
I20260709 12:20:23.916023 12229 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:23.962188 11003 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:20:23.878404 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 45303.9us
I20260709 12:20:24.020241 12276 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:24.023579 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 1016) took 1474 ms. Trace:
I20260709 12:20:24.024492 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:20:24.037941 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 310910us
I20260709 12:20:23.947985 12098 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:20:24.027207 11078 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.004s	sys 0.032s
I20260709 12:20:24.035225 11007 rpcz_store.cc:276] 0709 12:20:22.549594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.559539 (+  9945us) service_pool.cc:224] Handling call
0709 12:20:22.559823 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:22.564682 (+  4859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:22.564712 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:22.577735 (+ 13023us) log.cc:844] Serialized 26 byte log entry
0709 12:20:23.350720 (+772985us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b18002d36a0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b 00007f9bb0affd23 00007f9bb0b000d1 00007f9bb0f1ba0f
0709 12:20:23.689143 (+338423us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b4800130158. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb5e89aa1 00007f9bb5e80b37 00007f9bb5e809ca 00007f9bb5f7826f 00007f9bb5f77f37 00007f9bb5f8c55c 00007f9bb5f8c508 00007f9bb5f8c488 00007f9bb5f8c443 00007f9bb5f8b6ec 00007f9bb4eb5a96
0709 12:20:23.767916 (+ 78773us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:23.767962 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:23.768033 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:24.023350 (+255317us) raft_consensus.cc:1685] finished
0709 12:20:24.023371 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:24.023494 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11338,"raft.run_cpu_time_us":19537,"raft.run_wall_time_us":1109317,"spinlock_wait_cycles":18302208,"thread_start_us":396750,"threads_started":1,"wal-append.queue_time_us":1362414}
I20260709 12:20:23.938887 12213 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:20:24.040086 11078 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.004s	sys 0.032s
I20260709 12:20:23.964717 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:23.942009 12323 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:24.044600 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 304553us
I20260709 12:20:23.916472 12261 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:24.050365 11080 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.020s	sys 0.012s
W20260709 12:20:24.043064 12404 log.cc:927] Time spent T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 12:20:24.027637 12053 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:20:24.051738 11080 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.021s	sys 0.012s
I20260709 12:20:24.045456 12098 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.047849 12276 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:20:24.061810 12346 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.010s	sys 0.024s
I20260709 12:20:24.051354 12236 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:24.060827 11953 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:24.044596 12213 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.076488 11953 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.078881 11953 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:24.081697 12262 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:24.072213 12346 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.010s	sys 0.024s
I20260709 12:20:24.068679 12053 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.070262 12276 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.108399 12424 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:24.151827 12427 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:24.153769 12412 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:20:24.199252 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 152641us
I20260709 12:20:24.187791 12262 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:24.145045 12424 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.206351 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.196782 11953 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:24.219506 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:24.220979 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:24.207042 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.209658 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.210203 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.197976 12277 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:24.206314 12098 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:24.202247 11050 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:24.204514 12261 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:24.230746 11083 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:24.240171 11050 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:24.206501 12412 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.208923 12262 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.243881 12262 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:24.244735 12213 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:24.245793 12053 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:24.246439 12053 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:24.245884 12213 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:24.205547 12427 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:24.251385 12427 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:24.256560 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.258384 12276 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:24.259331 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:24.260602 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:24.261693 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:24.268131 12346 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:24.238098 12415 consensus_queue.cc:1059] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:20:24.271350 12276 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.275238 10929 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:24.276309 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:24.237739 12098 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:24.277494 10930 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
W20260709 12:20:24.247329 12422 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:20:24.279718 12438 raft_consensus.cc:3055] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:24.229270 11953 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.295233 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:24.233875 12277 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.284416 12438 raft_consensus.cc:740] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:24.280519 12379 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:24.272013 12276 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.305138 12424 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:24.319591 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 828) took 1549 ms. Trace:
W20260709 12:20:24.322198 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 80800.4us
I20260709 12:20:24.320120 10934 rpcz_store.cc:276] 0709 12:20:22.767382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.782283 (+ 14901us) service_pool.cc:224] Handling call
0709 12:20:22.782791 (+   508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:22.797188 (+ 14397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:22.797220 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:22.832048 (+ 34828us) log.cc:844] Serialized 26 byte log entry
0709 12:20:23.569076 (+737028us) spinlock_profiling.cc:243] Waited 9.46 ms on lock 0x7b1800247660. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b 00007f9bb0affd23 00007f9bb0b000d1 00007f9bb0f1ba0f
0709 12:20:24.064436 (+495360us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:24.064474 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:24.064538 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:24.313430 (+248892us) raft_consensus.cc:1685] finished
0709 12:20:24.313458 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:24.316863 (+  3405us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42486,"raft.queue_time_us":20300,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":22530,"spinlock_wait_cycles":21766912,"thread_start_us":495171,"threads_started":1,"wal-append.queue_time_us":1272386}
I20260709 12:20:24.316004 12090 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:24.333539 12277 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:24.307940 12379 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.335952 12379 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:24.337170 11953 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:24.338479 12438 consensus_queue.cc:260] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.340001 12438 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:24.340906 12323 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:24.345530 12229 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:24.346189 12229 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.349813 12261 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:24.350435 12261 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.332305 12098 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:24.352746 12261 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:24.353207 12098 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.355367 12260 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:24.353416 12261 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:24.355875 12229 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:24.356258 12261 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.358199 12261 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:24.355916 12260 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.364104 12345 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:24.365347 12098 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:24.353953 12336 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:24.366148 12336 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.367956 12336 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:24.362426 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:24.369454 10900 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:24.370079 12336 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:24.372561 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:24.373250 10935 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:20:24.374316 12276 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:20:24.385484 12411 log.cc:927] Time spent T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.313s	user 0.002s	sys 0.000s
I20260709 12:20:24.373503 12260 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:24.420652 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.350880 10818 catalog_manager.cc:5028] TS 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): tablet 38e2bba2f11943899027eb26325e2b6a (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:20:24.449895 10830 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 26) took 2103 ms. Trace:
I20260709 12:20:24.488452 12401 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:24.488674 12325 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:24.489078 12401 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.489434 12325 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.491413 12401 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:24.491631 12325 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:24.493089 10818 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 167714us
I20260709 12:20:24.485062 12412 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:24.497838 11051 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:24.495800 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.501935 12412 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:24.504694 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 976) took 1126 ms. Trace:
I20260709 12:20:24.505136 11084 rpcz_store.cc:276] 0709 12:20:23.378570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.379003 (+   433us) service_pool.cc:224] Handling call
0709 12:20:23.379265 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:23.385167 (+  5902us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:23.385196 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:23.385628 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 12:20:23.808480 (+422852us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:23.808516 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:23.808579 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:24.384869 (+576290us) spinlock_profiling.cc:243] Waited 9.21 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:20:24.504401 (+119532us) raft_consensus.cc:1685] finished
0709 12:20:24.504422 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:24.504632 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8094,"raft.queue_time_us":6423,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":13714,"spinlock_wait_cycles":21191936,"thread_start_us":422576,"threads_started":1,"wal-append.queue_time_us":673808}
I20260709 12:20:24.507046 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.511792 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.491537 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.514357 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.515488 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.519266 10977 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:24.524813 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.525542 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.528424 11050 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:24.518128 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.539191 10977 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:24.530776 12262 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:24.545805 11051 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:24.542572 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:24.484215 10830 rpcz_store.cc:276] 0709 12:20:22.357330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.359951 (+  2621us) service_pool.cc:224] Handling call
0709 12:20:24.449823 (+2089872us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:22.941691 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:23.106646 (+164955us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:23.107747 (+  1101us) write_op.cc:435] Acquired schema lock
0709 12:20:23.115933 (+  8186us) tablet.cc:662] Decoding operations
0709 12:20:23.172970 (+ 57037us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:23.173041 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:23.173071 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:23.173312 (+   241us) tablet.cc:701] Row locks acquired
0709 12:20:23.173327 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:20:23.173487 (+   160us) write_op.cc:270] Start()
0709 12:20:23.173618 (+   131us) write_op.cc:276] Timestamp: P: 1783599623173438 usec, L: 0
0709 12:20:23.173643 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:20:23.174408 (+   765us) log.cc:844] Serialized 594 byte log entry
0709 12:20:24.136785 (+962377us) op_driver.cc:464] REPLICATION: finished
0709 12:20:24.243314 (+106529us) write_op.cc:301] APPLY: starting
0709 12:20:24.243415 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:24.243542 (+   127us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:24.243662 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:24.243961 (+   299us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:24.244130 (+   169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:20:24.244176 (+    46us) write_op.cc:312] APPLY: finished
0709 12:20:24.245731 (+  1555us) log.cc:844] Serialized 22 byte log entry
0709 12:20:24.245920 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:24.246015 (+    95us) write_op.cc:454] Released schema lock
0709 12:20:24.246058 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:24.246476 (+   418us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:24.246505 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5601,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":98341,"apply.run_cpu_time_us":2087,"apply.run_wall_time_us":6270,"num_ops":1,"prepare.queue_time_us":368930,"prepare.run_cpu_time_us":11120,"prepare.run_wall_time_us":296723,"raft.queue_time_us":587788,"raft.run_cpu_time_us":10362,"raft.run_wall_time_us":97298,"replication_time_us":933792,"thread_start_us":746387,"threads_started":4,"wal-append.queue_time_us":200727}]]}
I20260709 12:20:24.545094 10977 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:24.550185 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:24.558687 11051 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:24.544580 12400 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:24.544559 12325 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:24.549400 10833 catalog_manager.cc:5697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 2 to 3, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 3 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:24.555550 12293 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:24.551833 12410 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:24.546180 12053 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:20:24.551012 12274 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:24.579768 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.580426 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.580708 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.581386 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:24.582289 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.582957 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.583097 10928 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:20:24.594193 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:24.594570 10928 pending_rounds.cc:85] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 1
I20260709 12:20:24.594898 10928 pending_rounds.cc:107] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:20:24.595131 10928 raft_consensus.cc:2889] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:24.583895 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:24.587037 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:24.588457 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:24.589871 12401 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:24.592263 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:24.600559 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:24.600807 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:24.564172 12236 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.574442 12438 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:24.596809 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.606616 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:24.577673 12293 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:24.609314 10899 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:24.622172 10899 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:24.624285 10899 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:24.625876 10899 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:24.627918 12409 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:24.628374 12409 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:24.628754 12409 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:24.628520 12323 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:24.615530 12236 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:24.631436 12449 log.cc:927] Time spent T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:20:24.633455 12236 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:24.634689 12229 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:24.611348 12438 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:24.619838 12293 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:24.618880 12387 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:24.622556 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:24.581511 12325 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:24.641603 12438 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:24.662962 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.663321 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.614398  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:24.671697 10833 catalog_manager.cc:5697] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 4 to 5, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 5 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:24.687296 12427 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:24.688055 12427 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:24.693483 11007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37578
I20260709 12:20:24.694232 11007 raft_consensus.cc:606] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:20:24.697983 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.698997 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.703986 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:20:24.725425 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 149874us
I20260709 12:20:24.742115 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.747524 12262 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:24.756356 12262 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.752568 11011 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37578
I20260709 12:20:24.760988 11011 raft_consensus.cc:606] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:20:24.767383 11624 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:24.768141 12325 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:24.768522 12427 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:24.769146 12427 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:24.770581 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.770924 12262 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:24.772393 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.773255 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.773643 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.773865 11004 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:24.774859 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.775887 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.776079 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.776628 12344 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.784060 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.784744 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.785408 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.790417 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.793939 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:24.794514 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:24.811955 10977 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:24.820351 10977 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:24.775842 12293 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.819878 12410 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:24.830818 10977 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:24.832168 10977 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:24.783027 12438 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:24.823429 10820 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for f1f6166d836f41229df11ee42cd8e4c7 already in progress [suppressed 57 similar messages]
I20260709 12:20:24.834942 12229 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.824473 12402 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:24.840227 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:24.796247 12344 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.837628 12293 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:20:24.844656 12450 log.cc:927] Time spent T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:20:24.841472 12167 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:24.843187 12392 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:24.848981 10901 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:24.853022 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.846616 11953 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:24.840287 12229 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.867816 11624 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:24.867110 10901 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:24.873848 12455 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:24.846683 12409 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.873086 12236 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:24.874091 12325 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:20:24.873951 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 50729.6us
I20260709 12:20:24.889364 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.893955 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.887823 12274 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:24.896908 12274 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.885335 12438 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:24.903211 12344 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:24.907435 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.907722 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.908679 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.911052 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.914348 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:24.886672 12347 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:24.929189 12347 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:24.931384 12347 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:24.931761 10832 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35608 (request call id 141) took 4059 ms. Trace:
I20260709 12:20:24.933126 10833 catalog_manager.cc:5697] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:24.932152 10832 rpcz_store.cc:276] 0709 12:20:20.872257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.872586 (+   329us) service_pool.cc:224] Handling call
0709 12:20:20.941295 (+ 68709us) spinlock_profiling.cc:243] Waited 61.6 ms on lock 0x7b5400096d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0eca090 00007f9bb0f68f3a 00007f9bb6d1ee9c 00007f9bb6e1d04e 00007f9bb52de2a4 00007f9bb52de232 00007f9bb52de161 00007f9bb52de0dc 00007f9bb52dd392 00007f9baf29b48c 00007f9baf29a8c6
0709 12:20:24.931668 (+3990373us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:24.200758 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:24.261009 (+ 60251us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:24.261053 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:20:24.261079 (+    26us) tablet.cc:662] Decoding operations
0709 12:20:24.261985 (+   906us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:24.262049 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:24.262088 (+    39us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:20:24.262604 (+   516us) tablet.cc:701] Row locks acquired
0709 12:20:24.262624 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:20:24.262795 (+   171us) write_op.cc:270] Start()
0709 12:20:24.262919 (+   124us) write_op.cc:276] Timestamp: P: 1783599624262746 usec, L: 0
0709 12:20:24.262942 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:20:24.305622 (+ 42680us) log.cc:844] Serialized 2459 byte log entry
0709 12:20:24.345053 (+ 39431us) op_driver.cc:464] REPLICATION: finished
0709 12:20:24.361746 (+ 16693us) write_op.cc:301] APPLY: starting
0709 12:20:24.363225 (+  1479us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:24.364052 (+   827us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:24.364143 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:24.364944 (+   801us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:24.365121 (+   177us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:20:24.365171 (+    50us) write_op.cc:312] APPLY: finished
0709 12:20:24.365430 (+   259us) log.cc:844] Serialized 52 byte log entry
0709 12:20:24.365605 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:24.365710 (+   105us) write_op.cc:454] Released schema lock
0709 12:20:24.365754 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:24.366048 (+   294us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:24.366073 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":230815,"reported_tablets":21,"spinlock_wait_cycles":141722880,"child_traces":[["op",{"apply.queue_time_us":9406,"apply.run_cpu_time_us":2406,"apply.run_wall_time_us":5372,"num_ops":6,"prepare.queue_time_us":379292,"prepare.run_cpu_time_us":4801,"prepare.run_wall_time_us":117862,"replication_time_us":81953,"thread_start_us":298020,"threads_started":1}]]}
I20260709 12:20:24.936309 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.910040 12409 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:24.937846 12274 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:24.903378 12130 raft_consensus.cc:993] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 0b171b6aaedc4f809f2753dcfadb14ce to start an election
I20260709 12:20:24.943684 12421 raft_consensus.cc:1081] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Signalling peer 0b171b6aaedc4f809f2753dcfadb14ce to start an election
I20260709 12:20:24.946977 11656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7"
dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
 from {username='slave'} at 127.0.0.1:59398
I20260709 12:20:24.947785 11656 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:24.948248 11656 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:24.934971 10833 catalog_manager.cc:5697] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 1 to 3, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 3 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:24.952522 10833 catalog_manager.cc:5697] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 3 to 4, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 4 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:24.954845 11002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37578
I20260709 12:20:24.956477 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:24.958943 11002 raft_consensus.cc:606] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:20:24.959645 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.960093 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.956755 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:24.957968 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:24.963151 11083 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:20:24.977535 11050 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:24.972858 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:24.981329 11050 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:20:24.981666 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 104077us
I20260709 12:20:24.982553 12293 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:20:24.988682 10882 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:20:24.989193 10882 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for f1f6166d836f41229df11ee42cd8e4c7 already in progress
W20260709 12:20:24.989498 10882 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for f1f6166d836f41229df11ee42cd8e4c7 already in progress
I20260709 12:20:24.983615 12229 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:24.993537 11079 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:25.002369 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:25.005656 11050 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:24.982613 12053 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:25.001513 10901 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:25.016040 10901 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:25.019470 11050 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:25.017541 12229 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:25.020589 12459 log.cc:927] Time spent T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:20:25.021566 11656 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:25.020546 12053 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:25.008371 12344 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:25.025511 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:25.026198 10931 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:25.037348 11050 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:25.043475 10901 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:25.047945 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:25.048172 11050 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:25.048625 11079 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:25.050175 10899 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:25.054489 10974 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:25.055907 10974 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:25.058481 12277 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:25.060770 12277 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:25.062305 10974 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:25.044028 12347 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:25.063964 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:25.062672 10901 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:25.064608 11011 raft_consensus.cc:3055] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:25.064942 11011 raft_consensus.cc:740] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:25.065407 10901 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:25.062122 12460 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:25.065706 11011 consensus_queue.cc:260] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:25.061293 12277 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:25.070026 11011 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:25.070708 10974 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:25.053066 12458 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:25.082106 10974 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:25.082360 10901 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:25.057958 12421 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:25.084585 11050 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:25.084913 12283 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:25.097221 10901 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:25.069248 12212 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:25.103227 12212 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:25.103739 12212 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:25.103969 12412 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:25.083554 11656 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:25.105825 12376 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:25.107451 10974 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:25.081468 12458 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:25.083251 12382 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:25.108953 12451 consensus_queue.cc:1059] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:25.102371 10901 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:25.072719 12409 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:25.081936 11953 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:25.083817 12305 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:25.125044 11011 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 4.
I20260709 12:20:25.130210 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:25.132853 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:25.133139 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:25.134522 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:25.136698 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:25.140074 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:25.145952 12277 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:25.137624 12401 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:25.149108 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:25.142717 12280 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:25.149366 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:25.113616 12392 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:20:25.114604 12236 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:25.117911 12424 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:25.156350 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:25.157037 11080 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:25.113740 12458 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:25.173712 11659 raft_consensus.cc:1240] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:25.177906 11051 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:25.179525 12423 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:25.179661 11051 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:25.180569 12293 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:25.182401 11051 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:25.188683 10931 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 4.
I20260709 12:20:25.193486 11625 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:25.194650 12455 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:25.195201 12455 raft_consensus.cc:697] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:20:25.175719 12212 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:25.196372 12455 consensus_queue.cc:237] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:25.197356 12167 raft_consensus.cc:3055] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:25.197795 12167 raft_consensus.cc:740] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:25.198628 12167 consensus_queue.cc:260] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:25.199156 11080 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 4.
I20260709 12:20:25.200517 12458 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:25.201540 10936 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:25.204980 10901 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:25.206604 12409 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:25.208683 12424 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:25.209149 11051 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:25.210274 12347 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:25.210628 11051 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:25.222633 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:25.202889 12167 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.216409 12423 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:25.214418 12212 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:25.220825 12053 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:25.288070 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 47283.1us
I20260709 12:20:25.294447 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:25.266459 12344 consensus_queue.cc:1059] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:20:25.242635 12423 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:25.316299 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:25.323825 12458 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:25.339347 12423 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:25.343492 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:25.357366 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:25.383002 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:25.388217 11051 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:25.389510 11084 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5. Ops: []
W20260709 12:20:25.390782 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 101408us
W20260709 12:20:25.397078 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 101737us
I20260709 12:20:25.397926 11010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
W20260709 12:20:25.403852 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 47293.9us
I20260709 12:20:25.398773 11010 raft_consensus.cc:606] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:25.398433 12438 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:25.410954 12392 consensus_queue.cc:1059] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:20:25.425460 12392 raft_consensus.cc:3055] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:25.425812 12392 raft_consensus.cc:740] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:25.426620 12392 consensus_queue.cc:260] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:25.427767 12392 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:25.458421 12438 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.459022 12438 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:25.459450 12445 raft_consensus.cc:3055] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:25.460003 12445 raft_consensus.cc:740] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:25.461339 12445 consensus_queue.cc:260] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:25.462998 12445 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:25.468389 10899 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:25.469527 12481 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:25.471045 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:25.471751 11004 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:25.474231 11050 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:25.475736 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:25.474961 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:25.471027 12438 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:25.476583 12438 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:25.476941 12438 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.477283 12438 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:25.480855 10977 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:25.482092 12477 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:25.482970 11080 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:25.494014 10933 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:25.495409 10930 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:25.499500 12477 consensus_queue.cc:1059] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:25.500664 12477 raft_consensus.cc:3055] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:25.501794 12477 raft_consensus.cc:740] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:25.502751 12477 consensus_queue.cc:260] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:25.505388 12477 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:25.523897 12438 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:25.528903 11004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37578
I20260709 12:20:25.537972 11004 raft_consensus.cc:606] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:20:25.539979 11004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:25.540772 11004 raft_consensus.cc:606] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:25.541174 11004 raft_consensus.cc:614] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:25.543385 10899 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:25.540820 10830 catalog_manager.cc:5697] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 3 to 4, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 4 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:25.533756 10834 catalog_manager.cc:5697] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 1 to 2, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 2 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:25.543042 11010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37578
I20260709 12:20:25.543879 11004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:25.544528 12336 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:25.545006 11004 raft_consensus.cc:606] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:25.545176 12336 raft_consensus.cc:697] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:25.546429 12336 consensus_queue.cc:237] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:25.545241 10834 catalog_manager.cc:5697] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:25.544631 11010 raft_consensus.cc:606] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:20:25.548892 10834 catalog_manager.cc:5697] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 1 to 2, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 2 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:25.548082 11004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:25.552304 11004 raft_consensus.cc:606] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:25.553049 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:25.562693 12477 consensus_queue.cc:1059] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:25.563654 12167 raft_consensus.cc:3055] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:25.564072 12167 raft_consensus.cc:740] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:25.564914 12167 consensus_queue.cc:260] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:25.566264 12167 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:25.574090 12438 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:25.576270 10834 catalog_manager.cc:5697] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 1 to 3, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 3 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:25.578292 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:25.581844 11010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37578
I20260709 12:20:25.588406 11004 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:25.588469 11010 raft_consensus.cc:606] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:20:25.530825 10833 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35614 (request call id 139) took 3469 ms. Trace:
I20260709 12:20:25.587327 10834 catalog_manager.cc:5697] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 1 to 2, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 2 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:25.597558 11004 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
W20260709 12:20:25.598289 10882 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:20:25.598712 10882 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 0774d95f5c1b4bdb990e50f5d858b600 already in progress
W20260709 12:20:25.598979 10882 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 0774d95f5c1b4bdb990e50f5d858b600 already in progress
I20260709 12:20:25.599144 11050 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:25.602672 12438 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:25.603193 12438 raft_consensus.cc:697] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:25.604347 12438 consensus_queue.cc:237] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:25.589805 10833 rpcz_store.cc:276] 0709 12:20:22.061739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.061893 (+   154us) service_pool.cc:224] Handling call
0709 12:20:25.530753 (+3468860us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:25.141970 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:25.160449 (+ 18479us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:25.160483 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:20:25.160501 (+    18us) tablet.cc:662] Decoding operations
0709 12:20:25.161155 (+   654us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:25.161211 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:25.161238 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:20:25.161766 (+   528us) tablet.cc:701] Row locks acquired
0709 12:20:25.161785 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:20:25.161935 (+   150us) write_op.cc:270] Start()
0709 12:20:25.162056 (+   121us) write_op.cc:276] Timestamp: P: 1783599625161886 usec, L: 0
0709 12:20:25.162178 (+   122us) op_driver.cc:348] REPLICATION: starting
0709 12:20:25.171613 (+  9435us) log.cc:844] Serialized 2135 byte log entry
0709 12:20:25.239874 (+ 68261us) op_driver.cc:464] REPLICATION: finished
0709 12:20:25.500052 (+260178us) write_op.cc:301] APPLY: starting
0709 12:20:25.500233 (+   181us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:25.500420 (+   187us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:25.500540 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:25.513095 (+ 12555us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:25.513267 (+   172us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:20:25.513308 (+    41us) write_op.cc:312] APPLY: finished
0709 12:20:25.513766 (+   458us) log.cc:844] Serialized 46 byte log entry
0709 12:20:25.513924 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:25.514424 (+   500us) write_op.cc:454] Released schema lock
0709 12:20:25.514469 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:25.514822 (+   353us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:25.514848 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":386849,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":259940,"apply.run_cpu_time_us":2611,"apply.run_wall_time_us":14746,"num_ops":5,"prepare.queue_time_us":83280,"prepare.run_cpu_time_us":3921,"prepare.run_wall_time_us":53663,"replication_time_us":77514,"thread_start_us":248451,"threads_started":2}]]}
I20260709 12:20:25.634696 10832 catalog_manager.cc:5697] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 2 to 4, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 4 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:25.644840 12477 raft_consensus.cc:993] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:25.645371 12477 raft_consensus.cc:1081] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:25.645543 10928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:20:25.646152 10928 raft_consensus.cc:606] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:25.646492 10928 raft_consensus.cc:614] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:25.639010 10832 catalog_manager.cc:5697] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 2 to 3, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 3 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:25.651162 11004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:25.651800 11004 raft_consensus.cc:606] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Received request to transfer leadership to TS 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:25.652158 11004 raft_consensus.cc:614] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:25.651094 11080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:20:25.653287 10832 catalog_manager.cc:5697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:25.648975 11083 consensus_queue.cc:237] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:25.655220 10832 catalog_manager.cc:5697] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 1 to 2, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 2 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:25.653692  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:20:25.657145 10832 catalog_manager.cc:5697] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 2 to 3, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 3 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:25.658761 10832 catalog_manager.cc:5697] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 2 to 3, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 3 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:25.659713 10832 catalog_manager.cc:5697] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 1 to 2, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 2 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:25.660089 10834 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35620 (request call id 134) took 3835 ms. Trace:
I20260709 12:20:25.654103 11080 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:25.658357  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:25.661178 11080 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:25.660668 10832 catalog_manager.cc:5697] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:25.666029 10928 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:25.690392 12455 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:25.660497 10834 rpcz_store.cc:276] 0709 12:20:21.824231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.827547 (+  3316us) service_pool.cc:224] Handling call
0709 12:20:22.082577 (+255030us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b5400096d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0eca090 00007f9bb0f68f3a 00007f9bb6d1ee9c 00007f9bb6e1d04e 00007f9bb52de2a4 00007f9bb52de232 00007f9bb52de161 00007f9bb52de0dc 00007f9bb52dd392 00007f9baf29b48c 00007f9baf29a8c6
0709 12:20:25.610482 (+3527905us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:25.610509 (+    27us) write_op.cc:454] Released schema lock
0709 12:20:25.660025 (+ 49516us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:25.599508 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:25.600038 (+   530us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:25.600073 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:20:25.600090 (+    17us) tablet.cc:662] Decoding operations
0709 12:20:25.600755 (+   665us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:25.600806 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:25.600834 (+    28us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:20:25.601328 (+   494us) tablet.cc:701] Row locks acquired
0709 12:20:25.601346 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:20:25.601476 (+   130us) write_op.cc:270] Start()
0709 12:20:25.601587 (+   111us) write_op.cc:276] Timestamp: P: 1783599625601432 usec, L: 0
0709 12:20:25.601623 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:20:25.602197 (+   574us) log.cc:844] Serialized 2078 byte log entry
0709 12:20:25.604066 (+  1869us) op_driver.cc:464] REPLICATION: finished
0709 12:20:25.604504 (+   438us) write_op.cc:301] APPLY: starting
0709 12:20:25.604587 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:25.604749 (+   162us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:25.604844 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:25.605577 (+   733us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:25.605737 (+   160us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:20:25.605782 (+    45us) write_op.cc:312] APPLY: finished
0709 12:20:25.605983 (+   201us) log.cc:844] Serialized 46 byte log entry
0709 12:20:25.606140 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:25.606233 (+    93us) write_op.cc:454] Released schema lock
0709 12:20:25.606274 (+    41us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":12230,"reported_tablets":14,"spinlock_wait_cycles":27400960,"child_traces":[["op",{"apply.queue_time_us":230,"apply.run_cpu_time_us":2042,"apply.run_wall_time_us":2036,"num_ops":5,"prepare.queue_time_us":109,"prepare.run_cpu_time_us":2968,"prepare.run_wall_time_us":2967,"replication_time_us":2328}]]}
I20260709 12:20:25.662336 12477 raft_consensus.cc:993] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 0b171b6aaedc4f809f2753dcfadb14ce to start an election
I20260709 12:20:25.707425 11080 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:25.709131 12402 raft_consensus.cc:1081] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Signalling peer 0b171b6aaedc4f809f2753dcfadb14ce to start an election
I20260709 12:20:25.717622 11659 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600"
dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
 from {username='slave'} at 127.0.0.1:59398
I20260709 12:20:25.718290 11659 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:25.718739 11659 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:25.740382  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:25.744187 12167 raft_consensus.cc:993] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:25.744701 12167 raft_consensus.cc:1081] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:25.741394 11083 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:25.747730 11004 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:25.749208 12455 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:25.752094 11656 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:25.752213 12438 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:25.753854 12347 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:25.755025 11084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:20:25.755615 11084 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:25.761121 11084 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:25.762944 11004 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:25.766633 12455 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:25.789499 11080 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:25.790292 11084 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:25.803416 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:25.839087 10931 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:25.796237 12376 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:25.844803 12376 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:25.854390 12376 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:25.848189 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:25.865232 11002 raft_consensus.cc:3055] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:25.865589 11002 raft_consensus.cc:740] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:25.866428 11002 consensus_queue.cc:260] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:25.891669 11002 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:25.895059 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:25.907838 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:25.908555 10930 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:25.912443 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:25.913283 11009 raft_consensus.cc:2368] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4.
I20260709 12:20:25.921448 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:25.922096 11005 raft_consensus.cc:3055] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:25.919647 11084 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:25.922379 11005 raft_consensus.cc:740] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:25.927358 10901 leader_election.cc:400] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4.
I20260709 12:20:25.928860 10901 leader_election.cc:403] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:25.928588 11005 consensus_queue.cc:260] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:25.936393 11005 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:25.940662 11002 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:25.946611 11050 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:25.952370 12402 raft_consensus.cc:993] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:25.959275 12402 raft_consensus.cc:1081] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:25.959152 11659 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:25.962641 11084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:20:25.963238 11084 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:25.963647 11084 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.945030 12212 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:20:25.979508 12486 log.cc:927] Time spent T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 12:20:25.956758 12423 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:25.991997 12423 raft_consensus.cc:697] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:25.992997 12423 consensus_queue.cc:237] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:26.020437 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 72565.1us
W20260709 12:20:26.020362 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 75126.8us
I20260709 12:20:26.033360 11659 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:26.048768 11084 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:26.054396 11084 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:26.055200 10930 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:26.053306 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:26.055922 11010 raft_consensus.cc:3055] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:26.056245 11010 raft_consensus.cc:740] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:26.061597 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:26.062276 10936 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:26.107992 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 152910us
I20260709 12:20:26.111896 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:26.112514 10935 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:26.072981 12396 log.cc:927] Time spent T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca: Append to log took a long time: real 0.120s	user 0.002s	sys 0.000s
I20260709 12:20:26.119894 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:26.120504 11080 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:26.122025 10936 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 4.
I20260709 12:20:26.124549 11082 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:26.057044 11010 consensus_queue.cc:260] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:26.183102 11080 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 4.
I20260709 12:20:26.188473 10931 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:26.204900 12479 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:26.206156 11010 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:26.206357 12212 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4.
I20260709 12:20:26.208010 10935 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:26.209302 11622 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:26.210121 12455 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:26.211169 11002 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:26.214102 12489 log.cc:927] Time spent T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
W20260709 12:20:26.215801 12490 log.cc:927] Time spent T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:20:26.215675 10930 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:20:26.216856 12488 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.082s	user 0.004s	sys 0.000s
I20260709 12:20:26.217548 11051 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:26.219704 11051 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:26.220140 12347 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:26.232692 11002 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:20:26.247277 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 293203us
I20260709 12:20:26.222430 12347 raft_consensus.cc:697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:26.246320 11010 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 4.
I20260709 12:20:26.259033 12493 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:26.267103 12347 consensus_queue.cc:237] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:26.270650 11005 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:26.274861 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:26.275501 11005 raft_consensus.cc:3055] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:26.275831 11005 raft_consensus.cc:740] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:26.276959 11005 consensus_queue.cc:260] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:26.278110 11005 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.287048 12323 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:20:26.336912 12455 raft_consensus.cc:697] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:20:26.340157 12455 consensus_queue.cc:237] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:26.341181 11005 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:26.351960 12293 raft_consensus.cc:2955] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:26.353358 10936 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 1. Current term is 2. Ops: []
W20260709 12:20:26.360586 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 140042us
I20260709 12:20:26.370476 12491 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:20:26.372318 10820 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0774d95f5c1b4bdb990e50f5d858b600 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2201bad9e18849b09cf82de29dd032d3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:26.404505 11004 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:26.406838 11010 raft_consensus.cc:2955] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:20:26.420428 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 51711.4us
I20260709 12:20:26.452277 12167 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.452828 12167 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:26.465049 12167 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:26.431684 11656 raft_consensus.cc:2955] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:26.459467 12492 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:20:26.473856 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:26.436159 12493 raft_consensus.cc:697] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:26.505436 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:26.506150 11082 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:26.532598 12493 consensus_queue.cc:237] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:26.545495 10974 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:26.553421 12514 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:26.553876 12514 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.554198 12514 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:26.557813 10818 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5e9e7be3e0bf4a1fa43f868eaf3e2c80 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:20:26.593055 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 87577.4us
I20260709 12:20:26.629926 11011 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:26.632164 10935 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:26.645771 12514 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:26.647635 12493 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:26.653221 12514 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:26.653419 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:26.654045 11082 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:26.660611 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:26.662276 11082 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:26.663467 10974 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:26.664198 12392 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:26.664703 12392 raft_consensus.cc:697] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:26.665548 12392 consensus_queue.cc:237] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:26.674842 12293 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:26.676757 10830 catalog_manager.cc:5697] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 3 to 4, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 4 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:26.679127 10830 catalog_manager.cc:5697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 3 to 5, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New cstate: current_term: 3 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:26.712294 10832 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35608 (request call id 142) took 1659 ms. Trace:
I20260709 12:20:26.712770 10832 rpcz_store.cc:276] 0709 12:20:25.052663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.052798 (+   135us) service_pool.cc:224] Handling call
0709 12:20:26.711835 (+1659037us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:25.796319 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:25.807309 (+ 10990us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:25.807343 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:20:25.807356 (+    13us) tablet.cc:662] Decoding operations
0709 12:20:25.808174 (+   818us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:25.808229 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:25.808254 (+    25us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:20:25.808896 (+   642us) tablet.cc:701] Row locks acquired
0709 12:20:25.808914 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:20:25.850652 (+ 41738us) write_op.cc:270] Start()
0709 12:20:25.882850 (+ 32198us) write_op.cc:276] Timestamp: P: 1783599625809007 usec, L: 0
0709 12:20:25.882885 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:20:25.942524 (+ 59639us) log.cc:844] Serialized 3233 byte log entry
0709 12:20:26.440815 (+498291us) op_driver.cc:464] REPLICATION: finished
0709 12:20:26.597917 (+157102us) write_op.cc:301] APPLY: starting
0709 12:20:26.598006 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:26.598262 (+   256us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:26.598379 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:26.624256 (+ 25877us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:26.624456 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:20:26.624501 (+    45us) write_op.cc:312] APPLY: finished
0709 12:20:26.624777 (+   276us) log.cc:844] Serialized 64 byte log entry
0709 12:20:26.656974 (+ 32197us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:26.657096 (+   122us) write_op.cc:454] Released schema lock
0709 12:20:26.657145 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:26.685816 (+ 28671us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:26.685850 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7042,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":152845,"apply.run_cpu_time_us":2823,"apply.run_wall_time_us":71238,"num_ops":8,"prepare.queue_time_us":1581,"prepare.run_cpu_time_us":5846,"prepare.run_wall_time_us":150426,"replication_time_us":551918,"thread_start_us":78031,"threads_started":1}]]}
I20260709 12:20:26.790540 10832 catalog_manager.cc:5697] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 2 to 3, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 3 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:26.791909 10919 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e9e7be3e0bf4a1fa43f868eaf3e2c80 with delete_type TABLET_DATA_TOMBSTONED (TS 9e8170bbe8244e40a2b2e5011e69b697 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:43546
I20260709 12:20:26.792332 10832 catalog_manager.cc:5697] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 3 to 4, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 4 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:26.793993 10832 catalog_manager.cc:5697] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:26.795564 12535 tablet_replica.cc:333] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:20:26.804366 12502 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:26.808928 12081 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:26.810653 12508 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.813928 12502 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:26.813949 12081 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:26.816344 12502 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:26.817176 12535 raft_consensus.cc:2243] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:26.817562 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:26.818194 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:26.818778 11009 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:26.816344 12081 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:26.817968 12535 raft_consensus.cc:2272] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:26.820034 11050 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:26.820919 12502 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:26.820283 12508 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:26.826354 12508 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:26.826903 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:26.827842 10935 raft_consensus.cc:2393] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 5: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:26.826927 12535 ts_tablet_manager.cc:1916] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:26.831049 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:26.831763 11009 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:26.833001 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:26.840073 11009 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:26.842211 11050 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:26.843045 12508 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:26.843511 12508 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.843971 12508 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:26.844236 12493 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:26.846715 12502 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:26.847148 12502 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:26.828236 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:26.854437 12508 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:26.855216 11080 raft_consensus.cc:2368] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 2. Current term is 3.
I20260709 12:20:26.856810 10899 leader_election.cc:400] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 2. Current term is 3.
I20260709 12:20:26.857120 10899 leader_election.cc:403] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:26.857707 12305 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:26.869050 12305 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 2. Current term is 3.
I20260709 12:20:26.870100 12502 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:26.873878 12508 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:26.875504 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:26.876165 11009 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:26.876154 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:26.879783 10935 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:26.883423 11009 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:20:26.892287 11050 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:26.905638 12502 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:26.910080 12293 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:26.911980 12492 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:26.922521 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:26.918460 12293 raft_consensus.cc:697] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:26.930487 12293 consensus_queue.cc:237] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:26.927393 12438 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:26.934280 12438 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:26.936581 12438 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:26.923394 10928 raft_consensus.cc:2393] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 5: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:26.939493 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:26.940218 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:26.940225 11011 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:26.940569 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:26.942312 11050 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:26.939119 11656 consensus_queue.cc:237] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:26.940999 10927 raft_consensus.cc:2393] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 5: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:26.949599 10928 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:26.951282 12455 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:26.954820 12438 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:26.956213 12438 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:26.956807 10936 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:26.961916 12518 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:26.968209 11080 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:26.956817 12438 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:26.979537 11009 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:26.989446 10931 raft_consensus.cc:2955] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:26.990906 11050 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:26.979453 12518 raft_consensus.cc:2955] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 3 to 6, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:26.970233 12535 ts_tablet_manager.cc:1929] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:20:26.984368 11011 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:26.993268 12229 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:26.993654 12502 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:26.987607 12519 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:26.993870 12229 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:26.994676 12455 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:26.995995 12535 log.cc:1199] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 9e8170bbe8244e40a2b2e5011e69b697: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-0-root/wals/5e9e7be3e0bf4a1fa43f868eaf3e2c80
I20260709 12:20:26.997092 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:26.996085 12229 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:27.000384 11011 raft_consensus.cc:2368] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6.
I20260709 12:20:27.003283 11080 raft_consensus.cc:2955] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:27.004750 10821 catalog_manager.cc:5028] TS 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): tablet 5e9e7be3e0bf4a1fa43f868eaf3e2c80 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:20:27.001009 10832 catalog_manager.cc:5697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 4 to 5, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 5 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:27.007751 11011 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:27.010633 12492 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:27.008920 12502 raft_consensus.cc:697] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:27.012948 10901 leader_election.cc:400] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6.
I20260709 12:20:27.012677 12502 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:27.013283 10901 leader_election.cc:403] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:27.015364 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:27.012965 12438 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:27.017756 12229 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:20:27.036505 10834 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35620 (request call id 135) took 1192 ms. Trace:
I20260709 12:20:27.051632 10931 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:27.052886 10832 catalog_manager.cc:5697] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: config changed from index 3 to 6, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New cstate: current_term: 4 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:27.040424 10834 rpcz_store.cc:276] 0709 12:20:25.844316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.844499 (+   183us) service_pool.cc:224] Handling call
0709 12:20:27.036424 (+1191925us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23927,"reported_tablets":22}
I20260709 12:20:27.060432 10833 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35614 (request call id 140) took 1367 ms. Trace:
I20260709 12:20:27.061044 10833 rpcz_store.cc:276] 0709 12:20:25.693512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.694102 (+   590us) service_pool.cc:224] Handling call
0709 12:20:27.060359 (+1366257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53071,"reported_tablets":24}
I20260709 12:20:27.057853 12383 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:20:27.071945 12229 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6.
I20260709 12:20:27.073505 11084 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:27.090981 10936 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:27.091392 12519 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:27.094715 10995 tablet_service.cc:1558] Processing DeleteTablet for tablet f1f6166d836f41229df11ee42cd8e4c7 with delete_type TABLET_DATA_TOMBSTONED (TS 2201bad9e18849b09cf82de29dd032d3 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:37578
I20260709 12:20:27.098086 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:27.103679 12438 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:27.110544 11009 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:27.112531 11050 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:27.115605 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:27.116379 10936 raft_consensus.cc:2393] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 5: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:27.119622 12445 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:27.117331 12507 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:27.121644 12507 raft_consensus.cc:697] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:27.122582 12507 consensus_queue.cc:237] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:27.137493 10819 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f1f6166d836f41229df11ee42cd8e4c7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:27.189163 11077 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:27.171921 10832 catalog_manager.cc:5697] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:27.200812 10832 catalog_manager.cc:5697] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 1 to 2, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 2 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:27.192760 12494 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:20:27.208636 12544 tablet_replica.cc:333] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:20:27.209767 12544 raft_consensus.cc:2243] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:27.210494 12544 raft_consensus.cc:2272] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:27.214008 12544 ts_tablet_manager.cc:1916] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:27.276250 12544 ts_tablet_manager.cc:1929] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:20:27.278307 12544 log.cc:1199] T f1f6166d836f41229df11ee42cd8e4c7 P 2201bad9e18849b09cf82de29dd032d3: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-1-root/wals/f1f6166d836f41229df11ee42cd8e4c7
I20260709 12:20:27.280491 10820 catalog_manager.cc:5028] TS 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): tablet f1f6166d836f41229df11ee42cd8e4c7 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
W20260709 12:20:27.288930 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 60904.9us
I20260709 12:20:27.289495 10830 catalog_manager.cc:5697] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 4 to 5, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 5 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.291622 10830 catalog_manager.cc:5697] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 4 to 6, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 6 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.301600 10995 tablet_service.cc:1558] Processing DeleteTablet for tablet f1f6166d836f41229df11ee42cd8e4c7 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 6)) from {username='slave'} at 127.0.0.1:37578
I20260709 12:20:27.304495 10830 catalog_manager.cc:5697] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 4 to 5, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 5 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.309360 10820 catalog_manager.cc:5028] TS 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): tablet f1f6166d836f41229df11ee42cd8e4c7 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:20:27.320504 11002 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:27.322841 12507 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:27.341976 12081 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.342541 12081 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:27.344712 12081 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:27.345345 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:27.346114 11005 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:27.346771 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:27.347402 10901 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:27.349052 12081 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:27.349428 12081 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.349752 12081 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:27.355463 12081 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:27.357231 12081 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:27.358165 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:27.358439 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:27.358793 11005 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:27.366627 11005 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:20:27.367779 10901 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:27.369063 12229 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:27.369551 12229 raft_consensus.cc:697] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:27.370437 12229 consensus_queue.cc:237] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:27.376890 10935 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:27.379698 12507 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:27.421814 10832 catalog_manager.cc:5697] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 5 to 6, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 6 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:27.463838 12229 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.464427 12229 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:27.468007 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:27.472455 11011 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:27.475056 10901 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:27.476334 12549 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:27.476733 12549 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.477038 12549 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:27.479557  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:27.468886 12229 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:27.468007 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:27.490339 12549 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:27.493697 12549 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:27.496203 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:27.496838 11005 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:27.497486 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:27.515337 10935 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:27.503640 11005 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:20:27.520782 10901 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:27.521013 12438 consensus_queue.cc:1059] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:27.521868 12438 raft_consensus.cc:3055] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:27.522210 12438 raft_consensus.cc:740] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:27.523063 12438 consensus_queue.cc:260] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:27.524317 12438 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:27.530742 12229 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:27.532606 12229 raft_consensus.cc:697] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:27.533460 12229 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:27.548012 10832 catalog_manager.cc:5697] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 5 to 6, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 6 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:27.607671 10935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:20:27.608265 10935 raft_consensus.cc:606] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:27.630384 11083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:20:27.630898 11083 raft_consensus.cc:606] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:27.633237 10935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "660a349ad34749648cae6a025708c84d"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:20:27.633684 10935 raft_consensus.cc:606] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:27.636837 10935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:20:27.637485 10935 raft_consensus.cc:606] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:27.640167 12438 raft_consensus.cc:993] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:27.640296 10935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:20:27.640659 12507 raft_consensus.cc:1081] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:27.641108 10935 raft_consensus.cc:606] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:27.643437  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:27.643790 11011 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37594
I20260709 12:20:27.644351 11011 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:27.644649 11011 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:27.647425  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:27.648317  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:27.651329 11011 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:27.661201 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:27.661780 11077 raft_consensus.cc:3055] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:27.662083 11077 raft_consensus.cc:740] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:27.662784 11077 consensus_queue.cc:260] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:27.663808 11077 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:27.664513 12549 raft_consensus.cc:993] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:27.665001 12081 raft_consensus.cc:1081] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:27.667127 11084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "660a349ad34749648cae6a025708c84d"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60046
I20260709 12:20:27.667675 11084 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:27.668035 11084 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:27.670928 10935 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:27.674350 11011 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:27.675486 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:27.676157 11656 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:27.675071 12438 consensus_queue.cc:1059] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:20:27.680169 12438 consensus_queue.cc:1243] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:20:27.682818 12508 raft_consensus.cc:3055] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:27.685683 12508 raft_consensus.cc:740] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:27.689224 12508 consensus_queue.cc:260] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:27.692101 12508 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:27.683261 11656 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:27.695284 11009 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:27.696497 10975 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:27.697415 12514 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:27.697978 12514 raft_consensus.cc:697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:27.725287 12514 consensus_queue.cc:237] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:27.680190 11084 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:27.761340 11077 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:27.761997 12549 raft_consensus.cc:993] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:27.768326 12549 raft_consensus.cc:1081] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:27.769698 11084 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:27.770105 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:27.770691 10935 raft_consensus.cc:3055] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:27.770990 10935 raft_consensus.cc:740] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:27.771685 10935 consensus_queue.cc:260] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:27.772912 10935 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:27.775707 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:27.776314 11002 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:27.785275 11004 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37586
I20260709 12:20:27.785965 11004 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:27.786517 11004 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:27.781600 10935 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:27.791589 11051 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:27.793459 12507 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:27.797946 12507 raft_consensus.cc:697] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:27.799257 12507 consensus_queue.cc:237] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:27.824738 11002 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:27.830859 10832 catalog_manager.cc:5697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 3 to 4, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 4 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:27.901830 11009 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:27.905115 12229 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:27.922158 10832 catalog_manager.cc:5697] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 1 to 2, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 2 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.942379 12229 raft_consensus.cc:993] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:27.942924 12081 raft_consensus.cc:1081] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:27.948468 11004 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:27.948990 11080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60046
I20260709 12:20:27.950402 11004 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:27.950500 11080 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:27.954838 11084 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:20:27.955211 11084 pending_rounds.cc:85] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 3
I20260709 12:20:27.955427 11084 pending_rounds.cc:107] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:20:27.955391 11080 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:27.956874 11084 raft_consensus.cc:2889] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:27.967589 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:27.968225 11084 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:27.979990 12229 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:27.974130 11080 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:27.993954 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:27.995124 10935 raft_consensus.cc:3055] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:27.995487 10935 raft_consensus.cc:740] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:28.001748 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:28.002485 10931 raft_consensus.cc:3055] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:28.002770 10931 raft_consensus.cc:740] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:28.004330 10935 consensus_queue.cc:260] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:28.005664 10935 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:28.006620 11084 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:28.007793 10974 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:28.009917 12494 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:28.010417 12494 raft_consensus.cc:697] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:28.011319 12494 consensus_queue.cc:237] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:28.003494 10931 consensus_queue.cc:260] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:28.014225 10931 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.016360 12081 raft_consensus.cc:993] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:28.016858 12081 raft_consensus.cc:1081] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:28.019033 11083 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60046
I20260709 12:20:28.019776 11083 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:28.020252 11083 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:28.032809 10936 consensus_queue.cc:237] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:28.042119 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:28.042853 11004 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:28.048051 10830 catalog_manager.cc:5697] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 1 to 2, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 2 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:28.052870 11004 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:28.055701 10935 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:28.057163 11051 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:28.058857 11080 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:28.059307 12492 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:28.066461 12492 raft_consensus.cc:697] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:28.067543 12492 consensus_queue.cc:237] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:28.068967 11084 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:20:28.069402 11084 pending_rounds.cc:85] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 2
I20260709 12:20:28.069639 11084 pending_rounds.cc:107] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:20:28.069872 11084 raft_consensus.cc:2889] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:28.086644 12387 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:28.088804 10931 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:28.064126 11083 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:28.095191 10900 consensus_peers.cc:597] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bda5e552d0f54d1daafad75449fbb509. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:28.096199 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:28.096824 11004 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:28.099063 11084 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:28.099107 11002 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:28.101117 12229 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:28.101756 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:28.102361 10935 raft_consensus.cc:3055] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:28.102655 10935 raft_consensus.cc:740] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:28.103418 10935 consensus_queue.cc:260] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:28.104558 10935 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:28.113945 10935 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:28.116431 11051 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:28.121510 12508 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:28.122125 12508 raft_consensus.cc:697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:28.123003 12508 consensus_queue.cc:237] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:28.127323 12081 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:28.132185 11007 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:20:28.133613 11004 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:28.135135 12549 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:28.096256 11083 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:28.187148 11082 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:28.194001 12383 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:28.199753 10931 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:28.205065 12492 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:28.219411 11656 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:28.222168 12494 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:20:28.224718 12081 raft_consensus.cc:2955] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:28.237191 11077 raft_consensus.cc:2955] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:28.254099 10931 consensus_queue.cc:237] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:28.262959 10832 catalog_manager.cc:5697] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 4 to 5, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 5 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:28.291056 11002 raft_consensus.cc:2955] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:28.305371 10832 catalog_manager.cc:5697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 2 to 3, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 3 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:28.310356 10830 catalog_manager.cc:5697] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: config changed from index -1 to 3, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 3 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
W20260709 12:20:28.314069 10900 consensus_peers.cc:597] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 33ccd4bc26b14304b81583bf6a6d3efb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:28.316090 11077 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:28.319543 12305 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:28.323565 11005 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:28.325330 12549 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:28.350880 11002 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:28.352836 12492 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:28.420132 12081 raft_consensus.cc:2955] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:28.423254 11002 raft_consensus.cc:2955] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:28.450771 10830 catalog_manager.cc:5697] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: config changed from index -1 to 3, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 3 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:28.470441 11077 raft_consensus.cc:2955] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:28.475322 10931 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:28.477910 12492 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:28.510399 11077 consensus_queue.cc:237] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:28.517148 11002 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:28.519097 12507 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:28.553328 11083 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:28.553443 12582 ts_tablet_manager.cc:933] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109)
I20260709 12:20:28.555256 12494 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:28.564005 12582 tablet_copy_client.cc:323] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.65:46109
I20260709 12:20:28.566371 10946 tablet_copy_service.cc:140] P 9e8170bbe8244e40a2b2e5011e69b697: Received BeginTabletCopySession request for tablet bda5e552d0f54d1daafad75449fbb509 from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:53346)
I20260709 12:20:28.566951 10946 tablet_copy_service.cc:161] P 9e8170bbe8244e40a2b2e5011e69b697: Beginning new tablet copy session on tablet bda5e552d0f54d1daafad75449fbb509 from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:53346: session id = 0b171b6aaedc4f809f2753dcfadb14ce-bda5e552d0f54d1daafad75449fbb509
I20260709 12:20:28.577922 10946 tablet_copy_source_session.cc:215] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:28.581534 12582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda5e552d0f54d1daafad75449fbb509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.590030 10931 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:28.592456 12383 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:28.593225 11049 consensus_peers.cc:597] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d263972b0e844fa281354fac07ccef80. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:28.598311 10935 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:28.600225 12492 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:28.609970 11005 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:28.611898 12438 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:28.639948 12582 tablet_copy_client.cc:806] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:28.648267 12582 tablet_copy_client.cc:670] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:28.683137 11005 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:28.683610 12508 raft_consensus.cc:2955] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:28.685051 12492 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:20:28.696554 12582 tablet_copy_client.cc:538] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:28.708545 11005 raft_consensus.cc:2955] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:28.713475 12582 tablet_bootstrap.cc:492] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:20:28.773243 10928 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:28.776365 10928 raft_consensus.cc:2955] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:28.808455 12582 tablet_bootstrap.cc:492] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:28.809494 12582 tablet_bootstrap.cc:492] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:20:28.810322 12582 ts_tablet_manager.cc:1403] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.018s
I20260709 12:20:28.819955 10928 consensus_queue.cc:237] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:28.821053 12582 raft_consensus.cc:359] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:28.832182 12582 raft_consensus.cc:740] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:20:28.832981 12582 consensus_queue.cc:260] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:28.835804 12582 ts_tablet_manager.cc:1434] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.004s
I20260709 12:20:28.857784 10946 tablet_copy_service.cc:342] P 9e8170bbe8244e40a2b2e5011e69b697: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-bda5e552d0f54d1daafad75449fbb509 received from {username='slave'} at 127.0.0.1:53346
I20260709 12:20:28.858297 10946 tablet_copy_service.cc:434] P 9e8170bbe8244e40a2b2e5011e69b697: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-bda5e552d0f54d1daafad75449fbb509 on tablet bda5e552d0f54d1daafad75449fbb509 with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:28.811262 10832 catalog_manager.cc:5697] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: config changed from index -1 to 3, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 3 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:28.887609 12507 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:28.893762 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 91064.3us
W20260709 12:20:28.899371 10900 consensus_peers.cc:597] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba629b94057b4c4e9085289ea50b42f1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:28.909785 11080 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:20:28.910240 11002 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:20:28.917021 12081 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:28.919725 12582 ts_tablet_manager.cc:933] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109)
I20260709 12:20:28.922667 12387 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:28.958832 12305 raft_consensus.cc:2955] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:28.964710 11080 raft_consensus.cc:2955] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:29.004566  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:29.031121 11002 raft_consensus.cc:2955] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:29.038182 11656 raft_consensus.cc:1217] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:20:29.049108 10832 catalog_manager.cc:5697] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: config changed from index -1 to 3, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 2 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:29.071836 12582 tablet_copy_client.cc:323] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.65:46109
I20260709 12:20:29.078987 10946 tablet_copy_service.cc:140] P 9e8170bbe8244e40a2b2e5011e69b697: Received BeginTabletCopySession request for tablet 33ccd4bc26b14304b81583bf6a6d3efb from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:53346)
I20260709 12:20:29.079651 10946 tablet_copy_service.cc:161] P 9e8170bbe8244e40a2b2e5011e69b697: Beginning new tablet copy session on tablet 33ccd4bc26b14304b81583bf6a6d3efb from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:53346: session id = 0b171b6aaedc4f809f2753dcfadb14ce-33ccd4bc26b14304b81583bf6a6d3efb
I20260709 12:20:29.088639 10946 tablet_copy_source_session.cc:215] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:29.109146 12600 ts_tablet_manager.cc:933] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:29.130923 12600 tablet_copy_client.cc:323] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.67:40209
I20260709 12:20:29.133196 11095 tablet_copy_service.cc:140] P 1abf4b385a2b493ab83f593a1f8c9cd1: Received BeginTabletCopySession request for tablet d263972b0e844fa281354fac07ccef80 from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:40200)
I20260709 12:20:29.133785 11095 tablet_copy_service.cc:161] P 1abf4b385a2b493ab83f593a1f8c9cd1: Beginning new tablet copy session on tablet d263972b0e844fa281354fac07ccef80 from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:40200: session id = 0b171b6aaedc4f809f2753dcfadb14ce-d263972b0e844fa281354fac07ccef80
I20260709 12:20:29.149782 12582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ccd4bc26b14304b81583bf6a6d3efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.173028 11095 tablet_copy_source_session.cc:215] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:29.189183 12600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d263972b0e844fa281354fac07ccef80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.271867 12600 tablet_copy_client.cc:806] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:29.274209 12600 tablet_copy_client.cc:670] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:29.281244 12600 tablet_copy_client.cc:538] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:29.285418 12582 tablet_copy_client.cc:806] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:29.286046 12582 tablet_copy_client.cc:670] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:29.293118 12582 tablet_copy_client.cc:538] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:29.312315 12600 tablet_bootstrap.cc:492] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:20:29.338310 12582 tablet_bootstrap.cc:492] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:20:29.374848 11080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:20:29.375475 11080 raft_consensus.cc:606] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:29.378942 10928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:20:29.379498 10928 raft_consensus.cc:606] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:29.382861 10928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:20:29.383431 10928 raft_consensus.cc:606] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:29.386056 11005 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:29.386729 11005 raft_consensus.cc:606] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:29.390566 11002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:29.391194 11002 raft_consensus.cc:606] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:29.392359  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:29.390256 12603 ts_tablet_manager.cc:933] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109)
I20260709 12:20:29.393939  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:29.394709  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:29.410344 12600 tablet_bootstrap.cc:492] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:29.411737 12600 tablet_bootstrap.cc:492] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:20:29.412701 12603 tablet_copy_client.cc:323] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.65:46109
I20260709 12:20:29.413232 12600 ts_tablet_manager.cc:1403] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 0.101s	user 0.028s	sys 0.000s
I20260709 12:20:29.414649 10946 tablet_copy_service.cc:140] P 9e8170bbe8244e40a2b2e5011e69b697: Received BeginTabletCopySession request for tablet ba629b94057b4c4e9085289ea50b42f1 from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:53346)
I20260709 12:20:29.415213 10946 tablet_copy_service.cc:161] P 9e8170bbe8244e40a2b2e5011e69b697: Beginning new tablet copy session on tablet ba629b94057b4c4e9085289ea50b42f1 from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:53346: session id = 0b171b6aaedc4f809f2753dcfadb14ce-ba629b94057b4c4e9085289ea50b42f1
I20260709 12:20:29.429549 10946 tablet_copy_source_session.cc:215] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:29.429577 12305 raft_consensus.cc:1064] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:20:29.433838 12603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba629b94057b4c4e9085289ea50b42f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.434576 12600 raft_consensus.cc:359] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:29.435637 12600 raft_consensus.cc:740] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:20:29.436349 12600 consensus_queue.cc:260] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:29.441768 12600 ts_tablet_manager.cc:1434] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.002s
I20260709 12:20:29.442276 12305 consensus_queue.cc:237] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:29.445349 11095 tablet_copy_service.cc:342] P 1abf4b385a2b493ab83f593a1f8c9cd1: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-d263972b0e844fa281354fac07ccef80 received from {username='slave'} at 127.0.0.1:40200
I20260709 12:20:29.445923 11095 tablet_copy_service.cc:434] P 1abf4b385a2b493ab83f593a1f8c9cd1: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-d263972b0e844fa281354fac07ccef80 on tablet d263972b0e844fa281354fac07ccef80 with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:29.447227 12582 tablet_bootstrap.cc:492] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:29.448249 12582 tablet_bootstrap.cc:492] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:20:29.449023 12582 ts_tablet_manager.cc:1403] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 0.111s	user 0.019s	sys 0.006s
I20260709 12:20:29.451969 12582 raft_consensus.cc:359] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:29.472057 12582 raft_consensus.cc:740] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:20:29.470908 12081 raft_consensus.cc:993] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:29.473045 12081 raft_consensus.cc:1081] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:29.472884 12582 consensus_queue.cc:260] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:29.475593 12582 ts_tablet_manager.cc:1434] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 12:20:29.477900 11002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37586
I20260709 12:20:29.480189 11002 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:29.480556 11002 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:29.487183 11002 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:29.494100 10946 tablet_copy_service.cc:342] P 9e8170bbe8244e40a2b2e5011e69b697: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-33ccd4bc26b14304b81583bf6a6d3efb received from {username='slave'} at 127.0.0.1:53346
I20260709 12:20:29.502779 11002 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:29.502918 10946 tablet_copy_service.cc:434] P 9e8170bbe8244e40a2b2e5011e69b697: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-33ccd4bc26b14304b81583bf6a6d3efb on tablet 33ccd4bc26b14304b81583bf6a6d3efb with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:29.505580 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:29.510320 11080 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:29.508957 11659 raft_consensus.cc:1217] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:20:29.509680 11656 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEARNER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:29.513594 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:29.508879 11083 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:29.514176 10936 raft_consensus.cc:3055] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:29.514771 10936 raft_consensus.cc:740] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:29.515290 12387 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:29.515650 10936 consensus_queue.cc:260] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:29.517072 10936 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:29.526929 12387 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:29.562098 11005 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:29.570825 12607 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:29.609148 10936 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:29.610301 12492 raft_consensus.cc:993] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:29.620905 10977 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:29.621694 12592 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:29.622165 12592 raft_consensus.cc:697] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:29.622406 12492 raft_consensus.cc:1081] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:29.622972 12592 consensus_queue.cc:237] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:29.619477 11080 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:29.625778 11002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37594
I20260709 12:20:29.626328 11002 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:29.626713 11002 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:29.629244 12603 tablet_copy_client.cc:806] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:29.629869 12603 tablet_copy_client.cc:670] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:29.633301 12607 raft_consensus.cc:2955] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:29.645253 11083 raft_consensus.cc:2955] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:29.646880 11656 raft_consensus.cc:2955] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:29.703979 11002 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:29.708662 10831 catalog_manager.cc:5697] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: config changed from index 3 to 4, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:29.731505 11002 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:29.735001 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:29.735749 11077 raft_consensus.cc:3055] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:29.736496 11077 raft_consensus.cc:740] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:29.738967 11077 consensus_queue.cc:260] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:29.747900 12392 raft_consensus.cc:993] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:29.748411 12392 raft_consensus.cc:1081] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:29.750375 11080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:20:29.750941 11080 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:29.751284 11080 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.761925 11080 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:29.763200 11077 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:29.765630 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:29.766222 10931 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:29.771529 12607 raft_consensus.cc:993] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:29.772055 12607 raft_consensus.cc:1081] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:29.782549 11080 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:29.783619 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:29.784261 11002 raft_consensus.cc:3055] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:29.784559 11002 raft_consensus.cc:740] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:29.785239 11002 consensus_queue.cc:260] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:29.812683 10931 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:29.814563 11002 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.816102 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:29.816707 11077 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:29.816849 11005 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37586
I20260709 12:20:29.817414 11005 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:29.817785 11005 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.824880 11005 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:29.826988 11005 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:29.827731 10931 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:29.836304 11002 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:29.836325 10931 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
W20260709 12:20:29.843376 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 62860.9us
I20260709 12:20:29.848501 11050 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:20:29.812177 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 93347.4us
W20260709 12:20:29.869833 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 52817.6us
I20260709 12:20:29.882838 12635 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:29.883986 10974 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:29.892307 12635 raft_consensus.cc:697] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:29.906904 12383 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:29.932925 12635 consensus_queue.cc:237] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:29.956480 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 65347.8us
W20260709 12:20:29.975769 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 68730.2us
I20260709 12:20:29.988575 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:29.989981 11084 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:29.997455 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 98774.1us
I20260709 12:20:30.013248 12603 tablet_copy_client.cc:538] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:30.016443 12383 raft_consensus.cc:697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:30.018024 11656 raft_consensus.cc:1217] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:20:30.018232 12383 consensus_queue.cc:237] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:30.053426 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 54856.3us
I20260709 12:20:30.104074 11084 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:30.097208 10833 catalog_manager.cc:5697] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 4 to 5, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 5 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.117805 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:30.118832 10931 raft_consensus.cc:3055] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:30.119230 10931 raft_consensus.cc:740] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:30.129134 12619 raft_consensus.cc:993] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:30.129935 12648 raft_consensus.cc:1081] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:30.137998 11010 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:30.130031 12628 raft_consensus.cc:1064] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:20:30.154292 12603 tablet_bootstrap.cc:492] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:20:30.141996 10974 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:30.142943 10931 consensus_queue.cc:260] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:30.161890 10931 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.144347 11002 raft_consensus.cc:2955] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:30.163051 12625 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:30.163666 12625 raft_consensus.cc:697] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:30.172343 12625 consensus_queue.cc:237] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:30.200242 11083 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:20:30.201136 11083 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:30.201506 11083 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:30.204648 10832 catalog_manager.cc:5697] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 1 to 2, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 2 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:30.208433 11079 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:30.210229 11083 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:30.212652 12628 consensus_queue.cc:237] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:30.236708 11083 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:30.238520 10930 consensus_queue.cc:237] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:30.243233 10931 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:30.256560 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:30.293771 11007 raft_consensus.cc:3055] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:30.294137 11007 raft_consensus.cc:740] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:30.295090 11007 consensus_queue.cc:260] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:30.296911 11007 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:30.258049 12618 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:30.275439 11656 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEARNER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:30.279433 11079 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:30.286870 11659 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:30.310176 10933 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:30.315716 12628 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:30.315744 12607 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:20:30.331656 11082 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:30.341269 12645 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:30.344100 11007 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:20:30.345185 11050 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:30.346141 12635 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:30.346625 12635 raft_consensus.cc:697] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:30.347467 12635 consensus_queue.cc:237] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:30.354662 11659 raft_consensus.cc:2955] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:30.369138 12646 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:30.374238 10829 catalog_manager.cc:5697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 2 to 3, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 3 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.352170 12649 raft_consensus.cc:2955] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:30.404134 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:30.422469 10928 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:30.432410 11007 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:30.435212 10829 catalog_manager.cc:5697] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 1 to 2, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 2 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.453877 10928 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:20:30.457086 10832 catalog_manager.cc:5697] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 5 to 6, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 6 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:30.466888 11004 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:30.482875 12081 raft_consensus.cc:2955] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:30.494545 11076 raft_consensus.cc:2955] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:30.505077 11659 raft_consensus.cc:2955] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:30.505097 10829 catalog_manager.cc:5697] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 4 to 5, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New cstate: current_term: 3 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:30.514556 12630 raft_consensus.cc:1064] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:20:30.526158 12630 consensus_queue.cc:237] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:30.528398 11004 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:30.531037 10831 catalog_manager.cc:5697] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: config changed from index 3 to 4, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:30.536309 10821 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bda5e552d0f54d1daafad75449fbb509 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:30.537314 11067 tablet_service.cc:1558] Processing DeleteTablet for tablet bda5e552d0f54d1daafad75449fbb509 with delete_type TABLET_DATA_TOMBSTONED (TS 1abf4b385a2b493ab83f593a1f8c9cd1 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60028
I20260709 12:20:30.552489 12635 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:20:30.566733 10928 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:30.571766 12617 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:20:30.554442 12387 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:20:30.578171  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:30.584985 12663 tablet_replica.cc:333] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:20:30.586423 12663 raft_consensus.cc:2243] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:30.587469 12663 raft_consensus.cc:2272] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:30.623102 12494 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:30.623093 10928 consensus_queue.cc:237] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:30.639164 10928 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:30.687989 10929 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:30.720070 12610 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:30.737810 11007 raft_consensus.cc:2955] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:20:30.757409 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 79654.8us
I20260709 12:20:30.760699 11085 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:30.703661 12648 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:20:30.771723 12603 tablet_bootstrap.cc:492] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:30.776979 11003 raft_consensus.cc:2955] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:30.847177 12645 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:20:30.854730 12603 tablet_bootstrap.cc:492] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:20:30.866900 12603 ts_tablet_manager.cc:1403] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 0.713s	user 0.026s	sys 0.021s
I20260709 12:20:30.874457 11659 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEARNER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:20:30.877010 12666 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:20:30.922695 12610 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:30.968779 10930 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:30.994036 12663 ts_tablet_manager.cc:1916] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:31.024812 11077 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:20:31.035215 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 46504.5us
W20260709 12:20:31.057930 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 65850us
I20260709 12:20:30.974355 12603 raft_consensus.cc:359] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:31.059700 12603 raft_consensus.cc:740] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:20:31.060560 12603 consensus_queue.cc:260] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:31.062112 12635 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:20:31.131958 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 167065us
I20260709 12:20:31.133605 10934 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:31.145200 11085 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:31.147290 11003 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:31.154068 11656 raft_consensus.cc:1217] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:20:31.155824 11007 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:31.170791 12684 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:31.192531 12603 ts_tablet_manager.cc:1434] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.325s	user 0.016s	sys 0.006s
I20260709 12:20:31.195411 11659 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:31.197073 12607 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:20:31.209468 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 85405.8us
I20260709 12:20:31.217824 12595 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:31.219776 12671 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:31.226862 10946 tablet_copy_service.cc:342] P 9e8170bbe8244e40a2b2e5011e69b697: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-ba629b94057b4c4e9085289ea50b42f1 received from {username='slave'} at 127.0.0.1:53346
I20260709 12:20:31.227451 10946 tablet_copy_service.cc:434] P 9e8170bbe8244e40a2b2e5011e69b697: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-ba629b94057b4c4e9085289ea50b42f1 on tablet ba629b94057b4c4e9085289ea50b42f1 with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:31.252682 12387 raft_consensus.cc:2955] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:31.254673 11656 raft_consensus.cc:2955] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:31.292239 12607 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:20:31.326465 12678 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:20:31.321192 10821 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 33ccd4bc26b14304b81583bf6a6d3efb with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:31.362999 11085 raft_consensus.cc:2955] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:31.371987 12663 ts_tablet_manager.cc:1929] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:20:31.372514 12663 log.cc:1199] T bda5e552d0f54d1daafad75449fbb509 P 1abf4b385a2b493ab83f593a1f8c9cd1: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-2-root/wals/bda5e552d0f54d1daafad75449fbb509
I20260709 12:20:31.375765 10818 catalog_manager.cc:5028] TS 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): tablet bda5e552d0f54d1daafad75449fbb509 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:20:31.424254 12649 raft_consensus.cc:1064] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:20:31.426954 12649 consensus_queue.cc:237] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:31.452921 10831 catalog_manager.cc:5697] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: config changed from index 4 to 5, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New cstate: current_term: 3 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:31.469971 11657 raft_consensus.cc:2955] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:31.476305 10936 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:20:31.467206 12686 raft_consensus.cc:2955] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:31.506740 11656 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 LEARNER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:20:31.509413 10934 raft_consensus.cc:2955] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:31.520586 12305 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:31.529652 11083 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:20:31.529518 11006 raft_consensus.cc:2955] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:31.531571 12081 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:31.538581 10936 raft_consensus.cc:606] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:31.538738 11007 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:20:31.541250 12387 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:31.558812 11007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:31.559417 11007 raft_consensus.cc:606] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:31.562427 10936 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:20:31.563108 10936 raft_consensus.cc:606] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:31.566339 11083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:20:31.566918 11083 raft_consensus.cc:606] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:31.587306 10936 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:20:31.587950 10936 raft_consensus.cc:606] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:31.598709  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:31.606787  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:31.638063 12672 raft_consensus.cc:993] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:31.638696 12686 raft_consensus.cc:1081] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:31.639226  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:31.646515 11007 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37594
I20260709 12:20:31.647203 11007 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:31.647562 11007 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:31.656276 11007 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:31.660183 11007 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:31.660799 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:31.661341 10934 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:31.667845 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:31.668592 11083 raft_consensus.cc:3055] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:31.668887 11083 raft_consensus.cc:740] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:31.674160 11007 raft_consensus.cc:2955] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:31.673791 12387 raft_consensus.cc:2955] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:31.677352 11083 consensus_queue.cc:260] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:31.682994 10934 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:31.684778 11083 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:31.706698 10977 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:31.710177 12685 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:31.713794 12685 raft_consensus.cc:697] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:31.716002 12685 consensus_queue.cc:237] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:31.728504 12708 log.cc:927] Time spent T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:20:31.739457 11083 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:31.773768 11083 raft_consensus.cc:2955] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:31.797827 12305 raft_consensus.cc:993] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:31.798329 12305 raft_consensus.cc:1081] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:31.799584 11659 raft_consensus.cc:2955] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:31.817137 11076 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60046
I20260709 12:20:31.817757 11076 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:31.818099 11076 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:31.824676 10995 tablet_service.cc:1558] Processing DeleteTablet for tablet 33ccd4bc26b14304b81583bf6a6d3efb with delete_type TABLET_DATA_TOMBSTONED (TS 2201bad9e18849b09cf82de29dd032d3 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:37578
I20260709 12:20:31.830722 11076 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:31.834575 10833 catalog_manager.cc:5697] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 3 to 4, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:31.836274 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:31.837028 11007 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:31.837697 11076 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:31.841477 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:31.842080 10934 raft_consensus.cc:3055] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:31.842391 10934 raft_consensus.cc:740] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:31.851619 10934 consensus_queue.cc:260] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:31.856060 10934 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:31.891991 10934 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:31.911420 11007 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:31.912729 11050 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:31.916955 12492 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:31.917485 12492 raft_consensus.cc:697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:31.918370 12492 consensus_queue.cc:237] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:31.953712 12305 raft_consensus.cc:993] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:31.954219 12387 raft_consensus.cc:1081] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:31.955909 11007 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37586
I20260709 12:20:31.956535 11007 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:31.956930 11007 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:31.935025 10832 catalog_manager.cc:5697] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 3 to 4, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 4 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:31.960093 10832 catalog_manager.cc:5697] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: config changed from index 3 to 4, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:31.964278 12714 tablet_replica.cc:333] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:20:31.967932 12714 raft_consensus.cc:2243] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:31.972489 12714 raft_consensus.cc:2272] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:31.983180 11007 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:31.985780 12714 ts_tablet_manager.cc:1916] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:31.985903 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:31.998163 11007 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:32.002573 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:32.033125 11076 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:32.033279 10933 consensus_queue.cc:237] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:32.008409 11083 consensus_queue.cc:237] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:32.010960 12628 raft_consensus.cc:993] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:32.036738 12628 raft_consensus.cc:1081] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:32.026321 12643 raft_consensus.cc:993] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:32.032611 10934 raft_consensus.cc:3055] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:32.038167 10934 raft_consensus.cc:740] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:32.038662 12643 raft_consensus.cc:1081] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:32.039011 10934 consensus_queue.cc:260] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:32.040306 10934 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:32.040494 11085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:20:32.041055 11085 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:32.041376 11085 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:32.043536 11007 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37586
I20260709 12:20:32.044162 11007 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:32.044498 11007 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:32.046218 10829 catalog_manager.cc:5697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 1 to 2, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 2 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:32.051474 11659 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:32.053171 12081 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:32.055243 10934 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:32.059427 11657 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:32.051590 11003 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:32.061019 12614 raft_consensus.cc:2955] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:32.062104 12595 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:32.062302 11007 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:32.064167 11003 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:32.066313 11656 raft_consensus.cc:2955] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:32.071475 12492 raft_consensus.cc:2955] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:32.072425 12686 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:32.077649 11659 raft_consensus.cc:2955] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:32.080366 12628 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:32.082854 11076 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:32.083432 10821 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ba629b94057b4c4e9085289ea50b42f1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:32.100407 11007 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:32.100843 11006 raft_consensus.cc:2955] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:32.106083 10977 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:32.107144 12643 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:32.107963 12643 raft_consensus.cc:697] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:32.108875 12643 consensus_queue.cc:237] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:32.110801 10927 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:32.107329 10831 catalog_manager.cc:5697] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 4 to 5, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New cstate: current_term: 2 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:32.114732 10818 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d263972b0e844fa281354fac07ccef80 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:32.115301 12592 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:32.125154 11085 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:32.134029 11067 tablet_service.cc:1558] Processing DeleteTablet for tablet ba629b94057b4c4e9085289ea50b42f1 with delete_type TABLET_DATA_TOMBSTONED (TS 1abf4b385a2b493ab83f593a1f8c9cd1 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60028
I20260709 12:20:32.136402 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:32.139925 11077 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:32.141103 11003 raft_consensus.cc:2955] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:32.140441 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:32.145784 10934 raft_consensus.cc:3055] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:32.146133 10934 raft_consensus.cc:740] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:32.153998 10934 consensus_queue.cc:260] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:32.156381 10934 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:32.159727 10831 catalog_manager.cc:5697] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 1 to 2, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 2 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:32.162565 11085 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:32.160606 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:32.164561 10927 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:32.166381 10934 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:32.167464 10977 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:32.165485 10832 catalog_manager.cc:5697] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 4 to 5, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New cstate: current_term: 3 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:32.173173 12669 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:32.186283 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:32.186960 11007 raft_consensus.cc:3055] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:32.187290 11007 raft_consensus.cc:740] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:32.188076 11007 consensus_queue.cc:260] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:32.189142 11007 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:32.180032 12669 raft_consensus.cc:697] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:32.202258 12717 tablet_replica.cc:333] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:20:32.209944 12669 consensus_queue.cc:237] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:32.217070 12717 raft_consensus.cc:2243] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:32.222301 12717 raft_consensus.cc:2272] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:32.229806 10927 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:20:32.231103 10934 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:32.231680 11051 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:32.232933 12492 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:32.233489 12492 raft_consensus.cc:697] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:32.235659 11007 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:20:32.243368 12492 consensus_queue.cc:237] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:32.251525 11077 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:32.280275 10919 tablet_service.cc:1558] Processing DeleteTablet for tablet d263972b0e844fa281354fac07ccef80 with delete_type TABLET_DATA_TOMBSTONED (TS 9e8170bbe8244e40a2b2e5011e69b697 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:43546
I20260709 12:20:32.292904 12714 ts_tablet_manager.cc:1929] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:20:32.296855 12714 log.cc:1199] T 33ccd4bc26b14304b81583bf6a6d3efb P 2201bad9e18849b09cf82de29dd032d3: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-1-root/wals/33ccd4bc26b14304b81583bf6a6d3efb
I20260709 12:20:32.299144 10820 catalog_manager.cc:5028] TS 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): tablet 33ccd4bc26b14304b81583bf6a6d3efb (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:20:32.307302 12717 ts_tablet_manager.cc:1916] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:32.326689 11083 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:32.329478 12648 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:32.323356 10832 catalog_manager.cc:5697] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 3 to 4, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 4 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:32.340616 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 76313.6us
I20260709 12:20:32.409309 12725 tablet_replica.cc:333] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:20:32.409612 12717 ts_tablet_manager.cc:1929] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:20:32.410053 12717 log.cc:1199] T ba629b94057b4c4e9085289ea50b42f1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-2-root/wals/ba629b94057b4c4e9085289ea50b42f1
I20260709 12:20:32.411387 12725 raft_consensus.cc:2243] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:32.412497 12725 raft_consensus.cc:2272] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:32.413308 10818 catalog_manager.cc:5028] TS 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): tablet ba629b94057b4c4e9085289ea50b42f1 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:20:32.421434 10933 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:32.429402 12726 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:32.440287 12725 ts_tablet_manager.cc:1916] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:32.439791 10829 catalog_manager.cc:5697] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 5 to 6, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 6 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:32.457957 11007 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:32.461808 12672 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:32.486191 12725 ts_tablet_manager.cc:1929] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:20:32.486673 12725 log.cc:1199] T d263972b0e844fa281354fac07ccef80 P 9e8170bbe8244e40a2b2e5011e69b697: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-0-root/wals/d263972b0e844fa281354fac07ccef80
I20260709 12:20:32.492774 10821 catalog_manager.cc:5028] TS 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): tablet d263972b0e844fa281354fac07ccef80 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:20:32.696524 10933 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:32.698098 12648 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:32.708299 11083 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:32.711798 12648 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:32.737123 11007 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:32.739799 12726 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:32.750679 11085 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:32.752324 12648 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:32.803306 10933 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:32.809306 12685 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:32.826526 10927 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:32.840871  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:32.839651 12672 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:32.968514 10933 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:20:32.969139 10933 raft_consensus.cc:606] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:32.981958 11077 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:20:32.982574 11077 raft_consensus.cc:606] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:32.989965 11007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:32.991016 11007 raft_consensus.cc:606] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:32.998548 11077 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d263972b0e844fa281354fac07ccef80"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:20:32.999291 11077 raft_consensus.cc:606] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Received request to transfer leadership to TS 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:33.004781 12595 raft_consensus.cc:993] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 0b171b6aaedc4f809f2753dcfadb14ce to start an election
I20260709 12:20:33.005285 12595 raft_consensus.cc:1081] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Signalling peer 0b171b6aaedc4f809f2753dcfadb14ce to start an election
I20260709 12:20:33.007371 11659 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d263972b0e844fa281354fac07ccef80"
dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
 from {username='slave'} at 127.0.0.1:59414
I20260709 12:20:33.007959 11659 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:33.008307 11659 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:33.009665 11007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:33.010285 11007 raft_consensus.cc:606] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:33.011976  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:33.013414  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:33.014030  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:33.016466 11659 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:33.021365 11659 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 4 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:33.022756 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:33.023411 11077 raft_consensus.cc:3055] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:33.023716 11077 raft_consensus.cc:740] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:33.042057 11077 consensus_queue.cc:260] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:33.051152 11077 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:33.056221 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:33.056874 11007 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:33.093505 12724 raft_consensus.cc:993] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:20:33.094077 12724 raft_consensus.cc:1081] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Signalling peer 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:20:33.107146 10927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:43556
I20260709 12:20:33.107738 10927 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:33.108111 10927 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:33.130111 11007 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 4.
I20260709 12:20:33.131614 11624 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:33.132817 12694 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:33.133625 12305 raft_consensus.cc:993] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:33.138664 12614 raft_consensus.cc:1081] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:33.138821 10927 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:33.141767 10927 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:33.142699 11008 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37586
I20260709 12:20:33.143246 11008 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:33.143556 11008 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:33.144703 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:33.145259 11083 raft_consensus.cc:3055] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:33.145510 11083 raft_consensus.cc:740] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:33.146241 11083 consensus_queue.cc:260] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:33.147258 11083 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:33.154351 11008 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:33.156144 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:33.164705 11003 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:33.166885 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:33.167491 11085 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:33.168592 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:33.169319 10927 raft_consensus.cc:3055] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:33.169641 10927 raft_consensus.cc:740] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:33.170547 10927 consensus_queue.cc:260] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:33.152580 12694 raft_consensus.cc:697] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:20:33.171880 10927 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:33.172415 12694 consensus_queue.cc:237] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:33.173734 11003 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:33.160526 11077 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 4.
I20260709 12:20:33.176021 10901 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:33.177865 11008 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:33.179098 12305 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:33.179642 12305 raft_consensus.cc:697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:33.180415 12305 consensus_queue.cc:237] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:33.185781 11085 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:33.186969 11083 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:33.188407 10974 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:33.189586 12648 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:33.190099 12648 raft_consensus.cc:697] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:33.191035 12648 consensus_queue.cc:237] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:33.226581 10927 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:33.226449 10829 catalog_manager.cc:5697] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 1 to 2, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 2 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:33.248034 10832 catalog_manager.cc:5697] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 3 to 4, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 4 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:33.254000 10833 catalog_manager.cc:5697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 3 to 4, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 4 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:33.264001 12685 raft_consensus.cc:993] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:33.264510 12685 raft_consensus.cc:1081] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:33.268306 11077 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:20:33.269026 11077 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:33.269387 11077 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:33.276894 11077 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:33.279608 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:33.280207 10933 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:33.289700 10933 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:20:33.292250 11051 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:33.293352 12726 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:33.293896 12726 raft_consensus.cc:697] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:33.294764 12726 consensus_queue.cc:237] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:33.302414 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:33.302717 11077 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:33.303079 11008 raft_consensus.cc:3055] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:33.303429 11008 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:33.304347 11008 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:33.305469 11008 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:33.313416 11008 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:20:33.339524 10833 catalog_manager.cc:5697] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 3 to 4, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 4 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:33.416442 12685 raft_consensus.cc:993] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:33.416986 12685 raft_consensus.cc:1081] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:33.418861 11077 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:20:33.419412 11077 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:33.419768 11077 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:33.431198 11077 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:33.434585 11077 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:33.434787 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:33.435462 10933 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:33.440193 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:33.440847 11007 raft_consensus.cc:3055] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:33.441154 11007 raft_consensus.cc:740] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:33.441885 11007 consensus_queue.cc:260] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:33.443128 11007 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:33.446251 10933 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:33.449792 11007 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:33.451588 11051 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:33.453118 12726 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:33.453653 12726 raft_consensus.cc:697] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:33.454512 12726 consensus_queue.cc:237] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:33.495190 10833 catalog_manager.cc:5697] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 2 to 3, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 3 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:33.573024 11008 consensus_queue.cc:237] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:33.585196 11077 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:33.588389 12740 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:20:33.607106 10975 consensus_peers.cc:597] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: edeb14680d6b4c7b95eed2b196750242. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:33.609948 11085 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:33.616910 12643 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:33.628808 11008 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:33.646677 12739 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:33.660439 12669 raft_consensus.cc:2955] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:33.672502 11083 raft_consensus.cc:2955] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:33.700639 10833 catalog_manager.cc:5697] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 4 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:33.719022 11083 consensus_queue.cc:237] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:33.738438 11077 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:33.742316 12643 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:33.771549 10927 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:33.773065 11084 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:33.774470 12694 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:33.778575 12595 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:33.798839 10936 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:33.806663 10936 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:33.809497 11007 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:33.811102 12726 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:33.840835 10933 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:33.845739 12724 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:33.893079 11008 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:33.896168 12305 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:33.892551 12685 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
W20260709 12:20:33.966023 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 50167.3us
W20260709 12:20:33.968197 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 82039.4us
W20260709 12:20:33.974938 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 64280.8us
I20260709 12:20:33.974545 12648 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 12:20:33.993664 11049 consensus_peers.cc:597] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11f1b75a0edb45d493bb20e8a0f34156. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:34.059561 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 88630us
I20260709 12:20:34.060511 10934 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:20:34.060770 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 100091us
I20260709 12:20:34.082273  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:34.093418 11007 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:34.094707 11008 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:34.099890 12726 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:34.103292 12771 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:34.125972 10936 raft_consensus.cc:2955] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:34.141913 12769 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:34.155087 12782 ts_tablet_manager.cc:933] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:34.166515 12769 raft_consensus.cc:2955] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:34.173314 11007 raft_consensus.cc:2955] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:34.182823 12782 tablet_copy_client.cc:323] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.66:41383
I20260709 12:20:34.189684 11021 tablet_copy_service.cc:140] P 2201bad9e18849b09cf82de29dd032d3: Received BeginTabletCopySession request for tablet edeb14680d6b4c7b95eed2b196750242 from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:41098)
I20260709 12:20:34.190308 11021 tablet_copy_service.cc:161] P 2201bad9e18849b09cf82de29dd032d3: Beginning new tablet copy session on tablet edeb14680d6b4c7b95eed2b196750242 from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:41098: session id = 0b171b6aaedc4f809f2753dcfadb14ce-edeb14680d6b4c7b95eed2b196750242
I20260709 12:20:34.199836 11021 tablet_copy_source_session.cc:215] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:34.207141 12782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edeb14680d6b4c7b95eed2b196750242. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.227783 12782 tablet_copy_client.cc:806] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:34.228399 12782 tablet_copy_client.cc:670] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:34.233657 12782 tablet_copy_client.cc:538] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:34.245162 12782 tablet_bootstrap.cc:492] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:20:34.255314 11083 consensus_queue.cc:237] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:34.265031 10933 raft_consensus.cc:2955] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:34.229548 10832 catalog_manager.cc:5697] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 4 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
W20260709 12:20:34.274989 11049 consensus_peers.cc:597] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b156bebcd53a4b6ea1f83c42906a5a03. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:34.276252 11003 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:34.278620 12724 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:34.286176 10936 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:34.349835 12724 raft_consensus.cc:2955] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
W20260709 12:20:34.354346 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 63541.8us
I20260709 12:20:34.357630 12771 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:34.430058 12782 tablet_bootstrap.cc:492] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:34.431027 12782 tablet_bootstrap.cc:492] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:20:34.431771 12782 ts_tablet_manager.cc:1403] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 0.187s	user 0.023s	sys 0.036s
I20260709 12:20:34.436494 10933 raft_consensus.cc:2955] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:34.440829 12782 raft_consensus.cc:359] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:34.442230 12782 raft_consensus.cc:740] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:20:34.441993 11003 raft_consensus.cc:2955] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:34.442900 12782 consensus_queue.cc:260] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:34.449204 12782 ts_tablet_manager.cc:1434] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:20:34.465695 11021 tablet_copy_service.cc:342] P 2201bad9e18849b09cf82de29dd032d3: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-edeb14680d6b4c7b95eed2b196750242 received from {username='slave'} at 127.0.0.1:41098
I20260709 12:20:34.466203 11021 tablet_copy_service.cc:434] P 2201bad9e18849b09cf82de29dd032d3: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-edeb14680d6b4c7b95eed2b196750242 on tablet edeb14680d6b4c7b95eed2b196750242 with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:34.540913 10933 consensus_queue.cc:237] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:34.552201 12782 ts_tablet_manager.cc:933] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:34.580936 10833 catalog_manager.cc:5697] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 4 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:34.610172 11657 consensus_queue.cc:237] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:34.618649 12782 tablet_copy_client.cc:323] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.67:40209
I20260709 12:20:34.620685 11095 tablet_copy_service.cc:140] P 1abf4b385a2b493ab83f593a1f8c9cd1: Received BeginTabletCopySession request for tablet 11f1b75a0edb45d493bb20e8a0f34156 from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:40200)
I20260709 12:20:34.621255 11095 tablet_copy_service.cc:161] P 1abf4b385a2b493ab83f593a1f8c9cd1: Beginning new tablet copy session on tablet 11f1b75a0edb45d493bb20e8a0f34156 from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:40200: session id = 0b171b6aaedc4f809f2753dcfadb14ce-11f1b75a0edb45d493bb20e8a0f34156
W20260709 12:20:34.688684 10900 consensus_peers.cc:597] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d3426d7ccdd943b882b65c3977a20040. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:34.703593 11077 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:34.707176 10934 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:20:34.707934 10934 raft_consensus.cc:606] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:34.707697 12305 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:34.710816 11083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:20:34.711386 11083 raft_consensus.cc:606] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:34.714960 11003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:34.715644 11003 raft_consensus.cc:606] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:34.717236  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:20:34.718904  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:34.719655  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:34.724575 11659 raft_consensus.cc:1217] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 12:20:34.743404 11095 tablet_copy_source_session.cc:215] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:34.749539 11003 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:34.759006 12782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11f1b75a0edb45d493bb20e8a0f34156. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.763125 12775 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:34.767531 12773 raft_consensus.cc:993] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:34.768172 12773 raft_consensus.cc:1081] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:34.771150 12775 raft_consensus.cc:2955] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:34.773754 11083 raft_consensus.cc:2955] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:34.777052 11077 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:34.778460 10933 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:34.780732 12694 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:34.788378 11003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37586
I20260709 12:20:34.790176 11003 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:34.790663 11003 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:34.791988 10829 catalog_manager.cc:5697] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: config changed from index -1 to 2, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:34.793992 12694 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:34.801210 11003 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:34.815840 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:34.816655 10933 raft_consensus.cc:3055] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:34.816946 10933 raft_consensus.cc:740] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:34.817785 10933 consensus_queue.cc:260] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:34.818418 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:34.818928 10933 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:34.819036 11077 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:34.834474 11077 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:34.835896 10974 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:20:34.836376 12801 log.cc:927] Time spent T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:20:34.836855 12797 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:34.838119 12797 raft_consensus.cc:697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:34.839042 12797 consensus_queue.cc:237] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:34.843264 11008 raft_consensus.cc:2955] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:34.853281 12694 raft_consensus.cc:2955] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 3 to 6, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:34.861778 11083 raft_consensus.cc:2955] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:34.871423 11003 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:34.878360 10933 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:34.888834 10829 catalog_manager.cc:5697] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: config changed from index 3 to 6, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New cstate: current_term: 4 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:34.904489 10933 raft_consensus.cc:2955] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:34.906884 10819 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0774d95f5c1b4bdb990e50f5d858b600 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 11)
I20260709 12:20:34.919088 12804 ts_tablet_manager.cc:933] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:34.924842 12782 tablet_copy_client.cc:806] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:34.925889 12782 tablet_copy_client.cc:670] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:34.945217 12804 tablet_copy_client.cc:323] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.67:40209
I20260709 12:20:34.949486 12724 raft_consensus.cc:993] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:20:34.950042 12724 raft_consensus.cc:1081] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Signalling peer 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:20:34.952497 10933 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:43556
I20260709 12:20:34.953111 11095 tablet_copy_service.cc:140] P 1abf4b385a2b493ab83f593a1f8c9cd1: Received BeginTabletCopySession request for tablet b156bebcd53a4b6ea1f83c42906a5a03 from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:40200)
I20260709 12:20:34.953061 10933 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:34.953687 11095 tablet_copy_service.cc:161] P 1abf4b385a2b493ab83f593a1f8c9cd1: Beginning new tablet copy session on tablet b156bebcd53a4b6ea1f83c42906a5a03 from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:40200: session id = 0b171b6aaedc4f809f2753dcfadb14ce-b156bebcd53a4b6ea1f83c42906a5a03
I20260709 12:20:34.963981 12782 tablet_copy_client.cc:538] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:34.953827 10933 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:34.974459 10995 tablet_service.cc:1558] Processing DeleteTablet for tablet 0774d95f5c1b4bdb990e50f5d858b600 with delete_type TABLET_DATA_TOMBSTONED (TS 2201bad9e18849b09cf82de29dd032d3 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:37578
I20260709 12:20:34.980610 10933 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:34.991209 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:34.991971 11083 raft_consensus.cc:3055] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:34.992295 11083 raft_consensus.cc:740] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:34.993227 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:34.993790 11008 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:34.990564 10933 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:34.992983 11083 consensus_queue.cc:260] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:34.999907 11083 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:35.000574 11008 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:35.007398 10901 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:35.017647 11083 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:35.012948 12802 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:35.041365 11095 tablet_copy_source_session.cc:215] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:35.024649 12802 raft_consensus.cc:697] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:35.044968 12804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b156bebcd53a4b6ea1f83c42906a5a03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:35.044651 12802 consensus_queue.cc:237] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:35.059540 12812 tablet_replica.cc:333] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:20:35.060626 12812 raft_consensus.cc:2243] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:35.061339 12812 raft_consensus.cc:2272] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:35.067607 12812 ts_tablet_manager.cc:1916] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:35.070607 10832 catalog_manager.cc:5697] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 3 to 4, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 4 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:35.084993 10830 catalog_manager.cc:5697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 3 to 4, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 4 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:35.115263 12782 tablet_bootstrap.cc:492] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:20:35.129596 12685 raft_consensus.cc:993] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:35.130273 12685 raft_consensus.cc:1081] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:35.132732 11083 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:20:35.133358 11083 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:35.134086 11083 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.137648 12804 tablet_copy_client.cc:806] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:35.138269 12804 tablet_copy_client.cc:670] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:35.150864 11083 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:35.159449 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:35.159657 12804 tablet_copy_client.cc:538] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:35.160205 10933 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.164943 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:35.165688 11008 raft_consensus.cc:3055] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:35.165979 11008 raft_consensus.cc:740] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:35.166720 11008 consensus_queue.cc:260] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:35.167747 11008 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.175653 12804 tablet_bootstrap.cc:492] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:20:35.210852 12782 tablet_bootstrap.cc:492] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:35.211942 12782 tablet_bootstrap.cc:492] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:20:35.212625 12782 ts_tablet_manager.cc:1403] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 0.098s	user 0.025s	sys 0.002s
I20260709 12:20:35.222508 12812 ts_tablet_manager.cc:1929] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:20:35.223022 12812 log.cc:1199] T 0774d95f5c1b4bdb990e50f5d858b600 P 2201bad9e18849b09cf82de29dd032d3: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-1-root/wals/0774d95f5c1b4bdb990e50f5d858b600
I20260709 12:20:35.224812 10820 catalog_manager.cc:5028] TS 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): tablet 0774d95f5c1b4bdb990e50f5d858b600 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:20:35.230674 12782 raft_consensus.cc:359] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:35.231602 12782 raft_consensus.cc:740] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:20:35.236078 12782 consensus_queue.cc:260] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:35.238565 12797 raft_consensus.cc:1064] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:20:35.241370 12797 consensus_queue.cc:237] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:35.253885 12816 ts_tablet_manager.cc:933] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109)
I20260709 12:20:35.260879 12816 tablet_copy_client.cc:323] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.65:46109
I20260709 12:20:35.262547 10946 tablet_copy_service.cc:140] P 9e8170bbe8244e40a2b2e5011e69b697: Received BeginTabletCopySession request for tablet d3426d7ccdd943b882b65c3977a20040 from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:53346)
I20260709 12:20:35.263126 10946 tablet_copy_service.cc:161] P 9e8170bbe8244e40a2b2e5011e69b697: Beginning new tablet copy session on tablet d3426d7ccdd943b882b65c3977a20040 from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:53346: session id = 0b171b6aaedc4f809f2753dcfadb14ce-d3426d7ccdd943b882b65c3977a20040
I20260709 12:20:35.275902 11083 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:35.286791 11008 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:35.289760 12804 tablet_bootstrap.cc:492] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:35.299594 10946 tablet_copy_source_session.cc:215] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:35.310297 12804 tablet_bootstrap.cc:492] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:20:35.310088 11050 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:35.311472 12793 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:35.312206 12793 raft_consensus.cc:697] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:35.312960 12816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3426d7ccdd943b882b65c3977a20040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:35.313079 12793 consensus_queue.cc:237] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:35.301173 10933 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:35.306200 11657 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEARNER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:35.321830 12804 ts_tablet_manager.cc:1403] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 0.146s	user 0.034s	sys 0.002s
I20260709 12:20:35.308061 10936 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:35.308195 11076 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:35.322623 10927 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:35.324047 12685 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:35.324863 12814 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:35.326176 12814 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:35.243093 12782 ts_tablet_manager.cc:1434] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:20:35.340003 11095 tablet_copy_service.cc:342] P 1abf4b385a2b493ab83f593a1f8c9cd1: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-11f1b75a0edb45d493bb20e8a0f34156 received from {username='slave'} at 127.0.0.1:40200
I20260709 12:20:35.340500 11095 tablet_copy_service.cc:434] P 1abf4b385a2b493ab83f593a1f8c9cd1: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-11f1b75a0edb45d493bb20e8a0f34156 on tablet 11f1b75a0edb45d493bb20e8a0f34156 with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:35.340972 12685 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:35.340566 12804 raft_consensus.cc:359] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:35.355697 12804 raft_consensus.cc:740] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:20:35.356530 12804 consensus_queue.cc:260] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:35.368077 12804 ts_tablet_manager.cc:1434] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.003s
I20260709 12:20:35.381588 11095 tablet_copy_service.cc:342] P 1abf4b385a2b493ab83f593a1f8c9cd1: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-b156bebcd53a4b6ea1f83c42906a5a03 received from {username='slave'} at 127.0.0.1:40200
I20260709 12:20:35.382051 11095 tablet_copy_service.cc:434] P 1abf4b385a2b493ab83f593a1f8c9cd1: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-b156bebcd53a4b6ea1f83c42906a5a03 on tablet b156bebcd53a4b6ea1f83c42906a5a03 with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:35.391152 12669 raft_consensus.cc:2955] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:35.394315 11076 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:35.404723 10832 catalog_manager.cc:5697] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 2 to 3, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 3 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:35.408959 11083 raft_consensus.cc:2955] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:35.412734 12816 tablet_copy_client.cc:806] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:35.424154 12816 tablet_copy_client.cc:670] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:35.431490 12816 tablet_copy_client.cc:538] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:35.440182 11077 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:35.442109 12803 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:35.445853 12816 tablet_bootstrap.cc:492] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:20:35.453550 11656 raft_consensus.cc:2955] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:35.475551 12816 tablet_bootstrap.cc:492] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:35.476485 12816 tablet_bootstrap.cc:492] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:20:35.478436 12797 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:35.481652 12816 ts_tablet_manager.cc:1403] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 0.039s	user 0.027s	sys 0.005s
I20260709 12:20:35.483122 10934 raft_consensus.cc:2955] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:35.488523 10831 catalog_manager.cc:5697] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 4 to 5, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:20:35.546092 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 66669us
I20260709 12:20:35.568516 11656 raft_consensus.cc:1217] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 12:20:35.585806 11008 consensus_queue.cc:237] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:35.615438 11002 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:35.645721 12833 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:20:35.616992 12816 raft_consensus.cc:359] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:35.657146 12816 raft_consensus.cc:740] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:20:35.672195 12816 consensus_queue.cc:260] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
W20260709 12:20:35.683533 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 83855.9us
I20260709 12:20:35.688634 12816 ts_tablet_manager.cc:1434] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.207s	user 0.010s	sys 0.000s
I20260709 12:20:35.708015 11658 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:20:35.719595 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 112855us
W20260709 12:20:35.730724 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 99422.7us
I20260709 12:20:35.763237 10946 tablet_copy_service.cc:342] P 9e8170bbe8244e40a2b2e5011e69b697: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-d3426d7ccdd943b882b65c3977a20040 received from {username='slave'} at 127.0.0.1:53346
I20260709 12:20:35.763763 10946 tablet_copy_service.cc:434] P 9e8170bbe8244e40a2b2e5011e69b697: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-d3426d7ccdd943b882b65c3977a20040 on tablet d3426d7ccdd943b882b65c3977a20040 with peer 0b171b6aaedc4f809f2753dcfadb14ce
W20260709 12:20:35.768890 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 62357.5us
I20260709 12:20:35.771214 12768 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:35.801594 11084 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:35.814894 12837 raft_consensus.cc:2955] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:35.825114 10820 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet edeb14680d6b4c7b95eed2b196750242 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:35.828377 11656 raft_consensus.cc:1217] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:35.831418 11658 raft_consensus.cc:1217] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 12:20:35.836408 12797 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:35.846951 11079 raft_consensus.cc:2955] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:35.851532 11659 raft_consensus.cc:2955] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:35.869879 10930 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:35.884025 12792 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:35.886639 10832 catalog_manager.cc:5697] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 5 to 6, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New cstate: current_term: 4 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:35.893777 11007 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:35.910375 12845 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:35.914391 10919 tablet_service.cc:1558] Processing DeleteTablet for tablet edeb14680d6b4c7b95eed2b196750242 with delete_type TABLET_DATA_TOMBSTONED (TS 9e8170bbe8244e40a2b2e5011e69b697 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:43546
I20260709 12:20:35.939774 12850 tablet_replica.cc:333] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:20:35.944258 12850 raft_consensus.cc:2243] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:35.952718 12850 raft_consensus.cc:2272] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:35.960883 12850 ts_tablet_manager.cc:1916] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:36.011956  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:36.040956 12850 ts_tablet_manager.cc:1929] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:20:36.041436 12850 log.cc:1199] T edeb14680d6b4c7b95eed2b196750242 P 9e8170bbe8244e40a2b2e5011e69b697: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-0-root/wals/edeb14680d6b4c7b95eed2b196750242
I20260709 12:20:36.043149 10821 catalog_manager.cc:5028] TS 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): tablet edeb14680d6b4c7b95eed2b196750242 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:20:36.083961 10930 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "015a67e38c364985be24b18358579506"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:20:36.084606 10930 raft_consensus.cc:606] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:36.088269 11002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:36.088860 11002 raft_consensus.cc:606] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:36.089882 12802 raft_consensus.cc:993] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:36.090366 12802 raft_consensus.cc:1081] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:36.092288 11002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "015a67e38c364985be24b18358579506"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37586
I20260709 12:20:36.093000 11002 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:36.093372 11002 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:36.098896 11002 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:36.092324 10930 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:20:36.100123 10930 raft_consensus.cc:606] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:36.103736 11009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:36.104312 11009 raft_consensus.cc:606] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Received request to transfer leadership to TS 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:36.105036 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:36.105635 10930 raft_consensus.cc:3055] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:36.105903 10930 raft_consensus.cc:740] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:36.106623 10930 consensus_queue.cc:260] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:36.107683 10930 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:36.108806 11002 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:36.109699 11079 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "660a349ad34749648cae6a025708c84d"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:20:36.109807 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:36.112051 11079 raft_consensus.cc:606] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:36.112105 11084 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:36.113548  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:36.114910 10930 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:36.115324  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:36.116156 10977 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:36.117035 12834 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:36.117501 12834 raft_consensus.cc:697] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:36.118300 12834 consensus_queue.cc:237] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:36.133833 11084 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:36.139487  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:36.158090 12845 raft_consensus.cc:1064] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:20:36.177721 12845 consensus_queue.cc:237] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:36.179361 10833 catalog_manager.cc:5697] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 2 to 3, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 3 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:36.201033 11659 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEARNER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:36.202498 11002 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:36.205610 10927 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:36.205188 12792 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:36.213464 12595 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:36.214380 12791 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:36.231302 12791 raft_consensus.cc:1064] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:20:36.243348 12791 consensus_queue.cc:237] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:36.310460 12832 raft_consensus.cc:1064] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:20:36.313169 12832 consensus_queue.cc:237] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:36.331276 12845 raft_consensus.cc:2955] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:36.337752 11002 raft_consensus.cc:2955] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:36.349790 10930 raft_consensus.cc:2955] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:36.384248 10832 catalog_manager.cc:5697] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: config changed from index 4 to 5, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:36.401330 11659 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 LEARNER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:36.414156 11009 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:36.418716 12791 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:36.406260 12802 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
W20260709 12:20:36.412156 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 51041.2us
I20260709 12:20:36.426960 11659 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEARNER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:36.426985 11009 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:36.427577 10930 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:36.428913 12803 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:36.429415 12844 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:36.431247 12844 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:36.427148 11083 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:36.445189 12803 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:36.482949 11658 raft_consensus.cc:2955] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:36.521747 12814 raft_consensus.cc:993] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:36.522151 12837 raft_consensus.cc:993] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 0b171b6aaedc4f809f2753dcfadb14ce to start an election
I20260709 12:20:36.522305 12814 raft_consensus.cc:1081] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:36.523979 12837 raft_consensus.cc:1081] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Signalling peer 0b171b6aaedc4f809f2753dcfadb14ce to start an election
I20260709 12:20:36.524432 11084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:20:36.524962 11084 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:36.525314 11084 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:36.525735 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 67375.8us
I20260709 12:20:36.526235 11657 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a"
dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
 from {username='slave'} at 127.0.0.1:59398
I20260709 12:20:36.526889 11657 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:36.527275 11657 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:36.529299 12802 raft_consensus.cc:993] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:36.529842 12802 raft_consensus.cc:1081] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:36.542071 11009 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37586
I20260709 12:20:36.542724 11009 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:36.543249 11009 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:36.542609 11084 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:36.549876 11084 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:36.549330 12792 raft_consensus.cc:2955] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:36.559298 12866 raft_consensus.cc:993] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:20:36.560243 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:36.561010 11002 raft_consensus.cc:3055] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:36.561340 11002 raft_consensus.cc:740] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:36.565305 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:36.565943 10930 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:36.566519 12595 raft_consensus.cc:1081] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Signalling peer 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:20:36.568523 10927 raft_consensus.cc:2955] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:36.562444 11002 consensus_queue.cc:260] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:36.573736 11002 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:36.575245 10930 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:36.576447 11051 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:36.578449 11084 consensus_queue.cc:237] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:36.580754 11002 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:36.606706 11009 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:36.588223 11659 raft_consensus.cc:2955] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:36.613333 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:36.613940 10927 raft_consensus.cc:3055] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:36.614370 10927 raft_consensus.cc:740] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:36.615082 10927 consensus_queue.cc:260] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:36.619933 10927 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:36.612444 11009 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:36.586381 12866 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:20:36.734259 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 107463us
I20260709 12:20:36.738390 10927 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
W20260709 12:20:36.745615 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 158321us
I20260709 12:20:36.782059 10833 catalog_manager.cc:5697] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: config changed from index 4 to 5, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:36.776258 12866 raft_consensus.cc:697] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:20:36.805253 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 57002.2us
I20260709 12:20:36.807442 11655 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:36.809018 10927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "660a349ad34749648cae6a025708c84d"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:43556
I20260709 12:20:36.809685 10927 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:36.810052 10927 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:36.806056 10977 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:36.824801 10927 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:36.839357 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:36.840183 11009 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:36.847631 11009 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:36.876253 10927 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:36.881661 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:36.882290 11084 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:36.852265 12834 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:36.893700 11079 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:36.898248 11084 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
W20260709 12:20:36.880228 12868 log.cc:927] Time spent T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:20:36.942854 11657 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:36.919449 12866 consensus_queue.cc:237] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:36.953415 12867 log.cc:927] Time spent T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 12:20:36.961939 12791 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:36.969594 12832 raft_consensus.cc:2955] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:36.970247 12883 raft_consensus.cc:2955] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:36.972188 11656 raft_consensus.cc:2955] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:36.976567 11659 raft_consensus.cc:2955] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:36.954993 11657 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:36.987620 10818 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b156bebcd53a4b6ea1f83c42906a5a03 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:20:36.991314 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 151918us
I20260709 12:20:37.015795 10927 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:37.018190 10901 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:36.994915 12834 raft_consensus.cc:697] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:37.038028 12834 consensus_queue.cc:237] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:37.054726 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:37.055528 11009 raft_consensus.cc:3055] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:37.055833 11009 raft_consensus.cc:740] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:37.057641 11009 consensus_queue.cc:260] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:37.059422 11009 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:37.056656 12874 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
W20260709 12:20:37.075120 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 172959us
I20260709 12:20:37.091789 12881 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:20:37.091686 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 73598.3us
I20260709 12:20:37.092826 12881 raft_consensus.cc:697] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:37.093756 12881 consensus_queue.cc:237] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:37.095377 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.096058 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 70332.3us
I20260709 12:20:37.107918 11002 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:37.109369 10829 catalog_manager.cc:5697] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 4 to 5, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 5 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:37.108467 11004 raft_consensus.cc:2955] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:37.137534 11009 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 2.
I20260709 12:20:37.138675 11624 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:37.139596 12878 raft_consensus.cc:2804] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:37.140182 12878 raft_consensus.cc:697] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:20:37.141131 12878 consensus_queue.cc:237] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:37.155768 12791 consensus_queue.cc:1059] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:20:37.168470 12791 raft_consensus.cc:3055] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:37.162310 10830 catalog_manager.cc:5697] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 2 to 3, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 3 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:37.168949 12791 raft_consensus.cc:740] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:37.163260 10931 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:37.192677 12791 consensus_queue.cc:260] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:37.194221 12791 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:37.205684 12880 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:37.221324 10829 catalog_manager.cc:5697] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 5 to 6, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New cstate: current_term: 4 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:37.223258 11009 raft_consensus.cc:2955] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:37.223313 10829 catalog_manager.cc:5697] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:37.237277 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:37.244719 11077 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:37.251405 11080 raft_consensus.cc:2955] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:37.255703 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:37.256374 10930 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:37.229713 10829 catalog_manager.cc:5697] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 1 to 2, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 2 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:37.257700 10931 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:37.264839 10930 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 2.
I20260709 12:20:37.293589 10929 raft_consensus.cc:2955] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:37.305984 10830 catalog_manager.cc:5697] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 2 to 3, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 3 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:37.316540 12834 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:37.322664  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:37.323717 10995 tablet_service.cc:1558] Processing DeleteTablet for tablet b156bebcd53a4b6ea1f83c42906a5a03 with delete_type TABLET_DATA_TOMBSTONED (TS 2201bad9e18849b09cf82de29dd032d3 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:37578
I20260709 12:20:37.338840 12908 tablet_replica.cc:333] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:20:37.340456 12908 raft_consensus.cc:2243] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:37.341295 12908 raft_consensus.cc:2272] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:37.348603 10930 consensus_queue.cc:237] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:37.373497 12908 ts_tablet_manager.cc:1916] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:37.379221 11659 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:37.379621 11004 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:37.380975 12881 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:37.381968 12891 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:20:37.414294 12859 log.cc:927] Time spent T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.061s	user 0.001s	sys 0.022s
I20260709 12:20:37.429879 11659 raft_consensus.cc:2955] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:37.435315 12908 ts_tablet_manager.cc:1929] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:20:37.435894 12908 log.cc:1199] T b156bebcd53a4b6ea1f83c42906a5a03 P 2201bad9e18849b09cf82de29dd032d3: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-1-root/wals/b156bebcd53a4b6ea1f83c42906a5a03
I20260709 12:20:37.428464 12881 raft_consensus.cc:2955] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:37.437935 10820 catalog_manager.cc:5028] TS 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): tablet b156bebcd53a4b6ea1f83c42906a5a03 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:20:37.446914 10821 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d3426d7ccdd943b882b65c3977a20040 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:37.450309 11004 raft_consensus.cc:2955] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:37.455430 11077 consensus_queue.cc:237] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:37.462860 10931 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:37.462922 11656 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:37.464967 12791 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:37.470494 11009 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:37.471908 12896 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:37.473311 11656 raft_consensus.cc:2955] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:37.471921 12880 raft_consensus.cc:2955] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:37.481215 10832 catalog_manager.cc:5697] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: config changed from index 3 to 4, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New cstate: current_term: 1 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:37.486332 10818 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 11f1b75a0edb45d493bb20e8a0f34156 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:37.492122 12883 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:37.502266 10931 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:37.506546 10931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:20:37.507138 10931 raft_consensus.cc:606] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Received request to transfer leadership to TS 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:37.519079 12791 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:37.511319 10931 raft_consensus.cc:2955] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:37.527439 11067 tablet_service.cc:1558] Processing DeleteTablet for tablet d3426d7ccdd943b882b65c3977a20040 with delete_type TABLET_DATA_TOMBSTONED (TS 1abf4b385a2b493ab83f593a1f8c9cd1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60028
I20260709 12:20:37.537861 10829 catalog_manager.cc:5697] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 5 to 6, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New cstate: current_term: 4 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:37.589068 11077 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:37.591005 12837 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:37.593119 10930 raft_consensus.cc:1275] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:37.595160 12878 consensus_queue.cc:1048] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:37.597325 11078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:20:37.609851 11082 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:37.611480 11078 raft_consensus.cc:606] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:20:37.625427 12912 log.cc:927] Time spent T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:20:37.614861 12911 tablet_replica.cc:333] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:20:37.630266 12832 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:37.632293 11004 raft_consensus.cc:1275] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:37.615235 10995 tablet_service.cc:1558] Processing DeleteTablet for tablet 11f1b75a0edb45d493bb20e8a0f34156 with delete_type TABLET_DATA_TOMBSTONED (TS 2201bad9e18849b09cf82de29dd032d3 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:37578
I20260709 12:20:37.649691 12908 tablet_replica.cc:333] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:20:37.650851 12908 raft_consensus.cc:2243] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:37.652336 12878 consensus_queue.cc:1048] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:37.651656 12908 raft_consensus.cc:2272] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:37.657238 11004 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:37.661607 12891 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:20:37.675223 12911 raft_consensus.cc:2243] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:37.676257 12911 raft_consensus.cc:2272] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:37.684648 11004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83b4e206b7694af695234c0e758055e2"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:37.685316 11004 raft_consensus.cc:606] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:37.686177 12911 ts_tablet_manager.cc:1916] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:37.686462 12908 ts_tablet_manager.cc:1916] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:37.695327 11082 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:20:37.696000 11082 raft_consensus.cc:606] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:37.697374 10934 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:37.701644 12894 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:20:37.712502 11004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:37.713251 11004 raft_consensus.cc:606] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:37.717423  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:37.719161  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:37.720836  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:37.774958 12911 ts_tablet_manager.cc:1929] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:37.785272 12911 log.cc:1199] T d3426d7ccdd943b882b65c3977a20040 P 1abf4b385a2b493ab83f593a1f8c9cd1: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-2-root/wals/d3426d7ccdd943b882b65c3977a20040
I20260709 12:20:37.790087 10818 catalog_manager.cc:5028] TS 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): tablet d3426d7ccdd943b882b65c3977a20040 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:20:37.807256 12894 raft_consensus.cc:993] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:37.807775 12768 raft_consensus.cc:1081] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:37.809856 11085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83b4e206b7694af695234c0e758055e2"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:20:37.810376 11085 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:37.810732 11085 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:37.817915 12908 ts_tablet_manager.cc:1929] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:20:37.818502 12908 log.cc:1199] T 11f1b75a0edb45d493bb20e8a0f34156 P 2201bad9e18849b09cf82de29dd032d3: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-1-root/wals/11f1b75a0edb45d493bb20e8a0f34156
I20260709 12:20:37.820348 11085 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:37.834331 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:37.835022 10820 catalog_manager.cc:5028] TS 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): tablet 11f1b75a0edb45d493bb20e8a0f34156 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:20:37.837240 10930 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:37.853502 10930 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:20:37.854642 11051 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:37.865411 12891 raft_consensus.cc:993] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 0b171b6aaedc4f809f2753dcfadb14ce to start an election
I20260709 12:20:37.865921 12891 raft_consensus.cc:1081] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Signalling peer 0b171b6aaedc4f809f2753dcfadb14ce to start an election
I20260709 12:20:37.867575 11659 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb"
dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
 from {username='slave'} at 127.0.0.1:59384
I20260709 12:20:37.868160 11659 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:37.868486 11659 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:37.880236 11659 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:37.873584 12883 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:37.882897 12883 raft_consensus.cc:697] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:37.883417 11659 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:37.883805 12883 consensus_queue.cc:237] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:37.888886 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:37.883975 12866 raft_consensus.cc:993] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:20:37.889489 10930 raft_consensus.cc:3055] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:37.890836 12791 raft_consensus.cc:1081] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Signalling peer 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:20:37.890821 10930 raft_consensus.cc:740] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:37.892671 10930 consensus_queue.cc:260] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:37.895206 10931 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:43556
I20260709 12:20:37.899976 10931 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:37.900357 10931 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:37.903237 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:37.904138 11002 raft_consensus.cc:3055] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:37.904462 11002 raft_consensus.cc:740] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:37.906107 10929 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:37.905218 11002 consensus_queue.cc:260] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:37.908385 11002 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:37.898598 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:37.910594 11085 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:37.910681 11082 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:37.912398 10931 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:37.915084 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:37.915620 11004 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:37.916215 10931 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:37.919924 11082 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 4.
I20260709 12:20:37.920807 10930 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:37.924598 11004 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:37.926767 10901 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:37.928223 12881 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:37.928750 12881 raft_consensus.cc:697] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:37.933624 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:37.934091 11082 raft_consensus.cc:3055] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:37.934326 11082 raft_consensus.cc:740] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:37.931197 12881 consensus_queue.cc:237] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:37.935042 11622 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:20:37.936045 12878 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:37.934655 11002 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:20:37.936491 12878 raft_consensus.cc:697] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:20:37.937357 12878 consensus_queue.cc:237] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:37.938884 10930 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 4.
I20260709 12:20:37.942610 11082 consensus_queue.cc:260] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:37.947113 11082 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:37.967061 12791 raft_consensus.cc:993] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:20:37.967607 12883 raft_consensus.cc:1081] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Signalling peer 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:20:37.969857 10931 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:43556
I20260709 12:20:37.970566 10931 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:37.972069 10931 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:37.975160 12768 raft_consensus.cc:993] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:37.975689 12768 raft_consensus.cc:1081] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:37.979239 10931 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:37.970800 11082 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:37.980849 11077 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:20:37.984115 11077 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:37.984551 11077 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:37.986550 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:37.988247 11002 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:37.996058 11077 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:37.997224 11002 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:38.006269 10901 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:38.007174 12881 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:38.007701 12881 raft_consensus.cc:697] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:37.983163 10829 catalog_manager.cc:5697] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 4 to 5, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 5 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:38.000897 10931 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:38.010437 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:38.001964 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:38.010916 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:38.011062 11002 raft_consensus.cc:3055] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:38.011266 11082 raft_consensus.cc:3055] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:38.011466 11002 raft_consensus.cc:740] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:38.011777 11082 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:38.012666 11002 consensus_queue.cc:260] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:38.013125 11082 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:38.014039 11002 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:38.014398 11082 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:38.009212 12881 consensus_queue.cc:237] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:38.029521 11082 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:38.042336 11002 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:38.043401 11050 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:38.044327 12883 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:38.044827 12883 raft_consensus.cc:697] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:38.044739 10830 catalog_manager.cc:5697] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 3 to 4, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 4 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:38.046022 12883 consensus_queue.cc:237] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:38.047619 11077 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:37.982656 10832 catalog_manager.cc:5697] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 3 to 4, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 4 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:38.050904 10930 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:38.059473 10829 catalog_manager.cc:5697] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 4 to 5, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 5 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:38.063023 10930 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:38.101449 10832 catalog_manager.cc:5697] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 2 to 3, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 3 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:38.326308 11077 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:38.327760 12903 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:38.346648 10931 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:38.348516 12903 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:38.386940 10931 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:38.388199 12791 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:38.402993 11002 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:38.408496 12883 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:38.437690 11082 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:38.618129 12832 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
W20260709 12:20:38.662667 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 119007us
I20260709 12:20:38.681751 10931 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:38.687143 11002 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:20:38.694407 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 54605.6us
I20260709 12:20:38.720196 12946 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:38.750876 11009 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:20:38.754290 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 90895.5us
I20260709 12:20:38.760561 11003 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:38.798751 11082 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:38.804713 12832 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:38.817704 12940 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:38.848620  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:38.867491 12955 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:20:38.897116 12933 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:20:38.981556 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 101501us
W20260709 12:20:39.009311 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 87720.4us
W20260709 12:20:39.030112 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 105616us
I20260709 12:20:40.418938 10931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1171) took 1292 ms. Trace:
I20260709 12:20:40.419461 10931 rpcz_store.cc:276] 0709 12:20:39.126568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:40.418048 (+1291480us) service_pool.cc:224] Handling call
0709 12:20:40.418426 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:40.418621 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:40.418645 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:40.418685 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:40.418712 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:40.418764 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:40.418876 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:40.453687 12984 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:40.454470 12984 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.615017 12984 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:40.510108 12986 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:40.615852 12986 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.618253 12986 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:40.618928 12986 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:40.619495 12986 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.556797 12985 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:40.648123 12985 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.650556 12985 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:40.651180 12985 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:40.661720 12985 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.595897 12988 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:40.599022 12987 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:40.692164 12988 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.551970 12934 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:40.581631 12982 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:40.693500 12982 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.684511 12989 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:40.693500 12934 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.694603 12989 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.695782 12982 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:40.696378 12982 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:40.696643 12934 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:40.693343 12985 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:20:40.684677 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 85577.4us
I20260709 12:20:40.696955 12989 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:40.685314 12984 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:20:40.687892 12986 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:40.523597 12896 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:40.692233 12987 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.549365 12955 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:40.700219 12896 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.700310 12986 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:40.701290 12986 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.702497 12896 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:40.702762 12987 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:40.703523 12896 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:40.703775 12986 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:40.697855 12952 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:40.704079 12896 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.704475 12952 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.706220 12896 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:40.706377 12952 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:40.700585 12985 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:20:40.708210 12985 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:40.707230 12984 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:40.696853 12982 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.697958 12989 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:40.711885 12989 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.699278 12988 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:40.697271 12934 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:40.700412 12955 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:40.683493 12981 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:20:40.720891 12955 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:40.720961 12981 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:40.719980 12878 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:40.722119 12989 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:40.716336 12984 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:40.722146 12878 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:40.723742 12981 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:40.724612 12878 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:40.721709 12934 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.726555 12934 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:40.727455 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:40.724611 12985 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:20:40.474393 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.494398 10932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1177) took 1366 ms. Trace:
I20260709 12:20:40.768072 12837 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:40.769446 12837 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.773016 12986 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:20:40.774207 12986 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:40.775156 12953 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:40.772907 12937 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:40.777848 12953 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.778260 12937 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.781150 12937 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:40.782385 12837 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:40.781184 12953 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:40.783177 12962 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:40.783428 12837 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:40.784224 12962 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.784518 12837 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.777834 12981 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:40.783084 12937 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:40.786239 12981 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.786616 12937 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.787323 12962 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:40.788966 12981 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:40.789422 12837 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:40.765267 10932 rpcz_store.cc:276] 0709 12:20:39.128218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:40.493416 (+1365198us) service_pool.cc:224] Handling call
0709 12:20:40.493772 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:40.493964 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:40.493989 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:40.494026 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:40.494054 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:40.494123 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:40.494240 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:40.791520 12985 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:40.792599 12985 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.793026 12987 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:40.783196 10832 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35620 (request call id 215) took 1829 ms. Trace:
I20260709 12:20:40.792936 12937 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:40.797657 10930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1173) took 1670 ms. Trace:
I20260709 12:20:40.793974 12987 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.798097 10930 rpcz_store.cc:276] 0709 12:20:39.127143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:40.795982 (+1668839us) service_pool.cc:224] Handling call
0709 12:20:40.796724 (+   742us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:40.797132 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:40.797160 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:40.797215 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:40.797240 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:40.797289 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:40.797429 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:40.800064 12981 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:40.794674 10832 rpcz_store.cc:276] 0709 12:20:38.953161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.983839 (+ 30678us) service_pool.cc:224] Handling call
0709 12:20:40.782911 (+1799072us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:20:40.802521 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:40.806021 12962 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:40.806533 12934 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:40.807264 12985 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:40.807554 12934 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.800890 12987 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:40.809141 11659 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:20:40.813905 12953 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:40.801026 12981 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:40.814808 12953 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.816901 12981 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:40.817593 11049 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:20:40.817708 12987 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:40.821537 12962 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.837641 12981 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:40.838922 12981 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.840804 12985 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:40.841404 12985 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:40.841866 12985 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:40.847589 12934 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:40.848359 12934 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:40.849140 12934 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:40.831730 12837 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:20:41.307098 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.836601 12987 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:41.101732 10957 debug-util.cc:398] Leaking SignalData structure 0x7b08001adce0 after lost signal to thread 9741
I20260709 12:20:41.306703 12993 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:20:41.356065 10957 debug-util.cc:398] Leaking SignalData structure 0x7b08001adca0 after lost signal to thread 9744
I20260709 12:20:41.356328 12996 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:20:41.356956 12992 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:20:41.372576 10974 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.007s	sys 0.057s
I20260709 12:20:41.374260 12996 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:41.377211 12996 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:41.378728 12948 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:41.379283 12994 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:20:41.379818 12948 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.380831 12996 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:41.381723 12996 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.386291 12996 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.387020 12996 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:41.382381 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1176) took 2254 ms. Trace:
I20260709 12:20:41.387669 12996 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.373785 12981 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.388130 10927 rpcz_store.cc:276] 0709 12:20:39.127954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.128053 (+    99us) service_pool.cc:224] Handling call
0709 12:20:41.381226 (+2253173us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b5800002d98. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3beee 000000000036eb39 00007f9bb5eaf1e0 00007f9bb5f780c4 00007f9bb5f78131 00007f9bb5f39fc0 00007f9bb5f24929 00007f9bb5f243d2 00007f9baf49bbd4
0709 12:20:41.381528 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:41.381912 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:41.381936 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:41.381994 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:41.382027 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:41.382091 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:41.382205 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14027264}
I20260709 12:20:41.382928 12948 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.374434 12992 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.392333 12946 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:41.392364 12950 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:41.393170 12946 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.393739 12992 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.394145 12950 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.395210 12992 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:41.395849 12946 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.380254 12994 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:41.396553 12946 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:41.397002 12950 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.397259 12946 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.368238 12837 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.398344 12994 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:41.399076 12994 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:41.398821 12993 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:41.387166 12985 consensus_meta.cc:287] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.545s	user 0.005s	sys 0.005s
W20260709 12:20:41.379019 10974 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.007s	sys 0.057s
I20260709 12:20:41.388211 12934 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.390067 12996 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.402916 12996 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:41.403573 12996 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.406090 12996 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.406647 12996 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:41.401242 12937 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:41.407691 12937 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.410441 12837 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.408376 12987 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.399729 12994 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.407287 12996 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.413096 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:41.414028 11654 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:41.414398 12996 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.414585 12950 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:41.415446 12950 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:41.417292 12937 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.417589 10900 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:41.424443 12987 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:41.425240 12987 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:41.430042 12987 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:41.433452 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.433728 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.445218 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.446041 12996 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:41.434480 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.446839 12996 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.447521 11080 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:41.434679 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.447729 12837 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:41.448073 12934 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:20:41.443719 12987 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:20:41.448482 12837 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.434979 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.449106 12987 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:41.435889 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.440759 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.442394 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.443034 12937 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:41.446969 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.414426 12994 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.395972 12992 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.449615 11081 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:41.449507 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.448367 11079 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:41.453801 11084 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:41.457631 11078 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:41.401990 12985 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:41.456830 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.460649 12981 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:41.462813 12981 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.460500 11076 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:41.452702 12994 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:41.463362 12837 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.455739 12946 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.466267 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.467564 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.468241 11079 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:41.469159 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.467367 12999 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:41.470566 12999 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:41.464150 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:41.470976 12999 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:41.471269 12993 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.472263 12985 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:41.474148 11080 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:41.476588 12950 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:41.478340 12992 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.479710 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.474143 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:41.482712 11654 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:41.483217 12997 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:41.483932 12997 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.470333 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.488848 12934 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:41.489938 12947 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:41.493181 13000 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:41.493631 12947 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.493906 13000 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.491032 13001 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:41.496197 12947 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:41.496307 13001 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.496793 12947 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:41.497459 12947 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.498343 12953 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.498790 13001 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:41.465381 12994 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.501421 12934 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:41.499585 12947 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:41.491739 12958 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:41.492553 12986 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:41.492736 12982 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:41.503998 12937 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.512380 10829 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 79) took 2691 ms. Trace:
I20260709 12:20:41.505559 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:41.482533 12999 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:41.526823 10829 rpcz_store.cc:276] 0709 12:20:38.820404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.829486 (+  9082us) service_pool.cc:224] Handling call
0709 12:20:41.512182 (+2682696us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:20:41.509609 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1167) took 2668 ms. Trace:
I20260709 12:20:41.501421 12994 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.653074 12985 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:41.580035 13001 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:41.654129 12982 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:41.653920 12985 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.654400 13001 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.656697 12985 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:41.657111 13001 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:41.657264 12985 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:41.658057 12985 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:41.651981 12996 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.660557 12999 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:41.650274 12883 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:20:41.568913 12837 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:41.661966 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:41.662086 12837 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.517324 10899 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:41.606056 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:41.601886 12997 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.667851 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.602662 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.507026 12947 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:41.672441 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.623219 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:41.672326 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.674428 12997 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:41.705283 12997 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:41.705724 12997 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:41.513774 12981 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.652592 10934 rpcz_store.cc:276] 0709 12:20:38.841079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.842688 (+  1609us) service_pool.cc:224] Handling call
0709 12:20:38.842987 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:38.855465 (+ 12478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:38.855495 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:38.856794 (+  1299us) log.cc:844] Serialized 26 byte log entry
0709 12:20:38.983934 (+127140us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:38.983977 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:38.984244 (+   267us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:41.509220 (+2524976us) raft_consensus.cc:1685] finished
0709 12:20:41.509255 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:41.509448 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25051,"raft.queue_time_us":13028,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":2469,"spinlock_wait_cycles":948608,"thread_start_us":126368,"threads_started":1,"wal-append.queue_time_us":182102,"wal-append.run_cpu_time_us":33496,"wal-append.run_wall_time_us":2593489}
I20260709 12:20:41.513089 12987 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:41.675567 12837 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.709556 12837 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:41.710161 12837 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.524155 12940 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:41.712765 12940 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.514089 12890 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:41.680776 11008 consensus_queue.cc:237] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:41.678347 12947 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.679126 12883 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:20:41.670928 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 153791us
I20260709 12:20:41.685111 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:20:41.686564 10901 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.827s	user 0.014s	sys 0.006s
I20260709 12:20:41.700323 12953 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:41.700026 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.700881 12950 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:41.701279 12935 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:41.702075 12943 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:20:41.721112 10901 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.861s	user 0.016s	sys 0.007s
I20260709 12:20:41.702270 12985 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:41.702951 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.703091 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:41.703436 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:41.514814 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:41.729241 12943 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.732730 12950 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.605866 11654 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:41.677537 12982 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.723793 12953 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.724354 10899 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:41.728348 11659 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:20:41.707648 12996 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:41.737835 11049 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:20:41.716601 12994 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:41.741936 12936 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:41.742612 12982 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:41.742580 12936 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.744789 12953 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.517787 12958 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.747406 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.748185 12935 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:41.760751 11049 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:20:41.753954 11081 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:41.745338 12953 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:41.735155 12943 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.753387 13000 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.769294 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.769680 10899 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:41.777912 11006 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:41.778456 12959 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:41.770206 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:41.778916 12959 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:41.779351 12959 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:41.779819 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.780073 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:41.770455 12936 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.771677 12957 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:41.781652 12957 raft_consensus.cc:697] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:41.782073 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.782717 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.784201 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.771941 12883 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:41.772722 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.772934 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.773842 12950 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.742651 12947 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:20:41.788934 10957 debug-util.cc:398] Leaking SignalData structure 0x7b0800193ac0 after lost signal to thread 10868
I20260709 12:20:41.775820 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:41.768428 12837 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.774252 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 1458) took 2897 ms. Trace:
I20260709 12:20:41.792063 11085 rpcz_store.cc:276] 0709 12:20:38.877144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.877261 (+   117us) service_pool.cc:224] Handling call
0709 12:20:41.773260 (+2895999us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b5800017d98. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3beee 000000000036eb39 00007f9bb5eaf1e0 00007f9bb5f780c4 00007f9bb5f78131 00007f9bb5f39fc0 00007f9bb5f24929 00007f9bb5f243d2 00007f9baf49bbd4
0709 12:20:41.773514 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:41.773800 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:41.773824 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:41.773864 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:41.773892 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:41.773941 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:41.774045 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7138688}
I20260709 12:20:41.753639 12948 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:41.797263 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.789465 12940 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:41.776075 12953 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.797592 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.760797 12982 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:41.785943 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.799911 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.782713 12957 consensus_queue.cc:237] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:41.786345 12962 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.778780 10899 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:20:41.789409 10957 debug-util.cc:398] Leaking SignalData structure 0x7b08001a80e0 after lost signal to thread 10882
I20260709 12:20:41.760043 12890 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:41.804685 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:41.747303 12994 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.796080 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.795104 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:20:41.800482 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 71016.3us
I20260709 12:20:41.799625 11082 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:41.800506 11081 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:41.806308 10899 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:20:41.805635 10957 debug-util.cc:398] Leaking SignalData structure 0x7b0800307f80 after lost signal to thread 10960
I20260709 12:20:41.802206 12937 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.807893 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.753688 12935 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:41.796769 12948 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:20:41.812127 12881 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:41.812440 12948 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:41.813192 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.813877 11002 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:41.815361 12994 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.817162 12890 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:41.799619 12982 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:41.820148 12982 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:41.820309 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.820602 12953 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.821179 12983 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:41.824714 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:41.825176 12983 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:41.825320 12881 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:41.825726 12983 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:41.822257 12958 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:41.826901 11081 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
W20260709 12:20:41.822480 10957 debug-util.cc:398] Leaking SignalData structure 0x7b08000cb580 after lost signal to thread 11035
I20260709 12:20:41.823129 11654 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:41.830229 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.828012 10899 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:41.831609 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:41.831544 10899 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:41.830001 12992 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:41.833509 12945 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:41.833740 12992 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:20:41.833961 12945 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:41.834262 12992 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:41.834520 12945 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:41.825798 12881 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:41.840751 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.839834 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:20:41.842365 10957 debug-util.cc:398] Leaking SignalData structure 0x7b0800324480 after lost signal to thread 11109
I20260709 12:20:41.842669 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:20:41.843592 10957 debug-util.cc:398] Leaking SignalData structure 0x7b080004f2a0 after lost signal to thread 11683
I20260709 12:20:41.846107 12983 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.848472 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.849785 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.850415 11085 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:41.852437 12945 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.854560 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.753768 12996 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.795080 12959 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.837582 12979 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:41.874959 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.875141 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.856967 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.869745 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.875334 12979 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:41.870995 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.876416 12979 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:41.875134 12983 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.873811 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.876132 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.885085 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.886250 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.887598 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.890349 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:41.892625 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:41.893831 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.894737 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.892441 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.896486 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:41.894493 11077 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:41.902403 11078 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 1.
I20260709 12:20:41.905084 12959 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.905864 12948 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:41.883570 12994 consensus_queue.cc:1059] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:20:41.907697 12944 raft_consensus.cc:3055] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:41.908092 12944 raft_consensus.cc:740] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:41.908152 12996 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.909055 12944 consensus_queue.cc:260] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:41.913285 12944 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:41.914945 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.917848 12982 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:41.920264 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.924536 11011 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
W20260709 12:20:41.925004 10975 consensus_peers.cc:597] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 59db2d2bb22c41aebd0d2073e2ba7d52. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:41.922214 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:41.926141 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.927079 12982 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:41.927771 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.930135 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.930284 12945 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.931231 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.932298 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.932399 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.936683 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.933543 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.932930 11010 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:41.939774 11005 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:41.920392 12992 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:41.940914 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.940068 12933 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:41.940173 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:41.939282 12997 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.941370 10932 raft_consensus.cc:1240] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:41.937234 11011 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:41.939134 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.941923 12933 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.947382 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:41.948407 12997 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.948899 12933 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.949256 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.945052 12992 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:41.950484 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.950691 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.950978 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.951258 11005 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 1.
I20260709 12:20:41.951592 11002 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:41.952412 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.952714 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.959566 12881 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.961930 12948 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:41.963672 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
W20260709 12:20:41.967095 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.973049 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.979030 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.981992 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.987362 11010 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:41.990099 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.973300 12881 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.990273 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.992002 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:41.966558 12979 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:41.994597 11082 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:20:41.995430 11082 raft_consensus.cc:606] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:41.996212 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:41.997334 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:41.997577 12979 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:41.997983 10932 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:41.998782 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:41.999143 12992 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:41.999174 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:41.999508 10936 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:41.999984 10927 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:41.999907 12992 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.000319 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.000501 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.000998 10930 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:42.001036 10934 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:42.002110 12992 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.005096 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.005777 10934 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:42.007453 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:42.008150 11082 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:42.012444 12983 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:42.013065 12983 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.014583 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:42.015162 12983 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.015246 11081 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:42.018877 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:42.019094 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:42.020403 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:42.021571 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:42.022568 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:42.022964 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:42.006862 12948 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:42.025379 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:42.026233 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:42.027724 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:42.030776 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:42.028360 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:42.031605 12948 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.036800 11624 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.037716 13012 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:42.038161 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:42.039661 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:42.041217 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:42.042384 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:42.042833 12948 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.044531 11050 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:42.046528 12957 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:42.046958 12957 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:42.047348 12957 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:42.047569 12958 raft_consensus.cc:993] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:42.048049 12958 raft_consensus.cc:1081] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:42.054905 11050 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:42.056118 12940 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:42.056525 12940 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:42.056864 12940 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:42.064675 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.065495 10934 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:42.070101 10901 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:42.073716 12979 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:42.074393 12979 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:42.074826 12979 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:42.075160 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.081518 10901 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.090642 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.100101 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.101248 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.102272 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.103034 12979 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.103299 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.103533 12993 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:42.092139 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.104552 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.092401 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.105369 12979 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.105758 10930 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:42.092901 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.106447 10931 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:42.093535 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.088335 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:42.094727 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.107460 10935 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:42.093278 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.105306 10936 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:42.095883 11081 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:42.096756 10974 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:42.095588 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:42.091845 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.097026 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.100028 10901 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.108867 10927 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:42.109160 11084 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:42.109063 10974 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:42.106559 10932 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:42.093864 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.110041 12944 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:42.110422 12944 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:20:42.110821 12944 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:42.111289 10974 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:42.112102 12935 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:42.112489 12935 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:42.112901 12935 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:42.113099 12993 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:20:42.113837 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 58987.3us
I20260709 12:20:42.108906 12890 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:42.114969 10901 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:42.115172 12957 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.115888 12993 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:42.116103 10901 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.116299 12993 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:42.116664 12993 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:42.116822 12983 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:42.117969 10901 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.112423 10974 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:42.118410 12940 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.119302 12953 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:42.119666 12953 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:42.119966 12890 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:42.120119 12953 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:42.120435 12890 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:42.121412 10974 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:42.121635 12940 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:42.122211 12996 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:42.122613 12996 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:42.122998 12996 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:42.131487 12953 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.132969 12890 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.135695 12935 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.122633 10830 catalog_manager.cc:5697] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 4 to 5, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 5 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:42.140950 12944 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:42.145685 11081 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:20:42.141351 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.146765 10927 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:42.146323 11081 raft_consensus.cc:606] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:42.143500 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.117916 12957 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:42.148988 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:42.148221 10934 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:42.145154 12996 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.142894 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.145502 12890 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.149682 12983 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:42.151298 12935 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.151417 12944 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:42.144200 12993 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.149546 12953 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.152842 10901 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.152987 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.153733 12983 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:42.153999 10901 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:42.149156 10974 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:42.154560 12993 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.155344 12953 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:42.155757 12953 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:42.155968 11008 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3625831778d468cb424c06fc474c323"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:42.156250 12953 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:42.156586 11008 raft_consensus.cc:606] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:42.158151 12996 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.160701 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.160992 10932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:20:42.161465 10936 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:42.161571 10932 raft_consensus.cc:606] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.160993 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.163461  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:20:42.165045 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.165897 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.165339  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:42.168032 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.168337 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.170468 10927 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:42.171072 12944 raft_consensus.cc:993] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:42.171337 10974 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:42.171576 12962 raft_consensus.cc:1081] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:42.172130 12890 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:42.172528 12890 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:42.172634 12962 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:42.172930 12890 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:42.175239 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.172999 10927 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:42.176043 11081 raft_consensus.cc:2393] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 4: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:42.178800 12953 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.179656 12979 raft_consensus.cc:2804] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:42.180163 12979 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:20:42.181313 10901 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:42.180917 11050 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.182672 10901 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:42.185711 11050 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.180622 12979 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:42.188324 10901 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:42.188503 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.189116 11084 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:42.191406 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:42.194749 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.195990 11077 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3625831778d468cb424c06fc474c323"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:20:42.196419 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.197098 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.197652 11083 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:42.196606 11077 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:42.199353 11077 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:42.190341 11008 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37594
I20260709 12:20:42.200119 11008 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:42.200467 11008 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:42.201336 10974 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:42.202262 12996 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:42.204342 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:42.183956 12993 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:42.187743 12922 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:42.187466 12983 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:42.211877 12983 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:42.212339 12983 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:42.194751 12948 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:42.187984 12940 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:42.215507 12948 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:42.209026 12993 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:42.227921 11080 raft_consensus.cc:1240] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:42.221375 12948 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:42.224517 12993 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:42.236831 10927 raft_consensus.cc:1240] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:42.237496 11084 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:42.239921 10974 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:42.245452 11083 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:20:42.246512 10974 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:42.250687 12935 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:42.251173 12953 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.256821 12944 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:42.257373 12944 raft_consensus.cc:697] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:42.257009 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.258555 11084 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:42.258224 12944 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.255100 12935 raft_consensus.cc:697] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:42.265513 12983 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.265900 12935 consensus_queue.cc:237] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.268188 12983 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.273072 11006 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:42.273398  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:42.274744 12957 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:42.279630 11084 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:42.277199 12996 consensus_queue.cc:1059] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:42.278964 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:42.280637 10974 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:42.280632 11077 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.281170 11008 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.287289 11009 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:42.287696 11008 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.290884 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.292783 10936 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:42.292793 11080 raft_consensus.cc:3055] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:42.295359 11080 raft_consensus.cc:740] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:42.298285 11083 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:42.300415 10934 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:42.295379 12953 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:42.305768 11077 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:42.309083 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:42.307760 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:42.310485 11008 raft_consensus.cc:3055] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:42.310935 11008 raft_consensus.cc:740] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:42.310799 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:42.309260 12953 raft_consensus.cc:697] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:42.320489 10936 raft_consensus.cc:1240] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:42.310477 13001 consensus_queue.cc:1059] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:20:42.324047 12962 raft_consensus.cc:3055] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:42.324481 12962 raft_consensus.cc:740] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:42.325141 12993 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.325320 12962 consensus_queue.cc:260] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:42.325521 12953 consensus_queue.cc:237] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.315478 12943 consensus_queue.cc:1059] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:20:42.326774 12962 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:42.327155 11051 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.606s (SENT) [suppressed 1 similar messages]
I20260709 12:20:42.333261 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:42.332269 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.328203 12993 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.334816 11080 consensus_queue.cc:260] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.318233 12890 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.351707 11008 consensus_queue.cc:260] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.353077 11008 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:42.361757 11008 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
W20260709 12:20:42.362562 12943 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:20:42.364048 11658 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:42.361792 12979 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:42.361692 12890 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.367000 12940 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:42.372151 11008 raft_consensus.cc:1240] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:42.374221 13012 consensus_queue.cc:1059] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:42.375244 13012 raft_consensus.cc:3055] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:42.375717 13012 raft_consensus.cc:740] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:20:42.376657 13012 consensus_queue.cc:260] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:42.378015 13012 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:42.380884 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.381876 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.382151 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.383092 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.383340 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.383767 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.384259 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.384619 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.385363 10933 raft_consensus.cc:1240] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:42.385861 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.386732 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:42.387151 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.387812 10934 raft_consensus.cc:2393] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 5: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:42.388646 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.391081 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:42.391624 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:42.392163 10933 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:42.396587 11050 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:42.398357 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.397707 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.398859 13001 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:42.398881 12890 raft_consensus.cc:2955] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:42.401373 10935 raft_consensus.cc:1240] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:42.398968 11083 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:42.402931 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:42.399546 13001 raft_consensus.cc:697] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:42.404853 13001 consensus_queue.cc:237] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.408207 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.403020 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.409902 10930 raft_consensus.cc:2393] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 2: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:42.412189 10977 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:42.413437 11083 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:42.414844 11080 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:42.401065 12979 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:42.417277 10974 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:42.415577 13008 consensus_queue.cc:1059] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:20:42.419148 11078 raft_consensus.cc:2955] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:42.420707 13008 raft_consensus.cc:3055] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:42.421063 13008 raft_consensus.cc:740] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:20:42.421975 13008 consensus_queue.cc:260] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:42.422838 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.423272 13008 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:42.419162 12944 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:42.418291 10977 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:42.425675 10977 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:42.426676 10977 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:42.426928 12937 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:42.427349 12837 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:42.427749 12837 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:42.428140 12837 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:42.427380 12937 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:42.428946 12943 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:42.429216 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.429557 12937 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:42.429685 12943 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:42.430097 12943 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:42.419224 12996 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:42.432381 12996 raft_consensus.cc:697] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:42.433280 12996 consensus_queue.cc:237] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.434504 10977 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:42.434592 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.437798 12937 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.438855 11009 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:42.439106 12944 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:42.439543 12944 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:42.432462 10927 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:42.439915 12944 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:42.406178 12948 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.441771 10977 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:42.452422 10933 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:42.453143 10930 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: []
W20260709 12:20:42.461546 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 144574us
I20260709 12:20:42.459904 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.469949 10899 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.457552 12935 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:42.474144 11078 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:42.474898 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.475590 10899 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:42.477995 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.480381 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.480660 10927 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:42.482649 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.485423 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.488191 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:42.488350 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:42.489437 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.492650 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.493827 11076 raft_consensus.cc:1240] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:42.494550 11083 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:42.495990 10977 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:42.496563 10899 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.499037 10899 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.503227 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:42.504496 11084 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:42.504745 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.504810 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.475755 12935 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:42.505424 11083 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:42.477373 12993 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:42.469941 12940 consensus_queue.cc:1059] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:20:42.486562 12983 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:42.513465 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.494413 12979 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:42.513109 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.498958 12992 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:42.516727 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.479874 12837 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.511343 12935 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:42.525247 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 45738.2us
I20260709 12:20:42.529493 12979 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.521013 12942 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:42.542096 11002 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:42.542382 13025 ts_tablet_manager.cc:933] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:42.543128 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:42.544119 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.547569 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.548440 10930 raft_consensus.cc:2393] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 6: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:42.549263 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.555190 11080 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:42.558648 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:42.558897 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:42.559638 10932 raft_consensus.cc:2393] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 6: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:42.560016 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:42.536127 12942 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:42.561517 12942 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:42.561987 12948 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.564157 13028 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:42.564631 13028 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:42.564976 13028 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:42.568037 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 69063.7us
I20260709 12:20:42.585801 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:42.589546 12957 raft_consensus.cc:3055] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:42.600039 12957 raft_consensus.cc:740] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:42.600337 12943 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.601006 12957 consensus_queue.cc:260] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.602154 12957 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:42.602476 12943 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.604367 12837 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.608052 13029 consensus_queue.cc:1059] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:42.590602 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:42.557915 12979 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.594705 10899 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:42.609579 11008 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:42.615535 10899 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:42.598070 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.610976 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:42.612433 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:42.624620 10974 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:42.623732 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:42.626255 10899 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.627089 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:42.568889 12890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:41090 (request call id 5) took 3670 ms. Trace:
I20260709 12:20:42.627460 12944 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.628509 11003 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:42.629832 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:42.616111 10832 catalog_manager.cc:5697] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 5 to 6, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 6 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:42.627794 11010 raft_consensus.cc:2393] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 6: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:42.632860 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.634171 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:42.635062 10899 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:42.636565 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:20:42.639036 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.642339 13030 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:42.642733 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.647782 12943 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:42.648399 12943 raft_consensus.cc:697] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:42.649365 12943 consensus_queue.cc:237] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.600363 12937 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.652500 12881 consensus_queue.cc:1059] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:42.627964 12890 rpcz_store.cc:276] 0709 12:20:38.858377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.860627 (+  2250us) service_pool.cc:224] Handling call
0709 12:20:41.679149 (+2818522us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b58005402d0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0ebc0aa 00007f9bb0f3e447 00007f9bb0f5b70a 00007f9bb0f5c76a 00007f9bb0f5b91b 00007f9bb0f6703c 00007f9bb0f666b3 00007f9bb5f26d29 00007f9baf4a51d4 00007f9baf4a5162
0709 12:20:41.733465 (+ 54316us) log.cc:844] Serialized 499 byte log entry
0709 12:20:41.919892 (+186427us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b540038c0a0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0ed9142 00007f9bb0eb9eaa 00007f9bb0ec0d53 00007f9bb0ec0cd9 00007f9bb0ec0c69 00007f9bb0ec0c31 00007f9bb0ebfdfd 0000000000388634 0000000000388479 00007f9bade73475
0709 12:20:41.921628 (+  1736us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b18003d1680. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade412a6 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0ee0b26 00007f9bb0eda49a 00007f9bb0ed9714
0709 12:20:41.922027 (+   399us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b540038c0a0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0ee0b26 00007f9bb0eda49a 00007f9bb0ed9714 00007f9bb0eb9eaa 00007f9bb0ec0d53 00007f9bb0ec0cd9 00007f9bb0ec0c69 00007f9bb0ec0c31 00007f9bb0ebfdfd 0000000000388634
0709 12:20:41.934823 (+ 12796us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b540038c0a0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0ed9142 00007f9bb0eb9eaa 00007f9bb0ec0d53 00007f9bb0ec0cd9 00007f9bb0ec0c69 00007f9bb0ec0c31 00007f9bb0ebfdfd 0000000000388634 0000000000388479 00007f9bade73475
0709 12:20:41.963194 (+ 28371us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b18003d1680. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:20:42.529200 (+566006us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23762,"raft.queue_time_us":45566,"raft.run_cpu_time_us":8495,"raft.run_wall_time_us":135822,"spinlock_wait_cycles":47690624,"thread_start_us":51358,"threads_started":1,"wal-append.queue_time_us":152710}
I20260709 12:20:42.653035 12935 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.636305 12992 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:42.654151 11011 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:42.653630 12881 raft_consensus.cc:3055] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:20:42.659785 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 163900us
I20260709 12:20:42.660782 10977 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:42.655488 12881 raft_consensus.cc:740] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:42.662750 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:42.636108 12933 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:42.667971 12890 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:42.669139 13030 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:42.679266 12890 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:42.684304 12890 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:42.676932 12979 consensus_queue.cc:1059] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:20:42.672897 12935 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.643021 12942 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.673346 13025 tablet_copy_client.cc:323] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.66:41383
I20260709 12:20:42.674000 12881 consensus_queue.cc:260] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.664341 12993 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:42.681102 10977 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:42.682014 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.682381 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:42.682687 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:42.669181 12933 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:42.690017 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:42.691896 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:42.692641 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:42.693583 11007 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:42.696218 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:42.698892 10977 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:42.699106 10901 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.700212 10901 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.701375 10901 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.701934 12933 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:42.702191 12997 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:42.702817 12983 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:42.702790 13028 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.703466 10901 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.685606 12979 raft_consensus.cc:3055] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:42.701319 12948 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:42.704461 12948 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:42.704849 10901 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.705704 12983 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:42.706924 10901 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.707638 12983 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:42.709131 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.709776 10901 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.710289 13031 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:42.710569 12983 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:42.710989 13031 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:42.711840 10901 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.712580 12948 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:42.713550 12881 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:42.713846 12942 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.714043 12922 consensus_queue.cc:1059] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:42.715246 12958 consensus_queue.cc:1059] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:42.716501 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.696287 13030 consensus_queue.cc:1059] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:20:42.717033 12958 consensus_queue.cc:1059] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:42.717228 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:42.718407 13001 raft_consensus.cc:3055] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:42.718801 13001 raft_consensus.cc:740] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:42.719584 13001 consensus_queue.cc:260] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.720983 13001 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:42.723486 11006 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:42.724017 11083 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:42.677943 12944 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.718147 12982 raft_consensus.cc:3055] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:42.717859 13030 raft_consensus.cc:3055] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:42.726491 13030 raft_consensus.cc:740] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:42.727272 13030 consensus_queue.cc:260] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.728408 11005 consensus_queue.cc:237] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:42.728627 10977 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:42.730257 10977 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:42.730778 12935 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:42.731355 10977 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:42.726076 12982 raft_consensus.cc:740] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:42.732270 12944 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:42.732867 12982 consensus_queue.cc:260] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.734488 12982 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:42.732599 10977 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:42.731464 12935 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:42.738749 10901 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.740278 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:42.741650 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:42.713884 11051 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:42.718446 12979 raft_consensus.cc:740] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:42.756268 10977 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:42.755089 10899 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.755571 10974 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:42.759187 10977 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:42.759598 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:42.761844 10901 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.762075 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:42.763916 10899 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:42.759172 12942 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:42.717952 12958 raft_consensus.cc:3055] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:42.766458 10977 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:20:42.767055 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 127370us
I20260709 12:20:42.769479 10935 raft_consensus.cc:1240] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:42.728622 13030 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:42.755643 12996 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:42.798019 10901 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:20:42.799512 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 85701.2us
I20260709 12:20:42.759265 12993 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:42.761200 13031 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:42.767581 12962 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:42.767403 12937 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:42.774374 12953 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:42.761052 12948 consensus_queue.cc:1059] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:20:42.808046 13042 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:42.805231 12940 consensus_queue.cc:1059] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:20:42.759598 12837 consensus_queue.cc:1059] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:20:42.803938 12957 consensus_queue.cc:1059] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:20:42.809814 12962 raft_consensus.cc:697] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:42.771478 12983 consensus_queue.cc:1059] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:20:42.805760 13031 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:42.811026 11051 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:42.804024 13035 consensus_queue.cc:1059] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:20:42.806939 12937 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:42.812717 13028 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.807021 12943 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:42.797835 12992 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:42.813741 12890 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.835345 13029 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:42.835484 12942 raft_consensus.cc:3055] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:42.835979 12942 raft_consensus.cc:740] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:42.759398 12881 consensus_queue.cc:1059] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:20:42.828917 12837 raft_consensus.cc:3055] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:42.837239 12837 raft_consensus.cc:740] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:42.837505 12881 raft_consensus.cc:3055] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:42.837910 12881 raft_consensus.cc:740] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:42.838024 12837 consensus_queue.cc:260] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.838798 12881 consensus_queue.cc:260] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.839502 12837 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:42.797567 12958 raft_consensus.cc:740] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:42.829062 12983 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:42.845588 11083 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:20:42.847503 13039 raft_consensus.cc:3055] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:42.847926 13039 raft_consensus.cc:740] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:42.848191 13026 raft_consensus.cc:3055] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:42.848557 13026 raft_consensus.cc:740] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:42.848888 13039 consensus_queue.cc:260] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.849349 13026 consensus_queue.cc:260] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.850081 13039 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:42.850656 13026 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:42.833815 12943 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:42.852224 12943 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:42.841023 12962 consensus_queue.cc:237] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.827205 13031 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:42.800297 12997 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:42.812033 13040 consensus_queue.cc:1059] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:42.828601 11078 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:42.829598 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.833998 11080 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:42.816807 10936 raft_consensus.cc:1240] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:42.840399 13042 consensus_queue.cc:1059] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:20:42.840783 12881 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:42.881413 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 83468.8us
I20260709 12:20:42.821216 12933 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.836544 12890 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.822777 12948 consensus_queue.cc:1243] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:20:42.833046 12937 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:42.844017 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:42.866940 13027 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:42.882294 10901 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:20:42.888375 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 121989us
I20260709 12:20:42.890558 10901 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:20:42.893128 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 72810.7us
W20260709 12:20:42.893729 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 82811.1us
I20260709 12:20:42.895673 12890 consensus_queue.cc:1059] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:42.895429 11051 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:42.896914 12890 raft_consensus.cc:3055] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:42.897536 12890 raft_consensus.cc:740] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:42.898567 12890 consensus_queue.cc:260] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.900360 12890 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:42.895675 10977 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:42.907248 12992 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:42.908226 12944 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:42.913347 10977 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:42.914645 12944 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:42.915076 12944 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:42.915419 12944 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:42.922685 10977 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:42.836751 12942 consensus_queue.cc:260] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.892863 12948 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:42.936422 11084 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:42.938076 10974 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:42.889353 13035 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
W20260709 12:20:42.942734 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 47401.9us
I20260709 12:20:42.889019 12996 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:20:42.945292 11051 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:42.931037 13040 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:20:42.960598 13038 log.cc:927] Time spent T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:20:42.968406 12953 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:42.970510 12953 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:42.971079 12953 raft_consensus.cc:697] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:42.972856 12933 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:42.974627 12983 raft_consensus.cc:993] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:42.961630 12942 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:42.975997 11051 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:42.977231 11051 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:42.931737 12958 consensus_queue.cc:260] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.984339 13040 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:42.985098 13040 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:42.992568 13031 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:42.993815 11008 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:42.996219 13045 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:42.975093 12983 raft_consensus.cc:1081] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:20:43.001268 12944 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:43.004192 12953 consensus_queue.cc:237] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:43.005745 12883 raft_consensus.cc:3055] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:43.006186 12883 raft_consensus.cc:740] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:43.006989 12883 consensus_queue.cc:260] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:43.008337 13008 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:43.008910 13008 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:43.009801 12979 consensus_queue.cc:260] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:43.011510 11051 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:20:43.011806 10975 consensus_peers.cc:597] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 097e40d4693b49118b91e7a4fd8e8eb1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:43.025179 11051 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.031714 11051 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.033095 11051 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.003599 12937 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:43.049568 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 126963us
I20260709 12:20:43.051637 10977 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:43.052814 11051 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.053013 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.052004 13042 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:43.054323 13027 raft_consensus.cc:2764] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:20:43.034322 12883 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:43.055976 12937 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:43.022986 13001 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:43.058645 12982 raft_consensus.cc:3055] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:43.059098 12982 raft_consensus.cc:740] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:43.059969 12982 consensus_queue.cc:260] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:43.060989 12982 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:43.064096 13047 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:43.065503 13008 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:43.051014 12922 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.070281 10977 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:43.074255 10977 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.075095 13047 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:43.075476 10977 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.076293 12837 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:43.076705 10977 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.069357 13048 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:43.077008 12837 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:43.077522 12962 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:43.075505 13047 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:43.078225 13047 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:43.082307 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.071312 12979 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:43.088696 11005 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37586
I20260709 12:20:43.089916 11005 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:43.090360 11005 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:43.088196 11051 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.075495 13050 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:43.092629 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:43.096132 11051 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.097330 13042 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:43.097232 13048 consensus_queue.cc:1059] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:43.098790 11051 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.099108 12943 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:43.099881 13048 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:43.101039 11051 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.101363 12943 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:43.101987 13048 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:43.107573 13050 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:43.108508 11051 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.115227 13050 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:43.117187 13008 consensus_queue.cc:1059] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:43.118681 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:43.121353 12958 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:43.122133 13012 raft_consensus.cc:3055] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:43.123361 11051 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:20:43.128437 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 49373.2us
I20260709 12:20:43.129334 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.130097 12935 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:43.130730 12957 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:43.132934 12996 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:43.141902 11051 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.146207 11002 raft_consensus.cc:1240] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:43.147745 12935 consensus_queue.cc:1059] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:43.029320 13045 consensus_queue.cc:1059] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:20:43.147826 10977 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.161283 10977 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.148998 13054 raft_consensus.cc:3055] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:43.165843 13054 raft_consensus.cc:740] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:43.166265 13041 raft_consensus.cc:3055] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:43.166647 13041 raft_consensus.cc:740] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:43.166754 13054 consensus_queue.cc:260] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:43.167706 13041 consensus_queue.cc:260] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:43.168278 13054 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:43.122623 13012 raft_consensus.cc:740] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:20:43.149405 13040 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:43.180486 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:43.148139 13039 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:43.168784 13041 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:43.185091 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:43.186303 10935 raft_consensus.cc:2393] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 4: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:43.186978 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:43.188632 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:43.189868 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:43.190251 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:43.158380 12943 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:43.199334 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:43.170359 12935 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:43.201274 11077 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:43.196748 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:43.205547 10935 raft_consensus.cc:2393] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 3: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:43.205726 11007 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:43.208225 11008 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:43.209470 11003 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:43.149576 13008 consensus_queue.cc:1059] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:20:43.201406 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:43.211728 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:43.212922 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:43.222996 11085 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:43.223372 10936 raft_consensus.cc:2393] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 3: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:43.214932 10932 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:43.216404 12944 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:43.216771 10934 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:20:43.217473 13001 consensus_queue.cc:1059] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:43.217864 12997 consensus_queue.cc:1059] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:43.218484 13031 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:43.218686 12957 consensus_queue.cc:1059] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:43.219317 13039 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:43.220067 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:43.224709 10935 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 3: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:20:43.228443 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 79009.2us
I20260709 12:20:43.233145 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:43.185187 13026 consensus_queue.cc:1059] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:20:43.250370 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:43.252833 10935 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:43.253706 10929 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 6: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:43.168998 13047 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:43.255434 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:43.257819 11051 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.262668 13026 raft_consensus.cc:3055] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:43.263160 13026 raft_consensus.cc:740] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:43.252971 13012 consensus_queue.cc:260] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:43.264166 13012 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:43.266963 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:43.267243 10977 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.268234 11021 tablet_copy_service.cc:140] P 2201bad9e18849b09cf82de29dd032d3: Received BeginTabletCopySession request for tablet 59db2d2bb22c41aebd0d2073e2ba7d52 from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:41098)
I20260709 12:20:43.268944 12937 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:43.264073 13026 consensus_queue.cc:260] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:43.239912 12890 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:20:43.272694 13026 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:43.273185 10931 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:43.274238 13001 raft_consensus.cc:3055] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:43.274658 13001 raft_consensus.cc:740] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:43.274875 10977 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.280807 11051 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.291662 10977 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.292986 10977 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.268918 11021 tablet_copy_service.cc:161] P 2201bad9e18849b09cf82de29dd032d3: Beginning new tablet copy session on tablet 59db2d2bb22c41aebd0d2073e2ba7d52 from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:41098: session id = 0b171b6aaedc4f809f2753dcfadb14ce-59db2d2bb22c41aebd0d2073e2ba7d52
I20260709 12:20:43.305619 12890 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:43.307384 12943 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:43.309055 13046 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:43.309648 10977 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.310508 13046 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:43.311044 10977 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.311829 12935 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:43.312914 11005 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:43.302603 11082 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:43.315405 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:43.304070 11011 raft_consensus.cc:1240] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:43.317278 13046 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:43.256006 12997 consensus_queue.cc:1243] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:20:43.321925 11005 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:43.263599 13059 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:20:43.304330 13063 raft_consensus.cc:3055] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:43.313678 12953 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:43.303730 13047 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:43.324532 13057 log.cc:927] Time spent T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:20:43.323590 13063 raft_consensus.cc:740] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:43.326117 13063 consensus_queue.cc:260] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:43.327489 13063 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:43.328258 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 47539us
I20260709 12:20:43.316696 10977 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.336716 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:43.336987 13047 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:43.339138 10977 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.341452 13047 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:43.342115 11006 raft_consensus.cc:1240] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:43.343583 13047 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:43.347849 13047 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:43.348673 12942 raft_consensus.cc:3055] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:43.349092 12942 raft_consensus.cc:740] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:43.349927 12942 consensus_queue.cc:260] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:43.351176 12942 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:43.351588 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:43.352825 11011 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:43.353636 12933 consensus_queue.cc:1059] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:43.354581 10933 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:43.355067 13053 raft_consensus.cc:3055] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:43.355441 13053 raft_consensus.cc:740] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:43.356156 10929 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:20:43.356854 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:43.357410 13062 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:43.337363 11076 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:43.362804 10974 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.361299 10977 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.378147 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:43.379539 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:43.380267 10928 raft_consensus.cc:2393] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 4: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:43.275105 13048 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:20:43.400374 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 272182us
I20260709 12:20:43.323606 12922 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:43.403936 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:43.406497 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:43.405392 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:43.428735 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:43.405560 12953 consensus_queue.cc:1059] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
W20260709 12:20:43.435577 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 224048us
I20260709 12:20:43.412204 10928 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:43.432379 10899 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:43.392853 12937 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:43.391834 12837 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:43.437505 11005 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:43.403347 12957 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:43.434104 10930 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:43.433732 11051 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.439252 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:43.275484 13001 consensus_queue.cc:260] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:43.397279 12948 consensus_queue.cc:1059] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:20:43.448803 10932 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:43.456003 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 54218.1us
W20260709 12:20:43.464452 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.464849 11051 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.445982 12937 raft_consensus.cc:697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:43.412207 12935 consensus_queue.cc:1059] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:20:43.451529 12883 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:20:43.455821 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 109398us
I20260709 12:20:43.470141 13048 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:43.476919 12937 consensus_queue.cc:237] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:43.456835 13040 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:43.486724 11051 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:20:43.529963 13060 log.cc:927] Time spent T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:20:43.493945 12883 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:43.491459 13001 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:43.494212 12982 consensus_queue.cc:1059] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:20:43.491190 13042 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:43.627170 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 158643us
I20260709 12:20:43.438308 13053 consensus_queue.cc:260] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:43.660552 11076 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:43.662173 11084 raft_consensus.cc:1240] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:43.664063 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.664748 10899 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:43.502769 13055 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:20:43.629915 12958 consensus_meta.cc:287] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.508s	user 0.012s	sys 0.008s
I20260709 12:20:43.664708 10974 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:43.628036 13062 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:43.494375 13040 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:43.676576 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 46813.8us
W20260709 12:20:43.706105 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.677213 13008 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:43.683679 13053 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:43.712373 13066 log.cc:927] Time spent T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.118s	user 0.000s	sys 0.004s
I20260709 12:20:43.689615 12953 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:43.702366 13055 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:43.732064 13074 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:20:43.732251 11021 tablet_copy_source_session.cc:215] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:43.738787 11079 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:43.744436 11076 raft_consensus.cc:1240] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:43.666819 11624 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:43.745379 13064 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:43.745501 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 92271.2us
W20260709 12:20:43.745716 13068 log.cc:927] Time spent T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:20:43.771462 10927 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:43.738011 12953 raft_consensus.cc:697] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:43.776405 12953 consensus_queue.cc:237] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:43.787557 13085 ts_tablet_manager.cc:933] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:20:43.788324 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 123636us
I20260709 12:20:43.789634 10899 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:43.790409 13081 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:43.723023 13008 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:43.720907 13076 consensus_queue.cc:1059] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:20:43.795125 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:43.799716 11077 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:43.800550 13053 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:43.801420 13085 tablet_copy_client.cc:323] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.66:41383
I20260709 12:20:43.803452 12883 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:43.801272 13053 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:43.825268  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:43.815721 10931 raft_consensus.cc:1240] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:43.803385 13064 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:43.860666 13067 raft_consensus.cc:3055] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:43.861145 13067 raft_consensus.cc:740] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:20:43.861624 13059 raft_consensus.cc:3055] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:43.862157 13059 raft_consensus.cc:740] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:43.862257 12940 raft_consensus.cc:3055] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:43.862658 12940 raft_consensus.cc:740] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:43.863479 12940 consensus_queue.cc:260] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:43.864226 13031 raft_consensus.cc:3055] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:43.864624 13031 raft_consensus.cc:740] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:43.864741 12940 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:43.865427 13031 consensus_queue.cc:260] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:43.866354 13031 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.869678 13053 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:43.843701 13041 consensus_meta.cc:287] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.648s	user 0.008s	sys 0.011s
I20260709 12:20:43.863096 13059 consensus_queue.cc:260] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
W20260709 12:20:43.852888 13012 consensus_meta.cc:287] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.586s	user 0.012s	sys 0.001s
I20260709 12:20:43.855756 13042 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:43.879964 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:43.881253 10929 raft_consensus.cc:1240] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:43.880612 11078 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
W20260709 12:20:43.883106 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 76188.7us
I20260709 12:20:43.885666 13008 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:43.888847 10899 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:43.844897 13086 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:20:43.896765 13071 consensus_queue.cc:1059] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:20:43.897032 11021 tablet_copy_service.cc:140] P 2201bad9e18849b09cf82de29dd032d3: Received BeginTabletCopySession request for tablet 097e40d4693b49118b91e7a4fd8e8eb1 from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:41098)
I20260709 12:20:43.897792 11021 tablet_copy_service.cc:161] P 2201bad9e18849b09cf82de29dd032d3: Beginning new tablet copy session on tablet 097e40d4693b49118b91e7a4fd8e8eb1 from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:41098: session id = 0b171b6aaedc4f809f2753dcfadb14ce-097e40d4693b49118b91e7a4fd8e8eb1
I20260709 12:20:43.898900 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:43.899498 11078 raft_consensus.cc:2393] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 5: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:43.889509 13059 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:43.901571 11085 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
W20260709 12:20:43.906625 13054 consensus_meta.cc:287] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.738s	user 0.011s	sys 0.000s
W20260709 12:20:43.901142 12942 consensus_meta.cc:287] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.003s
I20260709 12:20:43.874344 13064 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:43.908540 10936 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:43.910240 13064 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:43.892654 13081 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:43.916471 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:43.917199 11005 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 5.
I20260709 12:20:43.917548 13028 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.918033 13028 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:43.920143 13025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59db2d2bb22c41aebd0d2073e2ba7d52. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:43.922255 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.927074 10934 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:43.928300 10933 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:20:43.931767 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:43.932497 10930 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:43.932906 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:43.933369 10933 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:43.938263 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:43.940905 13067 consensus_queue.cc:260] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:43.942162 13067 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:43.944443 13001 raft_consensus.cc:3055] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:43.944947 13001 raft_consensus.cc:740] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:43.945930 13001 consensus_queue.cc:260] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:43.947260 13001 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:43.952106 13028 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:43.954066 11624 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:43.954309 10977 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:43.955155 13012 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:43.955559 13012 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:43.955986 13012 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:43.958995 13058 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:43.959457 13058 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.959800 13058 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:43.911764 13081 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:43.969514 12996 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:20:43.967833 13081 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:43.993078 11021 tablet_copy_source_session.cc:215] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:44.019562 11003 raft_consensus.cc:1240] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:44.020843 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:44.022984 13040 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:44.007364 13058 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.039330 13085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 097e40d4693b49118b91e7a4fd8e8eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:44.041438 11005 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:20:44.044713 13058 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:44.048614 13094 log.cc:927] Time spent T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 12:20:44.050087 13092 log.cc:927] Time spent T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:20:44.050427 12997 raft_consensus.cc:3055] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:44.050558 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:44.050909 12997 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:44.051832 12997 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.053000 12997 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:44.055051 13081 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:44.055691 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.057597 13040 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:44.050282 13069 raft_consensus.cc:3055] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:44.060202 13069 raft_consensus.cc:740] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:44.060266 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:44.062553 11010 raft_consensus.cc:2393] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 3: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:44.062346 13069 consensus_queue.cc:260] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.063319 13069 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:44.063670 13049 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:44.069510 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:44.070076 10928 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:44.070755 10931 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:44.073285 13049 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.078296 13049 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:44.079229 12890 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:44.085088 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:44.085839 11085 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:44.086350 10928 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:20:44.090078 12837 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:44.091651 13012 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:44.093945 13012 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:44.095345 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:44.095760 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:44.095898 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:44.096529 11082 raft_consensus.cc:2393] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 5: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:44.098050 11084 raft_consensus.cc:2955] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:44.100070 11050 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:44.100657 10936 raft_consensus.cc:2955] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:44.102109 11081 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:44.103291 13065 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:44.111665 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:44.115408 11008 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 5.
W20260709 12:20:44.117182 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.121100 13045 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:44.121702 13045 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.125341 11622 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:44.126129 13045 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:44.130237 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:44.131032 11005 raft_consensus.cc:2393] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 5: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:44.126976 13091 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.135210 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:44.134691 10832 catalog_manager.cc:5697] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 3 to 4, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 4 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:44.138767 10832 catalog_manager.cc:5697] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 6 to 7, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 7 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.137444 13045 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:20:44.143760 13045 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:44.147637 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:44.105521 13012 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.126900 13064 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:44.159091 12937 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.159631 12937 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:44.162955 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:44.149245 13035 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:44.168246 12922 consensus_queue.cc:1059] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:44.168612 12937 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:44.169179 12922 raft_consensus.cc:3055] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:44.169525 12922 raft_consensus.cc:740] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:44.169834 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:44.170449 11005 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:44.084141 12935 raft_consensus.cc:2955] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:44.156124 10935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
W20260709 12:20:44.172876 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.173113 10935 raft_consensus.cc:606] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:44.150736 10832 catalog_manager.cc:5697] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 5 to 6, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 6 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:44.132844 13091 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:44.152751 10933 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:20:44.148516 11624 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:44.156440 13012 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:44.149477 11654 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:44.180094 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:44.157642 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:44.180775 11083 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:44.181068 10927 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 5: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:44.173544 10935 raft_consensus.cc:614] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:44.177160 10832 catalog_manager.cc:5697] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 1 to 2, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 2 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:44.180218 12940 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.184300 12996 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:44.185035 12940 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.185865 13064 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:44.186395 13064 raft_consensus.cc:697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:20:44.187301 13064 consensus_queue.cc:237] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:44.189170 10899 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:20:44.185336 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 55254.7us
I20260709 12:20:44.170336 12922 consensus_queue.cc:260] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.190122 10899 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:44.183013 10832 catalog_manager.cc:5697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 3 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:44.157318 13045 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:44.197355 10832 catalog_manager.cc:5697] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 2 to 3, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 3 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:44.199167 10977 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:44.199240 10832 catalog_manager.cc:5697] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 2 to 3, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 3 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:44.187198 12940 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:44.205710 11049 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:20:44.207072 11051 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:44.206576 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:44.206451 10974 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:44.208040 10935 raft_consensus.cc:2393] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 5: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:44.207216 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:44.209172 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:44.209475 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:44.210008 10936 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:44.210421 11005 raft_consensus.cc:2393] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 3: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:44.185056 13081 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:44.216739 12940 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:44.217211 12940 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:20:44.217578 12940 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:44.218256 10931 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:44.197032 12948 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:44.217681 13059 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:44.219746 13059 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.220273 13059 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:44.221978 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:44.222397 11050 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:44.224684 11083 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:44.225450 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:44.226078 11003 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:44.227069 11050 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:44.197261 11658 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:44.212342 13053 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:44.222816 12937 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:44.221609 13065 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:44.240351 10899 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:44.228315 13045 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:44.229297 12948 raft_consensus.cc:697] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:44.231330 13040 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:44.227917 13031 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:20:44.245995 13084 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.237896 13053 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:44.266004 11077 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:20:44.269423 11077 raft_consensus.cc:606] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:44.269797 11077 raft_consensus.cc:614] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:44.255033 13040 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.247480 13081 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.252043 12997 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:44.251304 12937 raft_consensus.cc:697] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:44.251494 13045 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:44.238451 13039 consensus_queue.cc:1059] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:20:44.267663 13084 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.272331 13053 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:44.272540 13040 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:44.280146 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:44.282277 10931 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 5.
I20260709 12:20:44.276041 13045 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:44.283435 11625 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:44.276674 12997 raft_consensus.cc:697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:44.290189 13067 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:44.290628 13067 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.290992 13067 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:44.283883 13055 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.272833 13081 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.292181 13055 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:44.296154 13085 tablet_copy_client.cc:806] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:44.284790 13049 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:44.311314 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:44.312021 11003 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:44.313966 10901 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:44.306564 12937 consensus_queue.cc:237] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.314764 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:44.315351 11003 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:44.316872 10901 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:44.323406 11076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:20:44.323952 11076 raft_consensus.cc:606] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:44.324308 11076 raft_consensus.cc:614] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:44.325663 13112 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:44.326120 13112 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.326433 13112 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:44.317839 13012 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:44.284507 12948 consensus_queue.cc:237] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.341094 13055 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:44.342540 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:44.351898 13055 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:44.352061 11654 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:44.352362 13055 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.352726 13055 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:44.328567 12942 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:44.331961 13085 tablet_copy_client.cc:670] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:44.363583 10900 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:44.323838 13049 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.353063 12997 consensus_queue.cc:237] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.369572 12940 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:44.377686 12940 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:44.377815 13084 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:44.375703 13025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59398 (request call id 132) took 1942 ms. Trace:
W20260709 12:20:44.381508 13104 log.cc:927] Time spent T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.090s	user 0.003s	sys 0.000s
I20260709 12:20:44.362253 12942 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.382588 13059 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:44.383742 11005 raft_consensus.cc:2393] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 6: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:44.384356 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:44.384793 13091 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:44.385097 11003 raft_consensus.cc:2393] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 6: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:44.383545 12942 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:44.392701 13049 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:44.393524 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:44.394330 11003 raft_consensus.cc:2393] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 4: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:44.398216 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:44.399525 12957 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:44.400615 11085 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83b4e206b7694af695234c0e758055e2"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:20:44.418355 11085 raft_consensus.cc:606] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:44.418917 11085 raft_consensus.cc:614] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:20:44.419055 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 55558.2us
I20260709 12:20:44.386543 13053 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.416047 13040 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:44.429751 13111 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:20:44.422488 12933 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:44.440378 13079 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.445400 13079 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:44.446094 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:44.446749 11077 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 4.
I20260709 12:20:44.447530 13079 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:44.448601 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:44.448839 13059 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:44.449653 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:44.452018 12933 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.464282 11081 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 5.
I20260709 12:20:44.451704 13050 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.453501 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:44.456688 13067 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:44.418232 12957 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.458103 12922 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:44.434266 13110 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.465351 11008 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:44.440570 13035 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:44.380944 13025 rpcz_store.cc:276] 0709 12:20:42.433015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.433339 (+   324us) service_pool.cc:224] Handling call
0709 12:20:42.542663 (+109324us) ts_tablet_manager.cc:934] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
0709 12:20:43.918834 (+1376171us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:20:44.034904 (+116070us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:44.035028 (+   124us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:20:44.374959 (+339931us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:20:44.375252 (+   293us) tablet_replica.cc:206] Creating consensus instance
0709 12:20:44.375550 (+   298us) ts_tablet_manager.cc:989] Replica registered.
0709 12:20:44.375617 (+    67us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":16026,"tablet-copy.queue_time_us":108483,"thread_start_us":178349,"threads_started":2}
I20260709 12:20:44.466179 13050 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.451676 10829 catalog_manager.cc:5697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 4 to 5, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 5 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.465901 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:44.472626 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:44.473721 11622 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:20:44.464773 12933 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:44.476413 13109 log.cc:927] Time spent T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:20:44.469306 12948 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.477082 11654 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:44.503034 11008 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:44.506436 11008 raft_consensus.cc:606] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:44.486081 13025 tablet_copy_client.cc:806] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:44.512295 11050 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:44.478538 13045 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.485965 11658 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:44.514724 11049 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:20:44.515311 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:44.518023 11078 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:20:44.518275 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 142529us
I20260709 12:20:44.521687  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:44.522861 11081 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:44.523054  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:44.524003 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:44.524735 11085 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:44.480592 13035 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.532758 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:44.526017 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:44.533212 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:44.533861 11077 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:44.526645 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:44.517727 13082 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:44.521588 13069 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:44.529042 12957 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:44.529656 13050 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:44.530535 13053 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:44.495016 12948 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:44.533378 11082 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:44.536507 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:44.539991 10932 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:44.536772 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:44.542465 10931 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:44.521989 13025 tablet_copy_client.cc:670] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:44.534065 11085 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:20:44.480269 13110 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.553606 13110 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:44.548604 11005 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:44.547726 11008 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:44.550570 13069 raft_consensus.cc:697] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:44.555573 13069 consensus_queue.cc:237] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:44.558415 12935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:41090 (request call id 6) took 1833 ms. Trace:
I20260709 12:20:44.562889 12944 raft_consensus.cc:993] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:44.538816 13082 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.564832 13082 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:44.569847 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:44.570181 13090 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:44.571458 13085 tablet_copy_client.cc:538] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:44.572266 12944 raft_consensus.cc:1081] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:44.574244 13081 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:44.576642 13067 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:44.578408 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:44.579149 13025 tablet_copy_client.cc:538] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:44.582026 13035 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:44.582240 12948 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:44.559165 13112 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.585160 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:44.585742 11085 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:44.586745 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:44.587116 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:44.587385 11082 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:44.587750 11077 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:44.590359 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:44.590988 10932 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:44.591581 10899 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:44.595534 10899 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:44.596808 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:44.597371 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:44.598037 10936 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:44.589972 11078 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:44.599251 11051 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:44.600500 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:44.600898 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:44.601066 11010 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:44.601579 11008 raft_consensus.cc:2393] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 5: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:44.599032 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:44.603554 10935 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:44.606441 11085 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:20:44.607434 11622 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:20:44.608144 12942 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:44.616696 12942 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:44.617164 12942 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:44.618613  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:44.620193 13012 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:44.620782 13012 raft_consensus.cc:697] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:20:44.621697 13012 consensus_queue.cc:237] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:44.608903 12933 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:44.610730 11658 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:44.611196 13001 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:44.612210 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:44.588717 13059 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.631716 11004 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:44.589092 12948 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.630281 10899 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:44.635001 10927 raft_consensus.cc:2368] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6.
I20260709 12:20:44.640516 10899 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:44.642112 13040 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:44.644166 10975 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:44.646065 12837 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:44.646607 12837 raft_consensus.cc:697] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:44.655229 10935 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:20:44.633270 13001 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.628736 13064 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:44.631251 13081 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:44.633427 13091 raft_consensus.cc:2764] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:20:44.659870 12837 consensus_queue.cc:237] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:44.662515 13082 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:44.663306 13118 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:44.605551 13035 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:20:44.692345 10977 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:44.670042 11050 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:44.646481 13110 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:44.682749 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:44.684507 11080 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:44.691315 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:44.698339 10936 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:44.694187 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:44.683292 12933 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:44.657733 13112 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:44.645578 12948 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.701068 11078 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:20:44.558928 12935 rpcz_store.cc:276] 0709 12:20:42.724663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.726423 (+  1760us) service_pool.cc:224] Handling call
0709 12:20:42.824478 (+ 98055us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b4c00213ac0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9baf22ca20 00007f9baf23da29 00007f9baf203644 00007f9baf22af2d 00007f9baf22ab93 00007f9bb0eb91af 00007f9bb0eb8f3e 00007f9bb0f3e888 00007f9bb0f5b75c 00007f9bb0f5c76a 00007f9bb0f5b91b
0709 12:20:42.833932 (+  9454us) log.cc:844] Serialized 499 byte log entry
0709 12:20:43.107256 (+273324us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b540038eda0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0ed9142 00007f9bb0eb9eaa 00007f9bb0ec0d53 00007f9bb0ec0cd9 00007f9bb0ec0c69 00007f9bb0ec0c31 00007f9bb0ebfdfd 0000000000388634 0000000000388479 00007f9bade73475
0709 12:20:44.558304 (+1451048us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":2973,"mutex_wait_us":4575,"raft.queue_time_us":49348,"raft.run_cpu_time_us":3375,"raft.run_wall_time_us":111490,"spinlock_wait_cycles":38203136,"thread_start_us":142042,"threads_started":2,"wal-append.queue_time_us":75963,"wal-append.run_cpu_time_us":1965,"wal-append.run_wall_time_us":1034084}
I20260709 12:20:44.704140 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:44.709143 11078 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:44.709334 11085 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:44.715111 10936 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:20:44.716056 11078 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:44.717051 11077 raft_consensus.cc:2393] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 2: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:20:44.705603 13120 log.cc:927] Time spent T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:20:44.672973 13001 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:44.707017 11004 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:44.707144 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:44.721230 11003 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:44.672863 13058 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.639599 13059 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.717955 11085 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:44.676642 13081 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:44.724797 11051 leader_election.cc:400] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6.
I20260709 12:20:44.729871 11051 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:44.726390 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:44.701866 12922 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:44.695935 13118 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.732491 11081 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:44.733209 10932 raft_consensus.cc:2393] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 3: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:44.701093 13110 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.734864 13069 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:44.735435 13069 raft_consensus.cc:697] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:44.736133 13084 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.736670 13084 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.737918 13059 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:44.738838 13084 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:44.706822 13028 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:44.741660 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:44.744174 11078 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.730069 13081 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:44.679749 13064 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:44.754539 13064 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:44.736317 13069 consensus_queue.cc:237] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.757141 12948 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:44.707612 13047 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:20:44.765007 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:44.765728 11008 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:44.766595 13025 tablet_bootstrap.cc:492] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:20:44.751116 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:44.759994 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:44.761368 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:44.774711 11005 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:20:44.730316 13058 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.768167 11080 raft_consensus.cc:1240] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:44.768769 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:44.729049 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:44.774638 11076 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:20:44.789860 11077 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 5.
I20260709 12:20:44.770750 10899 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:44.736315 13082 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:44.774158 10930 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:44.740422 13118 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:44.745244 13028 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:44.740513 13110 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:44.741485 12922 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:44.773170 10901 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:44.758153 13045 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:44.799777 10899 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:44.802657 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:20:44.803589 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 74909.4us
I20260709 12:20:44.804718 10901 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:44.773375 12997 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.792055 13028 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:44.796149 12922 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:44.796268 11658 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:44.806722 10977 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:44.816908 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:44.803076 12948 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:44.769480 13055 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.769335 12942 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.808542 11622 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:20:44.827473 13124 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.827817 13091 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:44.805830 13053 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:44.827898 13112 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:44.805635 13126 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:44.829788 12935 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:20:44.854627 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:44.855273 10935 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:44.853734 13124 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:44.819499 12997 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.839442 13112 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.838423 12937 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:44.831964 13091 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:44.863312 13012 consensus_queue.cc:1059] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:20:44.875344 13012 raft_consensus.cc:3055] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:44.875715 13012 raft_consensus.cc:740] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:20:44.876749 13012 consensus_queue.cc:260] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:44.877710 13012 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:44.884486 11078 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:44.886252 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:44.886968 11005 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:44.887584 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:44.899617 10935 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:44.847626 12948 raft_consensus.cc:697] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:44.846726 13126 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.869043 13112 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:44.902088 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 53916.7us
I20260709 12:20:44.900980 11051 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:44.870713 13091 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:44.869390 12937 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:44.911927 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 69773.6us
I20260709 12:20:44.915827 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:44.916535 11085 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:44.880898 13055 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:44.924917 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:44.925630 11084 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
W20260709 12:20:44.928404 10882 auto_rebalancer.cc:629] Failed to schedule move for tablet 07467552f78d410bb9e5774f3340f134: Illegal state: Replica 9e8170bbe8244e40a2b2e5011e69b697 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:44.920410 11003 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:20:44.929426 11008 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:44.931839 11008 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:44.932204 11085 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:44.916482 12937 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:44.938620 10899 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:44.908334 13126 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:44.918458 13045 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:44.909050 13124 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:44.941957 11085 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:44.945099 13001 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.949867 13125 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:44.950206 13118 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:44.951880 10928 raft_consensus.cc:2368] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 5. Current term is 6.
I20260709 12:20:44.952808 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:44.953572 10935 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:44.955451 11005 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:44.961047 12948 consensus_queue.cc:237] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:44.961174 13127 raft_consensus.cc:476] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 12:20:44.957334 12979 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:44.943040 12933 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:20:44.971781 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:44.972301 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:44.978050 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:44.983662 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:44.947600 13053 raft_consensus.cc:697] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:44.983938 11005 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:44.986873 11085 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:44.961158 13045 raft_consensus.cc:697] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:44.975876 13118 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:45.008064 13085 tablet_bootstrap.cc:492] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:20:45.008888 12997 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:45.011094 11003 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:45.014050 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:45.014698 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:44.984012 11008 raft_consensus.cc:3055] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:45.015476 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:45.018098 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:45.025120 11079 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:44.996929 11658 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:20:45.007977 13091 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:45.020363 13001 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:45.025698 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:45.031385 11006 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:45.026253 11008 raft_consensus.cc:740] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:45.026661 11004 raft_consensus.cc:2393] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 4: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:45.018296 11005 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:20:45.026309 11659 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:45.021754 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:45.039507 13053 consensus_queue.cc:237] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.040141 11657 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:45.029245 11050 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:45.024590 11009 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:45.034488 11625 leader_election.cc:400] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 5. Current term is 6.
I20260709 12:20:45.007819 13039 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.036041 13110 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.036861 13091 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:45.010142 13045 consensus_queue.cc:237] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.039108 10900 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:45.050868 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:44.988015 12979 raft_consensus.cc:697] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:45.052482 10901 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:45.053946 10928 raft_consensus.cc:2368] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 5. Current term is 6.
I20260709 12:20:45.064595 11625 leader_election.cc:400] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 5. Current term is 6.
I20260709 12:20:45.062062 11008 consensus_queue.cc:260] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.064945 10900 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:45.064994 11625 leader_election.cc:403] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:20:45.069000 10927 raft_consensus.cc:2368] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6.
I20260709 12:20:45.051620 12890 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.072723 13136 raft_consensus.cc:2804] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:45.073103 13118 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:45.073683 13135 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:45.054543 13039 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.078013 13110 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:45.079488 11008 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:45.054811 13065 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:45.055289 11085 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:20:45.086467 10935 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
W20260709 12:20:45.109735 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 80581.4us
I20260709 12:20:45.100147 13136 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.112084 11050 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:45.101673 13135 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.106078 13118 raft_consensus.cc:697] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:20:45.122114 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.123966 12922 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.126092 12922 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:45.126832 11077 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:45.129475 12937 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.100092 12890 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.117590 13136 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:45.142758 11008 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:45.118641 13040 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:45.162966 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:45.119568 13135 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:45.113791 13065 raft_consensus.cc:697] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:45.218887 11004 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:45.220706 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:45.217958 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:45.219499 13047 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.131790 12937 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:45.270198 11008 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:45.150379 13058 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:45.147383 12942 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:45.137480 13039 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:45.290091 10933 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:20:45.222349 12922 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.222499 12944 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.224897 13040 raft_consensus.cc:697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:45.296278 11008 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:20:45.250696 13127 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.134493 13081 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.136183 13112 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.155839 13028 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.284773 12996 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.122486 12979 consensus_queue.cc:237] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.282691 13069 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:45.286715 13001 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:45.146546 13118 consensus_queue.cc:237] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:45.316218 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:45.328104 10934 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:45.314962 10899 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:20:45.283906 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 57941.9us
I20260709 12:20:45.322937 11076 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:45.315836 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:45.333937 13055 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:45.335794 13055 raft_consensus.cc:697] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:45.336182 13040 consensus_queue.cc:237] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:45.336722 13055 consensus_queue.cc:237] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:45.327809 13085 tablet_bootstrap.cc:700] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent opening tablet: real 0.192s	user 0.003s	sys 0.000s
I20260709 12:20:45.347168 10932 raft_consensus.cc:2368] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4.
I20260709 12:20:45.299765 12922 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.357028 11658 raft_consensus.cc:1240] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:45.360497 13050 consensus_queue.cc:1059] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:45.361544 13050 raft_consensus.cc:3055] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:45.364223 13050 raft_consensus.cc:740] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:20:45.360385 13137 log.cc:927] Time spent T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:20:45.375085 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:45.375330 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:45.376014 11004 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:45.304209 12944 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.378050 11004 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:45.378434 11050 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:45.379268 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:45.379820 11077 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:45.380887 10928 raft_consensus.cc:1240] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:45.291966 13047 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.380451 13050 consensus_queue.cc:260] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:45.382582 13050 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:45.384052 13047 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:45.365548 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 133915us
I20260709 12:20:45.309774 13127 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.393695 11006 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:20:45.326427 12996 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:45.396867 11082 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:20:45.397312 11082 pending_rounds.cc:85] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 3
I20260709 12:20:45.398209 11077 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:20:45.408566 11010 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:45.372236 12953 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.344520 13001 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.412434 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:45.412492 11077 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:45.393291 13041 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:45.397550 11082 pending_rounds.cc:107] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:20:45.421546 11082 raft_consensus.cc:2889] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:45.422163 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:45.422796 11083 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:45.391934 12935 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.421470 11079 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:45.328212 13069 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:45.428661 11051 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:45.355829 13126 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.431298 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:45.433835 11083 raft_consensus.cc:2368] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 5. Current term is 6.
I20260709 12:20:45.433887 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:45.432613 11082 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:45.434576 11050 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:45.428227 12890 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:45.401269 12996 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:45.438845 12922 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:45.439720 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:45.440614 13001 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:45.436498 13081 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:45.441193 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:45.424150 13045 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:45.443418 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.399817 13127 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:45.395059 12957 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:20:45.444432 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:45.442685 11080 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:45.424538 13041 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.443570 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:45.442723 13039 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:45.444305 13058 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:20:45.454253 10936 raft_consensus.cc:2393] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 7: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:45.453117 11077 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:45.450471 11082 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:45.447803 12944 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:45.362947 13065 consensus_queue.cc:237] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.429972 12935 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.453104 13041 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:45.445739 13079 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:45.485150 13079 raft_consensus.cc:697] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:45.486152 13079 consensus_queue.cc:237] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.473920 11085 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:45.424366 12953 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.493541 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:45.494158 12953 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:45.494781 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:45.495342 11008 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:45.496133 12935 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:45.476701 13028 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:45.473680 13069 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:45.494346 11006 raft_consensus.cc:2393] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 6: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:45.506727 11051 leader_election.cc:400] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6.
I20260709 12:20:45.436398 11657 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:20:45.448746 13045 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.488900 13112 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:45.510633 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 60684.6us
I20260709 12:20:45.522625 10928 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:45.517066 11051 leader_election.cc:400] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4.
I20260709 12:20:45.461244 11622 leader_election.cc:400] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 5. Current term is 6.
I20260709 12:20:45.519147 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:45.528903 10934 raft_consensus.cc:2393] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 2: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:45.526026 10974 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:45.519721 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:45.456226 12922 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:45.529700 10929 raft_consensus.cc:2393] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 4: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:45.529628 10901 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:45.517755 11008 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
W20260709 12:20:45.470911 13141 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:20:45.521148 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:45.519410 13126 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:45.458544 13039 raft_consensus.cc:697] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:45.521767 13012 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 5. Current term is 6.
I20260709 12:20:45.503947 13136 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:45.548442 10974 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:45.458683 13058 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:20:45.559108 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 102920us
I20260709 12:20:45.564270 13058 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:45.556844 12953 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:20:45.565423 13067 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:45.559697 11657 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:20:45.560242 10882 auto_rebalancer.cc:629] Failed to schedule move for tablet 80db8b3fbfd046e8a5535ff4a7380107: Illegal state: Replica 2201bad9e18849b09cf82de29dd032d3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:45.568996 10974 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:45.534009 12935 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:45.577461 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.524991 13135 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.572427 10901 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:45.554112 13125 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:45.584973 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:45.555215 12996 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:45.592232 10935 raft_consensus.cc:2393] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 5: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:45.552686 13112 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:20:45.546715 12922 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.577720 13090 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:45.595355 10974 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:45.557044 12937 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:20:45.603206 12922 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:45.587080 13115 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.603929 12922 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:45.604182 13115 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.604760 13081 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.605248 13081 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.605718 12890 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:45.606109 12890 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.606462 12890 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:45.607075 13125 raft_consensus.cc:697] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:45.597538 13090 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.588817 13118 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:45.610550 10974 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:45.614924 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:45.615343 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:45.615594 11082 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:45.616886 11083 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:20:45.617444 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:45.591451 13058 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.623535 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:45.628443 11006 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:45.591686 12996 raft_consensus.cc:697] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:45.586229 12935 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.635514 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:45.636201 11084 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:45.637607 13135 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:45.637311 12996 consensus_queue.cc:237] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.633914 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:45.638628 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:45.639319 11008 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:20:45.621011 13156 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:45.640677 13156 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.641010 13156 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:45.610695 13090 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:45.647984 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 48041.7us
I20260709 12:20:45.650017 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:45.650823 11005 raft_consensus.cc:2393] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 6: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:45.651132 10974 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:45.652127 11050 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:45.653595 11050 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:45.621352 13046 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:45.626813 13118 raft_consensus.cc:697] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:45.657562 10974 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:45.663110 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:45.588521 13039 consensus_queue.cc:237] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.639235 11657 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:45.608033 13125 consensus_queue.cc:237] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.622614 13028 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:20:45.658886 13046 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.660389 12944 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:45.659730 13145 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:45.664652 13082 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:45.634281 13058 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.673934 10975 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:45.670975 13046 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:45.673663 13145 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:45.673193 13082 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.722153 13082 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:45.756695 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 94046.7us
I20260709 12:20:45.762279 11084 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:45.785873 11081 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:45.685518 13166 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:45.688825 13127 raft_consensus.cc:2804] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:45.721160 13145 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:45.747234 13112 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.790966 13025 tablet_bootstrap.cc:492] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:45.811944 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:45.813098 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:45.813853 11085 raft_consensus.cc:2393] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 7: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:45.809476 10934 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:20:45.817459 13163 log.cc:927] Time spent T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 12:20:45.807452 13166 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.806236 13127 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:20:45.804041 12979 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:45.825564 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:45.826237 11085 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:45.829161 13169 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:45.829497 13045 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:45.832062 13127 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:45.822616 13166 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:45.723589 13118 consensus_queue.cc:237] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:45.848702 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 90987.3us
I20260709 12:20:45.848462 11085 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:45.820080 13115 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:45.816418 13112 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:45.847296 13162 log.cc:927] Time spent T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 12:20:45.841846 12890 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.839329 12979 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.866659 10974 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:20:45.864692 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 108861us
I20260709 12:20:45.845314 12935 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:45.871783 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 73450.4us
I20260709 12:20:45.872838 10899 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:45.832743 13134 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:20:45.848034 13041 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.864533 11657 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:45.869892 13025 tablet_bootstrap.cc:492] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
W20260709 12:20:45.995378 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 106782us
I20260709 12:20:46.001330 11077 raft_consensus.cc:2368] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:45.929214 13129 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:20:46.002061 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.928577 13058 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:45.997351 13175 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:46.033851 13025 ts_tablet_manager.cc:1403] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 1.264s	user 0.030s	sys 0.025s
I20260709 12:20:46.037810 13025 raft_consensus.cc:359] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:46.038810 13025 raft_consensus.cc:740] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:20:46.012104 13129 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:46.005438 12948 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:20:46.009397 13135 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:20:46.039578 13025 consensus_queue.cc:260] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:46.056082 13125 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
W20260709 12:20:46.063599 13172 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:20:46.085084 13041 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:46.088575 12890 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:46.090024 12979 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:46.091004 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:46.091512 11006 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:46.091892 11010 raft_consensus.cc:2393] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 5: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:46.104875 11659 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:20:46.105258 11659 pending_rounds.cc:85] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: Aborting all ops after (but not including) 6
I20260709 12:20:46.105485 11659 pending_rounds.cc:107] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:20:46.105692 13153 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.105718 11659 raft_consensus.cc:2889] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:46.108515 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 180513us
I20260709 12:20:46.051841 13129 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:46.110351 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:46.078967 13090 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:46.110801 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:46.117149 11003 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:46.078423 13085 tablet_bootstrap.cc:492] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:20:46.118520 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:46.128042 11007 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
W20260709 12:20:46.120998 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 119082us
I20260709 12:20:46.134244 13085 tablet_bootstrap.cc:492] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:20:46.134899 13085 ts_tablet_manager.cc:1403] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 1.127s	user 0.026s	sys 0.015s
I20260709 12:20:46.143414 13175 raft_consensus.cc:697] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:46.055202 13127 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:46.142395 13125 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:46.143908 13085 raft_consensus.cc:359] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:46.206565 13180 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:46.207690 13085 raft_consensus.cc:740] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:20:46.208565 13085 consensus_queue.cc:260] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:46.211342 11010 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:46.110384 13082 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:46.205940 13156 consensus_meta.cc:287] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.560s	user 0.003s	sys 0.008s
I20260709 12:20:46.194032 13136 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:46.106565 13153 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:46.226197 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:46.224227 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:46.227690 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:46.229646 10935 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:20:46.229516 10932 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:46.229782 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 86954.5us
I20260709 12:20:46.231587 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:46.231930 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:46.233861 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:46.234591 11085 raft_consensus.cc:2393] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 5: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:46.232568 11076 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:46.239391 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:46.241238 10929 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:20:46.242648 10933 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:46.250939 13082 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:20:46.254622 13046 consensus_meta.cc:287] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.002s
I20260709 12:20:46.257005 11010 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:46.260020 13153 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:46.261019 10899 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:46.219936 13125 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:46.264552 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:46.227129 13156 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:46.269034 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:46.269698 10931 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:46.265172 10935 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:46.264935 12948 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:46.266989 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:46.246496 12979 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:20:46.267849 13187 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:46.263496 13085 ts_tablet_manager.cc:1434] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.128s	user 0.011s	sys 0.003s
I20260709 12:20:46.274358 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:46.255088 13046 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:46.276336 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:46.280228 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:46.288336 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:46.282032 11078 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:46.286092 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:46.289469 10934 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:46.289382 10929 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:46.290751 10932 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:46.291680 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:46.292847 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:46.293828 10931 raft_consensus.cc:2368] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 3. Current term is 4.
I20260709 12:20:46.314339 11008 raft_consensus.cc:2368] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 4. Current term is 5.
I20260709 12:20:46.314409 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:46.268157 12944 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:46.294004 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:46.294965 11080 raft_consensus.cc:2368] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8.
W20260709 12:20:46.315650 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 51790.1us
I20260709 12:20:46.320982 10899 leader_election.cc:400] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8.
I20260709 12:20:46.321307 10899 leader_election.cc:403] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:46.316172 10932 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:46.316635 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:46.321942 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:46.288877 11076 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:46.315498 10934 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:46.318033 12948 raft_consensus.cc:697] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:46.321457 10901 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:46.325248 11076 raft_consensus.cc:1275] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:46.331161 11080 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:20:46.331630 11080 pending_rounds.cc:85] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 6
I20260709 12:20:46.331938 11080 pending_rounds.cc:107] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:20:46.332242 11080 raft_consensus.cc:2889] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:46.322557 12944 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:46.335834 13179 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:20:46.332821 13145 consensus_meta.cc:287] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.512s	user 0.008s	sys 0.002s
I20260709 12:20:46.323153 13084 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:20:46.352603 13191 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:46.353135 13191 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:46.353545 13191 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:46.335032 13090 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:46.352928 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 1501) took 1140 ms. Trace:
I20260709 12:20:46.356941 10936 rpcz_store.cc:276] 0709 12:20:45.212720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.220473 (+  7753us) service_pool.cc:224] Handling call
0709 12:20:46.352674 (+1132201us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b540017a7d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:20:46.352822 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423331712}
I20260709 12:20:46.359611 10977 leader_election.cc:400] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 3. Current term is 4.
I20260709 12:20:46.363288 11021 tablet_copy_service.cc:342] P 2201bad9e18849b09cf82de29dd032d3: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-097e40d4693b49118b91e7a4fd8e8eb1 received from {username='slave'} at 127.0.0.1:41098
I20260709 12:20:46.288539 13187 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:46.364202 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:46.347774 13127 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:46.347388 13190 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:20:46.261576 13175 consensus_queue.cc:237] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:46.366343 11654 raft_consensus.cc:1217] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:20:46.364475 12948 consensus_queue.cc:237] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:46.368057 13184 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:20:46.363840 11021 tablet_copy_service.cc:434] P 2201bad9e18849b09cf82de29dd032d3: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-097e40d4693b49118b91e7a4fd8e8eb1 on tablet 097e40d4693b49118b91e7a4fd8e8eb1 with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:46.360287 13156 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:46.347600 13145 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:46.384294 13125 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:46.387743 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 57989.4us
I20260709 12:20:46.389609 11051 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:46.392052 13040 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:46.394200 11007 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:46.394254 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:46.396679 11002 raft_consensus.cc:1275] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:46.397287 11051 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:46.401273 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:46.401408 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:46.402594 10931 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:46.400153 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:46.403954 11076 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:46.404063 11002 raft_consensus.cc:2368] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6.
I20260709 12:20:46.404239 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:46.403631 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:46.404844 11080 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:46.399454 11051 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:46.395571 13040 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:46.445803 10927 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:46.445725 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:46.446358 10901 leader_election.cc:400] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6.
I20260709 12:20:46.447729 10901 leader_election.cc:403] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:46.406639 13065 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:46.456940 10974 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:46.449330 13040 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:46.476763 13188 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:46.456702 13134 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:20:46.457829 13065 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:46.444839 13084 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 12:20:46.486050 13166 consensus_meta.cc:287] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.622s	user 0.008s	sys 0.000s
I20260709 12:20:46.482014 13145 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:20:46.491094 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 91719.7us
I20260709 12:20:46.462134 13187 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:46.482409 13188 raft_consensus.cc:697] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:46.488621 13065 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:46.500633 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:46.501748 10927 raft_consensus.cc:2393] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 2: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:46.392174 11654 raft_consensus.cc:2955] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEARNER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:46.491914 13090 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:46.504094 13090 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:46.501935 13192 log.cc:927] Time spent T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:20:46.490515 13166 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:46.506685 13204 consensus_queue.cc:1059] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:20:46.511296 13081 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:46.511134 12944 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:46.516067 13134 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6.
I20260709 12:20:46.518787 10974 leader_election.cc:400] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:46.493893 13182 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 12:20:46.528083 11080 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:20:46.538847 11009 raft_consensus.cc:2368] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8.
I20260709 12:20:46.539594 10974 leader_election.cc:403] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:20:46.543164 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:46.524089 13188 consensus_queue.cc:237] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:46.539038 11076 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:46.543781 11006 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:46.548401 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:46.549875 12890 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:46.549489 10974 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:46.550088 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:46.551112 10974 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:46.550520 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:46.551641 13202 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:20:46.552053 13205 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:46.552624 13205 raft_consensus.cc:697] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:46.553558 11003 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:46.554790 13035 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:46.556216 13035 raft_consensus.cc:697] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:46.554128 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:46.555140 11003 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:46.544945 13196 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:46.548483 13090 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:46.547982 13204 consensus_queue.cc:1243] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:20:46.557235 13035 consensus_queue.cc:237] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:46.568619 13204 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:46.569355 13168 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:46.556527 13179 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8.
I20260709 12:20:46.572754 13168 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:46.592427 13166 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:46.594552 12944 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:46.590478 13184 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.598414 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:46.562500 13191 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:46.580760 13090 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.595639 13184 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:46.601452 11658 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:46.601879 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:46.604391 11076 raft_consensus.cc:2393] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 8: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:46.604415 10975 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:46.605520 12944 raft_consensus.cc:2764] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:20:46.606899 10930 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:20:46.618068 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:20:46.618333 13129 consensus_meta.cc:287] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.505s	user 0.006s	sys 0.006s
I20260709 12:20:46.611411 13184 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:46.553391 13205 consensus_queue.cc:237] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:46.644011 13198 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.233s	user 0.003s	sys 0.000s
I20260709 12:20:46.610651 13090 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:20:46.642144 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 77837.8us
I20260709 12:20:46.665437 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:46.658015 13184 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:46.714433 11622 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:46.640221 13129 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:46.727061 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:46.728067 11003 raft_consensus.cc:2393] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 7: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:46.732131 10936 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:20:46.732626 13090 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:46.723706 13067 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:46.734290 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:46.738632 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:46.739168 13081 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:46.740134 11005 raft_consensus.cc:2393] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 3: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:46.739756 13081 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:46.720578 13191 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:46.742530 10975 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:46.715648 13184 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:46.750173 13184 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:46.750200 13115 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:46.745307 13134 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.741640 13215 consensus_queue.cc:1059] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:20:46.763355 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:20:46.776185 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 49083.4us
I20260709 12:20:46.783700 13200 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:46.785529 11050 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:46.761289 13168 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:46.756451 13115 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:45.720546  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:46.769857 13215 consensus_queue.cc:1243] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:20:46.915218 13081 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:46.922415 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 136944us
I20260709 12:20:46.827088 13129 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:46.946547 13112 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:46.768694 13134 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:46.960026 13115 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:46.962153 13204 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:46.923372 13212 consensus_queue.cc:1059] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:20:46.831830 13065 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:46.965845 13204 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:20:46.978116 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:46.978951 11082 raft_consensus.cc:2368] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7.
I20260709 12:20:46.982028 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60046 (request call id 1714) took 1218 ms. Trace:
W20260709 12:20:46.981546 13218 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:20:46.982455 11082 rpcz_store.cc:276] 0709 12:20:45.760812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.760923 (+   111us) service_pool.cc:224] Handling call
0709 12:20:46.977996 (+1217073us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b5800017d98. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3beee 000000000036eb39 00007f9bb5eaf1e0 00007f9bb5f780c4 00007f9bb5f78131 00007f9bb5f260a0 00007f9bb5f25984 00007f9baf4a06d4 00007f9baf4a0662
0709 12:20:46.979329 (+  1333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5300992}
W20260709 12:20:46.990098 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 666258us
W20260709 12:20:47.003057 11004 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 1811) took 1418 ms (client timeout 1669 ms). Trace:
W20260709 12:20:47.003532 11004 rpcz_store.cc:269] 0709 12:20:45.584622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.584733 (+   111us) service_pool.cc:224] Handling call
0709 12:20:47.002815 (+1418082us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b540029b3d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:20:47.002959 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591671168}
I20260709 12:20:46.999006 12922 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.006016 12922 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:47.007097 13134 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:20:46.999486 13040 consensus_meta.cc:287] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.510s	user 0.005s	sys 0.006s
I20260709 12:20:47.015260 13040 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:47.019884 11080 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:47.019505 13196 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3.
I20260709 12:20:47.027299 11007 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
W20260709 12:20:47.037684 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 114150us
I20260709 12:20:47.039152 11050 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:47.041517 10930 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:20:47.042264 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:47.042614 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:47.042995 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:47.043190 10930 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:47.043689 11081 raft_consensus.cc:2368] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6.
I20260709 12:20:47.044477 10935 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:47.056305 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:47.056563 11082 raft_consensus.cc:3055] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:47.056967 11082 raft_consensus.cc:740] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:47.046444 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:47.055356 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:47.057083 10928 raft_consensus.cc:2393] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 7: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:47.063670 10899 leader_election.cc:400] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7.
I20260709 12:20:47.063786 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:47.064343 10899 leader_election.cc:403] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:20:47.064769 10928 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:47.057698 11082 consensus_queue.cc:260] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:47.067322 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:47.067999 11081 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:47.067358 11082 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:47.071787 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:47.072579 10933 raft_consensus.cc:2368] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 3. Current term is 4.
I20260709 12:20:47.073273 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:47.076763 11080 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:20:47.078145 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:47.079663 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:47.080128 13040 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:47.036877 13169 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:47.081640 13169 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:47.081998 10930 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:20:47.082535 13126 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7.
I20260709 12:20:47.082973 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:47.084173 13224 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:47.084710 13224 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:47.085680 10936 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:47.086716 12922 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:47.088138 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:47.088941 12922 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:47.087630 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:47.038553 12942 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:47.090461 10933 raft_consensus.cc:2393] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 8: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:47.090545 12942 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:47.092039 10931 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:47.092850 12942 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:47.094944 10935 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:47.095713 11081 raft_consensus.cc:3055] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:47.096140 11081 raft_consensus.cc:740] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:47.096909 11081 consensus_queue.cc:260] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:47.100031 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:47.061100 13115 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:20:47.045106 13226 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:20:47.088953 13225 log.cc:927] Time spent T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:20:47.105451 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:47.088456 13045 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.056226 13082 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:20:47.113729 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:47.117569 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:47.066092 13112 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:20:47.116127 11082 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:20:47.119007 11082 pending_rounds.cc:85] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 3
I20260709 12:20:47.119338 11082 pending_rounds.cc:107] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:20:47.119663 11082 raft_consensus.cc:2889] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:47.117321 11078 raft_consensus.cc:2410] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:20:47.086723 13224 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:47.027441 13065 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:47.125356 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:47.130265 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:47.130920 11083 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:47.115625 13169 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:20:47.135263 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 94735us
I20260709 12:20:47.148658 11051 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:47.149362 11083 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:47.151561 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:47.166028 10928 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:47.119119 13045 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:47.177014 13228 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:20:47.150986 13169 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:47.114424 13226 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:47.180769 10974 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:47.161396 13215 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:20:47.175966 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 145499us
W20260709 12:20:47.184144 13197 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.820s	user 0.004s	sys 0.004s
I20260709 12:20:47.197747 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:47.198051 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:47.198837 11003 raft_consensus.cc:2368] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7.
I20260709 12:20:47.198873 11658 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:47.203529 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:47.204214 11003 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:20:47.210482 11659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59414 (request call id 103) took 1001 ms. Trace:
I20260709 12:20:47.192211 13065 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:47.211176 12890 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:47.188081 13169 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:47.211630 12890 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:47.212385 13045 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:47.213234 13169 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:47.196879 13035 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:47.215811 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:47.220013 12890 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:47.197639 13215 raft_consensus.cc:697] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:47.240007 10977 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:47.210912 11659 rpcz_store.cc:276] 0709 12:20:46.209052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.209222 (+   170us) service_pool.cc:224] Handling call
0709 12:20:46.209584 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:46.312952 (+103368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:46.312982 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:46.313475 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 12:20:46.363414 (+ 49939us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:46.363455 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:46.363520 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:47.101944 (+738424us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:20:47.210146 (+108202us) raft_consensus.cc:1685] finished
0709 12:20:47.210172 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:47.210387 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5847,"raft.queue_time_us":30723,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":5263,"spinlock_wait_cycles":11933568,"thread_start_us":142336,"threads_started":2,"wal-append.queue_time_us":49916}
I20260709 12:20:47.219393 13035 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:47.219162 13065 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:47.245582 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:20:47.246357 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 50308.6us
W20260709 12:20:47.301050 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 61167.9us
I20260709 12:20:47.303006 10977 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:47.317674 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:20:47.282804 13234 log.cc:927] Time spent T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:20:47.324692 11050 leader_election.cc:400] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7.
I20260709 12:20:47.328210 11050 leader_election.cc:403] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:20:47.278846 13226 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:47.250619 13173 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:47.251084 13222 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:47.250911 13233 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:47.343830 11003 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:20:47.250499 13215 consensus_queue.cc:237] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:47.358182 13165 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 12:20:47.358568 13237 log.cc:927] Time spent T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 12:20:47.364014 13229 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:20:47.364521 13046 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:47.365833 13025 ts_tablet_manager.cc:1434] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 1.331s	user 0.042s	sys 0.034s
W20260709 12:20:47.366194 13025 ts_tablet_manager.cc:1467] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: Tablet startup took 1331ms
I20260709 12:20:47.369024 13065 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:47.370241 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:47.370975 11659 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:47.372169 10975 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:47.372953 13127 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:47.373312 13127 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:47.373663 13127 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:47.366546 13025 ts_tablet_manager.cc:1469] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: Trace:
0709 12:20:42.433015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.433339 (+   324us) service_pool.cc:224] Handling call
0709 12:20:42.542663 (+109324us) ts_tablet_manager.cc:934] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
0709 12:20:43.918834 (+1376171us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:20:44.034904 (+116070us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:44.035028 (+   124us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:20:44.374959 (+339931us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:20:44.375252 (+   293us) tablet_replica.cc:206] Creating consensus instance
0709 12:20:44.375550 (+   298us) ts_tablet_manager.cc:989] Replica registered.
0709 12:20:44.375617 (+    67us) inbound_call.cc:177] Queueing success response
0709 12:20:44.766177 (+390560us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:20:46.034415 (+1268238us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:20:46.035112 (+   697us) tablet_replica.cc:261] Starting instrumentation
0709 12:20:46.035820 (+   708us) tablet_replica.cc:280] Starting consensus
0709 12:20:47.296566 (+1260746us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b54000fff70. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badec4bec 00007f9bb4958623 00007f9bb5f74e04 00007f9bb5f7348d 00007f9bb5fa4f4e 00007f9bb5f89fdd 00007f9bb5f89f89 00007f9bb5f89f19 00007f9bb5f89ee1 00007f9bb5f8910d
Metrics: {"dns_us":16026,"raft.queue_time_us":7229,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"spinlock_wait_cycles":4759296,"tablet-copy.queue_time_us":108483,"tablet-download-pool.queue_time_us":4591,"tablet-download-pool.run_cpu_time_us":1013,"tablet-download-pool.run_wall_time_us":22457,"thread_start_us":328605,"threads_started":3}
I20260709 12:20:47.354530 13222 raft_consensus.cc:697] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:47.387055 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:47.387703 11083 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:20:47.394606 11083 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
W20260709 12:20:47.395715 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 92775.4us
I20260709 12:20:47.369014 13035 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:47.410226 13222 consensus_queue.cc:237] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:47.354661 13233 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:47.414692 10977 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:47.415314 13046 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:47.415611 13168 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:47.421849 10977 leader_election.cc:400] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 3. Current term is 4.
I20260709 12:20:47.422526 10977 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:47.423730 10977 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:47.415154 13233 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:47.420128 13127 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:47.430969 13127 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:47.421563 13065 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7.
I20260709 12:20:47.432731 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:47.433339 11659 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:47.425345 13046 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:47.426677 13035 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:20:47.427013 13168 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:47.417133 13242 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:47.437362 13242 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:47.439774 13242 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:20:47.446816 11008 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 1321) took 1804 ms (client timeout 1901 ms). Trace:
W20260709 12:20:47.447294 11008 rpcz_store.cc:269] 0709 12:20:45.642327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.642606 (+   279us) service_pool.cc:224] Handling call
0709 12:20:47.446612 (+1804006us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b5400470754. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:20:47.446752 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1495802240}
W20260709 12:20:47.449291 11005 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 1817) took 1339 ms (client timeout 1771 ms). Trace:
W20260709 12:20:47.449725 11005 rpcz_store.cc:269] 0709 12:20:46.109685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.110606 (+   921us) service_pool.cc:224] Handling call
0709 12:20:47.449085 (+1338479us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b540044ff54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:20:47.449221 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1412059008}
I20260709 12:20:47.426218 10977 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:47.456001 13168 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:47.456532 13168 raft_consensus.cc:697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:20:47.464080 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 139519us
I20260709 12:20:47.465740 11050 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:47.468631 10832 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35614 (request call id 217) took 4001 ms. Trace:
W20260709 12:20:47.472645 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 46464.1us
I20260709 12:20:47.457391 13168 consensus_queue.cc:237] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:47.487749 11050 leader_election.cc:400] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 4. Current term is 5.
I20260709 12:20:47.488194 11050 leader_election.cc:403] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:47.488276 11659 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:47.485199 13242 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:47.489918 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:47.492305 11010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 1818) took 1382 ms. Trace:
I20260709 12:20:47.492997 11657 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:47.493536 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:47.496016 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:47.500111 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:47.511174 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:47.604992 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:20:47.610581 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 122981us
I20260709 12:20:47.644584 11005 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 3.
W20260709 12:20:47.581871 13247 log.cc:927] Time spent T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:20:47.631493 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:47.633138 11656 raft_consensus.cc:1240] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:47.632570 11010 rpcz_store.cc:276] 0709 12:20:46.109986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.110096 (+   110us) service_pool.cc:224] Handling call
0709 12:20:47.492147 (+1382051us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54002d9954. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:20:47.492250 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230565248}
I20260709 12:20:47.652465 10975 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:47.652853 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:47.653664 11007 raft_consensus.cc:2393] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 2: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:47.652938 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:47.654407 11010 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:20:47.646049 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:20:47.647173 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.657069 11050 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:47.655560 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:47.660028 11004 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:47.665638 13189 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.666404 13189 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:47.668365 13223 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:20:47.626237 11021 tablet_copy_service.cc:342] P 2201bad9e18849b09cf82de29dd032d3: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-59db2d2bb22c41aebd0d2073e2ba7d52 received from {username='slave'} at 127.0.0.1:41098
I20260709 12:20:47.673918 11021 tablet_copy_service.cc:434] P 2201bad9e18849b09cf82de29dd032d3: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-59db2d2bb22c41aebd0d2073e2ba7d52 on tablet 59db2d2bb22c41aebd0d2073e2ba7d52 with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:20:47.675407 11624 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:47.469095 10832 rpcz_store.cc:276] 0709 12:20:43.484318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.493057 (+  8739us) service_pool.cc:224] Handling call
0709 12:20:47.468547 (+3975490us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:44.320110 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:44.438137 (+118027us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:44.438852 (+   715us) write_op.cc:435] Acquired schema lock
0709 12:20:44.441480 (+  2628us) tablet.cc:662] Decoding operations
0709 12:20:44.470055 (+ 28575us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:44.470130 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:44.470159 (+    29us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:20:44.470829 (+   670us) tablet.cc:701] Row locks acquired
0709 12:20:44.470847 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:20:44.470985 (+   138us) write_op.cc:270] Start()
0709 12:20:44.471090 (+   105us) write_op.cc:276] Timestamp: P: 1783599644470946 usec, L: 0
0709 12:20:44.471116 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:20:44.507284 (+ 36168us) log.cc:844] Serialized 2906 byte log entry
0709 12:20:44.904668 (+397384us) op_driver.cc:464] REPLICATION: finished
0709 12:20:45.361410 (+456742us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b18003b9d40. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:20:45.361578 (+   168us) write_op.cc:301] APPLY: starting
0709 12:20:45.361672 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:45.364443 (+  2771us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:45.364466 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:45.398709 (+ 34243us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:45.398921 (+   212us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:20:45.398964 (+    43us) write_op.cc:312] APPLY: finished
0709 12:20:45.399206 (+   242us) log.cc:844] Serialized 59 byte log entry
0709 12:20:45.399386 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:45.399489 (+   103us) write_op.cc:454] Released schema lock
0709 12:20:45.399538 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:45.399963 (+   425us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:45.399991 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23966,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":160488,"apply.run_cpu_time_us":3299,"apply.run_wall_time_us":38304,"num_ops":7,"prepare.queue_time_us":37782,"prepare.run_cpu_time_us":26113,"prepare.run_wall_time_us":315997,"raft.queue_time_us":234385,"raft.run_cpu_time_us":34648,"raft.run_wall_time_us":394208,"replication_time_us":405071,"spinlock_wait_cycles":58879744,"thread_start_us":282887,"threads_started":4,"wal-append.queue_time_us":124671,"wal-append.run_cpu_time_us":27748,"wal-append.run_wall_time_us":1826022}]]}
W20260709 12:20:47.679648 11009 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 1826) took 1452 ms (client timeout 1616 ms). Trace:
W20260709 12:20:47.680116 11009 rpcz_store.cc:269] 0709 12:20:46.227267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.227454 (+   187us) service_pool.cc:224] Handling call
0709 12:20:47.679454 (+1452000us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b54004001d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:20:47.679586 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":710639488}
I20260709 12:20:47.631232 13242 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:47.682668 13242 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:47.618146 13173 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:47.626582 13065 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 4. Current term is 5.
I20260709 12:20:47.672796 13244 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:47.669032 13223 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:47.618599 13127 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.642958 13059 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:47.639192 13184 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:47.663640 11654 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:47.668916 13189 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:47.684288 13205 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:47.714046 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:47.714998 10932 raft_consensus.cc:2393] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 7: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:47.672696 13160 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:47.712255 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:47.712960 10935 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:20:47.716320 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:47.717906 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:47.723713 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:47.705979 13244 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:47.726187 13205 raft_consensus.cc:697] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:47.710213 13081 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:20:47.706067 13059 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:47.735594 13244 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:47.708652 13127 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:47.739120 13091 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:47.743686 13179 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:47.773195 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:47.744498 13223 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:47.746945 10829 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 82) took 3326 ms. Trace:
I20260709 12:20:47.715898 13184 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:47.759994 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:47.753726 13091 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:47.778559 13091 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:47.777453 13179 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:47.785516 13179 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:47.786615 13059 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:47.788673 13184 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:47.695312 13173 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:47.801884 11010 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:47.771193 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:47.776321 10829 rpcz_store.cc:276] 0709 12:20:44.434648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.438670 (+  4022us) service_pool.cc:224] Handling call
0709 12:20:47.746849 (+3308179us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:44.667690 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:44.752737 (+ 85047us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:44.752770 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:20:44.752786 (+    16us) tablet.cc:662] Decoding operations
0709 12:20:44.753121 (+   335us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:44.753164 (+    43us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:44.753195 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:44.753363 (+   168us) tablet.cc:701] Row locks acquired
0709 12:20:44.753380 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:20:44.753515 (+   135us) write_op.cc:270] Start()
0709 12:20:44.753624 (+   109us) write_op.cc:276] Timestamp: P: 1783599644753468 usec, L: 0
0709 12:20:44.753643 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:20:44.754299 (+   656us) log.cc:844] Serialized 533 byte log entry
0709 12:20:45.108520 (+354221us) op_driver.cc:464] REPLICATION: finished
0709 12:20:45.408133 (+299613us) write_op.cc:301] APPLY: starting
0709 12:20:45.408224 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:45.408319 (+    95us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:45.409950 (+  1631us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:45.410230 (+   280us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:45.410401 (+   171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:20:45.410458 (+    57us) write_op.cc:312] APPLY: finished
0709 12:20:45.423246 (+ 12788us) log.cc:844] Serialized 23 byte log entry
0709 12:20:45.423442 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:45.423525 (+    83us) write_op.cc:454] Released schema lock
0709 12:20:45.423567 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:45.423925 (+   358us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:45.423955 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1421699,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":274120,"apply.run_cpu_time_us":2552,"apply.run_wall_time_us":15746,"num_ops":1,"prepare.queue_time_us":138101,"prepare.run_cpu_time_us":2790,"prepare.run_wall_time_us":97075,"replication_time_us":350415,"thread_start_us":176064,"threads_started":1}]]}
I20260709 12:20:47.770522 10899 leader_election.cc:400] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6.
I20260709 12:20:47.807469 13173 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:47.730072 13160 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:47.809024 10899 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:47.810077 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:47.825358 10899 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:47.826375 13136 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:47.827049 13136 raft_consensus.cc:2764] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:20:47.811115 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:20:47.836337 13249 log.cc:927] Time spent T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.347s	user 0.003s	sys 0.000s
I20260709 12:20:47.840169 10974 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:47.815580 13205 consensus_queue.cc:237] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:20:47.817715 10901 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.669s (SENT) [suppressed 5 similar messages]
I20260709 12:20:47.818019 13127 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:47.839427 10899 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:47.845645 13136 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:47.848338 13173 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:20:47.874719 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 195780us
I20260709 12:20:47.889544 11081 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:47.891707 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:20:47.904558 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 218046us
I20260709 12:20:47.892804 10975 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:47.823208 13160 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:47.930801 11082 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:47.809234 13179 consensus_queue.cc:1059] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 12:20:47.936074 13182 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:47.932714 12933 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:47.943035 11004 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:47.943675 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:47.947726 12890 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:47.922685 13055 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:20:47.922989 13151 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:47.919118 13028 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:47.920709 13081 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:47.915640 13173 raft_consensus.cc:697] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:47.959257 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:48.008193 11085 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:48.009564 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:48.012990 11085 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:20:47.966152 11081 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:20:47.976437 11002 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:48.015097 11081 pending_rounds.cc:85] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 2
I20260709 12:20:48.015422 11081 pending_rounds.cc:107] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:20:47.976325 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:47.874112 13136 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:47.999920 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:47.977277 11076 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:20:48.003636 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 54577.5us
I20260709 12:20:48.018745 12890 consensus_queue.cc:1059] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:20:48.015653 11081 raft_consensus.cc:2889] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:48.053838 10974 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:20:47.996762 13204 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.023s	sys 0.067s
I20260709 12:20:47.998312 11657 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEARNER]: Advancing to term 5
I20260709 12:20:47.997354 13151 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:48.060882 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:48.070933 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:48.006968 12942 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:20:47.998286 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 321370us
I20260709 12:20:48.075464 13238 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:47.977186 13182 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:48.086055 12890 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:48.079614 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:47.977365 11654 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:48.018581 13250 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:48.078799 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:48.074849 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:48.060083 13204 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.023s	sys 0.070s
I20260709 12:20:48.087615 12890 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:48.088110 11624 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:48.088778 10930 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:48.055538 13227 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.089143 13189 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:48.095988 10977 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:48.097342 13058 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:48.006677 13028 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:48.105821 11082 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:48.111919 13174 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:20:48.112378 11081 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:48.107372 13189 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.114123 13189 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:48.115113 12890 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:48.076210 13151 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:48.116771 13059 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:48.123147 13059 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:48.123531 13059 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:48.124836 13091 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:48.126041 11655 raft_consensus.cc:1240] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:48.126955 13173 consensus_queue.cc:237] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:48.128328 13242 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:48.128615 13127 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:48.130491 13242 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:48.098843 12942 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:48.130529 13200 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:20:48.117780 12837 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:20:48.117785 10977 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:48.131399 11080 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:48.132869 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:48.141192 11085 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:48.132200 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:48.138952 10833 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35620 (request call id 217) took 3399 ms. Trace:
I20260709 12:20:48.154480 10900 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:48.157647 10974 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:48.120496 13227 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:48.153388 10833 rpcz_store.cc:276] 0709 12:20:44.739678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.755916 (+ 16238us) service_pool.cc:224] Handling call
0709 12:20:48.138796 (+3382880us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2210836,"reported_tablets":11}
W20260709 12:20:48.163077 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 45360.3us
I20260709 12:20:48.161036 12942 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:48.161224 12837 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:48.164244 12948 raft_consensus.cc:3055] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:48.166631 10977 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:48.122828 13256 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:48.115537 13028 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:48.120007 13238 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:48.169315 12948 raft_consensus.cc:740] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:48.169796 13115 raft_consensus.cc:2804] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:48.181028 13200 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:48.121292 13250 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:48.164974 13081 consensus_queue.cc:1059] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:20:48.203758 10830 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35608 (request call id 225) took 4000 ms. Trace:
I20260709 12:20:48.212352 10830 rpcz_store.cc:276] 0709 12:20:44.203292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.203430 (+   138us) service_pool.cc:224] Handling call
0709 12:20:48.203671 (+4000241us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":7}
I20260709 12:20:48.192152 13091 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:48.191969 12942 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:48.194898 13115 raft_consensus.cc:697] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:48.235693 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:48.240813 10977 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:20:48.223215 13049 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.027s	sys 0.014s
W20260709 12:20:48.242316 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 424603us
W20260709 12:20:48.245019 11084 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.004s	sys 0.019s
I20260709 12:20:48.198988 13059 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:48.215273 13118 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:20:48.174448 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 86270.4us
I20260709 12:20:48.247697 10977 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:48.237103 13156 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:48.246120 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:48.239567 13126 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:48.244668 13049 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.028s	sys 0.014s
I20260709 12:20:48.237052 13179 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:48.258306 10977 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:48.242161 13090 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:48.194698 12948 consensus_queue.cc:260] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:20:48.259596 11051 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.019s	sys 0.030s
I20260709 12:20:48.235037 12942 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:48.386638 11051 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.019s	sys 0.040s
I20260709 12:20:48.272716 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 1663) took 1708 ms. Trace:
W20260709 12:20:48.384248 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 111334us
W20260709 12:20:48.245693 11084 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.004s	sys 0.019s
W20260709 12:20:48.278505 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:48.249861 13046 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.016s	sys 0.013s
I20260709 12:20:48.268150 13182 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:48.255065 13012 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:48.419656 12948 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:48.439366 13250 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:20:48.413465 13046 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.019s	sys 0.013s
W20260709 12:20:48.269008 12935 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.002s	sys 0.022s
I20260709 12:20:48.259156 12837 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:48.256808 13135 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:48.256276 13084 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:48.256681 12933 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:48.271238 13136 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:48.449891 12935 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.002s	sys 0.022s
I20260709 12:20:48.447937 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:48.256165 13118 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:48.278851 13028 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:48.286105 13049 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:20:48.480190 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:48.269537 13160 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.177s
I20260709 12:20:48.267952 13156 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:48.440297 13257 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:48.269397 13126 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:48.258258 13188 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.540s	user 0.030s	sys 0.024s
I20260709 12:20:48.542675 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:48.544502 11080 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:20:48.522701 13223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.043s	sys 0.069s
I20260709 12:20:48.442540 13012 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:48.558502 11080 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:48.279433 13179 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:48.566200 13188 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.852s	user 0.030s	sys 0.029s
I20260709 12:20:48.514452 13084 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:48.509475 13135 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:48.522166 12933 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
W20260709 12:20:48.582525 13223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.044s	sys 0.070s
I20260709 12:20:48.606031 13245 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.449971 13115 consensus_queue.cc:237] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:48.607299 13250 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:48.642836 13242 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:48.662207 13136 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:48.662523 12933 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:48.543969 13222 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:48.643170 11653 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.019s	sys 0.023s
I20260709 12:20:48.610172 13112 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:48.542464 13049 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:48.705299 11010 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.043s	sys 0.080s
W20260709 12:20:48.708417 11010 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.043s	sys 0.080s
W20260709 12:20:48.666816 12997 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.015s	sys 0.030s
I20260709 12:20:48.662354 13135 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:48.666123 13173 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:20:48.708467 11653 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.020s	sys 0.023s
W20260709 12:20:48.714046 12997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.015s	sys 0.030s
W20260709 12:20:48.710762 13205 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.021s	sys 0.041s
I20260709 12:20:48.730000 13173 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:48.743486 13268 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:20:48.744349 13173 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:48.726284 13059 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:48.735657 13205 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.021s	sys 0.042s
I20260709 12:20:48.764954 13179 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:48.704910 13250 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:48.710188 13222 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:48.707624 13136 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:48.769497 13244 consensus_meta.cc:287] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.995s	user 0.010s	sys 0.001s
I20260709 12:20:48.706883 13242 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:48.759119 13231 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.005s	sys 0.022s
W20260709 12:20:48.775547 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:48.734741 13259 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:48.713613 13112 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:48.708623 13245 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:48.775452 12942 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:48.789103 11005 raft_consensus.cc:1240] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 1. Current term is 2. Ops: []
W20260709 12:20:48.785826 13231 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.005s	sys 0.023s
W20260709 12:20:48.791953 11081 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.018s	sys 0.045s
W20260709 12:20:48.784976 10901 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.025s	sys 0.028s
W20260709 12:20:48.799587 11050 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.103s	user 0.027s	sys 0.041s
I20260709 12:20:48.786757 13118 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:48.804735 11081 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.018s	sys 0.046s
W20260709 12:20:48.805094 10901 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.025s	sys 0.028s
W20260709 12:20:48.805121 11050 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.109s	user 0.027s	sys 0.041s
W20260709 12:20:48.810776 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 1.12457e+06us
W20260709 12:20:48.812299 13271 log.cc:927] Time spent T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:20:48.817935 13136 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:48.821439 13151 consensus_meta.cc:287] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.000s
I20260709 12:20:48.821929 13151 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:20:48.806017 11076 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.007s	sys 0.030s
W20260709 12:20:48.853077 11076 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.007s	sys 0.030s
W20260709 12:20:48.924722 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:48.935631 11050 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:48.799769 13174 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:48.788125 13244 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:48.807407 13028 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:20:48.964329 10974 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.014s	sys 0.026s
W20260709 12:20:48.965682 10974 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.014s	sys 0.026s
W20260709 12:20:48.926115 13204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.016s	sys 0.028s
W20260709 12:20:48.969707 13204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.016s	sys 0.029s
I20260709 12:20:48.791285 13259 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:48.810992 13156 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:48.971385 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:48.971905 10901 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:48.973138 11077 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:48.980327 10901 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:20:48.981920 11078 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.014s	sys 0.032s
I20260709 12:20:48.982293 13049 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:48.985328 10901 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:20:48.984536 11078 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.014s	sys 0.032s
I20260709 12:20:48.971421 13084 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:48.991642 13263 log.cc:927] Time spent T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:20:48.992342 13084 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:48.992959 13245 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:48.993263 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 1747) took 1318 ms. Trace:
I20260709 12:20:48.993089 13084 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:48.963642 13040 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:48.963919 13182 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:20:48.995966 10899 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.015s	sys 0.026s
I20260709 12:20:48.970604 13188 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:48.993623 11084 rpcz_store.cc:276] 0709 12:20:47.675328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.676108 (+   780us) service_pool.cc:224] Handling call
0709 12:20:47.676481 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:47.695740 (+ 19259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:47.695776 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:47.702817 (+  7041us) log.cc:844] Serialized 26 byte log entry
0709 12:20:48.388927 (+686110us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:48.388969 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:48.389038 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:48.993034 (+603996us) raft_consensus.cc:1685] finished
0709 12:20:48.993071 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:48.993207 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18896,"raft.queue_time_us":19057,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":6829,"thread_start_us":685808,"threads_started":1,"wal-append.queue_time_us":854123}
I20260709 12:20:48.970878 13261 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:20:49.030215 11658 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.016s	sys 0.016s
I20260709 12:20:48.981236 13045 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:48.995399 13136 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:48.976649 13151 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:20:49.009447 13189 consensus_meta.cc:287] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.895s	user 0.006s	sys 0.006s
I20260709 12:20:48.965047 13174 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:48.983745 13204 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:20:49.078298 11658 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.016s	sys 0.016s
I20260709 12:20:48.988333 13135 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:20:48.996593 10899 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.015s	sys 0.026s
I20260709 12:20:48.975674 13028 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:49.029785 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:49.078338 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:49.093407 11658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59414 (request call id 108) took 1179 ms. Trace:
I20260709 12:20:49.093856 11658 rpcz_store.cc:276] 0709 12:20:47.909307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.909445 (+   138us) service_pool.cc:224] Handling call
0709 12:20:47.909791 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:47.910008 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:48.270794 (+360786us) log.cc:844] Serialized 14 byte log entry
0709 12:20:49.088108 (+817314us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:49.088169 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:49.088219 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:49.088289 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:49.088438 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":804120,"prepare.run_cpu_time_us":161,"prepare.run_wall_time_us":1260,"raft.queue_time_us":96,"thread_start_us":1158761,"threads_started":2}
W20260709 12:20:49.080453 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.030539 13188 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:49.079147 13180 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.046003 13182 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:49.088253 12935 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.005s	sys 0.025s
W20260709 12:20:49.174052 11082 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.025s	sys 0.023s
I20260709 12:20:49.081918 13045 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.071964 13261 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:49.183746 13045 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:49.188074 13174 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:49.190263 13242 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:49.190551 13174 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:49.191164 13174 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:49.175491 13180 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:49.125893 13250 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:49.197415 11085 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:49.179136 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:20:49.180506 11082 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.025s	sys 0.024s
I20260709 12:20:49.133700 13012 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:49.092864 13189 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:49.171010 13227 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:49.253961 13223 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.259256 13223 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:49.260490 13293 raft_consensus.cc:3055] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:49.260962 13293 raft_consensus.cc:740] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:49.261902 13223 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:49.261817 13293 consensus_queue.cc:260] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:49.251789 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:49.262887 13293 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:49.257153 13118 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:20:49.265319 13118 consensus_queue.cc:1059] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:49.266408 13118 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:49.267037 13118 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:49.268359 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:49.254912 10899 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:49.082072 13040 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:49.182699 13222 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:49.096860 13204 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:49.280256 13204 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:49.281746 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:20:49.283313 11007 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.028s	sys 0.036s
W20260709 12:20:49.283633 11007 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.028s	sys 0.036s
I20260709 12:20:49.230279 13112 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:49.194586 11654 raft_consensus.cc:2393] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 4: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:20:49.218681 13136 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:49.291181 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 1348) took 1636 ms. Trace:
I20260709 12:20:49.229568 13288 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:49.194376 13180 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:49.287348 11084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:20:49.297619 11084 raft_consensus.cc:606] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:49.302474 11084 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:49.268270 12933 raft_consensus.cc:3055] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:49.196333 12935 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:20:49.303079 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:49.288379 11010 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.050s	sys 0.058s
I20260709 12:20:49.273717 12942 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:20:49.310693 11010 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.050s	sys 0.058s
W20260709 12:20:49.291740 13275 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.327s	user 0.001s	sys 0.001s
I20260709 12:20:49.292449 11007 rpcz_store.cc:276] 0709 12:20:47.648400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.660723 (+ 12323us) service_pool.cc:224] Handling call
0709 12:20:47.661013 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:48.015927 (+354914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:48.015957 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:48.060436 (+ 44479us) log.cc:844] Serialized 26 byte log entry
0709 12:20:48.530127 (+469691us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:49.283965 (+753838us) log.cc:844] Serialized 14 byte log entry
0709 12:20:49.284260 (+   295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:49.284334 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:49.284374 (+    40us) raft_consensus.cc:1685] finished
0709 12:20:49.284385 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:49.284530 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4742,"prepare.queue_time_us":215550,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":33613,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":10404,"thread_start_us":1448768,"threads_started":3,"wal-append.queue_time_us":689169}
I20260709 12:20:49.341203 12890 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:49.295579 13179 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:49.306862 12933 raft_consensus.cc:740] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:20:49.317148 11653 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.015s	sys 0.048s
I20260709 12:20:49.311810 13244 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:20:49.371081 10977 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.041s	sys 0.021s
I20260709 12:20:49.309182 13112 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:20:49.307063 13136 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:49.344254 13259 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:49.310381 13045 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:49.368086 13281 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:20:49.372479 11653 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.015s	sys 0.049s
I20260709 12:20:49.326431 12935 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:49.309899 13288 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:49.380971 11051 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.023s	sys 0.027s
W20260709 12:20:49.404851 11051 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.023s	sys 0.027s
W20260709 12:20:49.405156 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 563859us
W20260709 12:20:49.399591 13287 log.cc:927] Time spent T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
W20260709 12:20:49.377933 13279 log.cc:927] Time spent T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260709 12:20:49.415215 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:20:49.399216 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 412775us
I20260709 12:20:49.363453 12942 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:49.387566 10977 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.041s	sys 0.021s
I20260709 12:20:49.416364 10901 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:20:49.417500 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:49.418352 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.402396 13244 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.421464 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:49.422165 11084 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:49.423081 10901 leader_election.cc:400] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8.
I20260709 12:20:49.423079 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:49.390342 13291 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:49.426949 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:49.429055 11009 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:49.427655 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:49.429739 11004 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:20:49.405814 13028 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:49.430668 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:49.433727 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:49.434397 11002 raft_consensus.cc:1240] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:49.433475 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:49.432512 11011 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:20:49.445709 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:49.445891 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:49.409096 13223 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:49.451778 11004 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:49.449991 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:49.420267 13204 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:49.455381 11008 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:49.456826 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:49.464165 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:49.464373 13012 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:49.465101 12942 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:49.465000 13012 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:49.428719 13244 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:49.467181 13012 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:49.467788 13244 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:49.468425 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:49.468758 13040 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:49.444406 11653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59384 (request call id 160) took 1759 ms. Trace:
I20260709 12:20:49.469810 13112 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:49.469900 13223 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:49.471966 13223 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:49.428557 13193 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:20:49.472896 13285 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:20:49.409485 12933 consensus_queue.cc:260] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:49.473730 12933 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:49.474313 13284 log.cc:927] Time spent T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:20:49.476365 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 1712) took 1342 ms. Trace:
I20260709 12:20:49.476733 11078 rpcz_store.cc:276] 0709 12:20:48.133519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.134910 (+  1391us) service_pool.cc:224] Handling call
0709 12:20:48.135199 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:48.142851 (+  7652us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:48.142886 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:48.160979 (+ 18093us) log.cc:844] Serialized 26 byte log entry
0709 12:20:48.986516 (+825537us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:48.986553 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:48.986621 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:49.476150 (+489529us) raft_consensus.cc:1685] finished
0709 12:20:49.476169 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:49.476310 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7255,"raft.queue_time_us":7787,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":8429,"thread_start_us":825179,"threads_started":1,"wal-append.queue_time_us":1150543}
W20260709 12:20:49.477872 11657 consensus_meta.cc:287] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 1.396s	user 0.010s	sys 0.001s
I20260709 12:20:49.478394 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:49.446533 11624 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:49.480139 11081 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 1707) took 1360 ms. Trace:
I20260709 12:20:49.479939 13012 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:20:49.480865 12948 consensus_meta.cc:287] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 1.047s	user 0.007s	sys 0.003s
W20260709 12:20:49.481040 13289 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:20:49.481279 13204 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:49.481993 13295 log.cc:927] Time spent T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:20:49.482764 13292 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:20:49.479645 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:49.469164 13045 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:49.483573 13204 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:49.479573 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:49.486317 11009 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:49.445573 13028 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:49.479519 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 50910.4us
I20260709 12:20:49.478492 11657 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 LEARNER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:49.453029 13182 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:49.535027 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:20:49.527462 13297 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 12:20:49.457171 13118 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:49.447479 13180 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:49.537038 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:49.571519 11009 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:49.572450 13180 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:49.490749 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:20:49.557700 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:49.563190 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 275400us
I20260709 12:20:49.448879 13261 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:49.435801 13291 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:49.480516 11081 rpcz_store.cc:276] 0709 12:20:48.119291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.119821 (+   530us) service_pool.cc:224] Handling call
0709 12:20:48.120170 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:48.120504 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:48.120530 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:48.144110 (+ 23580us) log.cc:844] Serialized 26 byte log entry
0709 12:20:48.809320 (+665210us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:48.809365 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:48.809443 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:49.479925 (+670482us) raft_consensus.cc:1685] finished
0709 12:20:49.479947 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:49.480081 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":160,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":105,"spinlock_wait_cycles":59904,"thread_start_us":655571,"threads_started":1,"wal-append.queue_time_us":1217899}
I20260709 12:20:49.457935 13189 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:49.575459 13291 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:49.534013 13286 log.cc:927] Time spent T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.262s	user 0.001s	sys 0.001s
I20260709 12:20:49.577262 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 1713) took 1418 ms. Trace:
I20260709 12:20:49.577651 11076 rpcz_store.cc:276] 0709 12:20:48.158886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.159056 (+   170us) service_pool.cc:224] Handling call
0709 12:20:48.159433 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:48.159807 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:48.159836 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:48.165805 (+  5969us) log.cc:844] Serialized 26 byte log entry
0709 12:20:48.853551 (+687746us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:48.853598 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:48.853677 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:49.577043 (+723366us) raft_consensus.cc:1685] finished
0709 12:20:49.577068 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:49.577203 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"spinlock_wait_cycles":35712,"thread_start_us":659610,"threads_started":1,"wal-append.queue_time_us":989873}
I20260709 12:20:49.582547 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:49.584375 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:49.583302 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 1759) took 1023 ms. Trace:
I20260709 12:20:49.585599 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:49.585389 11085 rpcz_store.cc:276] 0709 12:20:48.559493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.282729 (+723236us) service_pool.cc:224] Handling call
0709 12:20:49.283058 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:49.283263 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:49.308503 (+ 25240us) log.cc:844] Serialized 14 byte log entry
0709 12:20:49.582206 (+273703us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:49.582767 (+   561us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:49.582831 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:49.582927 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:49.583248 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26251,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":3300,"raft.queue_time_us":1758,"thread_start_us":273286,"threads_started":1}
I20260709 12:20:49.586647 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:49.472898 13193 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:48.387202 11079 rpcz_store.cc:276] 0709 12:20:46.560416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.560582 (+   166us) service_pool.cc:224] Handling call
0709 12:20:47.440932 (+880350us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b5800017d98. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f39fc0 00007f9bb5f24929 00007f9bb5f243d2 00007f9baf49bbd4
0709 12:20:47.441116 (+   184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:47.441317 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:47.919062 (+477745us) log.cc:844] Serialized 14 byte log entry
0709 12:20:48.268622 (+349560us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:48.268692 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:48.268740 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:48.268815 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:48.268972 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":463732,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":437,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":6329,"spinlock_wait_cycles":4093824,"thread_start_us":816508,"threads_started":2}
I20260709 12:20:49.573958 11006 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:49.587049 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:49.601835 13308 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:49.602406 13308 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:49.601240 13291 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:49.604174 13291 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:49.606328 13291 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:49.570585 13256 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:49.544274 13028 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:49.581844 11657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59398 (request call id 149) took 1618 ms. Trace:
W20260709 12:20:49.673178 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 249200us
I20260709 12:20:49.673408 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:49.674309 11009 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:49.644852 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 54726.9us
I20260709 12:20:49.632645 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:49.677873 11658 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:49.679356 10975 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:20:49.640743 13301 log.cc:927] Time spent T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:20:49.697557 11009 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
W20260709 12:20:49.640170 13299 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:20:49.607650 13308 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:49.644707 13265 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:49.705662 10899 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:49.608498 13182 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:49.591166 12948 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.107s
I20260709 12:20:49.665151 13261 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:49.671716 13045 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:49.690208 13204 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:49.719486 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:49.712368 13304 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:49.712014 13182 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:49.696866 13223 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:20:49.718781 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.671254 13256 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:49.715375 12935 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:49.710057 13136 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:49.728401 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:20:49.713981 13296 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 12:20:49.671548 11657 rpcz_store.cc:276] 0709 12:20:47.963842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.975607 (+ 11765us) service_pool.cc:224] Handling call
0709 12:20:47.976973 (+  1366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:49.541639 (+1564666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:49.580867 (+ 39228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:49.727489 13304 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:49.722374 13261 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:49.752468 13304 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:49.757329 13028 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:49.706715 13315 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:20:49.759408 13259 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:49.724758 13045 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:49.766326 13045 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:49.729465 13288 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:49.719427 13309 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:20:49.785034 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:49.787464 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:49.788280 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:49.798877 11085 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 1.
I20260709 12:20:49.469514 11653 rpcz_store.cc:276] 0709 12:20:47.684786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.688173 (+  3387us) service_pool.cc:224] Handling call
0709 12:20:47.729442 (+ 41269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:47.734368 (+  4926us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:48.738445 (+1004077us) log.cc:844] Serialized 14 byte log entry
0709 12:20:49.409860 (+671415us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:49.409924 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:49.420288 (+ 10364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:49.428442 (+  8154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:49.438818 (+ 10376us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":915177,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":3634,"raft.queue_time_us":1934,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":11884,"thread_start_us":1622258,"threads_started":2,"wal-append.queue_time_us":682963}
I20260709 12:20:49.726854 13204 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:49.791065 11078 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:20:49.805588 10974 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:20:49.805981 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 100397us
I20260709 12:20:49.775501 13049 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:49.789995 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:49.722895 13265 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:49.797343 13045 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:49.736840 13223 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:49.807364 11076 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:49.807742 10899 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:20:49.821887 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.828877 13182 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:49.831990 13204 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:49.809398 13179 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.808382 13049 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:49.840183 13332 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:49.821280 13045 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:49.843385 13256 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:49.838438 13049 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:49.857556 13188 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:49.858279 13045 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:49.858912 13126 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:49.844863 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:49.864917 11076 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:20:49.838912 13179 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:49.899083 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 91411.6us
I20260709 12:20:49.867008 13332 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:49.864580 13314 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 12:20:49.907433 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 97336.8us
I20260709 12:20:49.954468 10974 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:49.960582 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:49.973789 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.909981 13312 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:49.980141 10934 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:20:50.032637 13264 log.cc:927] Time spent T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 1.514s	user 0.009s	sys 0.006s
W20260709 12:20:50.033605 13326 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:20:50.035132 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:50.036015 11003 raft_consensus.cc:2393] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 4: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:50.037287 13223 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:50.038148 13261 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:50.039130 12935 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:50.039677 12935 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.040098 12935 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:50.028414 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.045185 10930 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:49.951556 13118 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.983140 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:50.055642 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:50.056388 10928 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:50.057606 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.061458 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 1746) took 2386 ms. Trace:
I20260709 12:20:50.061934 11083 rpcz_store.cc:276] 0709 12:20:47.674943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.678038 (+  3095us) service_pool.cc:224] Handling call
0709 12:20:47.678432 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:47.696005 (+ 17573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:47.696032 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:47.696408 (+   376us) log.cc:844] Serialized 26 byte log entry
0709 12:20:48.057043 (+360635us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:48.057080 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:48.057146 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:50.032024 (+1974878us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:20:50.042689 (+ 10665us) raft_consensus.cc:1685] finished
0709 12:20:50.042710 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:50.061378 (+ 18668us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17226,"raft.queue_time_us":39954,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":6715,"spinlock_wait_cycles":26020736,"thread_start_us":328292,"threads_started":1,"wal-append.queue_time_us":694835}
I20260709 12:20:50.078135 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:50.091055 10928 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:20:50.056787 13312 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:50.114279 10931 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:50.117090 13049 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:50.119508 13331 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:50.119760 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:50.120231 13331 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:50.123183 13314 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.123929 13314 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:50.126505 13314 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:50.127190 13314 raft_consensus.cc:1064] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:20:50.082118 13118 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:50.081845 13261 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:50.128768 13261 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:49.979384 13012 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.119707 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:50.130033 13012 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:50.130895 13261 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:50.129408 13118 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:49.953944 13055 raft_consensus.cc:3055] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:50.030455 13304 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:50.133215 13055 raft_consensus.cc:740] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:49.910806 13332 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.136282 11007 raft_consensus.cc:2393] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 7: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:50.154981 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:50.155795 11652 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 2.
I20260709 12:20:50.107746 13265 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:50.159442 10900 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:20:49.979909 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 257803us
I20260709 12:20:50.111464 13312 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:50.168002 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:50.170168 11081 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:50.179263 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:50.180114 11081 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:50.181665 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.174530 12933 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:50.182873 12933 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:50.166493 13314 raft_consensus.cc:1068] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: Unable to promote non-voter 0b171b6aaedc4f809f2753dcfadb14ce: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:20:50.183354 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.184909 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.188258 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:50.132581 13012 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:50.193127 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:50.183276 12933 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:50.206459 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:20:50.185025 13081 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.914s	user 0.013s	sys 0.029s
W20260709 12:20:50.217432 13081 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.950s	user 0.013s	sys 0.029s
I20260709 12:20:50.176950 13118 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:20:50.220703 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.224355 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:50.223551 10929 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:50.226243 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:50.226693 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:50.227774 11078 raft_consensus.cc:2393] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 8: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:50.229317 10974 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:50.233108 11084 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:20:50.237756 12953 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:50.238365 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.238634 11003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:50.239168 11003 raft_consensus.cc:606] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:50.239571 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:50.240600 13334 raft_consensus.cc:1064] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:20:50.240720 13332 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:50.238394 12953 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:50.243073 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:50.243804 11652 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:50.249513 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:50.250985 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:50.251286 11010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 1851) took 2309 ms. Trace:
I20260709 12:20:50.225219 13304 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:50.251745 11010 rpcz_store.cc:276] 0709 12:20:47.942090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.945518 (+  3428us) service_pool.cc:224] Handling call
0709 12:20:47.945801 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:48.113529 (+167728us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:20:48.708841 (+595312us) log.cc:844] Serialized 14 byte log entry
0709 12:20:49.340877 (+632036us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:49.340945 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:49.340992 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.250856 (+909864us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b540012c0d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:20:50.250913 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:50.251176 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":631962,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":153,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":21562,"spinlock_wait_cycles":385248640,"thread_start_us":1208517,"threads_started":2,"wal-append.queue_time_us":719433}
I20260709 12:20:50.252403 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:50.258544 10929 raft_consensus.cc:2368] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7.
W20260709 12:20:50.257587 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.240684 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.226462 13335 raft_consensus.cc:1064] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:20:50.260219 10935 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:50.261960 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.262041 10974 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:50.262650 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:50.238270 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 270969us
I20260709 12:20:50.258932 12935 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:50.243139 13334 consensus_queue.cc:237] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:50.268762 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.364754 10929 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:50.280627 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:50.352435 13180 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:50.328644 13265 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:50.264621 13304 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.267215 13319 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:50.283893 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:50.300326 13331 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:50.369951 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:50.375687 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 69237.2us
I20260709 12:20:50.342330 13238 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:50.381673 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:50.378057 10975 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:50.386886 12837 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:50.355574 13332 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:50.273304 13337 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:50.403293 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:50.403940 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.303011 13312 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:50.409152 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:50.377331 12953 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:50.380136 13174 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:50.390955 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:50.300176 12933 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:50.410362 11010 raft_consensus.cc:2393] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 4: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:50.410135 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.376160 11652 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:20:50.393235 12935 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:50.376453 13319 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.375664 13265 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:50.387948 13304 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:50.419173 13165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.391s	user 0.016s	sys 0.011s
I20260709 12:20:50.431450 10935 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:50.433496 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:50.434764 13312 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:50.435353 12933 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:50.435365 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 1749) took 2747 ms. Trace:
I20260709 12:20:50.377942 11622 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:50.437311 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:50.479312 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.479844 11656 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:50.476578 11077 rpcz_store.cc:276] 0709 12:20:47.688303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.688500 (+   197us) service_pool.cc:224] Handling call
0709 12:20:47.688779 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:48.977308 (+1288529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.435129 (+1457821us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400278dd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:20:50.435299 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2953280384}
I20260709 12:20:50.436043 11624 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:50.456787 10975 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:50.432826 13319 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:50.459651 13351 log.cc:927] Time spent T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:20:50.464243 11007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:50.494257 11007 raft_consensus.cc:606] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:50.465662 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 1760) took 1877 ms. Trace:
I20260709 12:20:50.466218 13265 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:50.469233 13304 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:50.470157 11079 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:50.428598 13205 raft_consensus.cc:1064] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:20:50.403708 13337 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:50.477393 12890 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:50.477567 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.504877 12890 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:50.495095 11080 rpcz_store.cc:276] 0709 12:20:48.588021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.291038 (+703017us) service_pool.cc:224] Handling call
0709 12:20:49.291361 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:49.291775 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:49.291805 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:49.292280 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:20:50.381178 (+1088898us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b1800445de0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b 00007f9bb0affd23 00007f9bb0b000d1 00007f9bb0f1ba0f
0709 12:20:50.417102 (+ 35924us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:50.417141 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.417211 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:50.465363 (+ 48152us) raft_consensus.cc:1685] finished
0709 12:20:50.465392 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:50.465598 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4087,"raft.queue_time_us":90,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":14095,"spinlock_wait_cycles":57585536,"thread_start_us":35724,"threads_started":1,"wal-append.queue_time_us":1171643}
I20260709 12:20:50.478092 11005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 1852) took 2535 ms. Trace:
I20260709 12:20:50.505760 11005 rpcz_store.cc:276] 0709 12:20:47.942362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.945969 (+  3607us) service_pool.cc:224] Handling call
0709 12:20:47.946209 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:48.794090 (+847881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.477892 (+1683802us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b54002d9e54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:20:50.478042 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1931095296}
I20260709 12:20:50.481207 13012 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:20:50.472339 13165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.473s	user 0.019s	sys 0.011s
W20260709 12:20:50.481410 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 105567us
I20260709 12:20:50.487692 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:50.497087 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:50.514340 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.514762 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.515254 10930 raft_consensus.cc:2393] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 4: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:20:50.472608 13115 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.217s	user 0.004s	sys 0.016s
I20260709 12:20:50.516222 10935 raft_consensus.cc:2368] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7.
I20260709 12:20:50.519362 12890 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:50.512368 13012 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:50.494993 13151 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:50.520736 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:50.510286 13265 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:50.524570 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:50.510106 13337 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:50.512115 13205 raft_consensus.cc:1068] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: Unable to promote non-voter 0b171b6aaedc4f809f2753dcfadb14ce: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:20:50.522141 13311 log.cc:927] Time spent T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.786s	user 0.002s	sys 0.009s
I20260709 12:20:50.730624 11656 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:50.779524 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:50.690353 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:50.517221 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 94281.2us
I20260709 12:20:50.780519 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:50.517681 13115 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.266s	user 0.004s	sys 0.017s
W20260709 12:20:50.568079 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.778071 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:50.549872 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.796535 10932 raft_consensus.cc:2393] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 4: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:50.791585 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:50.666280 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 61916.9us
I20260709 12:20:50.528173 12890 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:50.786715 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.799989 10900 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:50.799213 10977 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:50.803434 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:50.709995 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:50.708250 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:50.804755 11079 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:50.805171 11085 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.806093 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.807662 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.807539 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 1708) took 2687 ms. Trace:
I20260709 12:20:50.665551 13055 consensus_queue.cc:260] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:50.811492 13055 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:50.813266 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:50.813757 13179 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:50.813874 11078 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:50.805226 12933 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:20:50.817698 12933 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:50.819073 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:50.687167 12944 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.820560 12944 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:50.822517 12944 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:50.819715 12933 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:20:50.827502 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.816135 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.827549 12837 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:50.758591 13353 log.cc:927] Time spent T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:20:50.832413 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.830410 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:50.527539 13012 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:50.823163 11078 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:50.837142 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.838049 10927 raft_consensus.cc:2410] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:20:50.838872 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.837859 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:50.840921 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.839643 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.717130 13315 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:20:50.839562 10927 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:50.854760 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.543779 13151 raft_consensus.cc:697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:20:50.855010 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.853022 11085 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:50.856568 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.857194 10930 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:20:50.858054 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.860849 13231 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:50.856328 12944 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:20:50.861479 13231 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:50.856462 12933 consensus_queue.cc:1059] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:20:50.863318 10927 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:50.864585 10927 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:50.866082 10927 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:20:50.866689 13315 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:50.868983 13315 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:50.871205 10974 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:50.826828 13266 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:50.872922 13300 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:50.873096 13266 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:50.863422 12933 raft_consensus.cc:3055] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:50.874145 12933 raft_consensus.cc:740] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:50.874991 12933 consensus_queue.cc:260] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:50.875353 13257 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:50.876200 12933 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:50.878288 10974 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:50.879244 13196 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:50.834951 13112 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:50.880453 13112 raft_consensus.cc:697] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:50.881481 13300 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:50.881323 13112 consensus_queue.cc:237] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:50.881994 13300 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:50.881557 13151 consensus_queue.cc:237] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:50.883744 11657 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEARNER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:50.884172 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:20:50.873436 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 44793.8us
I20260709 12:20:50.888621 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:50.888865 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:50.889631 11007 raft_consensus.cc:2393] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 6: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:50.890486 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:50.890832 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:50.891038 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:50.891455 11005 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:50.892220 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:20:50.897806 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:50.864778 13335 raft_consensus.cc:1068] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3: Unable to promote non-voter 0b171b6aaedc4f809f2753dcfadb14ce: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }.
  Pending config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:50.976745 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:50.912087 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:51.036871 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:51.037681 11005 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:51.063273 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:20:51.034462 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.064680 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:51.064815 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:51.065539 11005 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:51.066378 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:51.041406 10930 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:51.046617 10929 raft_consensus.cc:1240] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:50.920935 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:50.879793 13196 raft_consensus.cc:697] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:50.846503 11654 raft_consensus.cc:1240] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:51.057039 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:20:51.033377 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 122052us
I20260709 12:20:51.094271 10977 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:51.058601 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:51.069479 13266 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:51.098829 10930 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:20:51.059983 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 207834us
I20260709 12:20:50.913354 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:50.863713 13231 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:50.928233 12937 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.150s
I20260709 12:20:51.002111 13300 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:50.992547 11624 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:20:51.092682 13319 consensus_meta.cc:287] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.000s
I20260709 12:20:50.999809 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:51.101545 10977 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:51.100118 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:50.977391 13173 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:51.129076 10977 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:51.108736 13260 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:51.103331 13321 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.160626 13260 raft_consensus.cc:697] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:51.161770 13260 consensus_queue.cc:237] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:51.164427 13363 log.cc:927] Time spent T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:20:51.164876 13300 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:51.167503 11077 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:51.147023 13200 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:51.146728 13265 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:51.108536 13339 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:20:51.158588 11657 raft_consensus.cc:1240] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:51.146777 13173 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:51.297905 13173 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:51.226684 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.177428 13012 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:20:51.301874 11051 leader_election.cc:336] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.682s (SENT)
I20260709 12:20:51.239153 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.303231 10928 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:20:51.303921 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 1304) took 1038 ms. Trace:
I20260709 12:20:51.304258 10928 rpcz_store.cc:276] 0709 12:20:50.265575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.883635 (+618060us) service_pool.cc:224] Handling call
0709 12:20:51.238809 (+355174us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b5800002d98. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f260a0 00007f9bb5f25984 00007f9baf4a06d4 00007f9baf4a0662
0709 12:20:51.303816 (+ 65007us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2834816}
W20260709 12:20:51.224906 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 123270us
I20260709 12:20:51.306198 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.240792 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.241719 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 1579) took 1185 ms. Trace:
I20260709 12:20:51.238853 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.240674 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.240674 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.309698 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.311285 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:51.255844 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 126729us
I20260709 12:20:51.317399 10977 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:51.260425 11006 raft_consensus.cc:2393] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 4: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:51.259631 10830 catalog_manager.cc:5697] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 3 to 4, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 4 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:51.277401 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:51.176369 13196 consensus_queue.cc:237] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:51.279690 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:20:51.165314 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 245263us
I20260709 12:20:50.809001 11082 rpcz_store.cc:276] 0709 12:20:48.119675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.119780 (+   105us) service_pool.cc:224] Handling call
0709 12:20:48.120160 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:48.184720 (+ 64560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:48.184750 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:48.189070 (+  4320us) log.cc:844] Serialized 26 byte log entry
0709 12:20:49.209867 (+1020797us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:49.209914 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.789612 (+1579698us) spinlock_profiling.cc:243] Waited 64.2 ms on lock 0x7b54001a4ad4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:20:50.789658 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:50.789718 (+    60us) raft_consensus.cc:1685] finished
0709 12:20:50.789732 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:50.807474 (+ 17742us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4508,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":7014,"spinlock_wait_cycles":148769664,"thread_start_us":1018805,"threads_started":1,"wal-append.queue_time_us":1213203,"wal-append.run_cpu_time_us":3224,"wal-append.run_wall_time_us":1400148}
I20260709 12:20:51.287086 12937 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:51.309417 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.242244 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.312136 13049 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:51.308312 13118 consensus_queue.cc:1059] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:20:51.401816 13118 raft_consensus.cc:3055] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:51.402344 13118 raft_consensus.cc:740] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:51.243610 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.404947 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 1589) took 1318 ms. Trace:
I20260709 12:20:51.405368 10936 rpcz_store.cc:276] 0709 12:20:50.086370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.885639 (+799269us) service_pool.cc:224] Handling call
0709 12:20:51.243242 (+357603us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b5800002d98. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f260a0 00007f9bb5f25984 00007f9baf4a06d4 00007f9baf4a0662
0709 12:20:51.404881 (+161639us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7655168}
I20260709 12:20:51.376413 13291 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:51.314000 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.309589 10932 raft_consensus.cc:2410] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:20:51.310572 10930 raft_consensus.cc:2376] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5. Re-sending same reply.
I20260709 12:20:51.308223 10935 rpcz_store.cc:276] 0709 12:20:50.055774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.917409 (+861635us) service_pool.cc:224] Handling call
0709 12:20:51.043260 (+125851us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:51.043655 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:51.043686 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:51.044865 (+  1179us) log.cc:844] Serialized 26 byte log entry
0709 12:20:51.068870 (+ 24005us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:51.068901 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.068949 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:51.192317 (+123368us) spinlock_profiling.cc:243] Waited 6.56 ms on lock 0x7b240013b098. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badcf99c4 00007f9badcf7acb 00007f9badeb2dc9 00007f9badeb2a55 00007f9badeb1fb0 00007f9bb0b28488 00007f9bb0b28be8 00007f9bb0b00398 00007f9bb0afb76a 00007f9bb0afabb6
0709 12:20:51.241097 (+ 48780us) raft_consensus.cc:1685] finished
0709 12:20:51.241130 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:51.241529 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":440,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":15089536,"thread_start_us":23669,"threads_started":1,"wal-append.queue_time_us":16443}
I20260709 12:20:51.314497 11656 raft_consensus.cc:1240] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:51.314903 13173 consensus_queue.cc:1059] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:51.169890 13200 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:51.278477 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:51.424424 13200 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:51.157390 13308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.331s	user 0.013s	sys 0.018s
W20260709 12:20:51.427353 13308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.604s	user 0.014s	sys 0.018s
I20260709 12:20:51.120163 13319 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:51.432356 13319 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:51.158358 13321 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:51.433336 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:51.187589 13337 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:51.437054 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:51.320545 10899 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:20:51.369365 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:51.370839 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 53756.7us
I20260709 12:20:51.370445 10929 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:51.376359 13012 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:51.398111 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:51.447576 11077 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:51.399056 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.451782 11050 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:51.455497 13303 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:51.456032 13303 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:51.456501 13303 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:51.376413 13352 consensus_queue.cc:1059] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:20:51.406504 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.417367 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.418855 10933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1311) took 1088 ms. Trace:
I20260709 12:20:51.421559 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:51.463467 10930 raft_consensus.cc:2410] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:20:51.395073 10830 catalog_manager.cc:5697] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 4 to 5, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 5 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:51.422505 12953 consensus_queue.cc:1059] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:51.188987 13331 raft_consensus.cc:993] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:51.481292 13331 raft_consensus.cc:1081] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:51.482205 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.483168 13059 raft_consensus.cc:1064] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
W20260709 12:20:51.483693 13059 raft_consensus.cc:1068] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: Unable to promote non-voter 0b171b6aaedc4f809f2753dcfadb14ce: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:20:51.462239 10933 rpcz_store.cc:276] 0709 12:20:50.330665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.086308 (+755643us) service_pool.cc:224] Handling call
0709 12:20:51.086648 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:51.086859 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:20:51.087146 (+   287us) log.cc:844] Serialized 14 byte log entry
0709 12:20:51.418137 (+330991us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:51.418236 (+    99us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:51.418353 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.418444 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:51.418674 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1360,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":443,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":265,"thread_start_us":309848,"threads_started":1,"wal-append.queue_time_us":272007}
I20260709 12:20:51.485749 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.486444 10930 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:20:51.479458 10830 catalog_manager.cc:5697] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 5 to 7, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 7 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:51.487987 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:51.489358 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:51.490111 11007 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:51.407083 12937 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:51.490760 12937 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:51.491278 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:51.492624 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:51.444422 11011 raft_consensus.cc:2393] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 5: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:51.412339 10934 raft_consensus.cc:2376] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5. Re-sending same reply.
I20260709 12:20:51.445281 10977 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:51.446151 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:51.473831 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 163719us
I20260709 12:20:51.492710 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.474308 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:51.479161 13173 raft_consensus.cc:3055] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:51.482360 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1297) took 1294 ms. Trace:
I20260709 12:20:51.490041 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.400852 13193 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:51.489006 10830 catalog_manager.cc:5697] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 4 to 6, leader changed from 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 6 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:51.443306 13337 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:51.403664 13118 consensus_queue.cc:260] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:51.494745 10932 raft_consensus.cc:2376] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5. Re-sending same reply.
I20260709 12:20:51.496616 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:51.483577 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.525856 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 1293) took 1336 ms. Trace:
I20260709 12:20:51.526302 10934 rpcz_store.cc:276] 0709 12:20:50.186029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.885100 (+699071us) service_pool.cc:224] Handling call
0709 12:20:51.241970 (+356870us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b5800002d98. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f260a0 00007f9bb5f25984 00007f9baf4a06d4 00007f9baf4a0662
0709 12:20:51.518926 (+276956us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7592832}
I20260709 12:20:51.531288 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:51.532123 13321 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:51.540344 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:51.404837 11624 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:51.497588 13173 raft_consensus.cc:740] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:51.544490 12953 raft_consensus.cc:3055] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:51.545527 10931 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:51.546221 13115 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:51.548755 10830 catalog_manager.cc:5697] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 2 to 4, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 4 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:51.549401 13126 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:51.556860 13118 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:51.557461 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 112359us
I20260709 12:20:51.563076 10977 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:20:51.556730 11051 leader_election.cc:336] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.687s (SENT)
I20260709 12:20:51.564185 13126 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:51.567206 13126 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:51.546257 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:51.569813 11009 raft_consensus.cc:2410] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:20:51.570794 11010 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:51.497790 10927 rpcz_store.cc:276] 0709 12:20:50.187366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.868935 (+681569us) service_pool.cc:224] Handling call
0709 12:20:50.894639 (+ 25704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:50.894874 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:20:51.236623 (+341749us) log.cc:844] Serialized 14 byte log entry
0709 12:20:51.414453 (+177830us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:51.474619 (+ 60166us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:51.474672 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.482014 (+  7342us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:51.482185 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28080,"prepare.queue_time_us":161612,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":33206,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":66127,"thread_start_us":343374,"threads_started":2,"wal-append.queue_time_us":135145}
I20260709 12:20:51.551582 12953 raft_consensus.cc:740] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:51.544338 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:51.576090 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:51.557849 13173 consensus_queue.cc:260] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:51.578200 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.579595 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.540109 13059 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:51.580298 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.580245 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.603554 11077 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:51.586143 11656 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:51.610774 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.612744 13265 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:51.613487 13173 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:51.614264 13205 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:51.615196 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:51.614986 13179 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:51.615888 11010 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:51.616123 13380 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:20:51.616827 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 53958.1us
I20260709 12:20:51.617853 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:20:51.586256 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 181791us
I20260709 12:20:51.619809 11009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3625831778d468cb424c06fc474c323"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:51.620724 11009 raft_consensus.cc:606] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:51.621115 11009 raft_consensus.cc:614] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:51.621511 13260 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:51.559672 13231 raft_consensus.cc:3055] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:51.622218 13231 raft_consensus.cc:740] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:51.623353 13231 consensus_queue.cc:260] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:51.612015 11051 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:51.587365 10830 catalog_manager.cc:5697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 3 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:51.627352 11011 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:20:51.595845 13059 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:51.625104 13231 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:51.610798 13115 raft_consensus.cc:697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:51.631575 13059 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:51.638332 11050 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:51.643155 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.645416 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:51.634075 13352 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:51.579666 12953 consensus_queue.cc:260] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:20:51.654690 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 107705us
W20260709 12:20:51.655721 11051 leader_election.cc:336] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.737s (SENT)
I20260709 12:20:51.656392 11051 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:20:51.658763 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 48912.8us
I20260709 12:20:51.676115 13165 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:51.676002 13196 consensus_queue.cc:1059] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:20:51.677382 11011 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 7. Ops: []
I20260709 12:20:51.684645 12953 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:51.685192 11050 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:51.686622 13380 consensus_queue.cc:1059] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:51.647601 13200 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:51.692058 13379 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:51.693097 13379 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:51.693656 13379 raft_consensus.cc:697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:51.697301 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.697775 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:20:51.699200 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 43641.4us
W20260709 12:20:51.699975 11051 leader_election.cc:336] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.747s (SENT)
W20260709 12:20:51.702801 11051 leader_election.cc:336] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.882s (SENT)
I20260709 12:20:51.703256 11051 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:51.705883 13266 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:51.708700 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:51.709489 11084 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:20:51.709614 11080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:20:51.710248 11080 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:51.710590 11080 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:51.655758 13115 consensus_queue.cc:237] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:51.674038 10830 catalog_manager.cc:5697] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 4 to 6, leader changed from 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 6 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:51.721494 10830 catalog_manager.cc:5697] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 1 to 3, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 3 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:51.676697 13165 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:51.728331 13165 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:51.730268 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:51.737639 13200 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:51.738698 11005 raft_consensus.cc:2393] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 5: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:51.744779 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:51.744833 11010 raft_consensus.cc:1240] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:51.748915 10934 raft_consensus.cc:1240] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:51.749439 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:51.750243 11003 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:20:51.751338 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:51.694845 13379 consensus_queue.cc:237] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:51.758244 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:51.768226 13352 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:51.800806 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.803066 13352 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:51.774178 13231 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:51.767818 13303 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:51.807219 13303 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:51.775934 10830 catalog_manager.cc:5697] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:51.787504 11010 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:20:51.787829 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:51.788128 11009 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:51.788552 11003 raft_consensus.cc:1240] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:20:51.790453 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:51.798890 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.800465 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.816545 10936 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:20:51.816736 11006 raft_consensus.cc:1240] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:51.800341 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:51.785876 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:51.818452 11007 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:20:51.820616 11002 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:20:51.789719 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:51.824142 10974 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:51.800259 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:51.825629 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.821184 10830 catalog_manager.cc:5697] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:51.830233 11080 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:51.837611 10974 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:51.741053 12937 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:51.848008 11080 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:51.858333 10830 catalog_manager.cc:5697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 5 to 6, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 6 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:51.775492 13059 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:51.840567 13319 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:51.846460 13205 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.890950 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:51.876891 10830 catalog_manager.cc:5697] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 1 to 3, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 3 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:51.899981 13257 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:51.898945 13332 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:51.904326 11007 raft_consensus.cc:2410] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:20:51.907569 11002 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:51.878522 13337 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:51.913960 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:51.908507 13196 raft_consensus.cc:1064] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:20:51.925994 10830 catalog_manager.cc:5697] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 4 to 5, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 5 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:51.929844 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:20:51.933528 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 248458us
I20260709 12:20:51.914556 13337 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.889127 13319 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:51.915184 13291 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:51.923276 13257 raft_consensus.cc:697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:51.902388 13205 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:51.945748 13337 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:51.956635 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 253845us
I20260709 12:20:51.958652 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.958856 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.922326 13332 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:51.964080 13291 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:51.965236 13319 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:51.965674 13332 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:51.966291 13291 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:51.968585 11050 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:51.954599 12937 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:51.995227 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.995002 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:51.984915 10830 catalog_manager.cc:5697] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 4 to 6, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 6 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:51.959229 13293 raft_consensus.cc:3055] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:20:51.999516 13384 log.cc:927] Time spent T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:20:51.999773 11007 raft_consensus.cc:1275] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:52.000696 13386 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:52.001233 13386 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:52.001596 13386 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:51.998745 10830 catalog_manager.cc:5697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 5 to 6, leader changed from 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 6 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:52.005195 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:52.008131 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.008440 10928 raft_consensus.cc:2393] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 4: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:52.007618 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:52.009760 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:52.007782 10830 catalog_manager.cc:5697] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 3 to 5, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 5 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
W20260709 12:20:52.003371 11051 leader_election.cc:336] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.886s (SENT)
I20260709 12:20:52.003926 13293 raft_consensus.cc:740] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:52.012495 11051 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:20:52.016136 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 141601us
I20260709 12:20:52.021649 10830 catalog_manager.cc:5697] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:20:52.030501 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.020499 11050 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:20:52.043177 13387 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.080s	user 0.001s	sys 0.001s
I20260709 12:20:52.054587 10934 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:52.023213 13380 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:52.056970 11080 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:52.024478 13059 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:52.060684 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 65618.1us
I20260709 12:20:52.056730 10830 catalog_manager.cc:5697] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:52.066237 10830 catalog_manager.cc:5697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 2 to 3, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 3 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:52.055670 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:52.072427 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:52.075680 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:52.082432 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 146706us
W20260709 12:20:52.089893 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 76587.5us
I20260709 12:20:52.099901 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:52.090034 10830 catalog_manager.cc:5697] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:52.112452 11050 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:52.116554 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:52.123914 13385 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:52.125656 13386 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.129020 10901 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:52.137126 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:52.122761 10932 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:20:52.123310 10830 catalog_manager.cc:5697] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 4 to 6, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 6 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:20:52.155090 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 47617.1us
I20260709 12:20:52.155469 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:52.159976 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:52.164778 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:52.167083 13205 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:52.156038 10901 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:52.158978 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:52.150847 11011 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:52.172009 13396 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:52.147603 11624 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:52.070785 13293 consensus_queue.cc:260] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:52.183136 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:52.154623 13386 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:52.077525 13257 consensus_queue.cc:237] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.188867 11004 raft_consensus.cc:2410] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:20:52.189489 11078 raft_consensus.cc:2393] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 7: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:52.184054 11051 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.188438 13396 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:52.179186 13266 raft_consensus.cc:3055] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:52.117528 13165 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.186167 10830 catalog_manager.cc:5697] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 5 to 7, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 7 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:52.179291 10931 raft_consensus.cc:2955] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:52.196977 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:52.195358 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:52.193244 13266 raft_consensus.cc:740] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:52.209604 10830 catalog_manager.cc:5697] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:52.221341 13293 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:52.222149 13165 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:52.196624 13205 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:52.199829 13303 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:52.203541 11050 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:52.238930 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:52.239784 10934 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
W20260709 12:20:52.241808 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 62735.7us
W20260709 12:20:52.243490 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 123954us
I20260709 12:20:52.244372 13205 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:52.246747 13205 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:52.248193 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:52.231392 13303 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:52.255895 11051 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:20:52.257496 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 62375.3us
I20260709 12:20:52.259186 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:52.249392 10830 catalog_manager.cc:5697] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:52.260499 13402 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:20:52.263425 13395 log.cc:927] Time spent T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:20:52.259693 13386 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:52.272435 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:52.276000 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 52446.4us
I20260709 12:20:52.280762 13266 consensus_queue.cc:260] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.285459 13266 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:52.287005 10977 leader_election.cc:336] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.622s (SENT)
I20260709 12:20:52.261395 13303 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:52.291770 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:52.292541 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:52.292204 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:52.294615 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:52.295382 10935 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:20:52.284515 10901 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:52.280020 13165 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:52.234277 13332 consensus_queue.cc:1059] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:20:52.297843 11003 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:20:52.298260 11003 pending_rounds.cc:85] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 4
I20260709 12:20:52.298480 11003 pending_rounds.cc:107] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:20:52.298765 11003 raft_consensus.cc:2889] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:52.317286 10901 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:52.322996 10901 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:52.324601 11076 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:52.326027 11078 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:52.318142 10830 catalog_manager.cc:5697] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 4 to 6, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 6 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:52.328753 11657 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:52.318218 13115 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:52.330049 13115 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:52.330433 13115 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:52.320333 13165 raft_consensus.cc:697] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:20:52.323755 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 69347.4us
I20260709 12:20:52.331805 13165 consensus_queue.cc:237] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.333127 11085 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:20:52.318018 13385 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:52.333825 13385 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:52.334290 13385 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:52.354285 13196 consensus_queue.cc:237] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:52.368126 13200 raft_consensus.cc:3055] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:52.368513 13200 raft_consensus.cc:740] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:52.369318 13200 consensus_queue.cc:260] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.370507 13200 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:52.373016 12953 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:52.373013 11654 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:52.356117 10901 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:52.376827 10901 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:52.377960 10901 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:52.378715 13049 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:52.379191 13049 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:52.379580 13049 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:52.379968 13379 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:20:52.380517 13379 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:52.347410 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:52.361059 13118 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:52.363335 11051 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:52.323324 13084 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:52.344560 13332 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:20:52.273743 13337 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.389683 12937 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:52.390456 13337 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:52.391444 13055 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:52.391844 13055 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:52.392143 13231 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:52.392581 13231 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:52.392940 13231 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:52.366448 11050 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.367237 13059 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:52.387204 13396 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:20:52.402829 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:52.415156 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:52.419314 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.411257 13055 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:52.423545 11007 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:52.412457 13396 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:20:52.428606 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 62212.4us
I20260709 12:20:52.416379 13386 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:52.454953 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:52.456722 11085 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:52.441759 13396 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:52.458137 10974 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:20:52.458302 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 95075.3us
W20260709 12:20:52.457631 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 79762.2us
I20260709 12:20:52.481416 11050 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:52.487641 10901 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:52.484419 13337 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:52.495438 13118 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:20:52.500180 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.495184 13379 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:52.500746 11050 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:52.501660 13388 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:52.501914 13379 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:52.502358 13388 raft_consensus.cc:697] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:52.502358 13379 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:52.504439 13379 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:52.507251 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.497140 11654 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:20:52.512362 11654 pending_rounds.cc:85] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: Aborting all ops after (but not including) 4
I20260709 12:20:52.512769 11654 pending_rounds.cc:107] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.5
I20260709 12:20:52.513118 11654 raft_consensus.cc:2917] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Aborting config change with OpId 3.5: Aborted: Op aborted by new leader
I20260709 12:20:52.513626 11654 raft_consensus.cc:2889] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:52.511454 13303 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:52.500696 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 82688.4us
I20260709 12:20:52.538228 11076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:20:52.538950 11076 raft_consensus.cc:606] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.542637 11079 raft_consensus.cc:2393] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 4: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:52.544306 13303 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:20:52.553366 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:52.559303 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 95984.5us
I20260709 12:20:52.516825 13118 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:20:52.564494 13386 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:52.565194 10901 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:52.511700 13385 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:52.503408 13388 consensus_queue.cc:237] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.584049 11082 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:52.585430 10901 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:20:52.589579 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 48611.1us
I20260709 12:20:52.590750  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:52.592543 12933 consensus_queue.cc:1059] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:20:52.593292  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:52.596318 11654 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 LEARNER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:20:52.597083 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.597610 13084 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:52.598510 13084 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.599220 11051 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.600682 11051 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.599020 13084 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.606824 13385 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:20:52.603361 13402 raft_consensus.cc:670] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:52.588707 13059 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:20:52.583139 12937 consensus_queue.cc:1059] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:20:52.595304 13049 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.623373 11085 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:20:52.593314 13357 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:52.620898 13260 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:20:52.598606 13303 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:20:52.635637 12937 raft_consensus.cc:3055] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:52.613921 13165 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:52.636451 12937 raft_consensus.cc:740] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:52.637347 11051 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.644701 13417 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.645298 13417 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:52.647135 13417 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:52.621258 13380 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:52.602955 13231 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:52.654368 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 74417.6us
I20260709 12:20:52.654816 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:52.653885 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:52.652064 11625 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.661726 11080 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:52.637920 13115 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.665295 11051 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.667083 13055 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.668114 13049 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:52.669389 10901 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:52.652596 13303 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:52.669114 13402 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:52.683182 11051 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:52.685791 13303 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:52.686637 13303 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:52.687306 13303 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:52.673238 13165 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:52.668875 12933 consensus_queue.cc:1059] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:20:52.670397 13231 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:52.689000 11051 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.685741 13379 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.695842 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.707173 13200 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:52.709189 10977 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.710023 13291 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:52.710558 10977 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:20:52.700677 13411 log.cc:927] Time spent T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:20:52.701323 10901 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:52.712006 13257 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:52.702021 12933 consensus_queue.cc:1243] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:20:52.712320 13165 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:52.713392 12933 raft_consensus.cc:3055] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.713997 12933 raft_consensus.cc:740] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:52.675725 13049 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:52.675402 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:20:52.717360 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 54707.5us
I20260709 12:20:52.723623 11657 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:52.724195 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:52.724514 11051 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.722105 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:52.696772 13357 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:52.734427 10977 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:52.743302  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:52.744860 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:52.745627 11007 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 7: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:52.744535 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:52.749069 13055 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:52.716627 13049 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:20:52.756839 13418 log.cc:927] Time spent T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
I20260709 12:20:52.756377 12933 consensus_queue.cc:260] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.752082 13231 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:52.757731 12933 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.756534 13303 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.755136 10900 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:20:52.763181 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 45978.1us
W20260709 12:20:52.765550 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 113577us
I20260709 12:20:52.716243 13396 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.767191 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:52.755615 13049 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:52.771088 13084 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:52.771261 13303 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:52.773753 13357 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:52.768219 13379 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:52.777383 11625 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.779029 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:52.777447 11051 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
W20260709 12:20:52.780732 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 68003.3us
I20260709 12:20:52.781219 11007 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:52.787652 11625 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.788652 13402 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:52.789409 13402 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:52.790722 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:52.790861 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:52.792003 13231 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:52.792460 13231 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:20:52.792879 13231 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:52.796554 11625 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.797883 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:52.796927 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:52.797210 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:52.800208 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:52.797508 13084 raft_consensus.cc:1064] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
W20260709 12:20:52.801548 13084 raft_consensus.cc:1068] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697: Unable to promote non-voter 0b171b6aaedc4f809f2753dcfadb14ce: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:20:52.803474 10977 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.799039 13421 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:52.812251 11078 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:52.812696 13205 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:52.814034 11079 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:52.799162 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:52.817219 13396 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:52.780411 13357 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.818322 13357 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:52.775403 13420 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:52.822943 11051 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:52.805096 10977 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.824121 13165 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:52.824767 13165 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:52.825205 13165 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:52.833686 11005 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:20:52.811924 13414 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.835459 10977 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:20:52.835740 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 134533us
I20260709 12:20:52.836489 11050 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.837965 13417 raft_consensus.cc:3055] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:52.838486 13417 raft_consensus.cc:740] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:52.839478 13303 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:52.839120 12937 consensus_queue.cc:260] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.839401 13417 consensus_queue.cc:260] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.840543 13417 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:20:52.843504 10901 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:52.847886 13424 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:52.848240 11051 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.850350 11051 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.850607 10901 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:52.848095 13304 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:52.851517 11051 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.853675 10977 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.852044 13118 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:52.852034 13380 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:52.841847 13260 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:52.840740 12937 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:52.862900 11003 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:52.862339 10977 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.864394 10901 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:52.864621 11051 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.835404 13414 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:52.855835 13352 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:52.860260 13396 consensus_queue.cc:1059] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:20:52.862345 10974 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:52.856122 13205 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:52.866994 11050 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:52.865836 13293 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:52.862915 13196 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:52.860383 13420 consensus_queue.cc:1059] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:20:52.870234 13420 raft_consensus.cc:3055] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:52.865542 13388 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:52.870885 13425 consensus_queue.cc:1059] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:20:52.871603 13049 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.872057 13425 raft_consensus.cc:3055] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:52.872505 13425 raft_consensus.cc:740] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:52.873610 13380 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:52.873462 13425 consensus_queue.cc:260] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.874300 13049 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:52.872372 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:52.874740 13425 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:52.867795 13291 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:52.879156 13304 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:52.879645 13304 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:52.874382 13380 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:52.870427 13414 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:52.882107 13380 raft_consensus.cc:697] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:52.882929 13115 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:52.883476 13380 consensus_queue.cc:237] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.884038 13118 raft_consensus.cc:3055] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:52.884464 13118 raft_consensus.cc:740] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:52.885306 13118 consensus_queue.cc:260] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.886504 13118 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:52.889140 13420 raft_consensus.cc:740] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:52.890120 13420 consensus_queue.cc:260] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.867985 13165 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.891533 13420 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:52.870263 13231 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:52.894075 13231 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:52.896088 13165 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:52.896495 11051 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.897172 13055 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:52.897729 11051 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.897701 13379 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:52.904130 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:52.887351 13303 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:52.916579 10977 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:52.910279 13291 raft_consensus.cc:697] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:52.917865 13291 consensus_queue.cc:237] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.920450 11085 raft_consensus.cc:1240] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:52.925290 10977 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.916509 13388 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:52.926723 13293 consensus_queue.cc:1059] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:20:52.930955 13257 consensus_queue.cc:1059] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:52.931917 13257 raft_consensus.cc:3055] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:52.936229 12953 raft_consensus.cc:3055] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:52.932597 13331 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:52.953207 11085 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:52.948621 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 86710us
I20260709 12:20:52.955685 13385 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:52.958446 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:52.959007 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:52.959247 11085 raft_consensus.cc:2393] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 7: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:52.959686 11076 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:52.959611 13165 consensus_queue.cc:1059] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:52.948017 12953 raft_consensus.cc:740] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:52.937094 13257 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:52.961889 10901 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:52.949487 10977 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:52.962935 11076 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:52.953951 13196 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:52.964908 13414 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:52.965377 13266 raft_consensus.cc:3055] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:52.965754 13266 raft_consensus.cc:740] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:52.966593 13266 consensus_queue.cc:260] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.956548 13385 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.967974 13266 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:52.972739 13352 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:52.973737 13357 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:52.976230 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:52.978873 13379 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:52.939110 13205 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:20:52.981554 12953 consensus_queue.cc:260] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:52.984197 12953 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:52.984814 13385 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:52.988493 13257 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.989845 13257 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:52.954627 13331 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.992518 13304 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:52.994601 11085 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:52.995268 11079 raft_consensus.cc:1240] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:52.996608 11078 raft_consensus.cc:1240] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:52.997987 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:52.998389 11084 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:52.998245 13118 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:53.003322 11076 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7. Ops: []
W20260709 12:20:53.005877 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 56460us
I20260709 12:20:53.008288 11082 raft_consensus.cc:1240] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:53.012099 10977 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:20:53.014894 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.016471 11005 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:53.017277 10977 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:53.020352 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:53.020982 11656 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:53.008275 13331 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:53.011444 13118 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.027216 13118 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:53.029476 11656 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:53.030881 10900 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:53.008415 13357 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:53.032449 13055 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:53.033571 13055 raft_consensus.cc:697] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:20:53.074958 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.034493 13055 consensus_queue.cc:237] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:53.076977 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:53.079466 11003 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:53.080260 13205 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:53.081089 13331 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.082732 11010 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:53.084466 11084 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:53.089913 13414 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:53.091889 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:53.093321 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:53.094512 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:53.095275 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:53.130496 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:53.095772 11084 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:53.096068 13424 consensus_queue.cc:1048] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:53.134125 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:53.135780 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:53.096304 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:53.136303 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:53.136219 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:53.097558 13331 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:53.100612 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:53.100929 13357 consensus_queue.cc:1059] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:53.104730 13425 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:53.141716 11078 raft_consensus.cc:2368] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9.
I20260709 12:20:53.106036 13420 consensus_queue.cc:1059] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:53.108500 11005 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:20:53.142995 11005 pending_rounds.cc:85] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 4
I20260709 12:20:53.143064 13420 consensus_queue.cc:1243] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:20:53.143325 11005 pending_rounds.cc:107] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.5
I20260709 12:20:53.143687 11005 raft_consensus.cc:2917] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Aborting config change with OpId 3.5: Aborted: Op aborted by new leader
I20260709 12:20:53.144184 13357 raft_consensus.cc:3055] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:53.144598 13357 raft_consensus.cc:740] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:53.145007 13304 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:53.144243 11005 raft_consensus.cc:2889] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:53.145429 13357 consensus_queue.cc:260] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.146719 13357 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:53.148268 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:53.148765 13420 raft_consensus.cc:1064] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
W20260709 12:20:53.149175 13420 raft_consensus.cc:1068] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697: Unable to promote non-voter 0b171b6aaedc4f809f2753dcfadb14ce: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:20:53.149277 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:53.138453 13396 consensus_queue.cc:1059] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:20:53.150058 11003 raft_consensus.cc:2393] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 6: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:53.150940 13425 raft_consensus.cc:3055] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:53.151324 13425 raft_consensus.cc:740] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:53.152149 13425 consensus_queue.cc:260] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.138948 11007 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:53.159024 13417 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:53.160000 10899 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:53.161311 13424 consensus_queue.cc:1059] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:53.163672 13396 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:53.164544 13396 consensus_queue.cc:1059] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:53.165781 13424 raft_consensus.cc:3055] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:53.166184 13424 raft_consensus.cc:740] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:53.167119 13084 raft_consensus.cc:3055] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:53.167043 13424 consensus_queue.cc:260] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.136602 11002 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:53.136976 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:53.096792 11076 raft_consensus.cc:1240] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:53.170070 13425 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:53.149686 11006 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:53.170113 13424 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:53.173460 13118 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.137924 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:53.137539 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:53.140878 13402 consensus_queue.cc:1059] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:53.167537 13084 raft_consensus.cc:740] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:20:53.137583 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.074700 13291 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:53.179940 10899 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:20:53.127537 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 110331us
I20260709 12:20:53.184329 11083 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:53.196570 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:53.198904 10977 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:53.201323 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:53.210340 13084 consensus_queue.cc:260] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.211897 13084 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:53.214839 11011 raft_consensus.cc:2393] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 5: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:53.184937 12933 consensus_queue.cc:1059] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:20:53.185798 13231 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 12:20:53.219558 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.207190 13420 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:53.208161 13055 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:53.212975 13396 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:53.209968 12937 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:53.217303 13115 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.207165 13386 consensus_queue.cc:1059] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:20:53.242461 11003 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:53.259232 13388 raft_consensus.cc:3055] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:53.259682 13388 raft_consensus.cc:740] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:53.260728 13118 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:53.218528 13380 consensus_queue.cc:1059] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:20:53.261001 13388 consensus_queue.cc:260] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.261994 13380 raft_consensus.cc:3055] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:53.262252 13388 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:53.262385 13380 raft_consensus.cc:740] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:53.246106 10977 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:20:53.247632 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.248631 11008 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:53.228678 13205 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:53.225049 13385 consensus_queue.cc:1059] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:20:53.280699 13304 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:53.281872 13386 consensus_queue.cc:1059] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:53.263239 13380 consensus_queue.cc:260] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.283334 13379 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:53.231880 13420 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.234939 13055 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.286027 13391 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:53.289031 13385 raft_consensus.cc:3055] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:53.286677 13293 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.286844 13200 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.235414 12953 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 12:20:53.300935 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 75012.1us
I20260709 12:20:53.286288 13396 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:53.304423 11080 raft_consensus.cc:1240] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:53.269747 13115 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.352007 10899 leader_election.cc:400] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9.
I20260709 12:20:53.352427 10899 leader_election.cc:403] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:20:53.353267 13115 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:53.356107 13432 log.cc:927] Time spent T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:20:53.306001 13385 raft_consensus.cc:740] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:53.308350 13357 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:53.357740 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:53.358335 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:53.367782 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:53.370684 10932 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:53.377961 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:53.378243 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:53.378962 10930 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 2.
I20260709 12:20:53.379914 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:53.380985 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:53.396063 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:53.397296 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:53.397356 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:53.399935 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:53.401037 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:53.314529 12933 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:53.307674 13391 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.409397 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:20:53.404536 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 86406us
I20260709 12:20:53.309545 13293 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:53.366565 13417 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:53.368053 13425 consensus_queue.cc:1059] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:20:53.414630 10899 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:53.311168 13200 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:53.414872 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:53.315073 13196 consensus_queue.cc:1059] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 12:20:53.399936 13115 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:20:53.405310 13084 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:53.356603 13396 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:53.426507 10936 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:20:53.396962 13357 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.417807 13441 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.432647 10930 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:53.412559 12933 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.459939 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:20:53.477046 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.483109 10933 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:53.486639 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 97433.1us
W20260709 12:20:53.492318 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.430148 13417 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:53.499028 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:53.504138 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:53.508486 13447 consensus_queue.cc:1059] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 12:20:53.431102 13385 consensus_queue.cc:260] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.507444 13417 raft_consensus.cc:697] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:20:53.509938 13436 log.cc:927] Time spent T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
W20260709 12:20:53.511063 13439 log.cc:927] Time spent T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:20:53.511229 10934 raft_consensus.cc:1240] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:53.512305 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:53.512949 10934 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:20:53.513743 13440 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:53.514022 10934 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:53.514547 13385 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:53.515130 10934 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:53.508805 13391 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:53.516454 10934 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:20:53.516889 10934 pending_rounds.cc:85] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 3
I20260709 12:20:53.517145 10934 pending_rounds.cc:107] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:20:53.517438 10934 raft_consensus.cc:2889] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:53.431979 13084 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.519556 10931 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:20:53.512223 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:53.492446 13425 raft_consensus.cc:3055] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:53.529096 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:53.530992 10929 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:53.545393 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 117776us
I20260709 12:20:53.550237 10901 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:53.552047 10927 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:53.489959 13441 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.533663 13425 raft_consensus.cc:740] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:53.545430 13420 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:53.574717 12933 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:53.576867 13425 consensus_queue.cc:260] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.562851 13424 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:20:53.581467 13454 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:53.512964 13417 consensus_queue.cc:237] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.584127 13049 raft_consensus.cc:3055] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:53.584590 13049 raft_consensus.cc:740] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:53.585502 13049 consensus_queue.cc:260] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.585991 13441 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:53.586899 13049 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:53.588917 13084 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:53.572633 13055 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:53.613739 13357 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:53.605350 13425 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:53.617568 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:53.622798 13115 raft_consensus.cc:1064] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
W20260709 12:20:53.623219 13115 raft_consensus.cc:1068] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697: Unable to promote non-voter 0b171b6aaedc4f809f2753dcfadb14ce: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:20:53.625941 11011 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:53.627344 13304 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.627945 13304 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.640609 10929 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:20:53.641172 10933 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
W20260709 12:20:53.641264 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.639624 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:53.639111 10930 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:20:53.644974 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:53.647718 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:53.649401 11005 raft_consensus.cc:2393] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 6: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:53.651643 13420 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:53.652225 13420 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.654362 13420 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:53.654372 13421 raft_consensus.cc:3055] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:53.655540 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:53.650799 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:53.655508 13421 raft_consensus.cc:740] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:20:53.658639 13421 consensus_queue.cc:260] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:53.659714 13421 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:53.660000 10833 catalog_manager.cc:5697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:20:53.664299 11656 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:53.666986 13380 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:53.667491 10934 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 2.
I20260709 12:20:53.668433 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:53.668982 10934 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:53.669673 10833 catalog_manager.cc:5697] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:53.671386 10833 catalog_manager.cc:5697] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 2 to 4, leader changed from 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 4 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:53.649003 13293 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:53.672348 13448 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:53.651743 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:53.675500 10927 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:20:53.675508 10933 raft_consensus.cc:1240] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 6. Current term is 7. Ops: []
W20260709 12:20:53.641731 13257 consensus_meta.cc:287] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.000s
I20260709 12:20:53.681095 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:53.682436 10935 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:53.628790 13440 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9.
I20260709 12:20:53.687330 10928 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:53.667062 13200 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:53.630069 13304 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:53.689194 11002 raft_consensus.cc:2410] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:20:53.693060 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:53.695775 10932 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:53.697489 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:53.697824 10934 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:53.698222 10935 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:53.699697 10934 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:20:53.700845 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:53.701582 10931 raft_consensus.cc:2393] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 9: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:53.686277 13352 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:53.713459 10929 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:53.715713 10931 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:53.727982 13352 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.740206 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:53.741811 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:53.742710 10931 raft_consensus.cc:2393] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 4: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:53.745443 11076 raft_consensus.cc:1240] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:53.746963 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:53.747978 11080 raft_consensus.cc:2410] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:20:53.749361 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:53.754177 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:53.754529 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:53.755371 10934 raft_consensus.cc:2410] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:20:53.757303 10932 raft_consensus.cc:1240] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:53.759021 11079 raft_consensus.cc:2393] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 8: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:53.762542 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:53.763211 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:53.762343 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:20:53.770056 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.775375 10933 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:20:53.777941 13165 raft_consensus.cc:3055] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:53.778438 13165 raft_consensus.cc:740] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:53.779316 13165 consensus_queue.cc:260] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.780614 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:53.785523 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:53.786926 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:53.789027 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:53.793116 11051 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:53.761871 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:53.799926 11051 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:53.803406 11079 raft_consensus.cc:1240] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:53.819526 11051 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:53.791982 13396 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:20:53.825671 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 275554us
I20260709 12:20:53.798005 13388 raft_consensus.cc:2764] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:20:53.830598 10901 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:53.807361 13380 raft_consensus.cc:2764] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:20:53.844285 10977 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:53.801314 11654 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:20:53.829759 13231 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:53.856804 10901 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:53.859786 10901 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:53.864462 11051 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:53.847041 13440 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:53.860304 13448 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:20:53.867337 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.871372 11051 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:53.873320 13388 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:53.874011 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:53.864449 13417 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:53.875416 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:53.880450 13352 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:53.887831 13380 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:53.889308 11051 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:53.889693 10935 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:20:53.890264 13205 raft_consensus.cc:3055] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:53.890684 13205 raft_consensus.cc:740] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:53.891551 13205 consensus_queue.cc:260] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.892789 13205 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:53.895455 13450 raft_consensus.cc:3055] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:53.895936 13450 raft_consensus.cc:740] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:53.896070 13380 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:53.896812 13450 consensus_queue.cc:260] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.897300 11051 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:53.880430 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:53.897858 13450 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:53.900795 11051 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:53.896010 10975 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:53.904271 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:53.905306 11002 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 6: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:53.872911 13440 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.904225 13231 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:53.908021 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:53.911963 13440 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:53.913745 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:53.921103 13165 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:53.926899 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:53.900993 13380 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:53.929216 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:53.930034 11085 raft_consensus.cc:2393] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 4: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:53.931824 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:53.932480 11081 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:53.927821 11082 raft_consensus.cc:2410] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:20:53.923756 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.958192 13391 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:20:53.958632 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 114446us
I20260709 12:20:53.958798 13391 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:53.959411 10977 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:53.960563 10977 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:53.962754 13391 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:53.963057 13414 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:53.963500 13391 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:53.965359 11076 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:20:53.965680 10977 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:53.963726 13414 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:20:53.967602 11011 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:20:53.970099 11076 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:53.971938 13448 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:53.972157 13450 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:53.972513 13448 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.972664 13450 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:53.973503 13260 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:53.973928 13260 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.974251 13260 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:53.974723 13450 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:53.975826 13331 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:53.976469 10932 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:20:53.974740 13448 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:53.978521 11005 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:53.972970 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 77050.5us
I20260709 12:20:53.980206 11051 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:53.980320 11003 raft_consensus.cc:1240] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:53.978760 10977 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:53.988166 13440 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:53.990690 13440 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:53.992093 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:53.995415 13443 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:53.997584 13391 raft_consensus.cc:697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:53.998729 13391 consensus_queue.cc:237] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.000049 13448 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:54.000214 13331 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:54.000607 13448 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.000845 13331 raft_consensus.cc:697] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:54.013489 13448 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:54.019740 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:54.015914 10830 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35620 (request call id 218) took 2960 ms. Trace:
I20260709 12:20:54.025133 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:54.026948 11005 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:54.029654 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:54.031328 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:54.032964 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:54.028874 13059 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:20:54.034260 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:54.035194 11010 raft_consensus.cc:2410] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:20:54.031998 13304 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:54.038328 11051 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:54.040627 11051 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:54.041980 13231 consensus_queue.cc:1059] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:54.042214 13447 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:54.064796 11051 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:54.065892 13304 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:54.066778 13260 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:54.022229 10830 rpcz_store.cc:276] 0709 12:20:51.023608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.023801 (+   193us) service_pool.cc:224] Handling call
0709 12:20:51.033087 (+  9286us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b5400002490. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3c0b2 00007f9bb6db5759 00007f9bb6d4da76 00007f9bb6d1ed58 00007f9bb6e1d04e 00007f9bb52de2a4 00007f9bb52de232 00007f9bb52de161 00007f9bb52de0dc
0709 12:20:53.983950 (+2950863us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:52.542863 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:52.543505 (+   642us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:52.543572 (+    67us) write_op.cc:435] Acquired schema lock
0709 12:20:52.543610 (+    38us) tablet.cc:662] Decoding operations
0709 12:20:52.545572 (+  1962us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:52.545661 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:52.545687 (+    26us) tablet.cc:685] Acquiring locks for 25 operations
0709 12:20:52.566873 (+ 21186us) tablet.cc:701] Row locks acquired
0709 12:20:52.566912 (+    39us) write_op.cc:260] PREPARE: finished
0709 12:20:52.567097 (+   185us) write_op.cc:270] Start()
0709 12:20:52.567245 (+   148us) write_op.cc:276] Timestamp: P: 1783599652567030 usec, L: 0
0709 12:20:52.567268 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:20:52.570413 (+  3145us) log.cc:844] Serialized 9807 byte log entry
0709 12:20:52.869052 (+298639us) op_driver.cc:464] REPLICATION: finished
0709 12:20:52.955401 (+ 86349us) write_op.cc:301] APPLY: starting
0709 12:20:52.955515 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:52.956026 (+   511us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:52.956147 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:52.960656 (+  4509us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:52.961026 (+   370us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=25
0709 12:20:53.002666 (+ 41640us) write_op.cc:312] APPLY: finished
0709 12:20:53.030995 (+ 28329us) log.cc:844] Serialized 170 byte log entry
0709 12:20:53.031335 (+   340us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:53.031547 (+   212us) write_op.cc:454] Released schema lock
0709 12:20:53.031610 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:53.032074 (+   464us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:53.032117 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13997,"reported_tablets":33,"spinlock_wait_cycles":9405696,"child_traces":[["op",{"apply.queue_time_us":86064,"apply.run_cpu_time_us":5836,"apply.run_wall_time_us":76652,"num_ops":25,"prepare.queue_time_us":74299,"prepare.run_cpu_time_us":15027,"prepare.run_wall_time_us":109621,"raft.queue_time_us":110549,"raft.run_cpu_time_us":20838,"raft.run_wall_time_us":63832,"replication_time_us":301641,"thread_start_us":365620,"threads_started":5,"wal-append.queue_time_us":113822}]]}
I20260709 12:20:54.065398 11011 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:54.034178 13332 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:54.072479 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:54.074141 13443 consensus_queue.cc:1059] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:54.076256 13453 consensus_queue.cc:1059] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:54.064618 13165 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:54.077576 10974 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:54.068272 13303 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:54.081662 13266 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:54.092826 13303 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:54.093876 11051 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:54.096395 13303 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:54.096830 13231 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:54.098522 13260 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:54.101197 13165 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:54.101214 13440 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.104846 13440 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.100446 11051 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:54.042265 13331 consensus_queue.cc:237] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.106436 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:54.114351 11051 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:54.121307 10977 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:20:54.121780 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 48030.2us
I20260709 12:20:54.108441 13165 raft_consensus.cc:697] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:54.128177 13165 consensus_queue.cc:237] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.115538 13266 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:54.131069 10974 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:54.132102 13205 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:54.134848 13231 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:54.122310 13200 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:54.113997 11654 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:54.120630 13453 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:54.141155 10899 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:54.147261 10899 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:54.139546 13293 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:54.139845 13266 raft_consensus.cc:697] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:54.141055 13388 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:20:54.173580 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:54.172464 10936 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:20:54.173193 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:54.153937 13450 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:54.166918 10899 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:54.164319 13453 raft_consensus.cc:697] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:54.169397 13420 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.174005 13386 raft_consensus.cc:3055] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:54.175179 13449 raft_consensus.cc:3055] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:54.168201 13462 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:54.213487 11005 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
W20260709 12:20:54.216300 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 49478.3us
I20260709 12:20:54.195580 12937 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.188297 13440 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:54.169803 13352 raft_consensus.cc:3055] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:54.167806 13414 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:20:54.274051 10899 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:54.207644 13059 consensus_queue.cc:1059] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:20:54.230547 13425 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:54.303831 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:54.313166 11077 raft_consensus.cc:2393] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 4: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:54.307809 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:54.308573 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:54.314582 11076 raft_consensus.cc:2393] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 6: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:54.246938 13417 raft_consensus.cc:1064] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:20:54.309335 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:54.308331 13266 consensus_queue.cc:237] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.227679 13386 raft_consensus.cc:740] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:20:54.318715 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 69898us
I20260709 12:20:54.323407 10899 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:54.246917 13448 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.229583 13449 raft_consensus.cc:740] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:54.273039 13352 raft_consensus.cc:740] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:54.330617 10899 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:54.234462 13421 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:20:54.332672 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 136315us
I20260709 12:20:54.335228 10899 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:54.229382 13420 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.341797 10899 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:54.320597 13462 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:54.309780 13303 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.357203 13440 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:54.300473 12937 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.331055 13396 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:54.342948 13425 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:54.358603 13475 log.cc:927] Time spent T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:20:54.329521 13388 consensus_queue.cc:1059] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:20:54.361797 13450 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:54.347054 13453 consensus_queue.cc:237] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.376173 13449 consensus_queue.cc:260] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.377620 13449 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:54.336068 13448 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.389365 13443 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:20:54.394573 12937 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:54.345338 13421 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:54.401239 11005 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:20:54.404264 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 93075.2us
I20260709 12:20:54.379449 13386 consensus_queue.cc:260] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:54.385615 13486 consensus_queue.cc:1175] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2201bad9e18849b09cf82de29dd032d3" responder_term: 3 status { last_received { term: 3 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 3 index: 3 } }
W20260709 12:20:54.411957 13487 consensus_queue.cc:1175] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2201bad9e18849b09cf82de29dd032d3" responder_term: 6 status { last_received { term: 6 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 6 index: 4 } }
I20260709 12:20:54.412148 13386 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:54.415191 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 73503us
I20260709 12:20:54.418115 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:54.418771 11005 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:20:54.422574 10901 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:54.421356 10899 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:54.371448 13352 consensus_queue.cc:260] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.414193 13337 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.425052 10899 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:54.423568 13396 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.429427 13491 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:20:54.446302 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:54.448927 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 74643.9us
I20260709 12:20:54.456033 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:54.466359 11050 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:20:54.442344 13490 log.cc:927] Time spent T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:20:54.469554 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:20:54.472234 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 49734.5us
I20260709 12:20:54.431116 13487 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.473922 10899 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:54.472409 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:54.476770 11076 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:20:54.476097 10901 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:54.439608 13304 raft_consensus.cc:3055] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:54.442509 13303 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:54.437789 13447 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:54.476014 11078 raft_consensus.cc:2393] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 6: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:54.440022 13448 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:54.458063 13491 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:54.479941 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:54.491153 11083 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:54.430020 11654 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:20:54.439108 13421 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:54.497315 13231 raft_consensus.cc:3055] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:54.497794 13231 raft_consensus.cc:740] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:54.497867 13499 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:54.498864 13231 consensus_queue.cc:260] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.499452 13491 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:54.499979 13448 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:54.505807 13425 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:54.506317 13352 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:54.485219 13487 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.508201 10975 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:54.487223 13447 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.509979 13447 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:54.436239 13396 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.493808 13200 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:54.479288 13304 raft_consensus.cc:740] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:54.526227 13304 consensus_queue.cc:260] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.527153 11076 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:20:54.516466 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:54.519451 10833 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 83) took 2561 ms. Trace:
I20260709 12:20:54.429222 13337 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:54.488029 13495 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:54.520496 13414 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:54.512897 13491 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.521381 10974 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:54.532276 11011 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:20:54.549472 13414 raft_consensus.cc:697] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 8 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:54.550542 13448 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:54.550837 13196 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.551314 13196 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.553030 13447 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.553501 13196 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:54.554157 13196 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:54.554519 13196 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:54.534037 13483 log.cc:927] Time spent T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:20:54.554858 13196 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:54.555162 13447 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:54.542503 13487 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:54.545069 13420 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:54.549463 13491 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:54.557379 13396 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:54.559355 13337 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:20:54.561854 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 75820.5us
I20260709 12:20:54.563951 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:54.564690 11010 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:20:54.527592 13304 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:54.568646 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:54.569358 11657 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:54.568482 13231 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:54.571188 13491 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.550508 13414 consensus_queue.cc:237] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:54.573432 13491 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:54.574254 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 50450us
I20260709 12:20:54.584466 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:20:54.586195 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 112374us
I20260709 12:20:54.586494 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:54.587244 11076 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:54.585204 11080 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:54.588359 10899 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:54.589769 10899 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:54.589991 11080 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:20:54.590559 11080 pending_rounds.cc:85] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 3
I20260709 12:20:54.590921 11080 pending_rounds.cc:107] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:20:54.591202 11080 raft_consensus.cc:2889] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:54.569309 13388 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:54.592576 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 117160us
I20260709 12:20:54.594162 10974 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:54.595148 10974 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:54.596585 10899 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:54.598582 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:54.602237 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:54.607251 11003 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:54.604673 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:54.608755 10931 raft_consensus.cc:2393] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 6: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:54.601687 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:54.609979 11002 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:54.606869 10936 raft_consensus.cc:2393] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 7: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:54.600783 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:54.614224 11010 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:20:54.601979 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:54.615227 11009 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:54.616907 11051 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:54.528913 10833 rpcz_store.cc:276] 0709 12:20:51.958760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.959053 (+   293us) service_pool.cc:224] Handling call
0709 12:20:54.519385 (+2560332us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:53.908400 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:53.908942 (+   542us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:53.908975 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:20:53.908992 (+    17us) tablet.cc:662] Decoding operations
0709 12:20:53.909527 (+   535us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:53.909578 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:53.909604 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:20:53.909920 (+   316us) tablet.cc:701] Row locks acquired
0709 12:20:53.909938 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:20:53.910074 (+   136us) write_op.cc:270] Start()
0709 12:20:53.910185 (+   111us) write_op.cc:276] Timestamp: P: 1783599653910028 usec, L: 0
0709 12:20:53.910208 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:20:53.910829 (+   621us) log.cc:844] Serialized 1355 byte log entry
0709 12:20:54.088076 (+177247us) op_driver.cc:464] REPLICATION: finished
0709 12:20:54.320427 (+232351us) write_op.cc:301] APPLY: starting
0709 12:20:54.326180 (+  5753us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:54.342914 (+ 16734us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:54.361719 (+ 18805us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:54.366341 (+  4622us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:54.366555 (+   214us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:20:54.367510 (+   955us) write_op.cc:312] APPLY: finished
0709 12:20:54.372605 (+  5095us) log.cc:844] Serialized 35 byte log entry
0709 12:20:54.377025 (+  4420us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:54.377148 (+   123us) write_op.cc:454] Released schema lock
0709 12:20:54.377192 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:54.377574 (+   382us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:54.377605 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":448585,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":158538,"apply.run_cpu_time_us":2611,"apply.run_wall_time_us":67824,"num_ops":3,"prepare.queue_time_us":197632,"prepare.run_cpu_time_us":2731,"prepare.run_wall_time_us":2730,"replication_time_us":172800,"thread_start_us":211158,"threads_started":2}]]}
I20260709 12:20:54.620944 10901 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:54.597569 13205 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.603220 13059 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:54.604971 13396 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:54.603071 13488 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:54.631470 10901 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:54.592478 13388 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.633540 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:54.638324 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:54.643849 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:54.648010 11076 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:54.642222 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:54.647998 11082 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:54.651482 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:54.652031 11082 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:54.652819 11050 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:54.648625 11080 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:20:54.621434 13453 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:54.603417 12937 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:20:54.597668 13501 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:54.676234 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:54.678457 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:54.680943 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:54.682636 10934 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:54.690795 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:54.631237 13059 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.648593 13488 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.646577 13450 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:54.715675 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:54.719944 10927 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:54.661659 13440 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:54.667207 13447 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:54.689216 13499 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.743352 10832 catalog_manager.cc:5697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 3 to 4, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 4 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:54.632256 13205 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.717476 13059 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:54.722759 13488 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:54.723438 13450 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.758607 13499 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.752367 13293 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:54.764449 13293 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.723194 13391 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:54.771492 13391 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.773159 13205 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:54.774605 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.763567 13499 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:54.774276 13450 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:54.725972 13331 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:54.741719 13447 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.773698 13391 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:54.786429  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:54.785240 13386 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.794790 13386 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.786916 13331 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.796986 13386 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:54.797958 13331 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:54.805783 11082 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:20:54.808523 11003 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:20:54.778795 13380 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.802857 10832 catalog_manager.cc:5697] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:54.816246 10901 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:54.787361 13447 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:54.812677 13506 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:20:54.808267 13385 raft_consensus.cc:2764] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:20:54.821283 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:54.875963 11003 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:54.820107 13425 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:20:54.901558 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 52472.8us
I20260709 12:20:54.817978 13380 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:54.909361 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:54.910053 10934 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:54.882973 13421 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.907577 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:54.913748 10928 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:20:54.916465 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:54.902704 13509 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.905450 13425 raft_consensus.cc:697] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:54.919340 10928 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:54.926581 11002 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:20:54.936896 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:54.938122 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:54.938932 11080 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 6: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:54.940575 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:54.942281 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:54.943112 11082 raft_consensus.cc:2393] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 6: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:54.945190 11077 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:54.947851 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:54.915182 13388 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:54.945441 13293 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:55.038192 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:55.038883 11003 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:55.039079 13492 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.039599 13492 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:54.917553 13421 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:20:55.047130 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 144965us
I20260709 12:20:55.048226 11009 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:20:55.041792 13492 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:55.049414 11003 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:55.054163 11050 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:20:55.057610 13196 consensus_meta.cc:287] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.000s
I20260709 12:20:54.931990 13509 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.062634 13388 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:55.076718 13380 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:55.080307 13396 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:55.081745 13421 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:55.044378 13291 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:20:55.086553 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:55.087363 10932 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:20:55.087554 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:55.098801 10929 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 7.
I20260709 12:20:55.062109 13231 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:20:55.063671 13425 consensus_queue.cc:237] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.103966 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:55.106081 11654 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:55.109061 11080 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:55.106307 13450 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.106679 13509 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:55.061960 13495 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:20:55.097410 13388 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.113988 10974 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:55.085011 13196 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.117570 13388 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:55.126367 13291 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:20:55.131270 13450 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:55.119433 13509 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:55.132081 13509 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.132447 13509 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:55.136138 13488 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.145581 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:55.146215 11080 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:55.152993 13509 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.155236 13509 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:55.144080 13196 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:55.160163 13514 log.cc:927] Time spent T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:20:55.167891 13059 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:20:55.171202 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:55.173743 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.176476 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:55.177270 11082 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:55.183619 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:55.189889 10931 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:55.196727 11082 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:55.204077 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:55.204352 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:55.208819 10927 raft_consensus.cc:1275] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:55.216454 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:55.230149 10930 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:20:55.219844 11084 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:55.222200 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:55.225560 10929 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:20:55.226927 13453 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.220641 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:55.229051 11080 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:55.229748 11077 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 7.
I20260709 12:20:55.237437 10974 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:55.242497 11622 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:20:55.236152 13488 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:55.227578 13447 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.249358 10974 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:55.253338 11051 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:55.260097 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:55.262167 11082 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:55.246258 13440 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.247680 13304 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:55.248059 13421 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:55.253026 13513 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:55.258565 12937 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:55.258970 13522 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.240093 13453 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.276583 11082 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:20:55.292193 10974 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:55.268842 13518 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:55.295192 13196 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:55.300084 13196 raft_consensus.cc:697] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:55.301204 13196 consensus_queue.cc:237] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.280655 13421 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.284343 13505 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:20:55.310735 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 57501.4us
I20260709 12:20:55.284557 13304 raft_consensus.cc:697] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:55.279763 13352 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:20:55.295787 12937 raft_consensus.cc:697] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:55.280254 13440 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.307919 13518 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.309595 13421 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:55.400888 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.408684 13518 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:55.293848 13513 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.412318 13513 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:55.413424 12937 consensus_queue.cc:237] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.296749 13522 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.418902 13522 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:55.429297 13507 log.cc:927] Time spent T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:20:55.423193 13505 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.444191 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:55.444796 11081 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:55.449024 13529 log.cc:927] Time spent T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:20:55.449877 13304 consensus_queue.cc:237] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.454092 13440 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:55.456169 13440 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.456666 13440 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.458766 13440 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:55.455683 11081 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:20:55.462690 10901 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:55.463788 10901 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:55.464622 13440 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:55.465044 13440 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.465471 13440 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:55.467199 13522 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:55.467828 13522 raft_consensus.cc:697] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:55.469803 13505 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.476815 13440 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.468752 13522 consensus_queue.cc:237] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.494992 10977 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:55.485037 13460 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:55.479458 13388 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.510059 10977 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:55.525471 11085 raft_consensus.cc:2393] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 6: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:55.528381 10977 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:55.534140 13205 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:55.534597 13205 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:55.534869 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:55.535306 13059 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:55.535748 11658 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:20:55.540674 13304 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:55.534960 13205 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:55.543107 13440 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:55.508610 13488 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:55.544508 13488 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.546744 13488 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:55.548739 11625 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:55.549188 13388 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:55.553936 13421 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:55.523981 13447 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:55.524967 13337 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:55.557267 13337 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:55.557725 13337 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:55.569468 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:55.573807 10932 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:55.574308 11658 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:20:55.578030 10975 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:55.580216 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:55.580999 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:55.581067 10931 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:55.581638 10932 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:55.583374 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.524209 13512 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:55.541018 13505 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:55.595829 10934 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:55.597153 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:55.599366 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:55.599987 10927 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:55.600754 11003 raft_consensus.cc:1275] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:55.575239 13448 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.603883 12937 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:55.589355 13534 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.065s	user 0.000s	sys 0.004s
I20260709 12:20:55.604369 12937 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.502744 13460 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.608120 10931 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:55.619661 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:55.620316 10935 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:55.609185 12937 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:55.595006 13304 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:55.622242 13304 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:55.610385 13448 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.628042 13453 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:55.628512 13448 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:55.616680 13493 raft_consensus.cc:2764] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:20:55.602929 13059 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:55.629289 13059 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.631287 13059 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:55.632838 13421 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:55.633863 13417 consensus_queue.cc:237] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:55.601656 13512 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.638003 13512 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:55.638872 13460 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:55.643826 13205 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.627954 13337 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.646641 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:55.647462 10931 raft_consensus.cc:2393] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 7: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:55.648223 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:55.648782 10931 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:20:55.649591 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:55.650254 10931 raft_consensus.cc:2393] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 6: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:55.650113 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:55.650699 10928 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:20:55.651638 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:55.652374 10934 raft_consensus.cc:2393] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 4: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:55.653388 13512 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:55.655759 13331 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:55.656507 13331 raft_consensus.cc:697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:55.657505 13331 consensus_queue.cc:237] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:55.662685 10927 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:55.663472 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:55.667019 11081 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 8
I20260709 12:20:55.667204 10977 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:55.664517 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:55.669631 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:55.670409 10929 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:20:55.672009 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:55.672631 11082 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:20:55.672818 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:55.673375 11077 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:55.673262 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:55.673705 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:55.674516 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:55.675702 11076 raft_consensus.cc:2393] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 5: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:55.676625 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:55.664675 10935 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:20:55.678608 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:55.686550 10935 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:55.687076 13196 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:55.698640 13196 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:55.700291 12937 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:55.700871 13196 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:55.701110 13293 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:55.667040 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:55.701915 10931 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:55.703429 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:55.704110 11080 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:20:55.688197 13488 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:55.655438 13337 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:55.689248 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:55.689846 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:55.689242 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:55.692201 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:55.692821 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:55.705516 11009 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:20:55.696188 11005 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:55.697335 13205 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:55.697708 11081 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:20:55.704782 10977 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:55.705471 11002 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:55.705981 11079 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:55.705324 11003 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:20:55.712741 11080 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:20:55.715396 10977 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:55.720456 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:55.721341 10935 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:55.655652 13543 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:55.725167 11051 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:55.737505 11051 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:55.723668 11002 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:20:55.727497 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:55.764845 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:55.779820 11656 raft_consensus.cc:2393] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 8: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:20:55.786110 10935 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:20:55.727483 13460 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:55.790014 11051 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:55.799991 11077 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:20:55.792117 10900 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:55.753438 13535 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:20:55.802794 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 224842us
I20260709 12:20:55.806042 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:55.806249 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:55.806649 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:55.807530 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:55.763558 13385 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.763796 13388 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:55.857623 11009 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:55.834502 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:55.860328 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:55.862918 11010 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:55.839224 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 84968us
I20260709 12:20:55.814416 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:55.858635 11006 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:20:55.875182 11085 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:20:55.750383 13449 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:20:55.808480 10931 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8.
I20260709 12:20:55.877852 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:55.878705 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:55.879484 11077 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:20:55.875080 10977 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:55.879788 11625 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:55.797115 13460 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.885577 10899 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:55.885757 10931 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:55.894001 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:55.889019 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:55.795516 13414 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:55.895512 11077 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:55.857322 13388 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.857004 13380 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:55.752278 13543 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.903612 11081 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:55.898382 10899 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:55.834628 13535 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:55.868338 13523 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.910048 11077 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8.
I20260709 12:20:55.880949 13462 raft_consensus.cc:1027] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: attempt to promote peer 0b171b6aaedc4f809f2753dcfadb14ce: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:20:55.917775 10899 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:55.882087 13447 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:55.931160 10899 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:55.896377 13460 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:55.896003 13421 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:55.938344 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:55.940416 10932 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:20:55.945125 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:55.870044 13231 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:20:55.952322 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:55.902347 13522 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:55.930047 13535 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:55.962186 11004 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:55.932325 13291 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:55.913684 13391 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:55.892479 13385 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.920020 13380 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.915488 13388 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:55.930410 13425 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:55.930351 13414 raft_consensus.cc:697] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:55.944115 13417 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:55.982649 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:55.960809 13522 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:55.988842 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 93592.4us
I20260709 12:20:55.976930 13440 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:55.947721 13523 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:55.981596 13380 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:55.943965 13536 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:20:55.989210 10932 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 8. Current term is 9. Ops: [7.5-8.6]
I20260709 12:20:55.990784 11077 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:55.988085 13417 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.055555 11050 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:55.983050 13425 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.990474 13522 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:55.991210 13449 raft_consensus.cc:476] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 12:20:55.986737 13291 raft_consensus.cc:697] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:56.080395 13530 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:56.071311 13527 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:56.085429 11009 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
W20260709 12:20:56.086712 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 103625us
W20260709 12:20:56.087941 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 207282us
I20260709 12:20:56.052177 13421 raft_consensus.cc:697] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:20:56.052055 13440 raft_consensus.cc:697] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:56.059185 13417 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:55.981071 13304 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.088860 10975 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:56.081130 13530 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.090332 10974 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:56.070400 13425 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:56.080468 13553 log.cc:927] Time spent T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:20:55.984591 13391 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:56.097046 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 160460us
I20260709 12:20:56.091809 13453 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:56.112004 11656 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEARNER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:56.098212 13337 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:56.084446 13527 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:56.121476 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:56.124832 10931 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
W20260709 12:20:56.128885 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 197793us
I20260709 12:20:56.131309 10899 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:56.132098 11009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "015a67e38c364985be24b18358579506"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:56.132680 11009 raft_consensus.cc:606] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:56.133008 11009 raft_consensus.cc:614] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:56.084450 13414 consensus_queue.cc:237] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.150259 10931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:43546
I20260709 12:20:56.151000 10931 raft_consensus.cc:606] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Received request to transfer leadership
I20260709 12:20:56.133287 13449 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:56.152141 13562 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:20:56.165752 13541 log.cc:927] Time spent T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 12:20:56.167675 13523 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:56.168347 13556 log.cc:927] Time spent T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:20:56.172024 13565 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.153244 13543 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:56.154953 13385 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:56.172631 13565 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.131407 13291 consensus_queue.cc:237] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.159727 13450 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:20:56.158670 13487 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:56.188972 13530 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:20:56.189477 13551 log.cc:927] Time spent T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 12:20:56.189803 13550 log.cc:927] Time spent T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
W20260709 12:20:56.191256 13552 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:20:56.158281 13449 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.187631 13523 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:20:56.209450 13449 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:56.211374 13527 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:56.201597 13487 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:20:56.194762 13565 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:56.160087 13562 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:56.198186 11010 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:20:56.178113 13453 raft_consensus.cc:697] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:56.139904 13421 consensus_queue.cc:237] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:20:56.202176 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 79150.6us
I20260709 12:20:56.141124 13440 consensus_queue.cc:237] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.191700 13559 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:20:56.205664 13566 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:56.166064 13557 consensus_queue.cc:1059] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.135s
I20260709 12:20:56.240397 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:56.207509 13304 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:56.207811 13554 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.162s	user 0.002s	sys 0.000s
W20260709 12:20:56.228595 13549 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 12:20:56.215385 13487 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:56.241286 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:56.262061 13462 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:56.241413 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:56.260083 13566 raft_consensus.cc:697] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:56.264503 13462 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.265542 13566 consensus_queue.cc:237] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.266834 13462 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:56.268234 13558 consensus_queue.cc:1059] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:20:56.269240 13555 log.cc:927] Time spent T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:20:56.269527 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:56.260644 13417 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.231783 13565 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:56.220955 13425 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.271824 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:56.319360 10901 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:56.303556 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:56.298262 11007 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:56.276904 11009 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:20:56.272053 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:56.298389 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:56.276197 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:56.223125 13562 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:56.319015 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:56.335304 11005 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:20:56.278025 11002 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:20:56.284294 11656 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:20:56.336603 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 212479us
I20260709 12:20:56.335764 11003 raft_consensus.cc:2393] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 6: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:56.336865 11051 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:56.333974 10901 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:56.342213 10974 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:20:56.350386 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 219133us
I20260709 12:20:56.348258 11003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:56.349160 10901 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:56.349721 13425 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:56.276151 13567 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:56.365450 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:56.366930 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:56.372025 11076 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:56.309185 13572 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.339615 13512 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:56.353170 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 202624us
I20260709 12:20:56.353029 11003 raft_consensus.cc:606] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:56.345886 13449 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:56.379851 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:56.383298 10936 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:20:56.384268 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:56.409395 10931 raft_consensus.cc:2368] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5.
I20260709 12:20:56.386925 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:56.282624 13388 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.422361 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:56.423004 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:56.423826 10930 raft_consensus.cc:2393] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 6: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:56.279441 13460 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.314872 13522 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.283262 13380 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.347600 13565 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.443619 13573 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.477092 13565 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:56.476879 13573 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.279016 13535 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.479096 13535 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:56.354368 13559 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 12:20:56.424844 13450 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:20:56.312000 13453 consensus_queue.cc:237] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.480059 11085 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:56.480695 10928 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:56.361744 13547 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:56.360023 13502 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:56.426676 11083 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:56.423516 13558 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:56.472469 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 106035us
I20260709 12:20:56.427465 10936 raft_consensus.cc:1275] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:56.473711 10977 leader_election.cc:400] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5.
I20260709 12:20:56.473487 11625 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:56.494897 10977 leader_election.cc:403] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:56.494994 10974 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:56.360958 13495 raft_consensus.cc:3055] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:56.426517 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:20:56.471603 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 122542us
I20260709 12:20:56.485268 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:56.422308 13449 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:56.446694 13574 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:20:56.489378 10928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
W20260709 12:20:56.448164 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 46814.8us
I20260709 12:20:56.506641 10928 raft_consensus.cc:606] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:56.506995 10928 raft_consensus.cc:614] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:56.507519 13449 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:56.406982 13420 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:56.500020 13527 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:56.502508 13495 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:56.499902 11004 raft_consensus.cc:2393] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 8: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:56.502715 13448 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:56.503760 11078 raft_consensus.cc:2368] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7.
I20260709 12:20:56.405280 13332 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.482187 13566 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.517469 13495 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.518939 13495 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:56.520627 13563 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:20:56.511219 13420 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.522756 11003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:56.523350 11003 raft_consensus.cc:606] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:56.523902 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:56.524544 11084 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:56.525429 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:56.525185 13566 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.526252 11084 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 6: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:56.508911 13059 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:20:56.515012 13293 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:20:56.529286 10928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:43546
I20260709 12:20:56.529839 10928 raft_consensus.cc:606] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Received request to transfer leadership
I20260709 12:20:56.508751 13509 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:56.530532 13509 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:56.530895 13509 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:56.531780 13420 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:56.532140 11003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3625831778d468cb424c06fc474c323"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:56.532709 11003 raft_consensus.cc:606] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:56.536021 11003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:56.536559 11003 raft_consensus.cc:606] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:56.537828  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:20:56.536896 10901 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:56.544835 11083 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:20:56.544235 10901 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:56.546079 11084 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:56.546380 10901 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:56.547837 12937 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.548391 10901 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:56.549345 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:56.548970 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:56.550314 10901 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:56.551435 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:56.552417 10929 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:56.553587 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:56.549628 12937 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.554226 11009 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:20:56.557958 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:56.560142 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:56.561113 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:56.561395 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:56.564442 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:56.553493 13440 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:56.553685 13580 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:56.565955 13580 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.566305 13580 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:56.562804 13513 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:20:56.544224 13425 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:56.567937 13391 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:56.553779 13499 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:20:56.569113 13460 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:56.569456 13380 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:56.553926 13420 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:20:56.573271 11084 raft_consensus.cc:1275] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:56.405018 13572 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.575450 13388 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:56.577247 13572 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:56.575565 13566 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:56.585139 11084 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:20:56.586083 13417 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:56.587258 13562 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.585300 13565 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:56.588043 13573 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:56.591944 12937 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:56.593075 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:56.584626 13509 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.593168 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:56.594066 11004 raft_consensus.cc:2410] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:20:56.484562 13567 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:20:56.596276 10821 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 097e40d4693b49118b91e7a4fd8e8eb1 already in progress [suppressed 34 similar messages]
I20260709 12:20:56.598194 13522 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:56.537767 13332 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.605638 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:56.506295 13558 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.612694 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:56.622713 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:56.623287 11010 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:56.621953 11002 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:56.633194 11011 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:20:56.643834 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:56.644558 11008 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:56.648871 11005 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:20:56.645467 11050 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:56.660638 13580 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.664152 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:56.664812 11083 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:56.665160 13580 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:56.666097 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:56.666266 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:56.666859 11078 raft_consensus.cc:2393] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 8: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:56.668074 11078 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:20:56.669813 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:56.671082 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:56.663301 11080 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:56.679184 13559 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:56.680469 13488 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:56.679665 13414 consensus_queue.cc:1048] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:20:56.681636 13509 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:56.682569 12937 consensus_queue.cc:1059] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:56.683511 13293 raft_consensus.cc:3055] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:56.685364 13293 raft_consensus.cc:740] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:56.683785 13562 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:56.685616 13563 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5.
I20260709 12:20:56.721066 13558 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:56.680951 13567 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:20:56.726593 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 52817.8us
I20260709 12:20:56.727195 11010 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:20:56.735973 11002 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:20:56.742910 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:56.743845 10935 raft_consensus.cc:2393] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 8: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:56.744475 10974 leader_election.cc:400] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7.
I20260709 12:20:56.745818 10974 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:56.747670 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:56.750242 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:56.751555 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:56.752002 10935 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:20:56.752218 10927 raft_consensus.cc:2368] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8.
I20260709 12:20:56.753871 11080 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:20:56.755339 10936 raft_consensus.cc:2368] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5.
I20260709 12:20:56.721542 13293 consensus_queue.cc:260] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.744510 13522 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:56.763686 13200 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:56.761718 13260 consensus_queue.cc:1048] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:20:56.792917 10977 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:56.778569 13200 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:56.811338 11010 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:56.814905 11010 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:20:56.773615 13522 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.817353 13522 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:56.817979 13522 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:20:56.796708 10821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 200558us
I20260709 12:20:56.822194 10977 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:56.823359 10977 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:56.823674 13420 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:56.823942 13059 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:56.826372 13059 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:56.826534 10932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:43546
I20260709 12:20:56.827170 10932 raft_consensus.cc:606] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Received request to transfer leadership
I20260709 12:20:56.828429 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:56.792133 13491 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:56.836608 10977 leader_election.cc:400] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8.
I20260709 12:20:56.836971 10977 leader_election.cc:403] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:20:56.836134 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:56.777405 13257 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:20:56.815317 13200 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:56.843016 10977 leader_election.cc:400] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5.
I20260709 12:20:56.847920 10977 leader_election.cc:403] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:20:56.793396 13449 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.834244 13304 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:56.834829 13332 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:56.851019 10901 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:56.840843 13059 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8.
I20260709 12:20:56.856781 11081 raft_consensus.cc:2393] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 5: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:56.857754 13575 raft_consensus.cc:993] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:56.858301 13575 raft_consensus.cc:1081] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:56.860106 10931 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:56.863008 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:56.863812 11078 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:56.842149 13460 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:20:56.856163 13425 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:56.872995 13304 raft_consensus.cc:697] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:56.880322 13304 consensus_queue.cc:237] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.882871 11007 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:56.868844 13527 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:20:56.886888 13449 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:56.856338 13414 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:56.895493 10882 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:20:56.895996 10882 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 097e40d4693b49118b91e7a4fd8e8eb1 already in progress
W20260709 12:20:56.896286 10882 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 097e40d4693b49118b91e7a4fd8e8eb1 already in progress
W20260709 12:20:56.908288 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 61729us
I20260709 12:20:56.910434 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:56.915576 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:56.916287 10933 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:20:56.922663 10974 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:56.893260 13425 raft_consensus.cc:697] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:56.935688 13332 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:56.936184 13332 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.936517 13332 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:56.937975 13440 raft_consensus.cc:993] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 0b171b6aaedc4f809f2753dcfadb14ce to start an election
I20260709 12:20:56.938514 13440 raft_consensus.cc:1081] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Signalling peer 0b171b6aaedc4f809f2753dcfadb14ce to start an election
I20260709 12:20:56.940335 13425 consensus_queue.cc:237] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:56.952153 11656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1"
dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
 from {username='slave'} at 127.0.0.1:59384
I20260709 12:20:56.953047 11656 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:56.953577 11656 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:56.979372 11656 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:56.991137 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:56.991771 10932 raft_consensus.cc:3055] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:56.992094 10932 raft_consensus.cc:740] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:56.993158 13291 raft_consensus.cc:993] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:56.992859 10932 consensus_queue.cc:260] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:56.993647 13291 raft_consensus.cc:1081] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:56.995959 11656 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:57.000137 11657 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:57.001987 11081 raft_consensus.cc:1240] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:57.009044 11081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:20:57.009686 11081 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:57.010051 11081 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:57.038512 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:57.029528 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 400831us
I20260709 12:20:57.031183 11078 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:20:57.031002 11081 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.038539 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:57.043676 13385 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.076375 11081 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:57.077286 13385 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.080664 13385 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:57.088120 10901 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:57.089283 13491 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:57.090039 13491 raft_consensus.cc:697] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:57.028512 13573 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.104327 10928 raft_consensus.cc:1275] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:57.022696 13414 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5.
I20260709 12:20:57.127149 13523 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:57.127746 13523 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.129863 13523 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:57.130980  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:57.131830  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:57.028735 13332 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.135567 10833 catalog_manager.cc:5697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 6 to 7, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 7 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:57.136633 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:57.025225 13200 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.137543 10833 catalog_manager.cc:5697] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:57.143750 13200 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:57.137389 13332 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:57.150693 13547 raft_consensus.cc:993] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:57.151239 13547 raft_consensus.cc:1081] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:57.151952 13420 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:57.152489 13420 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.154656 13420 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:57.155185 13420 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:57.157799 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:57.155630 13293 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:57.158385 11007 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:57.161945 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:57.159816 13420 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:57.162528 10901 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:57.165131 13523 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:57.165546 13523 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.122170 13573 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.167470 13573 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:57.165886 13523 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:57.090996 13491 consensus_queue.cc:237] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.171516 13337 consensus_queue.cc:1048] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:20:57.174858 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 529437us
I20260709 12:20:57.194558 11050 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:57.175822 10933 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:20:57.180287 11076 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:20:57.195499 11076 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:57.195904 11076 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:57.180827 11007 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 5.
I20260709 12:20:57.191829 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:57.202876 10936 raft_consensus.cc:2393] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 6: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:57.210824 11080 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:20:57.209367 11076 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.216591 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:20:57.218609 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 147267us
I20260709 12:20:57.194674 13449 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:57.223160 11050 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:57.231958 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:57.232579 10936 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:57.232610 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:57.232874 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:57.233752 10927 raft_consensus.cc:2393] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 5: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:57.233374 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:57.232942 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:57.235200 10930 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:57.233271 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:57.236040 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.236783 11076 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:57.202224 13380 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:57.241979 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:57.236465 10933 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:20:57.242609 10927 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:20:57.241896 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:57.243594 10935 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:57.244781 10899 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:57.245110 11050 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:57.245926 10899 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:57.246100 11050 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:57.248320 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:57.248775 11078 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:57.224300 13260 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:57.258991 10935 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:57.231739 13231 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:57.260571 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:57.218637 13331 consensus_queue.cc:1059] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:20:57.279556 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:57.276794 11050 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:57.281368 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:57.282008 10935 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:57.274712 10930 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:20:57.283327 13450 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:20:57.288846 13513 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:57.289374 13513 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.289742 13530 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:57.254755 13487 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:57.292333 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:57.292577 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:57.292906 11011 raft_consensus.cc:3055] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:57.255295 13425 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:57.293226 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:57.256247 13557 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:20:57.298942 11005 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:57.293253 11011 raft_consensus.cc:740] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:57.299675 10935 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:57.294128 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:57.287693 11078 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:20:57.294684 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:57.302476 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:57.322775 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:57.325598 11078 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:57.302173 11076 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:20:57.302846 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:57.326712 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:57.292081 13536 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:57.326730 11081 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:57.324086 13573 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:57.329288 11076 raft_consensus.cc:2393] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 5: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:57.329485 13573 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:57.330163 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:57.330914 11076 raft_consensus.cc:2393] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 5: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:57.331609 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:57.332361 11076 raft_consensus.cc:2410] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:20:57.328374 13536 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.279171 13580 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:57.305565 11006 raft_consensus.cc:2393] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 5: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:57.339303 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:57.261082 13231 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:57.340701 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:57.333711 13460 raft_consensus.cc:993] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:57.261076 13260 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:57.342909 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:57.290310 13530 raft_consensus.cc:697] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:57.321646 13567 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:57.297597 13487 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:57.333779 13573 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:57.286688 13488 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:20:57.354260 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:57.478888 11085 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:20:57.379884 11078 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:20:57.361352 11081 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:57.395877 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:57.476186 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:57.416355 10936 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:20:57.488593 11081 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:20:57.485983 11051 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:57.488770 11076 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:20:57.345263 11010 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:57.493034 11076 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:57.493489 11076 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:57.335332 13557 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:57.523589 10932 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:57.518663 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:57.387562 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:57.480134 13559 raft_consensus.cc:1081] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:57.543432 11083 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:57.342517 13449 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:57.486312 13487 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:57.344170 13580 raft_consensus.cc:697] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:57.563017 11051 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:57.568115 11051 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:57.569494 10932 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 5.
I20260709 12:20:57.572433 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:20:57.573007 13612 log.cc:927] Time spent T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.391s	user 0.007s	sys 0.000s
I20260709 12:20:57.574558 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 1867) took 1209 ms. Trace:
I20260709 12:20:57.353835 13420 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:57.574923 11082 rpcz_store.cc:276] 0709 12:20:56.365416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.366443 (+  1027us) service_pool.cc:224] Handling call
0709 12:20:56.472355 (+105912us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:56.472884 (+   529us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:20:56.901527 (+428643us) spinlock_profiling.cc:243] Waited 6.45 ms on lock 0x7b18002dbbc0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:20:56.997463 (+ 95936us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b18002dbbc0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade70455 00007f9bb49583c7 00007f9bb0f6a9a7 00007f9bb0f7a0bf 00007f9bb0f7a038
0709 12:20:57.021354 (+ 23891us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b18002dbbc0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9baddedc0a 00007f9bb752d219 00007f9bb4e3458f 00007f9bade73571 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd
0709 12:20:57.066526 (+ 45172us) log.cc:844] Serialized 14 byte log entry
0709 12:20:57.221218 (+154692us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:57.221663 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 12:20:57.221813 (+   150us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:57.221845 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:57.221914 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:57.572514 (+350600us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:20:57.574350 (+  1836us) raft_consensus.cc:1685] finished
0709 12:20:57.574372 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:57.574499 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47097,"prepare.queue_time_us":20114,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":39686,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":13828,"spinlock_wait_cycles":42900480,"thread_start_us":174889,"threads_started":2,"wal-append.queue_time_us":109234}
I20260709 12:20:57.577792 13580 consensus_queue.cc:237] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.584117 13569 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:57.575069 13260 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:57.580107 13509 raft_consensus.cc:3055] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:57.584745 13569 raft_consensus.cc:697] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:57.585057 13509 raft_consensus.cc:740] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:57.580601 13505 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:57.587759 11051 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:57.521056 13573 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:57.585785 13569 consensus_queue.cc:237] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.585978 13509 consensus_queue.cc:260] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.570421 11076 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.534387 13536 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:57.596045 11625 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:57.597165 11009 raft_consensus.cc:3055] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:57.604012 10935 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:20:57.533300 13388 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.491128 13567 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.594928 11051 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:57.589304 13505 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.630191 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:57.631232 10932 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:57.608014 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:57.604317 11009 raft_consensus.cc:740] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:57.527510 13557 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.610533 13421 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:57.612123 11076 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:57.614835 10899 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:57.591610 13495 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:57.617396 13231 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:57.602190 13527 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:20:57.597590 13291 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:20:57.628804 11080 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:20:57.630172 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:57.602916 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:57.632513 11009 consensus_queue.cc:260] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.650797 11009 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:57.613512 13513 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:57.641134 10932 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:20:57.644881 10899 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:57.632977 13505 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:57.632506 13573 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:57.662065 10899 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:57.668866 11005 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:20:57.665324 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:57.669683 11010 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:20:57.671643 10899 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:57.673004 10899 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:57.671666 10974 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:57.648722 13522 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:57.678845 11009 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:20:57.673096 11002 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:20:57.684265 10899 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:57.649858 13421 raft_consensus.cc:697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:20:57.630867 13388 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.649474 13495 raft_consensus.cc:697] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:57.684844 11051 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:57.646404 13385 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:20:57.662518 13420 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:57.698383 10899 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:57.702311 10974 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:57.702924 10832 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35608 (request call id 226) took 5372 ms. Trace:
I20260709 12:20:57.683056 13513 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:57.686203 13566 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:57.682853 13425 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:57.644999 13530 consensus_queue.cc:237] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.696126 13417 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:20:57.728577 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 43807.6us
I20260709 12:20:57.730618 13388 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:57.718756 13563 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:57.732978 10927 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:57.698016 13573 raft_consensus.cc:697] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:57.707062 10832 rpcz_store.cc:276] 0709 12:20:52.324751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.325091 (+   340us) service_pool.cc:224] Handling call
0709 12:20:57.697360 (+5372269us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:55.072431 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:55.077647 (+  5216us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:55.077696 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:20:55.077721 (+    25us) tablet.cc:662] Decoding operations
0709 12:20:55.078294 (+   573us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:55.078383 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:55.078417 (+    34us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:20:55.078713 (+   296us) tablet.cc:701] Row locks acquired
0709 12:20:55.078727 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:20:55.078876 (+   149us) write_op.cc:270] Start()
0709 12:20:55.078990 (+   114us) write_op.cc:276] Timestamp: P: 1783599655078830 usec, L: 0
0709 12:20:55.079010 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:20:55.079742 (+   732us) log.cc:844] Serialized 980 byte log entry
0709 12:20:55.135781 (+ 56039us) op_driver.cc:464] REPLICATION: finished
0709 12:20:55.282681 (+146900us) write_op.cc:301] APPLY: starting
0709 12:20:55.286339 (+  3658us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:55.306830 (+ 20491us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:55.319253 (+ 12423us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:55.319644 (+   391us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:55.407312 (+ 87668us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:20:55.407366 (+    54us) write_op.cc:312] APPLY: finished
0709 12:20:55.407596 (+   230us) log.cc:844] Serialized 29 byte log entry
0709 12:20:55.407762 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:55.407852 (+    90us) write_op.cc:454] Released schema lock
0709 12:20:55.407914 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:55.408255 (+   341us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:55.408283 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16066,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":134782,"apply.run_cpu_time_us":2887,"apply.run_wall_time_us":130099,"num_ops":2,"prepare.queue_time_us":165505,"prepare.run_cpu_time_us":3238,"prepare.run_wall_time_us":17648,"replication_time_us":56616,"thread_start_us":142218,"threads_started":2}]]}
I20260709 12:20:57.721418 11011 consensus_queue.cc:260] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.703828 13491 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 12:20:57.771180 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.749529 11051 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:57.685781 13565 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
W20260709 12:20:57.758854 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 45375.4us
I20260709 12:20:57.736864 13558 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:57.703966 13575 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:57.712690 13572 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:57.783201 11050 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:57.712517 13495 consensus_queue.cc:237] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.774420 13563 raft_consensus.cc:697] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:57.804944 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:57.809422 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:57.809824 11002 raft_consensus.cc:3055] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:57.810220 11002 raft_consensus.cc:740] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:57.806341 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:57.808806 11085 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:57.813812 11050 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:57.815358 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:57.817070 11085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3625831778d468cb424c06fc474c323"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:20:57.817714 11085 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:57.818086 11085 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:57.821635 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:57.825975 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 106794us
I20260709 12:20:57.831336 11050 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:20:57.832943 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.840299 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:57.853152 13567 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:57.793602 13421 consensus_queue.cc:237] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:20:57.829528 13624 log.cc:927] Time spent T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:20:57.850289 13231 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:57.793854 13575 raft_consensus.cc:697] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:57.826372 13558 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:57.863706 13575 consensus_queue.cc:237] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.864205 13385 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:57.865473 13573 consensus_queue.cc:237] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.866135 13557 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:20:57.867573 13627 log.cc:927] Time spent T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:20:57.866400 13293 raft_consensus.cc:2955] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Committing config change with OpId 5.6: config changed from index 4 to 6, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:20:57.869810 13628 log.cc:927] Time spent T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:20:57.789867 13380 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:20:57.830444 11002 consensus_queue.cc:260] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.874991 13563 consensus_queue.cc:237] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.862766 13449 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.849221 11085 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.886996 11076 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: []
W20260709 12:20:57.889894 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 50217.1us
I20260709 12:20:57.890823 10974 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:57.900658 11085 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:57.888381 13449 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:57.912721 13385 raft_consensus.cc:697] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:57.919364 11085 raft_consensus.cc:2955] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:20:57.911109 13611 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.615s	user 0.002s	sys 0.000s
I20260709 12:20:57.899797 13331 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:57.922376 13630 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:57.942006 10930 raft_consensus.cc:1240] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:20:57.904289 13608 consensus_queue.cc:1059] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:20:57.956200 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 1945) took 1440 ms. Trace:
I20260709 12:20:57.957538 13630 raft_consensus.cc:697] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:57.956735 11084 rpcz_store.cc:276] 0709 12:20:56.515708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.593969 (+ 78261us) service_pool.cc:224] Handling call
0709 12:20:56.621431 (+ 27462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:57.029257 (+407826us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:57.029288 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:57.045800 (+ 16512us) log.cc:844] Serialized 26 byte log entry
0709 12:20:57.183536 (+137736us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:57.226587 (+ 43051us) log.cc:844] Serialized 14 byte log entry
0709 12:20:57.226815 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:57.226903 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:57.910511 (+683608us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:20:57.951832 (+ 41321us) raft_consensus.cc:1685] finished
0709 12:20:57.955924 (+  4092us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:57.956124 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":439888,"prepare.queue_time_us":43606,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":33,"raft.queue_time_us":425814,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":208,"spinlock_wait_cycles":59523328,"thread_start_us":137314,"threads_started":1,"wal-append.queue_time_us":209178}
I20260709 12:20:57.958364 13630 consensus_queue.cc:237] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:57.970695 13615 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.629s	user 0.000s	sys 0.003s
I20260709 12:20:57.971817 13505 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:57.973032 11079 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:57.974390 13505 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:20:57.975364 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:57.985077 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 235618us
W20260709 12:20:57.976336 13523 consensus_meta.cc:287] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.768s	user 0.014s	sys 0.006s
I20260709 12:20:57.991118 13566 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:57.944928 13385 consensus_queue.cc:237] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:58.005473 13495 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:58.006109 13495 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:58.009626 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:58.010519 11080 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 7: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:58.008252 13495 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:58.002414 13523 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:58.056421 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 203898us
I20260709 12:20:58.068706 11002 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:58.070604 10929 raft_consensus.cc:2393] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 5: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:58.077461 11050 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:58.082669 11002 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:20:58.082612 11050 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:58.085172 13630 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:58.091115 13388 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:20:58.194506 13487 consensus_meta.cc:287] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.596s	user 0.012s	sys 0.006s
I20260709 12:20:58.194821 13523 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:58.195044 13487 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
W20260709 12:20:58.197582 13639 log.cc:927] Time spent T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260709 12:20:58.200496 13648 log.cc:927] Time spent T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:20:58.100522 13200 consensus_queue.cc:1059] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 12:20:58.204511 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:58.299175 11084 raft_consensus.cc:2393] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 5: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:20:58.205327 13449 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:58.210449 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:58.217178 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 106769us
I20260709 12:20:58.294181 11657 raft_consensus.cc:2955] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:58.351915 13460 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:58.352509 13460 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:58.354570 13460 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:58.355059 13460 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:58.355751 11002 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:58.355509 13460 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:58.359139 13460 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:58.365857 13421 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:58.368647 10929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 1778) took 1177 ms. Trace:
I20260709 12:20:58.369096 10929 rpcz_store.cc:276] 0709 12:20:57.191099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.191214 (+   115us) service_pool.cc:224] Handling call
0709 12:20:58.368396 (+1177182us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b5400060ed4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:20:58.368541 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1961960832}
I20260709 12:20:58.305197 10934 raft_consensus.cc:2955] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:58.376995 11078 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:20:58.381599 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:58.390002 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.413339 10935 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:20:58.335470 13649 log.cc:927] Time spent T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 12:20:58.335285 13645 log.cc:927] Time spent T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:20:58.452878 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:58.465251 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.427021 13570 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:58.472404 13570 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:58.490762 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.438117 13635 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:20:58.481647 13291 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.512393 13449 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:58.513163 13291 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:58.549829 13487 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:58.552076 13291 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:58.576095 13488 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:58.578670 13488 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:58.580890 13488 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:58.593065 11011 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:58.597827 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:58.599154 11007 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:20:58.609623 13644 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.546s	user 0.009s	sys 0.005s
I20260709 12:20:58.610591 13491 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:58.611166 13491 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:58.613221 13491 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:20:58.614353 13638 log.cc:927] Time spent T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.545s	user 0.003s	sys 0.011s
I20260709 12:20:58.624195 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 1881) took 1289 ms. Trace:
I20260709 12:20:58.624635 11078 rpcz_store.cc:276] 0709 12:20:57.334725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.487094 (+152369us) service_pool.cc:224] Handling call
0709 12:20:57.487600 (+   506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:58.377507 (+889907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:58.623832 (+246325us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b5400219154. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:20:58.624130 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2044494208}
I20260709 12:20:58.665014 10929 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:58.666539 13559 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.667150 13559 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:58.669273 13559 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:58.685036 13557 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:58.685640 13523 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:58.686699 13523 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:58.685761 13557 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:58.689061 13523 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:58.689636 13557 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:58.693594 13522 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:58.694269 13522 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:58.697918 13522 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:58.698132  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:58.698536 13522 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:58.699056 13522 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:58.701486 13522 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:58.719583 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:58.725674 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:58.727530 11076 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:58.730715 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:58.731489 11076 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:20:58.659633 10833 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 84) took 3914 ms. Trace:
I20260709 12:20:58.743824 13617 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:58.753186 11085 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:58.754462 13570 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:58.756762 13509 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:58.774943 13629 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:58.775573 13629 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:58.777616 13629 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:58.779363 11076 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:58.784885 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:58.786201 11076 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:20:58.791131 11079 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:20:58.810602 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.825290 13617 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:58.835461 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:58.837040 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:58.847201 11011 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:58.934940 11011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 1469) took 1643 ms. Trace:
I20260709 12:20:58.946164 11011 rpcz_store.cc:276] 0709 12:20:57.291878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.292081 (+   203us) service_pool.cc:224] Handling call
0709 12:20:57.720982 (+428901us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b4c00213740. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9baf22ca20 00007f9baf23da29 00007f9baf203644 00007f9baf22af2d 00007f9baf22ab93 00007f9bb0f5b18b 00007f9bb0f5bcb5 00007f9bb0f56f30 00007f9bb0f587de 00007f9bb0f6427c 00007f9bb5f25b17
0709 12:20:57.908024 (+187042us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b18002767e0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f9b646 00007f9bb0ed558e 00007f9bb0f56f9e 00007f9bb0f587de 00007f9bb0f6427c 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c
0709 12:20:58.592621 (+684597us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b58004ff4d0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0ebc0aa 00007f9bb0f3e447 00007f9bb0f56fe7 00007f9bb0f587de 00007f9bb0f6427c 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c
0709 12:20:58.934825 (+342204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1396299136}
I20260709 12:20:58.861872 13523 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.970922 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:58.889730 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:58.890030 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:58.892241 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:58.972918 11004 raft_consensus.cc:3055] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:58.973218 11004 raft_consensus.cc:740] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:58.973603 13523 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:58.973994 11004 consensus_queue.cc:260] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:58.975059 11004 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:58.892925 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:58.975950 13523 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:58.976564 13641 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.900926 13513 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.912024 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:58.912220 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:58.927627 13522 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:58.735013 10833 rpcz_store.cc:276] 0709 12:20:54.745471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.745689 (+   218us) service_pool.cc:224] Handling call
0709 12:20:58.659561 (+3913872us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:57.916003 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:57.920613 (+  4610us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:57.920649 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:20:57.920669 (+    20us) tablet.cc:662] Decoding operations
0709 12:20:57.921054 (+   385us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:57.921134 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:57.921160 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:20:57.980979 (+ 59819us) tablet.cc:701] Row locks acquired
0709 12:20:57.984004 (+  3025us) write_op.cc:260] PREPARE: finished
0709 12:20:57.991804 (+  7800us) write_op.cc:270] Start()
0709 12:20:57.991998 (+   194us) write_op.cc:276] Timestamp: P: 1783599657991749 usec, L: 0
0709 12:20:57.992023 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:20:58.062680 (+ 70657us) log.cc:844] Serialized 913 byte log entry
0709 12:20:58.623107 (+560427us) op_driver.cc:464] REPLICATION: finished
0709 12:20:58.624302 (+  1195us) write_op.cc:301] APPLY: starting
0709 12:20:58.624386 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:58.624496 (+   110us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:58.624619 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:58.624928 (+   309us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:58.625108 (+   180us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:20:58.625150 (+    42us) write_op.cc:312] APPLY: finished
0709 12:20:58.625341 (+   191us) log.cc:844] Serialized 29 byte log entry
0709 12:20:58.626071 (+   730us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:58.626167 (+    96us) write_op.cc:454] Released schema lock
0709 12:20:58.626215 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:58.733774 (+107559us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b5400096d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5be28 00007f9bb4996581 00007f9bb4995d58 00007f9bb499a9f1 00007f9bb499a9a9 00007f9bb499a939 00007f9bb499a901 00007f9bb4999b2d 0000000000388634 0000000000388479
0709 12:20:58.733985 (+   211us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:58.734016 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2127613,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":953,"apply.run_cpu_time_us":1648,"apply.run_wall_time_us":2211,"num_ops":2,"prepare.queue_time_us":176984,"prepare.run_cpu_time_us":125987,"prepare.run_wall_time_us":843161,"raft.queue_time_us":60613,"raft.run_cpu_time_us":911,"raft.run_wall_time_us":5245,"replication_time_us":630920,"spinlock_wait_cycles":67257088,"thread_start_us":561691,"threads_started":4,"wal-append.queue_time_us":441054}]]}
W20260709 12:20:58.857154 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.952382 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:58.956579 13572 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:58.983415 10832 catalog_manager.cc:5697] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:58.960734 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:58.964001 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:58.965992 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:58.966056 10933 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:58.988224 10932 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:58.989136 10933 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:20:58.990388 10933 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:58.991503 10933 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:20:58.967278 10928 raft_consensus.cc:1275] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:20:58.968739 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:58.969828 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:58.992908 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:58.867154 13460 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.993637 10930 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:58.993814 13460 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:58.893704 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:58.995582 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:58.983392 13513 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:58.980952 11005 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:58.998121 13513 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:58.984643 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:58.959694 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:58.987749 10935 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:58.999470 10934 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:59.001277 10932 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:20:59.005016 11076 raft_consensus.cc:2393] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 10: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:59.008740 10832 catalog_manager.cc:5697] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 3 to 4, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 4 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:59.010596 10832 catalog_manager.cc:5697] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:59.013765 10832 catalog_manager.cc:5697] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:59.016594 11011 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:59.017791 10901 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:59.026477 11011 raft_consensus.cc:606] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:59.037501 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:59.037995 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:59.039459 11007 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:20:59.040150 11009 raft_consensus.cc:1275] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:20:59.041126 11009 pending_rounds.cc:85] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 3
I20260709 12:20:59.041352 11009 pending_rounds.cc:107] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:20:59.039490 11008 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:20:59.041555 11009 raft_consensus.cc:2889] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:59.042526 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:59.028262 10832 catalog_manager.cc:5697] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 3 to 4, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 4 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:59.047190 13509 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:20:59.047804 13509 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.049983 13509 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:59.047082 10832 catalog_manager.cc:5697] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 6 to 7, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 7 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:58.982686 13641 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.052117 10832 catalog_manager.cc:5697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 3 to 4, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 4 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:59.048303 10829 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35614 (request call id 218) took 6839 ms. Trace:
I20260709 12:20:59.054878 10829 rpcz_store.cc:276] 0709 12:20:52.226101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.229277 (+  3176us) service_pool.cc:224] Handling call
0709 12:20:59.047793 (+6818516us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58954,"reported_tablets":29}
I20260709 12:20:59.069330 11005 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:20:59.073837 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 58887.7us
I20260709 12:20:59.057520 11010 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:58.983420 13522 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.056298 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:59.056126 10832 catalog_manager.cc:5697] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:59.082705 13491 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:59.076880 13572 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:59.020399 13460 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:59.095237 10935 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:20:59.088814 10934 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:20:59.096907 13621 consensus_queue.cc:1059] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:59.039939 13513 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:20:59.081744 10832 catalog_manager.cc:5697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 5 to 7, now has a pending config: VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65), VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66), VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67), VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 7 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:59.092761 13572 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:59.102727 13629 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:59.113997 11006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:59.116153 11006 raft_consensus.cc:606] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:59.111811 13561 raft_consensus.cc:3055] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:59.115170 10832 catalog_manager.cc:5697] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 5 to 6, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 6 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
W20260709 12:20:59.121538 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 107349us
I20260709 12:20:59.115417 13572 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:59.124039 10832 catalog_manager.cc:5697] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 1 to 2, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 2 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:59.129508 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:59.132697 10936 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7. Ops: [5.4-6.5]
I20260709 12:20:59.132268 10832 catalog_manager.cc:5697] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 5 to 6, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 6 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:59.133810 10832 catalog_manager.cc:5697] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:59.135931 10832 catalog_manager.cc:5697] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:59.122334 10974 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:59.137234 10832 catalog_manager.cc:5697] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 4 to 5, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 5 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:20:59.139410 10935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83b4e206b7694af695234c0e758055e2"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:20:59.141970 10935 raft_consensus.cc:606] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:59.143507 11004 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:20:59.144215 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:59.118173 13629 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.122363 13561 raft_consensus.cc:740] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:59.147791 10974 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:59.153577 10974 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:59.140057 13563 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:59.161979 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:59.155629 13260 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:59.157191 13522 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:59.169008 11004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:20:59.170498 11004 raft_consensus.cc:606] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:59.166716 13515 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:59.172341 13515 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.170210 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:59.175185 11078 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:59.172581 13629 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:59.164943 13641 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:59.179785 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:59.177318 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:59.169515 13561 consensus_queue.cc:260] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.186774 10935 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:59.195132 10934 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:20:59.167933 13602 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:59.175128 13515 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:59.202455 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:59.204631 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:59.205680 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:59.207795 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:59.212144 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:59.211313 13527 raft_consensus.cc:2955] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 LEADER]: Committing config change with OpId 4.6: config changed from index 4 to 6, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:59.222586 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:59.170346 13599 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:59.235414 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:59.236148 11004 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
W20260709 12:20:59.220559 13668 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:20:59.184376 13548 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:59.241621 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:59.223979 13509 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:59.228566 13257 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.243517 13509 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:59.175805 13563 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:20:59.182683 13557 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:20:59.237397 13599 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.249619 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:59.246730 13509 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:59.220044 13602 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:59.255299 13548 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.233628 13460 raft_consensus.cc:993] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:59.227072 10936 raft_consensus.cc:2955] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:59.234916 13570 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:59.243655 13257 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.239197 13561 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:59.268643 13659 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.275764 13460 raft_consensus.cc:1081] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:59.303004 13257 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:59.277366 13509 consensus_queue.cc:1059] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:20:59.306937 13509 raft_consensus.cc:3055] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:59.307329 13509 raft_consensus.cc:740] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:59.308132 13509 consensus_queue.cc:260] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.309135 13548 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:59.311204 13602 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:59.277940 13570 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.316044 13599 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:59.317263 11080 raft_consensus.cc:2955] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:20:59.296753 13659 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.324829 13659 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:59.325868 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:59.319677 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:20:59.309273 13509 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:59.327484 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 245118us
I20260709 12:20:59.333328 13491 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.333886 13491 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.336102 13491 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:59.338949 13570 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:59.311272 13572 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.345912 13572 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:59.354045 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:59.354715 13515 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.355583 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:59.354888 11079 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 7: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:20:59.363483 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 184252us
I20260709 12:20:59.363562 10901 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:59.369339 13557 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:59.372289 13573 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:20:59.373906 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 100322us
I20260709 12:20:59.381971 13515 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:59.390935 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:59.391220 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:59.392581 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:59.393510 11078 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:20:59.394099 11078 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:59.394483 11078 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:59.395638 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:59.401144 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:59.401851 10936 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:20:59.402959 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:59.404733 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:20:59.407820 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 191616us
I20260709 12:20:59.408639 10977 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:59.382643 13659 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:59.414731 11078 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:59.435160 11078 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:20:59.464354 11006 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:59.464931 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:59.465576 11011 raft_consensus.cc:2393] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 10: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:20:59.416543 13669 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:20:59.466097 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:59.461524 13260 raft_consensus.cc:993] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:59.471316 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:59.473320 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:59.474838 12937 raft_consensus.cc:1081] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:59.467278 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:59.467765 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:59.466750 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:20:59.476200 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 91479.7us
I20260709 12:20:59.477798 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:59.470659 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:59.475458 11003 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:59.479643 11006 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:20:59.469817 13566 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:59.481769 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 73212.6us
I20260709 12:20:59.481889 11085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:20:59.483397 11085 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:59.482368 12937 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:59.483771 11085 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:59.485419 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:59.474509 13509 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.491209 10977 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:59.477676 13677 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.497352 12937 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:59.498354 10901 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:59.487234 13566 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.500983 13565 consensus_queue.cc:1059] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:59.502101 13565 raft_consensus.cc:3055] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:59.504281 10901 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:59.481463 13641 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:59.502452 13565 raft_consensus.cc:740] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:59.505975 10901 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:59.507273 11085 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.483584 13679 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:59.508718 10977 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:59.515658 11085 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:59.510346 10901 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:59.508960 13580 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:59.497232 13509 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.508198 13522 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:59.517704 10901 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:59.513159 13566 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:59.513592 13491 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:59.486894 13690 consensus_queue.cc:1048] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:20:59.518977 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:20:59.520771 10901 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:59.513401 13565 consensus_queue.cc:260] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.523538 13491 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:59.524000 13565 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:59.524948 10901 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:59.526443 10901 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:59.535149 10977 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:59.525365 13671 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:59.540501 13678 raft_consensus.cc:993] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:59.540961 13561 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:59.543754 13570 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.537113 13380 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:20:59.544440 13570 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.545241 13391 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:59.541018 13678 raft_consensus.cc:1081] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:20:59.548200 13693 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.548727 13693 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.550707 13693 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:59.551183 13693 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:59.534464 13491 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:59.552838 13491 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.553198 13491 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:59.523065 11653 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:59.560587 11050 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:59.562309 11050 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:20:59.563691 11085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:20:59.520161 13260 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:59.564296 11085 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:59.565789 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:59.568984 11085 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:59.566131 10977 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:59.521502 13659 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:59.569177 11003 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:20:59.571974 10901 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:20:59.506026 13677 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.582625 11010 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:20:59.584021 11006 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:20:59.564735 13580 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:59.585625 10901 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:59.588443 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:59.514951 13641 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.608662 13629 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:59.609333 13629 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.610510 13641 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:59.571213 13691 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:20:59.584030 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 120217us
I20260709 12:20:59.596210 13260 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:59.610575 11085 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.521653 13679 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:59.617219 10901 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:20:59.582617 13513 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:59.586122 13677 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:59.616420 11051 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:59.596060 13675 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:59.597609 13580 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.623999 11051 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:59.624066 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:59.624423 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:59.612885 13509 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:59.626714 11051 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:59.626932 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:59.626859 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:59.615404 13447 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:59.633649 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:59.634922 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:59.636900 13690 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:59.637719 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:59.638536 10936 raft_consensus.cc:2410] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:20:59.638289 13690 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:59.639477 13671 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:59.639963 13671 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.640339 13671 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:59.642817 11653 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:20:59.629195 11085 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:59.645725 13447 raft_consensus.cc:697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:20:59.646761 13447 consensus_queue.cc:237] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.648329 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:59.648977 11006 raft_consensus.cc:3055] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:59.649307 11006 raft_consensus.cc:740] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:59.620417 13691 raft_consensus.cc:697] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:20:59.650038 11006 consensus_queue.cc:260] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:59.650578 13691 consensus_queue.cc:237] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.620594 13513 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.652200 13513 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:59.655992 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:59.656672 10931 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:20:59.658308 11051 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:59.659958 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:59.660554 11010 raft_consensus.cc:3055] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:59.660871 11010 raft_consensus.cc:740] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:59.668300 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:59.669070 10936 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:20:59.661648 11010 consensus_queue.cc:260] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.681960 11010 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:59.627239 13580 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:59.623315 13675 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.686518 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:59.693358 13675 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:59.693699 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:59.694384 11007 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:20:59.695257 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:20:59.627508 13641 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:59.699957 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:59.628525 13693 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:59.704149 11051 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:59.638230 13695 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:20:59.727329 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 110182us
I20260709 12:20:59.736548 11051 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:59.738148 11051 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:59.739971 11010 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:20:59.736593 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:20:59.675894 13559 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:20:59.745237 11002 raft_consensus.cc:3055] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:59.745568 11002 raft_consensus.cc:740] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:20:59.677938 13676 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:59.751449 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:20:59.704706 13570 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:20:59.676801 13674 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 12:20:59.738457 13694 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:59.747664 13557 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:59.797911 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:59.802320 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 64255us
I20260709 12:20:59.803248 11051 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:59.810664 11051 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:20:59.746523 13573 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:20:59.823436 11051 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:20:59.827560 13641 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:59.762766 13691 consensus_queue.cc:1048] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:20:59.749590 13513 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:20:59.837865 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 66336.1us
I20260709 12:20:59.766953 13559 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:20:59.860476 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:59.865782 10936 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:59.861503 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:59.866613 10927 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:59.861778 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:20:59.863454 13696 log.cc:927] Time spent T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 12:20:59.867499 10933 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:20:59.807483 13380 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:59.882454 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:20:59.883152 10930 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:59.886049 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:59.886788 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:20:59.824802 13695 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:59.888818 11002 consensus_queue.cc:260] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.832306 13692 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:59.893904 10935 raft_consensus.cc:2393] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 8: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:20:59.905185 10927 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:20:59.834159 13491 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:20:59.832665 13676 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:20:59.911551 11002 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:59.912459 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 173219us
I20260709 12:20:59.909952 10930 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:20:59.889662 11653 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:59.888948 13629 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:20:59.909171 10936 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:20:59.967728 11002 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
W20260709 12:20:59.970002 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 57575.3us
I20260709 12:21:00.014748 11006 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:00.016747 13513 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:00.024592 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:00.025883 11050 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:00.033753 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:20:59.980002 13711 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:20:59.980707 13679 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:00.014359 13580 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:00.047931 10935 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:21:00.050966 10935 raft_consensus.cc:1240] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:21:00.045529 11050 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:00.059633 11006 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:00.064939 13721 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:00.068742 13709 log.cc:927] Time spent T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:21:00.070575 10932 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 12:21:00.064507 13702 log.cc:927] Time spent T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:21:00.036672 13711 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:00.076984 11051 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:00.042616 13671 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:00.073336 13641 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:00.085875 10929 raft_consensus.cc:2393] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 6: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:00.087841 11051 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:00.076136 13692 raft_consensus.cc:697] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:00.091305 13559 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:00.092902 13693 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:00.105700 13693 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:00.106261 13693 raft_consensus.cc:697] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:00.107328 11051 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:00.098448 13491 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:00.111617 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 219717us
W20260709 12:21:00.113508 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:00.113701 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 252233us
I20260709 12:21:00.120396 11007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:21:00.099742 13580 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:00.101194 13671 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:00.121889 11007 raft_consensus.cc:606] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:00.120632 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:00.078393 13721 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:00.093816 13523 raft_consensus.cc:993] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:21:00.124712 13523 raft_consensus.cc:1081] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:21:00.125578 10936 raft_consensus.cc:1240] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:21:00.121233 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:00.118971 11011 raft_consensus.cc:2955] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:00.141422 10833 catalog_manager.cc:5697] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:00.143005 10977 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:00.159924 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:00.160627 11003 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:00.163364 11002 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:21:00.168968 10832 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35620 (request call id 219) took 1381 ms. Trace:
I20260709 12:21:00.147048 10833 catalog_manager.cc:5697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 4 to 6, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65), VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66), VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67), VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 7 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:00.168606 10977 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:00.140681 13641 raft_consensus.cc:697] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:00.170094 10833 catalog_manager.cc:5697] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:00.178642 13723 consensus_queue.cc:1059] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:21:00.168684 13691 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:00.181892 10977 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:00.184897 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:00.168336 13515 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:00.186595 10977 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:00.180768 10833 catalog_manager.cc:5697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 4 to 5, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68), now has a pending config: VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65), VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66), VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67), VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 5 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:00.169406 10832 rpcz_store.cc:276] 0709 12:20:58.773893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.774018 (+   125us) service_pool.cc:224] Handling call
0709 12:21:00.155262 (+1381244us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:59.208770 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:59.209266 (+   496us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:59.209299 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:20:59.209315 (+    16us) tablet.cc:662] Decoding operations
0709 12:20:59.210550 (+  1235us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:59.210605 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:59.210632 (+    27us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:20:59.211658 (+  1026us) tablet.cc:701] Row locks acquired
0709 12:20:59.211676 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:20:59.211815 (+   139us) write_op.cc:270] Start()
0709 12:20:59.224125 (+ 12310us) write_op.cc:276] Timestamp: P: 1783599659211772 usec, L: 0
0709 12:20:59.228841 (+  4716us) op_driver.cc:348] REPLICATION: starting
0709 12:20:59.314493 (+ 85652us) log.cc:844] Serialized 6233 byte log entry
0709 12:20:59.497377 (+182884us) op_driver.cc:464] REPLICATION: finished
0709 12:20:59.611334 (+113957us) write_op.cc:301] APPLY: starting
0709 12:20:59.611421 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:59.611726 (+   305us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:59.627820 (+ 16094us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:59.790483 (+162663us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:59.790803 (+   320us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 12:20:59.790863 (+    60us) write_op.cc:312] APPLY: finished
0709 12:20:59.840838 (+ 49975us) log.cc:844] Serialized 107 byte log entry
0709 12:20:59.897841 (+ 57003us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:59.975657 (+ 77816us) write_op.cc:454] Released schema lock
0709 12:20:59.978315 (+  2658us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:00.056831 (+ 78516us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:00.057451 (+   620us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":81442,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":108111,"apply.run_cpu_time_us":13129,"apply.run_wall_time_us":375872,"num_ops":15,"prepare.queue_time_us":13173,"prepare.run_cpu_time_us":5440,"prepare.run_wall_time_us":111923,"replication_time_us":253929,"thread_start_us":113648,"threads_started":1}]]}
I20260709 12:21:00.191447 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:00.168855 13695 raft_consensus.cc:697] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:00.107283 13693 consensus_queue.cc:237] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:00.192646 13548 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:00.187768 13679 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:00.174551 13675 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:00.193032 13677 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:00.183059 13724 consensus_queue.cc:1059] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:21:00.183992 13509 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:00.198843 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:00.199956 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:00.193892 10977 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:00.236631 10977 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:21:00.248759 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 66032.4us
I20260709 12:21:00.249568 10977 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:00.234833 13691 raft_consensus.cc:697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:00.237534 13679 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:00.246236 13509 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:00.255105 13548 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:00.296430 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:00.270442 13509 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:00.319270 13691 consensus_queue.cc:237] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:00.323114 13728 log.cc:927] Time spent T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:21:00.241600 13641 consensus_queue.cc:237] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:00.284469 13548 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:00.324481 13548 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:00.377247 13725 log.cc:927] Time spent T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:21:00.262970 13695 consensus_queue.cc:237] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:00.236351 13692 consensus_queue.cc:237] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:00.326637 13509 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:00.399778 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 150285us
I20260709 12:21:00.400759 10977 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:00.404174 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 154675us
I20260709 12:21:00.410687 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:00.411270 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:00.410729 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:00.412931 10935 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:21:00.414958 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:00.414808 10977 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:00.423418 11011 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:00.432071 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:00.432341 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:00.432541 11085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83b4e206b7694af695234c0e758055e2"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60046
I20260709 12:21:00.432135 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:00.433050 11085 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:00.433450 11085 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:00.434823 11081 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:00.414630 13683 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:00.441627 13561 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.445848 13561 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:00.447991 10899 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:00.449108 13522 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:00.449556 11050 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:00.450541 13711 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:00.452634 13732 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:00.454042 13732 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:00.454545 13732 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:00.460932 13675 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:00.451611 13711 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:00.468211 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:00.427083 13674 raft_consensus.cc:3055] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:00.436808 13515 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:00.486127 10932 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:00.423249 13573 consensus_queue.cc:1059] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:21:00.489319 13561 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:00.488757 13674 raft_consensus.cc:740] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:00.489547 13513 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:21:00.491820 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:00.493491 11085 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:00.517936 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:00.519304 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:00.520358 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:00.523790 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:00.524742 12937 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:00.567116 11085 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:00.520358 13711 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:00.495776 13573 raft_consensus.cc:3055] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:00.511466 13721 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:00.586679 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:00.588114 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:00.505599 13732 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:00.527637 13677 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:00.591630 11007 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:00.598248 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:00.606478 13548 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:00.584363 13573 raft_consensus.cc:740] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:00.608722 13573 consensus_queue.cc:260] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:00.610083 13573 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:00.584416 13711 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:00.611768 13515 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:00.626061 13690 raft_consensus.cc:3055] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:00.626617 13690 raft_consensus.cc:740] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:00.629913 10977 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:00.630585 11007 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:00.630767 13720 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:00.634995 11003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3625831778d468cb424c06fc474c323"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
W20260709 12:21:00.659009 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 201883us
I20260709 12:21:00.660897 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:21:00.676177 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 238131us
W20260709 12:21:00.662024 13709 log.cc:927] Time spent T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:21:00.501591 13674 consensus_queue.cc:260] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:00.589988 13509 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:00.681270 11051 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:00.660735 13720 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.686357 11051 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:00.630089 13690 consensus_queue.cc:260] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:00.695995 10899 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:00.697283 10899 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:00.696056 11010 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:00.700345 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:00.687418 13720 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:00.702064 10927 raft_consensus.cc:1240] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:21:00.702162 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:00.708320 10931 raft_consensus.cc:3055] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:00.708652 10931 raft_consensus.cc:740] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:00.703294 10935 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:21:00.694641 13641 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:00.692410 13691 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:21:00.685461 13693 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:00.706049 11003 raft_consensus.cc:606] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:00.715063 11003 raft_consensus.cc:614] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:00.713970 11085 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:00.685690 13692 consensus_queue.cc:1059] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:21:00.705469 13704 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:00.712415 13690 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:00.719574 13522 consensus_queue.cc:1059] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:21:00.717080 13557 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:00.714404 13572 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:00.750797 13571 consensus_queue.cc:1059] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:21:00.768158 13734 raft_consensus.cc:3055] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:00.768673 13734 raft_consensus.cc:740] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:21:00.774554 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 111703us
W20260709 12:21:00.779515 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 109568us
I20260709 12:21:00.760717 13704 raft_consensus.cc:3055] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:21:00.810490 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 117020us
I20260709 12:21:00.808457 11049 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:00.778498 13548 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:00.808756 13704 raft_consensus.cc:740] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:00.837034 13704 consensus_queue.cc:260] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:00.764283 13557 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:00.846494 13766 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.847205 13766 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:00.849409 13766 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:00.852986 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 148593us
I20260709 12:21:00.853787 10899 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:00.820762 13641 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:00.777177 13734 consensus_queue.cc:260] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:00.874418 13745 log.cc:927] Time spent T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 12:21:00.867388 13671 consensus_queue.cc:1059] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:21:00.858981 13580 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:21:00.882130 13742 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:21:00.882939 13557 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:00.885749 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 84773.6us
W20260709 12:21:00.880985 13747 log.cc:927] Time spent T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 12:21:00.881145 13509 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:00.891378 11050 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:00.893065 13557 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:00.894166 13741 log.cc:927] Time spent T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:21:00.894968 11050 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:00.882378 13683 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:00.896123 13691 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:00.896674 13691 raft_consensus.cc:697] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:00.905510 13691 consensus_queue.cc:237] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:00.907193 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:00.923368 13704 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:00.927294 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:00.929738 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:00.932219 11656 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:00.935794 13732 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:00.915228 13711 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:00.948798 13711 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:00.952867 13720 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:00.959055 13720 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:00.959833 13755 raft_consensus.cc:993] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:21:00.960549 13755 raft_consensus.cc:1081] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:21:00.962819 13674 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:00.965947 13713 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.966532 13713 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:00.968639 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:00.984470 11003 raft_consensus.cc:1240] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:00.986465 11002 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:00.988722 11011 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:00.991365 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:00.992378 11007 raft_consensus.cc:2393] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:00.996904 11003 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:01.006837  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:21:01.008986  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:01.031018 13713 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:01.051091 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:01.051512 11011 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:01.055394 10931 consensus_queue.cc:260] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:01.061618 10931 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:01.076617 10931 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:01.078783 11011 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:01.082177 11011 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:21:01.082736 11011 pending_rounds.cc:85] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 4
I20260709 12:21:01.082958 11011 pending_rounds.cc:107] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:21:01.083176 11011 raft_consensus.cc:2889] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:01.086692 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:01.088332 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:01.088990 11081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:21:01.089543 11081 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:01.089876 11081 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:01.090314 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:01.090869 11085 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:01.092592 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:01.093216 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:01.093852 11007 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:01.094138 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:01.094806 10935 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:01.098253 13734 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:01.104725 13695 consensus_queue.cc:1059] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:01.105540 13695 consensus_queue.cc:1243] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:21:01.105732 13629 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:21:01.106274 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:01.106959 13744 consensus_queue.cc:1059] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:01.108336 13674 raft_consensus.cc:3055] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:01.108695 13674 raft_consensus.cc:740] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:01.108750  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:01.116164 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:01.116904 10935 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:01.119940 11081 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:01.126497 11081 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:01.131891 10935 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:01.139734 13724 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:01.147635 13724 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:01.147934 10901 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:01.150254 13704 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:01.150657 13704 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.150986 13704 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:01.154809 10936 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:01.157155 10936 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:01.158704 13522 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:01.159054 10934 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:01.093555 13571 consensus_queue.cc:1059] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:21:01.160461 13571 raft_consensus.cc:3055] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:01.160725 13522 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:01.161654 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:01.162866 13522 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:01.162604 13674 consensus_queue.cc:260] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:01.163928 10934 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:01.163911 13674 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:01.165988 13704 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:01.168253 10936 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:01.168357 13629 raft_consensus.cc:3055] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:01.170974 10833 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 85) took 2089 ms. Trace:
I20260709 12:21:01.171272 13571 raft_consensus.cc:740] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:01.171437 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:01.172281 10934 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:01.172478 13571 consensus_queue.cc:260] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:01.173106 13704 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:01.173766 13571 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:01.171068 13629 raft_consensus.cc:740] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:01.173429 10833 rpcz_store.cc:276] 0709 12:20:59.081636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.081768 (+   132us) service_pool.cc:224] Handling call
0709 12:21:01.170913 (+2089145us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:00.256663 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:00.257291 (+   628us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:00.257330 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:21:00.257349 (+    19us) tablet.cc:662] Decoding operations
0709 12:21:00.258027 (+   678us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:00.258111 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:00.258143 (+    32us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:21:00.393402 (+135259us) tablet.cc:701] Row locks acquired
0709 12:21:00.394180 (+   778us) write_op.cc:260] PREPARE: finished
0709 12:21:00.417490 (+ 23310us) write_op.cc:270] Start()
0709 12:21:00.426471 (+  8981us) write_op.cc:276] Timestamp: P: 1783599660414184 usec, L: 0
0709 12:21:00.429755 (+  3284us) op_driver.cc:348] REPLICATION: starting
0709 12:21:00.463162 (+ 33407us) log.cc:844] Serialized 2041 byte log entry
0709 12:21:00.769103 (+305941us) op_driver.cc:464] REPLICATION: finished
0709 12:21:01.112290 (+343187us) write_op.cc:301] APPLY: starting
0709 12:21:01.112378 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:01.112512 (+   134us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:01.112650 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:01.113085 (+   435us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:01.113280 (+   195us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:21:01.113320 (+    40us) write_op.cc:312] APPLY: finished
0709 12:21:01.113542 (+   222us) log.cc:844] Serialized 41 byte log entry
0709 12:21:01.113709 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:01.121355 (+  7646us) write_op.cc:454] Released schema lock
0709 12:21:01.125032 (+  3677us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:01.131557 (+  6525us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:01.131590 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":28194,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":342930,"apply.run_cpu_time_us":1995,"apply.run_wall_time_us":19233,"num_ops":4,"prepare.queue_time_us":64110,"prepare.run_cpu_time_us":3924,"prepare.run_wall_time_us":206938,"replication_time_us":339172,"thread_start_us":351765,"threads_started":2}]]}
I20260709 12:21:01.179497 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:01.182307 10935 raft_consensus.cc:2368] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10.
W20260709 12:21:01.186160 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 53669us
I20260709 12:21:01.188798 10830 catalog_manager.cc:5697] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:01.193311 10934 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:21:01.195775 13724 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:01.200500 10830 catalog_manager.cc:5697] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:01.205717 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:01.206318 11010 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:01.207935 11051 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:01.208972 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:01.204859 10830 catalog_manager.cc:5697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 4 to 6, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 6 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:01.216567 10830 catalog_manager.cc:5697] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 6 to 8, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 8 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:01.231053 11010 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:01.223615 10977 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:01.234887 11051 leader_election.cc:400] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10.
I20260709 12:21:01.235407 11051 leader_election.cc:403] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:01.238997 11051 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:01.234980 10830 catalog_manager.cc:5697] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:01.240176 10830 catalog_manager.cc:5697] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 5 to 7, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 7 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:01.241127 10830 catalog_manager.cc:5697] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 3 to 5, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 5 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:01.242027 10830 catalog_manager.cc:5697] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:01.243083 10830 catalog_manager.cc:5697] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 3 to 5, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 5 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:01.236982 10901 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:01.237825 10974 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:01.245333 10830 catalog_manager.cc:5697] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:01.217844 13676 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:01.199131 13380 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:21:01.253664 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:01.224551 13713 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:01.258915 13713 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:01.236681 13724 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:21:01.261976 11080 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:01.262802 13762 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:01.254257 13693 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:01.233865 13695 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:21:01.263962 13693 raft_consensus.cc:697] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:01.264933 13693 consensus_queue.cc:237] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:01.212770 13734 consensus_queue.cc:1059] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:21:01.251129 13723 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:21:01.250902 13776 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:01.270900 13776 raft_consensus.cc:697] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:01.271833 13776 consensus_queue.cc:237] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:01.255273 13763 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:01.278977 13763 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.279366 13763 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:01.257805 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:01.293628 13713 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:01.293817 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:01.298822 10977 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:01.299610 13762 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:01.300108 13762 raft_consensus.cc:697] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 8 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:01.300946 13762 consensus_queue.cc:237] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:01.308300 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 55470.4us
I20260709 12:21:01.279229 13629 consensus_queue.cc:260] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:01.312326 10974 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:01.313195 13720 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:01.313256 13629 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:01.324435 10899 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:01.352521 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:01.359841 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:01.360522 11002 raft_consensus.cc:3055] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:01.360872 11002 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:01.361708 11002 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:01.362895 11002 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:01.403138 11002 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:21:01.413261 11076 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:01.413636 10899 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:01.345474 13565 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:01.416877 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 69222.5us
I20260709 12:21:01.347167 13704 consensus_queue.cc:1059] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:21:01.537525 13713 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:01.587947 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 174381us
W20260709 12:21:01.631608 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 275173us
W20260709 12:21:01.633330 13781 log.cc:927] Time spent T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:21:01.634814 13733 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
W20260709 12:21:01.648625 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 282487us
I20260709 12:21:01.668403 13763 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:01.670924 13763 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:01.672164 13778 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 12:21:01.674130 13723 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10.
I20260709 12:21:01.708298 13522 raft_consensus.cc:3055] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:01.708745 13522 raft_consensus.cc:740] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:01.709528 13522 consensus_queue.cc:260] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:01.710817 13522 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:01.761428 10934 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:21:01.784521 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:01.798691 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:21:01.807258 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 378469us
I20260709 12:21:01.812741 13571 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.813652 13571 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:01.836920 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 49354us
W20260709 12:21:01.855953 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 335682us
I20260709 12:21:01.856264 13629 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.857245 13629 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:01.860134 13723 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:01.860134 13629 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:01.879932 13571 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:01.883944 11084 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:01.920496 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:01.921516 10929 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:01.932626 13797 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:01.933449 13797 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:01.946839 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:01.948798 11005 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:21:01.951149 11010 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:21:01.953459 11009 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:01.955252 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:01.955679 13713 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:01.956447 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:01.957405 11006 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:01.960289 13572 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.961092 13572 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:01.963268 13572 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:01.965909 11084 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:01.966876 10931 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:01.970074 13571 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.970693 13571 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:01.972183 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:01.973727 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:01.984309 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:01.985378 11077 raft_consensus.cc:2410] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:21:01.985585 13571 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:01.984068 11051 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:01.987049 11007 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:01.987315 13733 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:01.987830 13733 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.988911 13733 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:01.989486 13629 consensus_queue.cc:1059] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:01.990355 13629 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:02.000200 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:02.003685 10928 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:02.005007 13788 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:02.005851 13788 consensus_queue.cc:1243] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 1abf4b385a2b493ab83f593a1f8c9cd1 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:21:02.007992 11050 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:02.008852 13571 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:02.009310 13571 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.009701 13571 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:02.010637 10899 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:02.005551 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:02.016834 11006 raft_consensus.cc:2410] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:21:01.935787 13797 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:02.043720 11084 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:21:02.052630 11077 pending_rounds.cc:85] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 3
I20260709 12:21:02.043488 13713 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:02.036123 13629 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:21:02.054368 10977 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:02.060294 11077 pending_rounds.cc:107] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:21:02.065824 11077 raft_consensus.cc:2889] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:02.068174 10833 catalog_manager.cc:5697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 4 to 6, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65), VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66), VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67), VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 5 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:02.067762 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:02.095072 10901 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:02.096431 13713 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:02.103288 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:02.104242 10934 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:02.094921 13762 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:21:02.110225 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 63333.8us
I20260709 12:21:02.116888 13733 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.154476 13733 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:02.159006 13765 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:02.159824 13765 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.122073 13571 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.171080 10928 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:02.135419 13763 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:02.188544 13763 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.233106 13765 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:02.233938 13776 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
W20260709 12:21:02.240072 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 139546us
W20260709 12:21:02.241603 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 119373us
I20260709 12:21:02.241895 11051 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:02.242412 13691 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:02.244020 13691 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:02.244401 13691 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.244768 13691 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:02.245829 13763 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:02.246161 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:02.246809 11011 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:21:02.252638 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:02.255438 11081 raft_consensus.cc:2368] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7.
W20260709 12:21:02.274549 13804 log.cc:927] Time spent T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.179s	user 0.003s	sys 0.000s
I20260709 12:21:02.282160 13766 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:21:02.293375 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:02.294301 10928 raft_consensus.cc:2393] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 6: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:02.294231 13380 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.296695 13380 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.303589 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:02.304687 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:02.305353 10936 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:02.307711 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:02.308413 10933 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:02.304692 11076 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 8: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:02.309924 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:02.310730 10927 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:02.334507 10936 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:02.340502 11051 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:02.349933 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:02.357100 10927 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:02.358826 10833 catalog_manager.cc:5697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 7 to 8, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 8 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:02.372634 10974 leader_election.cc:400] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7.
I20260709 12:21:02.373027 10974 leader_election.cc:403] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:02.375603 13721 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:02.380010 13621 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.383323 11011 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:02.380285 13380 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:02.411145 13676 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.411721 13571 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:02.417948 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 152644us
I20260709 12:21:02.432000 13599 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7.
I20260709 12:21:02.380609 13621 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.434844 13621 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:02.435905 13734 raft_consensus.cc:3055] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:02.436339 13734 raft_consensus.cc:740] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:02.437217 13734 consensus_queue.cc:260] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.438293 11051 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:02.438467 13734 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:02.440524 13817 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:02.440937 13817 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.441270 13817 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:02.444047 13812 log.cc:927] Time spent T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 12:21:02.447539 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 148989us
I20260709 12:21:02.418949 13721 raft_consensus.cc:697] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:02.489086 10933 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:02.493064 11007 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:21:02.483315 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:02.500098 11003 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:02.411775 13676 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.496306 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:02.511497 10977 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:02.516820 11009 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:02.528604 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:02.529642 13561 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:02.511171 13380 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.545240 13721 consensus_queue.cc:237] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.560920 11051 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:02.564268 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:02.565630 13380 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.577054 13676 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:02.530153 13561 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:02.580927 13561 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:02.589524 13641 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:02.590214 13641 raft_consensus.cc:697] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:02.532157 13691 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.593781 13691 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:02.608189 13380 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:02.608966 13641 consensus_queue.cc:237] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:02.609385 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 96340us
I20260709 12:21:02.616694 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:02.629997 10830 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35608 (request call id 227) took 3682 ms. Trace:
I20260709 12:21:02.632167 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:02.637557 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:02.638168 10929 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:02.663160 11003 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:02.630712 10830 rpcz_store.cc:276] 0709 12:20:58.947639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.947798 (+   159us) service_pool.cc:224] Handling call
0709 12:21:02.629747 (+3681949us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:01.707940 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:01.708498 (+   558us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:01.708535 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:21:01.708552 (+    17us) tablet.cc:662] Decoding operations
0709 12:21:01.709467 (+   915us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:01.709522 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:01.709547 (+    25us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:21:01.710283 (+   736us) tablet.cc:701] Row locks acquired
0709 12:21:01.710302 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:21:01.710439 (+   137us) write_op.cc:270] Start()
0709 12:21:01.710544 (+   105us) write_op.cc:276] Timestamp: P: 1783599661710392 usec, L: 0
0709 12:21:01.710562 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:21:01.711255 (+   693us) log.cc:844] Serialized 4004 byte log entry
0709 12:21:01.714941 (+  3686us) op_driver.cc:464] REPLICATION: finished
0709 12:21:01.891550 (+176609us) write_op.cc:301] APPLY: starting
0709 12:21:01.891729 (+   179us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:01.892096 (+   367us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:01.892278 (+   182us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:01.923605 (+ 31327us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:01.923998 (+   393us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:21:01.924054 (+    56us) write_op.cc:312] APPLY: finished
0709 12:21:01.924578 (+   524us) log.cc:844] Serialized 77 byte log entry
0709 12:21:01.947976 (+ 23398us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:01.948339 (+   363us) write_op.cc:454] Released schema lock
0709 12:21:01.948425 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:01.949072 (+   647us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:01.949107 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":33191,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":176214,"apply.run_cpu_time_us":5261,"apply.run_wall_time_us":57535,"num_ops":10,"prepare.queue_time_us":358313,"prepare.run_cpu_time_us":3734,"prepare.run_wall_time_us":9649,"replication_time_us":4207,"thread_start_us":600056,"threads_started":2}]]}
I20260709 12:21:02.685273 13566 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:02.685873 13566 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.688292 13566 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:02.689070 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 134041us
I20260709 12:21:02.691300 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:02.692495 11007 raft_consensus.cc:2393] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 11: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:02.694624 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:02.695397 11009 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:21:02.708019 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:02.708922 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:02.709601 11009 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:02.707979 13817 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.713589 13817 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:02.716625 11050 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:02.723977 10974 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:02.724406 13599 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:02.732055 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 69712.8us
I20260709 12:21:02.741770 10929 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:02.751021 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:02.751374 13599 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.751803 10931 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:02.746287 13734 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:02.752384 13734 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.752754 13734 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:02.753767 13599 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:02.755255 11050 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:02.756238 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:02.756868 10927 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:02.757038 13727 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:02.758839 13727 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.759186 13727 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:02.764626 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:02.765323 11009 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:02.772951 10977 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:02.777647 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:02.782019 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:02.786772 11051 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:02.790164 13788 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:02.797518 11077 raft_consensus.cc:2393] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 7: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:02.801002 13755 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:02.801506 13755 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:02.801889 13755 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:02.821204 10931 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:02.764664 13734 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.823966 13770 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:02.824538 13770 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.826594 13770 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:02.790630 13561 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.828658 13561 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:02.833647 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:02.834287 11011 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:02.834857 11051 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:02.835461 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:02.823877 13817 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:02.832185 13676 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.829311 13734 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:02.836541 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:02.845371 10934 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:21:02.838510 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:02.840095 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:02.842511 13571 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:02.846700 11078 raft_consensus.cc:2368] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5.
I20260709 12:21:02.844028 13817 raft_consensus.cc:697] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:02.849515 10899 leader_election.cc:400] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5.
I20260709 12:21:02.849728 10931 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:02.849850 10899 leader_election.cc:403] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:02.847056 13676 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.851894 13571 raft_consensus.cc:697] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:02.855415 13571 consensus_queue.cc:237] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.858299 11009 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:02.862246 13561 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:02.862859 13561 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.865141 13561 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:02.862279 13817 consensus_queue.cc:237] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.866853 10934 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:21:02.867831 13566 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5.
I20260709 12:21:02.868562 11051 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:02.868717 10977 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:02.872896 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:02.873937 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:02.874840 10931 raft_consensus.cc:2410] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:21:02.876243 11077 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 8: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:02.881361 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:02.880461 13561 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:02.885684 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:02.878789 13734 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:02.889425 13676 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:02.886616 10934 raft_consensus.cc:2368] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 8. Current term is 9.
I20260709 12:21:02.898949 10977 leader_election.cc:400] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 8. Current term is 9.
I20260709 12:21:02.899286 10977 leader_election.cc:403] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:02.900229 11011 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:21:02.902940 13561 raft_consensus.cc:697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 8 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:02.905390 13561 consensus_queue.cc:237] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.905088 13548 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:21:02.902731 13734 raft_consensus.cc:697] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:02.915946 13734 consensus_queue.cc:237] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.918041 13727 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.928239 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:02.930984 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:02.931654 11004 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:02.933449 11050 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:02.934317 13676 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:02.935427 11076 raft_consensus.cc:2368] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12.
I20260709 12:21:02.938969 11004 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:02.939889 10899 leader_election.cc:400] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12.
I20260709 12:21:02.940217 10899 leader_election.cc:403] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:02.940335 11050 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:02.940807 13566 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:21:02.930930 13755 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.942353 13548 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 8. Current term is 9.
I20260709 12:21:02.922137 13727 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:02.945567 13693 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:02.946133 13693 raft_consensus.cc:697] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:02.947060 13693 consensus_queue.cc:237] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:02.941491 13829 log.cc:927] Time spent T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.052s	user 0.001s	sys 0.002s
I20260709 12:21:02.951952 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:02.955462 13566 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12.
I20260709 12:21:02.963218 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:02.964051 11077 raft_consensus.cc:2393] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 7: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:02.971982 13755 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:02.974713 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:02.984694 11656 consensus_queue.cc:237] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:02.983731 10934 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:02.990983 10931 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:02.993232 10977 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:02.995069 13763 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:02.995610 13763 raft_consensus.cc:697] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:02.996503 13763 consensus_queue.cc:237] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:02.989171 10830 catalog_manager.cc:5697] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:03.010329 10833 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 86) took 1789 ms. Trace:
I20260709 12:21:03.009513 10830 catalog_manager.cc:5697] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 2 to 3, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 3 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:03.015921 10830 catalog_manager.cc:5697] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 8 to 9, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 9 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:03.018776 10830 catalog_manager.cc:5697] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 5 to 8, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 8 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:03.010773 10833 rpcz_store.cc:276] 0709 12:21:01.217621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.217801 (+   180us) service_pool.cc:224] Handling call
0709 12:21:03.006707 (+1788906us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:02.617172 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:02.721505 (+104333us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:02.721559 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:21:02.721580 (+    21us) tablet.cc:662] Decoding operations
0709 12:21:02.722106 (+   526us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:02.722215 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:02.722249 (+    34us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:21:02.722610 (+   361us) tablet.cc:701] Row locks acquired
0709 12:21:02.722657 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:21:02.723927 (+  1270us) write_op.cc:270] Start()
0709 12:21:02.725070 (+  1143us) write_op.cc:276] Timestamp: P: 1783599662722756 usec, L: 0
0709 12:21:02.725093 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:21:02.725834 (+   741us) log.cc:844] Serialized 1037 byte log entry
0709 12:21:02.901853 (+176019us) op_driver.cc:464] REPLICATION: finished
0709 12:21:02.957827 (+ 55974us) write_op.cc:301] APPLY: starting
0709 12:21:02.957923 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:02.958044 (+   121us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:02.958174 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:02.958510 (+   336us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:02.958702 (+   192us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:21:02.958743 (+    41us) write_op.cc:312] APPLY: finished
0709 12:21:02.958934 (+   191us) log.cc:844] Serialized 29 byte log entry
0709 12:21:02.972721 (+ 13787us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:02.972808 (+    87us) write_op.cc:454] Released schema lock
0709 12:21:02.972848 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:02.973232 (+   384us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:02.973259 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":230175,"reported_tablets":3,"spinlock_wait_cycles":1408,"child_traces":[["op",{"apply.queue_time_us":53963,"apply.run_cpu_time_us":1774,"apply.run_wall_time_us":15372,"num_ops":2,"prepare.queue_time_us":125908,"prepare.run_cpu_time_us":3449,"prepare.run_wall_time_us":188717,"replication_time_us":159822,"thread_start_us":68610,"threads_started":2}]]}
I20260709 12:21:03.037499 10830 catalog_manager.cc:5697] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 6 to 7, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 7 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:03.040450 10830 catalog_manager.cc:5697] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:03.060478 10830 catalog_manager.cc:5697] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 9 to 10, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 10 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:03.064528 10830 catalog_manager.cc:5697] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:03.072203 11009 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:21:03.073071 10830 catalog_manager.cc:5697] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 9 to 10, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 10 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:03.077400 10830 catalog_manager.cc:5697] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 4 to 5, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 5 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:03.074465 13826 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:21:03.087296 11076 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:21:03.089673 13826 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:03.117729 10927 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:03.130710 13817 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:03.134910 13826 raft_consensus.cc:2955] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 LEADER]: Committing config change with OpId 5.8: config changed from index 6 to 8, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:03.150460 11004 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:03.169899 11076 raft_consensus.cc:2955] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Committing config change with OpId 5.8: config changed from index 6 to 8, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:03.189082 10927 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:03.175307 11009 raft_consensus.cc:2955] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Committing config change with OpId 5.8: config changed from index 6 to 8, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:03.236668 10819 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 097e40d4693b49118b91e7a4fd8e8eb1 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:03.170024 13693 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:21:03.240981 13571 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:03.261211 10832 catalog_manager.cc:5697] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 4 to 5, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 5 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:03.264452 10832 catalog_manager.cc:5697] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 5 to 7, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 7 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:03.293725 13691 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.304292 11004 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:03.313535  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:03.298043 13691 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:03.348567 13691 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:03.326818 13727 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:21:03.350932 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:03.351640 10931 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:03.352837 11051 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:03.355736 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:03.366670 13691 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:03.368547 13691 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.372989 10929 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:03.399546 10932 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:21:03.402758 11009 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:21:03.405263 10932 raft_consensus.cc:1275] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:21:03.408608 13744 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:03.408958 13571 consensus_queue.cc:1048] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:03.410737 13832 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:03.388767 13691 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:03.427129 13817 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:21:03.473459 11078 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:03.520040 13548 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:03.540535 13770 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:03.577841 10934 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:21:03.560276 13770 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:03.582312 13770 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:03.589198 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:03.590226 11004 raft_consensus.cc:2393] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 8: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:21:03.617434 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 109782us
I20260709 12:21:03.632431 11009 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:03.636696 11007 raft_consensus.cc:1275] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:21:03.646350 10934 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:03.652618 10927 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:21:03.643441 13744 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:21:03.662436 13727 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:21:03.662654 13744 consensus_queue.cc:1048] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:21:03.669189 13852 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.669728 13852 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:03.705709 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:03.706569 11077 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
W20260709 12:21:03.784536 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 101857us
W20260709 12:21:03.778828 13845 log.cc:927] Time spent T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:21:03.877951 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 54722.8us
I20260709 12:21:03.881323 13852 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:03.833534 13561 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
W20260709 12:21:03.888005 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 59880.8us
I20260709 12:21:03.883833 10899 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:03.889029 13858 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:03.889520 13858 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:03.889925 13858 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:03.920384 13691 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:03.920619 13861 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:21:03.921582 11076 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:03.946034 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:03.946803 11009 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:03.946157 11003 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:21:03.956516 13691 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:03.983264 13858 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:03.985491 13858 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:03.992134 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 49986.7us
I20260709 12:21:04.019246 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:21:04.020709 13877 log.cc:927] Time spent T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.002s
I20260709 12:21:04.026338 13879 consensus_queue.cc:1059] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:04.027254 13621 raft_consensus.cc:3055] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:04.027666 13621 raft_consensus.cc:740] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:04.028537 13621 consensus_queue.cc:260] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:04.029765 13621 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:04.032066 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:04.032836 11007 raft_consensus.cc:2393] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 8: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:21:04.036052 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 44548.8us
I20260709 12:21:04.041352 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:04.054594 10830 catalog_manager.cc:5697] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:04.054721 10831 catalog_manager.cc:5697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 6 to 8, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New cstate: current_term: 5 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:04.060590 10830 catalog_manager.cc:5697] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:04.063598 11050 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:04.068125 13691 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:04.079097 11084 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:04.093936 10829 catalog_manager.cc:5697] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:04.103263 10919 tablet_service.cc:1558] Processing DeleteTablet for tablet 097e40d4693b49118b91e7a4fd8e8eb1 with delete_type TABLET_DATA_TOMBSTONED (TS 9e8170bbe8244e40a2b2e5011e69b697 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:43546
I20260709 12:21:04.106174 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:04.107033 13734 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:04.108814 13734 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:04.109223 13734 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:04.106855 10934 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:04.112658 10829 catalog_manager.cc:5697] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:04.118434 10899 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:04.119411 13859 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:04.121109 13859 raft_consensus.cc:697] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:04.121954 13859 consensus_queue.cc:237] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:04.135118 13734 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:04.137403 13734 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:04.139667 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:04.141894 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:04.183609 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:04.184267 11004 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:04.188115 13886 tablet_replica.cc:333] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:21:04.189447 13886 raft_consensus.cc:2243] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:04.186213 11051 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:04.316074 13886 raft_consensus.cc:2272] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:04.357092 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 170934us
W20260709 12:21:04.344067 10899 raft_consensus.cc:687] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697: failed to submit failure detected task: Service unavailable: Thread pool token was shut down
W20260709 12:21:04.364527 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 173304us
I20260709 12:21:04.363421 13691 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:21:04.404989 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 216099us
I20260709 12:21:04.435883 10832 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35614 (request call id 219) took 3721 ms. Trace:
I20260709 12:21:04.460489 11004 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:04.444701 10832 rpcz_store.cc:276] 0709 12:21:00.716984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.717182 (+   198us) service_pool.cc:224] Handling call
0709 12:21:04.435787 (+3718605us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:03.498918 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:03.558067 (+ 59149us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:03.558105 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:21:03.558119 (+    14us) tablet.cc:662] Decoding operations
0709 12:21:03.558509 (+   390us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:03.558559 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:03.558588 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:21:03.558914 (+   326us) tablet.cc:701] Row locks acquired
0709 12:21:03.558928 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:21:03.559070 (+   142us) write_op.cc:270] Start()
0709 12:21:03.559201 (+   131us) write_op.cc:276] Timestamp: P: 1783599663559022 usec, L: 0
0709 12:21:03.559220 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:21:03.575632 (+ 16412us) log.cc:844] Serialized 919 byte log entry
0709 12:21:03.580240 (+  4608us) op_driver.cc:464] REPLICATION: finished
0709 12:21:03.580812 (+   572us) write_op.cc:301] APPLY: starting
0709 12:21:03.580893 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:03.581007 (+   114us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:03.581097 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:03.581473 (+   376us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:03.581724 (+   251us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:21:03.581775 (+    51us) write_op.cc:312] APPLY: finished
0709 12:21:03.581997 (+   222us) log.cc:844] Serialized 29 byte log entry
0709 12:21:03.582188 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:03.582293 (+   105us) write_op.cc:454] Released schema lock
0709 12:21:03.582337 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:03.582843 (+   506us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:03.582874 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":41150,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":332,"apply.run_cpu_time_us":1952,"apply.run_wall_time_us":1952,"num_ops":2,"prepare.queue_time_us":6300,"prepare.run_cpu_time_us":3628,"prepare.run_wall_time_us":86623,"replication_time_us":20860}]]}
W20260709 12:21:04.517136 13887 log.cc:927] Time spent T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:21:04.544382 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 179055us
W20260709 12:21:04.604171 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 124022us
I20260709 12:21:04.694334 10829 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35620 (request call id 220) took 1661 ms. Trace:
W20260709 12:21:04.715811 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 87776.4us
I20260709 12:21:04.695710 10829 rpcz_store.cc:276] 0709 12:21:03.033047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.034279 (+  1232us) service_pool.cc:224] Handling call
0709 12:21:03.049855 (+ 15576us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b5400002490. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3c0b2 00007f9bb6db5759 00007f9bb6d4da76 00007f9bb6d1ed58 00007f9bb6e1d04e 00007f9bb52de2a4 00007f9bb52de232 00007f9bb52de161 00007f9bb52de0dc
0709 12:21:04.694238 (+1644383us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:04.120482 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:04.120982 (+   500us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:04.121017 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:21:04.121031 (+    14us) tablet.cc:662] Decoding operations
0709 12:21:04.121415 (+   384us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:04.121463 (+    48us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:04.121492 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:21:04.121797 (+   305us) tablet.cc:701] Row locks acquired
0709 12:21:04.121810 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:21:04.121932 (+   122us) write_op.cc:270] Start()
0709 12:21:04.122033 (+   101us) write_op.cc:276] Timestamp: P: 1783599664121890 usec, L: 0
0709 12:21:04.122049 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:21:04.122643 (+   594us) log.cc:844] Serialized 923 byte log entry
0709 12:21:04.124865 (+  2222us) op_driver.cc:464] REPLICATION: finished
0709 12:21:04.125319 (+   454us) write_op.cc:301] APPLY: starting
0709 12:21:04.125402 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:04.125512 (+   110us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:04.125636 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:04.125931 (+   295us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:04.126088 (+   157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:21:04.126137 (+    49us) write_op.cc:312] APPLY: finished
0709 12:21:04.126332 (+   195us) log.cc:844] Serialized 29 byte log entry
0709 12:21:04.126512 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:04.126598 (+    86us) write_op.cc:454] Released schema lock
0709 12:21:04.126639 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:04.126991 (+   352us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:04.127028 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":68811,"reported_tablets":31,"spinlock_wait_cycles":4084096,"child_traces":[["op",{"apply.queue_time_us":216,"apply.run_cpu_time_us":1628,"apply.run_wall_time_us":1628,"num_ops":2,"prepare.queue_time_us":129,"prepare.run_cpu_time_us":2421,"prepare.run_wall_time_us":2420,"replication_time_us":2695}]]}
I20260709 12:21:04.727314 11004 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:04.742431 13566 consensus_queue.cc:1059] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:04.743317 13566 raft_consensus.cc:3055] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:04.743644 13566 raft_consensus.cc:740] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:04.744457 13566 consensus_queue.cc:260] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:04.745590 13566 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:04.764832 11084 consensus_queue.cc:237] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:04.769755 13894 log.cc:927] Time spent T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:21:04.770138 13886 ts_tablet_manager.cc:1916] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:04.776150 11076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:21:04.781545 11076 raft_consensus.cc:606] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Received request to transfer leadership to TS 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:04.835449 11085 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
W20260709 12:21:04.863441 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 86382.7us
I20260709 12:21:04.864216 11050 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:04.859485 13770 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:04.871896 13770 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:04.874264 13770 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:04.882332 10831 catalog_manager.cc:5697] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 6 to 7, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 7 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:04.897116 10831 catalog_manager.cc:5697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:04.907465 10831 catalog_manager.cc:5697] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 6 to 9, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 9 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:04.920720 13875 raft_consensus.cc:993] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 0b171b6aaedc4f809f2753dcfadb14ce to start an election
W20260709 12:21:04.932063 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 67926.7us
I20260709 12:21:04.939426 13727 raft_consensus.cc:1081] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Signalling peer 0b171b6aaedc4f809f2753dcfadb14ce to start an election
I20260709 12:21:04.942937 11657 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156"
dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
 from {username='slave'} at 127.0.0.1:59414
I20260709 12:21:04.943594 11657 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:04.943951 11657 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:04.939524 13861 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:04.956202 13861 raft_consensus.cc:697] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:04.957228 13861 consensus_queue.cc:237] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:04.983748 11657 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:04.987994 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:04.989951 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 143204us
I20260709 12:21:05.002687 11657 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:05.013836 11003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:21:05.014508 11003 raft_consensus.cc:606] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:05.014883 11003 raft_consensus.cc:614] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:05.017268 11009 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:21:05.006592 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:05.028883 11084 raft_consensus.cc:3055] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:05.030536 11084 raft_consensus.cc:740] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:05.031257 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:05.031890 10929 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:05.045117 11084 consensus_queue.cc:260] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:05.046558 11084 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:05.055737 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:05.062743 11653 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:21:05.064672 13727 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:05.072436 13886 ts_tablet_manager.cc:1929] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.7
I20260709 12:21:05.073048 13886 log.cc:1199] T 097e40d4693b49118b91e7a4fd8e8eb1 P 9e8170bbe8244e40a2b2e5011e69b697: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-0-root/wals/097e40d4693b49118b91e7a4fd8e8eb1
I20260709 12:21:05.061807 11084 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 5.
I20260709 12:21:05.084703 11084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:21:05.086897 11084 raft_consensus.cc:606] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:05.081233 10901 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:05.088501 11622 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:05.093240 13566 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:05.093519 13826 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:05.094142 13826 raft_consensus.cc:697] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:05.095063 13826 consensus_queue.cc:237] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:05.082815 13744 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:21:05.131085 13863 raft_consensus.cc:993] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:21:05.131613 13863 raft_consensus.cc:1081] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Signalling peer 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:21:05.138566 10932 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:43556
I20260709 12:21:05.139344 10932 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:05.139788 10932 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:05.144436 11084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:21:05.145151 11084 raft_consensus.cc:606] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:05.151077 13886 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43546 (request call id 78) took 1050 ms. Trace:
I20260709 12:21:05.151595 13886 rpcz_store.cc:276] 0709 12:21:04.100452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.102887 (+  2435us) service_pool.cc:224] Handling call
0709 12:21:04.187673 (+ 84786us) ts_tablet_manager.cc:1151] Deleting tablet 097e40d4693b49118b91e7a4fd8e8eb1
0709 12:21:04.187779 (+   106us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:21:04.734940 (+547161us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b2c0003f1c8. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9baf210291 00007f9baf22aaaf 00007f9bb0f5b62e 00007f9bb0f68534 00007f9bb495334c 00007f9bb5f7660a 00007f9bb5fa72d0 00007f9bb5f8d83d 00007f9bb5f8d7e9 00007f9bb5f8d779 00007f9bb5f8d741
0709 12:21:04.969728 (+234788us) tablet_metadata.cc:665] Metadata flushed
0709 12:21:05.072292 (+102564us) tablet_metadata.cc:665] Metadata flushed
0709 12:21:05.150918 (+ 78626us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1523,"spinlock_wait_cycles":29502848,"tablet-delete.queue_time_us":81214,"thread_start_us":74125,"threads_started":1}
I20260709 12:21:05.154570 10821 catalog_manager.cc:5028] TS 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): tablet 097e40d4693b49118b91e7a4fd8e8eb1 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:21:05.158886 10929 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 5.
I20260709 12:21:05.174896 10932 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:05.181810 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:05.182567 11011 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:05.182578 11084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:21:05.183804 11084 raft_consensus.cc:606] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:05.184984 10932 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:05.188278 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:05.192574 11085 raft_consensus.cc:3055] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:05.192905 11085 raft_consensus.cc:740] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:05.224725 11085 consensus_queue.cc:260] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:05.226794 11085 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:05.240036  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:05.242058  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:21:05.242399 13914 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:21:05.243197  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:05.238865 11011 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:05.267513 10901 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:05.306529 13891 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:05.307183 13891 raft_consensus.cc:697] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:05.308105 13891 consensus_queue.cc:237] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:05.302317 13744 raft_consensus.cc:2955] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 6 to 9, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:05.341003 11007 raft_consensus.cc:2955] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 6 to 9, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:05.342993 10833 catalog_manager.cc:5697] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 4 to 5, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 5 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:05.347048 11085 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:05.364295 10831 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35608 (request call id 230) took 1189 ms. Trace:
I20260709 12:21:05.370311 10832 catalog_manager.cc:5697] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:05.367460 10831 rpcz_store.cc:276] 0709 12:21:04.175396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.175556 (+   160us) service_pool.cc:224] Handling call
0709 12:21:05.364208 (+1188652us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:04.992571 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:04.993104 (+   533us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:04.993138 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:21:04.993155 (+    17us) tablet.cc:662] Decoding operations
0709 12:21:04.993683 (+   528us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:04.993759 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:04.993799 (+    40us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:21:04.994106 (+   307us) tablet.cc:701] Row locks acquired
0709 12:21:04.994123 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:21:04.994249 (+   126us) write_op.cc:270] Start()
0709 12:21:04.994360 (+   111us) write_op.cc:276] Timestamp: P: 1783599664994206 usec, L: 0
0709 12:21:04.994381 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:21:04.996658 (+  2277us) log.cc:844] Serialized 1308 byte log entry
0709 12:21:05.087935 (+ 91277us) op_driver.cc:464] REPLICATION: finished
0709 12:21:05.255564 (+167629us) write_op.cc:301] APPLY: starting
0709 12:21:05.260278 (+  4714us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:05.272309 (+ 12031us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:05.305519 (+ 33210us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:05.326771 (+ 21252us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:05.331359 (+  4588us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:21:05.346633 (+ 15274us) write_op.cc:312] APPLY: finished
0709 12:21:05.346843 (+   210us) log.cc:844] Serialized 35 byte log entry
0709 12:21:05.347006 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:05.347111 (+   105us) write_op.cc:454] Released schema lock
0709 12:21:05.347149 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:05.347569 (+   420us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:05.349496 (+  1927us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":352880,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":148125,"apply.run_cpu_time_us":8345,"apply.run_wall_time_us":108528,"num_ops":3,"prepare.queue_time_us":42880,"prepare.run_cpu_time_us":3005,"prepare.run_wall_time_us":4444,"replication_time_us":93384,"spinlock_wait_cycles":12672,"thread_start_us":149854,"threads_started":2}]]}
I20260709 12:21:05.386770 11653 raft_consensus.cc:2955] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 6 to 9, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:21:05.393137 13916 log.cc:927] Time spent T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.088s	user 0.002s	sys 0.000s
W20260709 12:21:05.404057 13918 log.cc:927] Time spent T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:21:05.435448 10818 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 59db2d2bb22c41aebd0d2073e2ba7d52 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:05.470260 10833 catalog_manager.cc:5697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 6 to 9, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New cstate: current_term: 8 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:05.471114 10831 catalog_manager.cc:5697] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 7 to 8, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 8 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:05.483650 13861 raft_consensus.cc:993] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:21:05.484493 13861 raft_consensus.cc:1081] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Signalling peer 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:21:05.506191 10928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:43556
I20260709 12:21:05.506878 10928 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:05.508538 10928 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:05.523679 10919 tablet_service.cc:1558] Processing DeleteTablet for tablet 59db2d2bb22c41aebd0d2073e2ba7d52 with delete_type TABLET_DATA_TOMBSTONED (TS 9e8170bbe8244e40a2b2e5011e69b697 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:43546
I20260709 12:21:05.526118 13886 tablet_replica.cc:333] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:21:05.529801 13886 raft_consensus.cc:2243] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.530810 13886 raft_consensus.cc:2272] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.535293 10932 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:05.537194 13826 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:05.538441 10932 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:21:05.538947 10932 pending_rounds.cc:85] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 5
I20260709 12:21:05.539239 10932 pending_rounds.cc:107] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:21:05.537215 13876 raft_consensus.cc:993] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:21:05.539995 13886 ts_tablet_manager.cc:1916] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:05.540259 13891 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:05.540804 13891 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:05.543000 13891 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:05.536453 10928 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:05.545441 10928 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:05.545629 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:05.546550 11011 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:05.548447 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:05.549427 11006 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:05.550683 10901 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:05.551632 13891 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:05.552225 13891 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:05.552687 13891 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:05.556851 11006 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:05.557981 10901 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:05.558738 13860 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:05.559239 13860 raft_consensus.cc:697] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:05.560086 13860 consensus_queue.cc:237] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:05.563230 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:05.563668 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:05.564019 11081 raft_consensus.cc:2393] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 8: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:05.564309 11085 raft_consensus.cc:3055] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:05.564643 11085 raft_consensus.cc:740] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:05.565361 11085 consensus_queue.cc:260] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:05.566103 10932 raft_consensus.cc:2889] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:05.566625 11085 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:05.568290 13907 raft_consensus.cc:1081] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Signalling peer 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:21:05.578966 11085 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:05.591702 11081 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:05.603920 13886 ts_tablet_manager.cc:1929] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.8
I20260709 12:21:05.604249 13891 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:05.605846 13907 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:05.608446 13891 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:05.609210 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:05.610003 11081 raft_consensus.cc:2393] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 8: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:05.611487 13872 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:05.613087 11007 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:05.616500 13693 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:05.620224 10932 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:43556
I20260709 12:21:05.620836 10932 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:05.621217 10932 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:05.643635 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:05.660861 11006 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:05.636021 13886 log.cc:1199] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 9e8170bbe8244e40a2b2e5011e69b697: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-0-root/wals/59db2d2bb22c41aebd0d2073e2ba7d52
I20260709 12:21:05.672222 10901 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:05.679563 13860 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:05.683983 10932 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:05.685891 13860 raft_consensus.cc:697] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:05.687153 13860 consensus_queue.cc:237] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:05.698694 10829 catalog_manager.cc:5697] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 5 to 6, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 6 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:05.700886 10821 catalog_manager.cc:5028] TS 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): tablet 59db2d2bb22c41aebd0d2073e2ba7d52 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
W20260709 12:21:05.728492 13924 log.cc:927] Time spent T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:21:05.737609 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:05.738240 11004 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:05.744537 11004 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:05.751329 10901 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:05.754637 11004 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:05.759074 10932 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:05.764129 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:05.764649 11084 raft_consensus.cc:3055] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:05.764871 11084 raft_consensus.cc:740] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:05.758797 13713 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:21:05.773077 11084 consensus_queue.cc:260] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:05.775851 11084 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:05.763046 13892 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:05.780364 13892 raft_consensus.cc:697] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:05.781296 13892 consensus_queue.cc:237] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:05.787130 10832 catalog_manager.cc:5697] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:05.805758 11084 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:05.881433 11084 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:05.888003 13860 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:21:05.886842 10829 catalog_manager.cc:5697] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 7 to 8, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 8 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:05.953824 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 211225us
I20260709 12:21:05.975952 10833 catalog_manager.cc:5697] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 5 to 6, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 6 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:06.062088 11011 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:06.064463 13860 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:06.120453 11084 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:06.122689 13892 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:06.201799 11084 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:06.231698 13770 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:06.241289 11004 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:06.247632 11011 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:06.265462 13891 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:06.276363 13891 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:06.299690 11078 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:06.302863 13860 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:06.476182  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:06.714813 10929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:21:06.715435 10929 raft_consensus.cc:606] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:06.733075 11078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:21:06.733701 11078 raft_consensus.cc:606] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Received request to transfer leadership to TS 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:06.736368 11011 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "660a349ad34749648cae6a025708c84d"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:21:06.737010 11011 raft_consensus.cc:606] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:06.741657 11011 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:21:06.742187 11011 raft_consensus.cc:606] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:06.745473 11011 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:21:06.746017 11011 raft_consensus.cc:606] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:06.762144 11011 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:21:06.762745 11011 raft_consensus.cc:606] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:06.765760  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:21:06.767194  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:06.769169  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:06.790755 13868 raft_consensus.cc:993] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:21:06.791350 13868 raft_consensus.cc:1081] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:21:06.795190 11084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:21:06.795809 11084 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:06.796183 11084 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:06.806847 13874 raft_consensus.cc:993] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:21:06.807435 13874 raft_consensus.cc:1081] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Signalling peer 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:21:06.812804 10932 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:43552
I20260709 12:21:06.813437 10932 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:06.813858 10932 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:06.820989 10932 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:06.823087 10932 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:06.825656 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:06.826259 11078 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:06.827579 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:06.828208 11004 raft_consensus.cc:3055] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:06.828584 11004 raft_consensus.cc:740] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:06.829324 11004 consensus_queue.cc:260] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:06.830672 11004 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:06.832816 10882 auto_rebalancer.cc:629] Failed to schedule move for tablet 9b668506e6eb4a57aa83a9e45c3eb356: Remote error: Service unavailable: leader transfer in progress
I20260709 12:21:06.838541 11081 consensus_queue.cc:237] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:06.851440 11078 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:21:06.852831 10899 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:06.853751 13892 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:06.854493 13892 raft_consensus.cc:697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:06.855582 13892 consensus_queue.cc:237] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:06.820894 11084 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:06.861887 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:06.862540 10932 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:06.863354 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:06.865981 11011 raft_consensus.cc:3055] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:06.866272 11011 raft_consensus.cc:740] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:06.867777 11011 consensus_queue.cc:260] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:06.872797 10932 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:21:06.873302 11011 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:06.874087 11051 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:06.874889 13876 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:06.875391 13876 raft_consensus.cc:697] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:06.862120 11084 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:06.884374 13876 consensus_queue.cc:237] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:06.911399 11004 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:21:06.930151 13755 raft_consensus.cc:993] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:21:06.930747 13874 raft_consensus.cc:1081] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:21:06.937458 11011 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:21:06.949098 10829 catalog_manager.cc:5697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 4 to 5, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 5 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:06.957659 11049 consensus_peers.cc:597] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b6c427f0a234dbab806dced4d3ba0fb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:06.978960 10934 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:21:06.983484 13744 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:06.994068 11078 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "660a349ad34749648cae6a025708c84d"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:21:06.994716 11078 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:07.008874 11078 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:07.026389 11078 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:07.031935 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:07.032544 10934 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:07.035331 11078 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:07.042158 10934 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:07.081544 13755 raft_consensus.cc:993] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:21:07.082126 13755 raft_consensus.cc:1081] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:21:07.082194 11004 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:21:07.086797 11085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:21:07.087368 11085 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:07.087800 11085 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:07.097990 11085 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:07.099947 11085 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:07.114699 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:07.115360 10934 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:07.115581 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:07.116405 11011 raft_consensus.cc:3055] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:07.116796 11011 raft_consensus.cc:740] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:07.117578 11011 consensus_queue.cc:260] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:07.119894 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:07.120606 11006 raft_consensus.cc:3055] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:07.120891 11006 raft_consensus.cc:740] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:07.129185 10934 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:07.133327 11011 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:07.135624 11051 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:07.137523 11051 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:07.121654 11006 consensus_queue.cc:260] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:07.142904 11011 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:07.146297 11006 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:07.152156 13876 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:07.164781 11006 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:07.171648 13876 raft_consensus.cc:697] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:07.172987 13876 consensus_queue.cc:237] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:07.179683 13948 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:07.220558 13744 raft_consensus.cc:993] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 0b171b6aaedc4f809f2753dcfadb14ce to start an election
I20260709 12:21:07.223600 13948 raft_consensus.cc:697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:07.224905 13860 raft_consensus.cc:993] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:21:07.224674 13948 consensus_queue.cc:237] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:07.225893 13770 raft_consensus.cc:1081] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:21:07.228802 13744 raft_consensus.cc:1081] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Signalling peer 0b171b6aaedc4f809f2753dcfadb14ce to start an election
I20260709 12:21:07.193476 13956 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 12:21:07.252444 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 92081.2us
W20260709 12:21:07.257400 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 74353.9us
I20260709 12:21:07.259052 10832 catalog_manager.cc:5697] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 2 to 3, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 3 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:07.274353 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 112928us
I20260709 12:21:07.286967 13956 raft_consensus.cc:2955] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:21:07.380873 11657 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52"
dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
 from {username='slave'} at 127.0.0.1:59414
I20260709 12:21:07.381605 11657 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:07.381981 11657 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:07.390712 11657 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:07.413200 11657 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:07.442854 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:07.443532 11078 raft_consensus.cc:3055] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:07.443913 11078 raft_consensus.cc:740] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:07.446095 11081 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:07.451771 11078 consensus_queue.cc:260] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:07.453253 11078 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:07.478884 11004 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37586
I20260709 12:21:07.479492 11004 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:07.479907 11004 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:07.481148 11009 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:07.492906 11078 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
I20260709 12:21:07.498786 11622 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
W20260709 12:21:07.534045 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 49521.8us
I20260709 12:21:07.539525 10934 raft_consensus.cc:2955] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:21:07.484292 13957 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:21:07.518936 13946 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:07.550827 13946 raft_consensus.cc:697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:07.551829 13946 consensus_queue.cc:237] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:07.492528 13949 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:21:07.601382 10929 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:07.602036 11004 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:07.611085 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 76266.6us
I20260709 12:21:07.611505 11004 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:07.612484 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:07.613129 11656 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:07.625377 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:07.626006 11009 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:07.636353 11004 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:07.645498 11009 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
I20260709 12:21:07.648524 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:21:07.714659 13979 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:21:07.716074 10928 raft_consensus.cc:3055] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:07.716575 10928 raft_consensus.cc:740] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:07.717410 10928 consensus_queue.cc:260] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:07.722055 10928 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:07.729791 10928 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:21:07.740890 11656 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:21:07.749574 13978 ts_tablet_manager.cc:933] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:07.754634 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 106773us
W20260709 12:21:07.775533 13965 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 12:21:07.775629 10975 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:21:07.783566 13962 log.cc:927] Time spent T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:21:07.797261 13954 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:21:07.820371 13874 raft_consensus.cc:2804] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:07.829794 13874 raft_consensus.cc:697] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:07.830799 13874 consensus_queue.cc:237] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:07.855741 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:07.866339 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 215560us
I20260709 12:21:07.865983 13770 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:21:07.901382 10832 catalog_manager.cc:5697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 8 to 9, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 9 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:07.909693 10833 catalog_manager.cc:5697] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 4 to 5, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 5 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:07.912695 10829 catalog_manager.cc:5697] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: config changed from index -1 to 5, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 5 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:21:07.936312 13978 tablet_copy_client.cc:323] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.67:40209
W20260709 12:21:07.937218 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 140426us
I20260709 12:21:07.947041 10931 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:21:07.947443 10934 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:21:07.949716 11095 tablet_copy_service.cc:140] P 1abf4b385a2b493ab83f593a1f8c9cd1: Received BeginTabletCopySession request for tablet 9b6c427f0a234dbab806dced4d3ba0fb from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:40200)
I20260709 12:21:07.950467 11095 tablet_copy_service.cc:161] P 1abf4b385a2b493ab83f593a1f8c9cd1: Beginning new tablet copy session on tablet 9b6c427f0a234dbab806dced4d3ba0fb from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:40200: session id = 0b171b6aaedc4f809f2753dcfadb14ce-9b6c427f0a234dbab806dced4d3ba0fb
I20260709 12:21:07.963201 11095 tablet_copy_source_session.cc:215] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:07.968297 13978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b6c427f0a234dbab806dced4d3ba0fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:07.990126 11011 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:21:08.006088 11003 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:21:08.013348 10829 catalog_manager.cc:5697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 6 to 7, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 7 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:08.014736 10829 catalog_manager.cc:5697] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 6 to 7, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 7 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:08.021437 10932 consensus_queue.cc:237] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:08.026549  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:08.025676 13983 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:21:08.037770 11008 raft_consensus.cc:2955] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:21:08.026435 13956 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:21:08.049964 11078 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:08.051084 11003 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:08.052386 13984 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:08.053150 13826 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:08.081303 13978 tablet_copy_client.cc:806] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:08.082084 13978 tablet_copy_client.cc:670] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:08.256847 13744 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:08.258513 10933 raft_consensus.cc:1275] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:08.283190 13978 tablet_copy_client.cc:538] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:08.245247 13950 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:21:08.299639 13977 consensus_queue.cc:1048] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:21:08.365938 13978 tablet_bootstrap.cc:492] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
W20260709 12:21:08.387096 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 90410.2us
I20260709 12:21:08.387599 11078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "015a67e38c364985be24b18358579506"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:21:08.388388 11078 raft_consensus.cc:606] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:08.419592 10932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:21:08.420354 10932 raft_consensus.cc:606] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:08.431880 11009 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:21:08.432037 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 144357us
W20260709 12:21:08.435076 10900 consensus_peers.cc:597] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6aa58b8bde194f658aced897744b4d35. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:08.512919 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 77960.4us
W20260709 12:21:08.550361 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 114959us
I20260709 12:21:08.626696 11653 raft_consensus.cc:1275] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:21:08.633903 14008 log.cc:927] Time spent T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
W20260709 12:21:08.687630 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 111268us
W20260709 12:21:08.705331 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 172492us
W20260709 12:21:08.749471 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 335845us
W20260709 12:21:08.763391 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 70090us
I20260709 12:21:08.773175 13972 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:08.778388 11085 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:21:08.792133 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 147927us
I20260709 12:21:08.793905 13755 consensus_queue.cc:1048] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:21:08.800088 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 49081.1us
I20260709 12:21:08.811142 11006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:21:08.811789 11006 raft_consensus.cc:606] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:21:08.910152 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 55252.8us
W20260709 12:21:08.957527 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 43992.4us
I20260709 12:21:08.830265 14028 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
W20260709 12:21:08.926971 14012 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:21:08.978241 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 132883us
W20260709 12:21:09.016209 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 47528.6us
W20260709 12:21:09.024883 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 45862.8us
I20260709 12:21:09.042223 13952 raft_consensus.cc:993] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:21:09.042785 13952 raft_consensus.cc:1081] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:21:09.039681  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 12:21:09.048046 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 65011.7us
I20260709 12:21:09.084102 13891 raft_consensus.cc:2955] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:21:09.091492 14029 raft_consensus.cc:993] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:21:09.099351 11085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:21:09.100011 11085 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:09.100385 11085 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:09.095847 11011 raft_consensus.cc:2955] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:21:09.123907  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:09.124948  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:09.132043 11085 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:09.139153 11085 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:09.135147 13948 raft_consensus.cc:1081] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Signalling peer 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:21:09.170131 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:09.170786 10932 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:09.173743 13975 raft_consensus.cc:993] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:21:09.174333 13975 raft_consensus.cc:1081] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:21:09.176342 10934 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "015a67e38c364985be24b18358579506"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:43556
I20260709 12:21:09.176954 10934 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:09.177327 10934 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.196446 10932 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:09.204667 11083 raft_consensus.cc:2955] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:21:09.205942 11010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37586
I20260709 12:21:09.206512 11010 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:09.206950 11010 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:09.216107 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:09.216753 11006 raft_consensus.cc:3055] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:09.217060 11006 raft_consensus.cc:740] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:09.217816 11006 consensus_queue.cc:260] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:09.218688 11051 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:09.218894 11006 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:09.219689 11085 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:09.192466 10934 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:09.224845 10928 raft_consensus.cc:1240] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:09.240566 13876 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:09.241132 13876 raft_consensus.cc:697] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:09.242012 10934 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:09.245193 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:09.246022 11084 raft_consensus.cc:3055] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:09.246366 11084 raft_consensus.cc:740] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:09.247143 11084 consensus_queue.cc:260] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:09.248059 11084 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.250384 11006 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:09.258184 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:09.259094 11006 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.264462 14039 ts_tablet_manager.cc:933] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109)
I20260709 12:21:09.241969 13876 consensus_queue.cc:237] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:09.262197 11010 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:09.257041 13891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53330 (request call id 8) took 1250 ms. Trace:
I20260709 12:21:09.289225 11010 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:09.294304 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:09.294930 10928 raft_consensus.cc:3055] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:09.295238 10928 raft_consensus.cc:740] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:09.296159 10928 consensus_queue.cc:260] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:09.297376 10928 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:09.280349 13891 rpcz_store.cc:276] 0709 12:21:08.018362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.019722 (+  1360us) service_pool.cc:224] Handling call
0709 12:21:08.035916 (+ 16194us) log.cc:844] Serialized 499 byte log entry
0709 12:21:08.375622 (+339706us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b2c00057318. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9baf859a11 00007f9baf868a0a 00007f9baf868693 00007f9baf868631 00007f9bb0f9cb52 00007f9bb0f9ccf5 00007f9bb0ed9691 00007f9bb0eb9eaa 00007f9bb0ec0d53 00007f9bb0ec0cd9 00007f9bb0ec0c69
0709 12:21:08.376900 (+  1278us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b540032dd20. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0ed9142 00007f9bb0eb9eaa 00007f9bb0ec0d53 00007f9bb0ec0cd9 00007f9bb0ec0c69 00007f9bb0ec0c31 00007f9bb0ebfdfd 0000000000388634 0000000000388479 00007f9bade73475
0709 12:21:08.633466 (+256566us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b18002712a0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade412a6 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0ed9142 00007f9bb0eb9eaa 00007f9bb0ec0d53
0709 12:21:08.634320 (+   854us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b540032dd20. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0ed9142 00007f9bb0eb9eaa 00007f9bb0ec0d53 00007f9bb0ec0cd9 00007f9bb0ec0c69 00007f9bb0ec0c31 00007f9bb0ebfdfd 0000000000388634 0000000000388479 00007f9bade73475
0709 12:21:09.256418 (+622098us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11498,"raft.queue_time_us":14090,"raft.run_cpu_time_us":7283,"raft.run_wall_time_us":414305,"spinlock_wait_cycles":59476608,"thread_start_us":278678,"threads_started":1,"wal-append.queue_time_us":327575}
I20260709 12:21:09.317106 11083 consensus_queue.cc:237] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:09.322707 11084 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:21:09.324591 10899 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:09.336912 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:09.337706 11084 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:09.338869 10928 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:21:09.342658 11006 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:21:09.345010 11084 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:21:09.346386 10974 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:09.354754 10829 catalog_manager.cc:5697] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: config changed from index -1 to 7, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 8 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:09.388412 13978 tablet_bootstrap.cc:492] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:09.389480 13978 tablet_bootstrap.cc:492] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:21:09.371614 13985 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:09.390991 13985 raft_consensus.cc:697] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:09.370105 13947 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:09.390230 13978 ts_tablet_manager.cc:1403] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 1.025s	user 0.027s	sys 0.029s
I20260709 12:21:09.407495 11006 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:21:09.393237 13985 consensus_queue.cc:237] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:09.412817 13947 raft_consensus.cc:697] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:21:09.412998 11049 consensus_peers.cc:597] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c1b75831227444d382e9c0fc5b367564. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:09.415421 10928 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:21:09.444828 13947 consensus_queue.cc:237] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:09.452855 13949 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:09.401974 14039 tablet_copy_client.cc:323] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.65:46109
I20260709 12:21:09.460678 13744 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:09.465868 13978 raft_consensus.cc:359] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:09.468895 13978 raft_consensus.cc:740] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:21:09.469578 13978 consensus_queue.cc:260] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:09.476330 10946 tablet_copy_service.cc:140] P 9e8170bbe8244e40a2b2e5011e69b697: Received BeginTabletCopySession request for tablet 6aa58b8bde194f658aced897744b4d35 from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:53346)
I20260709 12:21:09.476977 10946 tablet_copy_service.cc:161] P 9e8170bbe8244e40a2b2e5011e69b697: Beginning new tablet copy session on tablet 6aa58b8bde194f658aced897744b4d35 from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:53346: session id = 0b171b6aaedc4f809f2753dcfadb14ce-6aa58b8bde194f658aced897744b4d35
I20260709 12:21:09.485455 13978 ts_tablet_manager.cc:1434] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.000s
I20260709 12:21:09.486253 10946 tablet_copy_source_session.cc:215] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:09.490483 11095 tablet_copy_service.cc:342] P 1abf4b385a2b493ab83f593a1f8c9cd1: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-9b6c427f0a234dbab806dced4d3ba0fb received from {username='slave'} at 127.0.0.1:40200
I20260709 12:21:09.491024 11095 tablet_copy_service.cc:434] P 1abf4b385a2b493ab83f593a1f8c9cd1: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-9b6c427f0a234dbab806dced4d3ba0fb on tablet 9b6c427f0a234dbab806dced4d3ba0fb with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:09.493140 13744 raft_consensus.cc:2955] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:21:09.497362 14039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aa58b8bde194f658aced897744b4d35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:09.496695 11010 raft_consensus.cc:2955] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:21:09.567356 14039 tablet_copy_client.cc:806] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:09.569958 14039 tablet_copy_client.cc:670] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:09.576195 14039 tablet_copy_client.cc:538] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:09.574739 10932 raft_consensus.cc:2955] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:21:09.588793 14039 tablet_bootstrap.cc:492] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:21:09.616858 10832 catalog_manager.cc:5697] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 7 to 8, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 8 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:09.632835 10829 catalog_manager.cc:5697] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 4 to 5, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 5 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:09.634748 10829 catalog_manager.cc:5697] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: config changed from index -1 to 4, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 3 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:21:09.655902 10831 catalog_manager.cc:5697] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 5 to 6, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 6 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:09.672909 11010 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:09.694226 11656 raft_consensus.cc:1217] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 LEARNER]: Deduplicated request from leader. Original: 5.4->[5.5-5.5]   Dedup: 5.5->[]
I20260709 12:21:09.682706 13744 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:21:09.764335 10928 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:09.770730 13861 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:09.864500 14039 tablet_bootstrap.cc:492] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:09.868068 14039 tablet_bootstrap.cc:492] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:21:09.868930 14039 ts_tablet_manager.cc:1403] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 0.280s	user 0.060s	sys 0.050s
I20260709 12:21:09.897912 11083 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:21:09.887209 14039 raft_consensus.cc:359] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:09.901088 14039 raft_consensus.cc:740] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:21:09.906733 14039 consensus_queue.cc:260] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:09.912753 13891 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:09.938156 14039 ts_tablet_manager.cc:1434] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.068s	user 0.000s	sys 0.006s
I20260709 12:21:09.941926 10946 tablet_copy_service.cc:342] P 9e8170bbe8244e40a2b2e5011e69b697: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-6aa58b8bde194f658aced897744b4d35 received from {username='slave'} at 127.0.0.1:53346
I20260709 12:21:09.942435 10946 tablet_copy_service.cc:434] P 9e8170bbe8244e40a2b2e5011e69b697: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-6aa58b8bde194f658aced897744b4d35 on tablet 6aa58b8bde194f658aced897744b4d35 with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:09.962949 11006 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:21:09.975112 11656 raft_consensus.cc:1217] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEARNER]: Deduplicated request from leader. Original: 8.6->[8.7-8.7]   Dedup: 8.7->[]
I20260709 12:21:10.007397 13958 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:21:10.048756 14039 ts_tablet_manager.cc:933] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:10.054316 10932 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:10.055570 11079 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:10.059237 14017 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:10.068908 14043 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:10.084228 14039 tablet_copy_client.cc:323] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.67:40209
I20260709 12:21:10.086783 11095 tablet_copy_service.cc:140] P 1abf4b385a2b493ab83f593a1f8c9cd1: Received BeginTabletCopySession request for tablet c1b75831227444d382e9c0fc5b367564 from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:40200)
I20260709 12:21:10.087450 11095 tablet_copy_service.cc:161] P 1abf4b385a2b493ab83f593a1f8c9cd1: Beginning new tablet copy session on tablet c1b75831227444d382e9c0fc5b367564 from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:40200: session id = 0b171b6aaedc4f809f2753dcfadb14ce-c1b75831227444d382e9c0fc5b367564
I20260709 12:21:10.097560 11095 tablet_copy_source_session.cc:215] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:10.108858 14039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b75831227444d382e9c0fc5b367564. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:10.265674 14068 log.cc:927] Time spent T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:21:10.330502 14039 tablet_copy_client.cc:806] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:10.331163 14039 tablet_copy_client.cc:670] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:10.374756  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:11.567740 13946 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:11.568486 13946 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:11.571080 13946 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:11.573431 13826 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:11.574088 13826 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:11.627067 11623 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.009s	sys 0.002s
W20260709 12:21:11.644949 11623 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.201s	user 0.009s	sys 0.004s
I20260709 12:21:11.673583 14070 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:11.674292 14070 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:11.676045 14071 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:11.676661 14071 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:11.765026 13826 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:11.818127 14070 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:11.820556 14071 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:12.130303 11622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.503s	user 0.043s	sys 0.051s
W20260709 12:21:12.131057 11622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.504s	user 0.043s	sys 0.051s
I20260709 12:21:12.307752 13946 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:12.307929 14071 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:12.308614 13946 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:12.310048 14070 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:12.310700 14070 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:12.311352 13946 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:12.308705 14071 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:12.312947 14070 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.313117 14071 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:12.313884 14071 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:12.314204 14070 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:12.314740 14071 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:12.315069 14070 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:12.316934 14071 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.317466 14070 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.445254 14075 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:21:12.471063 10932 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.403s	user 0.048s	sys 0.030s
I20260709 12:21:12.446899 14075 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.474972 14075 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:12.472097 10932 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.404s	user 0.048s	sys 0.032s
I20260709 12:21:12.478883 10932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2170) took 2412 ms. Trace:
I20260709 12:21:12.483569 14075 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:12.484810 14075 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.490262 14081 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:12.490761 14075 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.479368 10932 rpcz_store.cc:276] 0709 12:21:10.065948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.066598 (+   650us) service_pool.cc:224] Handling call
0709 12:21:10.066934 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:10.067408 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:10.067438 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:10.067985 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 12:21:12.478166 (+2410181us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:12.478234 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:12.478377 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:12.478487 (+   110us) raft_consensus.cc:1685] finished
0709 12:21:12.478499 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:12.478757 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1181,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":109,"thread_start_us":2409503,"threads_started":1,"wal-append.queue_time_us":107191,"wal-append.run_cpu_time_us":2187,"wal-append.run_wall_time_us":1093083}
I20260709 12:21:12.493178 14079 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:12.499035 14079 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.506136 14079 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.500350 14081 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.521168 14074 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:12.636777 11079 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.562s	user 0.020s	sys 0.015s
W20260709 12:21:12.650803 11079 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.576s	user 0.021s	sys 0.015s
I20260709 12:21:12.630478 14078 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:12.656064 14074 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.656682 14078 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.637003 14081 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.638001 14079 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:12.659443 14078 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.656044 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2404) took 2583 ms. Trace:
I20260709 12:21:12.659332 14074 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:12.667609 14082 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:12.665815 14081 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:12.676192 14079 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:12.680728 11009 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.624s	user 0.068s	sys 0.165s
I20260709 12:21:12.642359 14077 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:12.642596 14075 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:21:12.687798 11009 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.631s	user 0.069s	sys 0.166s
I20260709 12:21:12.688133 14081 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.688462 14077 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.687882 14082 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.691056 14081 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.692853 14082 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.690974 14075 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.693809 14082 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:12.692988 14077 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.687810 14078 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:12.664446 11079 rpcz_store.cc:276] 0709 12:21:10.072602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.072756 (+   154us) service_pool.cc:224] Handling call
0709 12:21:10.073082 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:10.073497 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:10.073525 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:10.074042 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 12:21:12.651511 (+2577469us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:12.651600 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:12.653196 (+  1596us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:12.655572 (+  2376us) raft_consensus.cc:1685] finished
0709 12:21:12.655592 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:12.655871 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":104,"thread_start_us":2576893,"threads_started":1,"wal-append.queue_time_us":99147,"wal-append.run_cpu_time_us":3223,"wal-append.run_wall_time_us":1140190}
I20260709 12:21:12.696300 14075 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.694607 14082 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.698700 14082 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.699198 14080 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:12.700340 14080 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.701594 14075 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:12.702395 14075 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.695544 14079 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:12.704224 14081 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:12.703642 14080 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.695551 14078 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:12.723260 14078 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:12.725780 14088 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:12.726759 14088 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.728869 14081 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.731781 10830 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 104) took 1074 ms. Trace:
I20260709 12:21:12.732038 14088 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.737031 14081 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.741878 10830 rpcz_store.cc:276] 0709 12:21:11.657171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.729058 (+1071887us) service_pool.cc:224] Handling call
0709 12:21:12.731536 (+  2478us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":0}
I20260709 12:21:12.743297 14083 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:12.743986 14081 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:12.744181 14083 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.744807 14081 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.746984 14083 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.756763 14078 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:12.758333 14078 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.766747 14084 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:12.767679 14084 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.770291 14084 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.761124 14088 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:12.771486 14078 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.749356 14081 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.775066 14086 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:12.753652 14079 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:12.811240 14092 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:12.771708 14088 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:12.820896 14086 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.824054 14087 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:12.824997 14087 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.823717 14086 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:12.836668 14081 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:12.819002 14079 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.861732 14087 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.904873 14100 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:12.905783 14100 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:12.893887 14086 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:12.915568 14086 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.917308 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2306) took 2862 ms. Trace:
I20260709 12:21:12.902735 14075 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.920775 14081 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.916589 14074 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:12.900899 14092 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.928335 14083 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:12.965039 14083 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.952394 14088 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.951529 14079 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.963750 14074 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.954792 14086 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:12.967263 14086 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:12.968043 14086 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.965682 14094 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:12.941357 14096 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:12.969072 14094 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.969211 14096 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.921118 11009 rpcz_store.cc:276] 0709 12:21:10.038371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.038523 (+   152us) service_pool.cc:224] Handling call
0709 12:21:10.038837 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:10.041177 (+  2340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:10.041211 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:10.045042 (+  3831us) log.cc:844] Serialized 26 byte log entry
0709 12:21:12.689071 (+2644029us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:12.749344 (+ 60273us) log.cc:844] Serialized 14 byte log entry
0709 12:21:12.881375 (+132031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:12.893183 (+ 11808us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:12.894628 (+  1445us) raft_consensus.cc:1685] finished
0709 12:21:12.894643 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:12.900572 (+  5929us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15641,"prepare.queue_time_us":85399,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":96414,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":366,"thread_start_us":2781968,"threads_started":4,"wal-append.queue_time_us":306741,"wal-append.run_cpu_time_us":1795,"wal-append.run_wall_time_us":1008786}
I20260709 12:21:12.971412 14094 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.968346 14097 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:12.972360 14097 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.949911 14100 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.974637 14097 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:12.974709 14085 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:12.963892 14102 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:12.975718 14102 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:12.998704 14081 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.003299 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.004875 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.006561 14102 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.009591 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.010744 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.011622 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.012491 14101 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:12.975533 14085 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:13.014390 14083 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.014995 14076 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:13.017026 10928 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 5.
I20260709 12:21:13.016332 14102 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:13.034006 14076 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.034618 14102 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.036073 14109 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:13.036782 14102 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.037411 14102 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:13.037575 14076 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.038113 14102 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.036840 14109 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.075307 14104 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:13.076013 14074 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.076422 14103 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:13.075115 14096 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.085783 14103 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.076901 14086 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.057478 14101 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.094957 14101 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.064329 14094 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:13.095237 14085 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.080035 14084 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:13.080701 14090 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:13.081203 14080 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:13.081807 14099 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:13.082275 14078 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:13.057044 14081 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:13.088315 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.090814 14103 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.079469 14109 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.070158 14088 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:13.097865 14084 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.120324 14112 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:13.121722 14099 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.122722 14080 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:13.100821 14102 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.102509 14086 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:13.105806 14077 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:13.102259 14074 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:13.240139 14079 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:13.123212 14092 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.240999 14103 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:13.124752 14078 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.238862 14088 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.190667 14111 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:13.296980 14123 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:13.298134 14126 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:13.298348 14120 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:13.180843 14094 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.238528 14081 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:13.238333 14104 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.115374 14090 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.290592 14096 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:21:13.332782 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 132924us
I20260709 12:21:13.332137 14114 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:13.268499 14077 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.332973 14113 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:13.332441 14108 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:13.292557 14086 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.339219 14124 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:13.344367 14125 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:13.346917 14080 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.303772 14074 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.333446 14098 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:13.316723 14102 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:13.374816 14096 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.364320 14120 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.379379 14096 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.315713 14111 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.380023 14124 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.334154 14101 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:13.381309 14101 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.381997 14111 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.379560 14120 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:13.314574 14079 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.387939 14119 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:13.397333 14119 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.337366 14095 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:13.386122 14106 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:13.387140 14101 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.387727 14116 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:13.388257 14092 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:13.388684 14097 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:13.389233 14081 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.335783 14103 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.390378 14084 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.390807 14077 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.391225 14090 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.392560 14086 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:13.392753 14117 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:13.280926 14112 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.394189 14098 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.394856 14114 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.395931 14127 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:13.311802 14126 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.432528 14097 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:13.433485 14106 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.396625 14102 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.434571 14113 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.435120 14092 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.436100 14116 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.439261 14124 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.398300 14108 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.388594 14118 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:13.447616 14085 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:21:13.452848 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 89233.1us
I20260709 12:21:13.448000 14081 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:13.467381 14093 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:13.469269 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:13.469486 14092 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:13.469882 14130 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:13.485287 14130 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.486784 14092 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:13.470460 14129 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:13.487506 14092 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.486809 14112 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.488297 14129 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.453753 14080 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:13.471477 11009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:21:13.465113 14078 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.494400 14116 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.451270 14117 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.495952 14108 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.383057 14123 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.440006 14095 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.472987 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.518471 14095 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.389664 14125 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.520542 14077 raft_consensus.cc:1064] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:21:13.520820 14125 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:13.467667 14097 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.472316 14106 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.472360 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.521376 14099 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.473901 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.479233 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.522619 11004 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 5.
I20260709 12:21:13.481446 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.481248 14127 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.523291 14123 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.480715 14102 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:13.473675 14088 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.525127 14135 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:13.526008 14135 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.483958 14104 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.469429 14098 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.484431 14128 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:13.470934 14114 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.487720 14130 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.492364 14119 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.492614 14092 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:13.493103 14094 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.492871 14118 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.548516 14088 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:13.549139 14088 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.549568 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.479302 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.504725 14117 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.505235 14080 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.552553 14118 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.552750 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:13.505750 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:13.506031 14085 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.554291 14080 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.556089 14085 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.485339 14103 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.483227 14126 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:13.507376 14074 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.507175 14093 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.552621 14087 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:13.557711 14087 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.558629 14093 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:13.492791 14129 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.513242 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.560032 14094 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:13.560160 11006 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 5.
I20260709 12:21:13.560563 14094 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.552568 14105 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:13.562119 14105 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.514657 14133 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:13.522562 11002 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 2.
I20260709 12:21:13.525322 14127 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:13.483222 14113 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.483435 14081 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.563382 14133 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.564529 14114 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:13.565099 14081 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.565804 14133 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:13.491029 11009 raft_consensus.cc:606] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:13.537388 11624 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:13.565109 14114 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.536955 14095 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:13.568152 14122 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:13.568665 14095 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.569159 11624 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:13.570125 11624 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:13.539183 14100 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:13.571125 14132 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:13.571549 14132 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:13.571628 14115 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:13.571964 14132 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:13.572221 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.572244 14115 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:13.568612 14122 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:13.539366 14128 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.572690 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.573694 11009 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:13.574864 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.575170 14128 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:13.540967 14077 consensus_queue.cc:237] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.536664 14102 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:13.576411 14102 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.544260 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.542351 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.544622 14131 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:13.545316 14134 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:13.545657 14079 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.544160 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.546028 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.550257 11005 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:13.551088 11010 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 3.
I20260709 12:21:13.575413 14122 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:13.577965 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.545141 14116 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:13.640432 14133 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:13.618314 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:13.656299 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.664608 14128 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:13.678748 14128 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.547717 14135 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:13.666143 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.652091 14094 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.640560 14096 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:13.660063 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.649935 14088 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.620051 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:13.683274 11080 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:13.679694 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.646750 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.622466 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.573025 14100 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.685034 14133 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.685612 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.685925 14096 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.686297 11008 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:13.629105 14136 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:13.686349 14100 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.572891 11002 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:21:13.639878 14087 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.687374 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.652817 14105 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.656692 14102 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.578531 11003 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:21:13.666568 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:21:13.666913 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 57891.1us
I20260709 12:21:13.688586 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:13.659925 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 123927us
I20260709 12:21:13.662335 14095 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.690169 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.687402 14136 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.691629 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.692341 11002 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:13.692751 14136 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.680830 14116 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.693322 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.616544 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.677356 14131 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.699818 11625 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:13.702224 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:13.703315 14114 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:13.682583 11004 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:13.706207 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.695220 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.707160 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.707561 11002 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:13.706072 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.708648 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.709621 14096 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.681805 14128 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.709103 11080 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:13.714138 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.713181 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.694353 14133 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.715958 10931 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:13.716073 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.716667 14132 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.707090 11078 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:21:13.718593 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.718911 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.719127 14132 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.695451 14116 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.720152 11656 raft_consensus.cc:2393] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 6: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:13.621991 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.722519 14134 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:13.706156 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.723789 11003 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:13.724155 11624 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:13.724890 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.725644 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.688143 11008 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:13.622774 10928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:21:13.726997 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.727169 10928 raft_consensus.cc:606] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:13.727774 11008 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:13.726354 11002 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:13.728772 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.561152 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.729532 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.729967 11006 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
W20260709 12:21:13.655905 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.681424 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.732066 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.729192 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.736589 11002 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:13.582934 14115 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:13.726961 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.740510 11657 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEARNER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:13.740674 11005 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:13.740976 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.741927 11079 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:21:13.742044 14079 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:13.742686 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.755087 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.755630 10934 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:21:13.755437 11079 raft_consensus.cc:606] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:13.757745  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:21:13.757938 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.758647 10933 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:13.755630 11081 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:13.759766  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:13.762566 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.700984 14131 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.730942 14139 raft_consensus.cc:2804] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:13.764338 14139 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:13.764879 14139 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:13.754387 11010 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:13.768436  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:13.726091 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.743939 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:13.773140 14134 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.744580 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.773305 11009 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:13.744642 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.745494 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.745708 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.729882 11004 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:21:13.609808 14098 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:13.775739 11077 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:13.776228 14098 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.729485 11008 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
W20260709 12:21:13.752303 11106 debug-util.cc:398] Leaking SignalData structure 0x7b08002dc120 after lost signal to thread 9744
I20260709 12:21:13.777752 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:13.778492 11106 debug-util.cc:398] Leaking SignalData structure 0x7b08002dc720 after lost signal to thread 10868
W20260709 12:21:13.779793 11106 debug-util.cc:398] Leaking SignalData structure 0x7b080025c7e0 after lost signal to thread 10960
W20260709 12:21:13.780905 11106 debug-util.cc:398] Leaking SignalData structure 0x7b0800149020 after lost signal to thread 11035
W20260709 12:21:13.781939 11106 debug-util.cc:398] Leaking SignalData structure 0x7b080026e4c0 after lost signal to thread 11109
W20260709 12:21:13.783036 11106 debug-util.cc:398] Leaking SignalData structure 0x7b0800380420 after lost signal to thread 11683
W20260709 12:21:13.783365 11106 debug-util.cc:398] Leaking SignalData structure 0x7b08003b6000 after lost signal to thread 13861
W20260709 12:21:13.783609 11106 debug-util.cc:398] Leaking SignalData structure 0x7b0800194b20 after lost signal to thread 13992
W20260709 12:21:13.784053 11106 debug-util.cc:398] Leaking SignalData structure 0x7b08003596e0 after lost signal to thread 14065
I20260709 12:21:13.784152 14098 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:13.786278 10974 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:13.787173 14131 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:13.787636 14131 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:13.753110 14132 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:13.753832 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.788707 10932 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:21:13.754364 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.789027 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.746461 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:13.790287 11622 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.67:40209 timed out after 1.657s (SENT)
I20260709 12:21:13.790731 14132 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:13.788082 14131 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:13.791513 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.792580 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.794653 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:13.796906 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 58579.8us
I20260709 12:21:13.797585 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.798524 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.799124 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.800720 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.802264 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.802853 11007 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
W20260709 12:21:13.804271 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 104553us
I20260709 12:21:13.804759 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.783061 11009 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:21:13.806309 11008 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:13.809198 14131 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:13.811440 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.812215 11082 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:13.807061 14132 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:13.815603 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.816208 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.817081 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.817675 11083 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:13.821667 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:13.822734 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:13.822934 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.823678 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.824373 11657 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:13.807237 14139 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.827958 14139 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.823630 11083 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:21:13.829193 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.830098 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.830495 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.830725 11084 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
W20260709 12:21:13.831475 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.823046 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:13.832089 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.831319 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:13.835678 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.836210 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.836834 11082 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:13.838864 14131 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:13.839582 14115 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.841934 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.842734 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.843933 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.844485 11655 raft_consensus.cc:1240] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:13.841267 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.842303 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.847237 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.844533 11085 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:21:13.847311 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.848847 10933 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:13.849522 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.848868 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.839377 14122 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.851219 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.849850 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.850077 14081 consensus_queue.cc:1059] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:13.851531 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.852159 10931 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:13.852218 10928 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 3.
I20260709 12:21:13.852370 14119 raft_consensus.cc:3055] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:13.852849 14119 raft_consensus.cc:740] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:13.853628 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.853726 14119 consensus_queue.cc:260] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.854413 14132 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.855388 14119 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:13.853987 14122 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.856294 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:13.856673 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:13.856382 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:13.857295 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.858434 14132 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.860096 14098 consensus_queue.cc:1059] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:13.860517 14133 raft_consensus.cc:1064] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:21:13.853986 11656 raft_consensus.cc:1240] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:13.864825 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:13.862916 14133 consensus_queue.cc:237] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.866634 14098 raft_consensus.cc:3055] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:13.867033 14098 raft_consensus.cc:740] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:13.868062 14098 consensus_queue.cc:260] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.869297 14098 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:13.859179 14115 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:13.873389 14081 consensus_queue.cc:1059] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:13.874882 14079 raft_consensus.cc:3055] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:13.875298 14079 raft_consensus.cc:740] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:13.889045 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.892015 14079 consensus_queue.cc:260] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.892521 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:13.893380 14079 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:13.896221 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.902802 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:13.904701 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.905237 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.905520 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:13.903198 11624 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:13.906706 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:13.906849 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:13.908428 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.908623 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.909621 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.914067 14132 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:13.914616 14132 raft_consensus.cc:697] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:13.915347 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.915556 14132 consensus_queue.cc:237] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:13.916045 11079 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:13.918427 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.919092 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.920694 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.922027 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.922696 11655 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 LEARNER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:13.921958 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.924840 11080 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:13.927493 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.929494 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.932314 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.932976 10931 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:13.934700 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.935992 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.929718 10928 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:13.938675 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.938953 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.940220 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.941504 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.942116 11082 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:21:13.942176 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.953694 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.954612 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.952991 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.962667 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.964753 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.966022 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.967299 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.968281 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.968997 10928 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:21:13.969518 14128 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:13.971657 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.977684 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.977845 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.978929 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:13.982767 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.987987 11657 raft_consensus.cc:1240] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:13.991568 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:13.993350 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.999467 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:14.001191 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.003686 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.005272 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:14.006799 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:14.008064 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.008275 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.009716 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.011312 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.013360 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.009585 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:14.014513 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:13.993330 14112 consensus_queue.cc:1059] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:21:14.015486 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.016376 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.016697 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.017159 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.017814 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.018234 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.018919 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.019316 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.020200 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.020394 11009 raft_consensus.cc:1240] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:14.009660 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:14.020525 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.025592 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.025650 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.036156 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.034297 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.036649 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.037428 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.038470 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.036886 10935 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:21:14.040421 10901 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:14.040740 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.040309 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.042536 10901 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:14.044005 10929 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:21:14.045467 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.048564 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.049129 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.044919 10901 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:14.050827 10901 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.052455 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:14.052963 10901 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:14.055003 10901 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:14.060983 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.058807 14077 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:14.064929 14077 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:14.065081 14083 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:14.065369 14077 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:14.054018 14081 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:14.068362 14081 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:14.058019 14080 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:14.068794 14081 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:14.047302 14079 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:14.071441 14079 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:14.071883 14079 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:14.076356 14134 raft_consensus.cc:3055] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:14.076824 14134 raft_consensus.cc:740] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:14.077683 14134 consensus_queue.cc:260] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:14.079103 14134 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:14.046593 14119 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:14.080150 14119 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:14.080571 14119 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:14.082923 14077 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.084492 14083 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:14.085582 14083 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:14.086396 14077 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.087992 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.089365 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:14.101449 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:14.101750 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:14.068738 10830 catalog_manager.cc:5697] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 5 to 6, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 6 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:14.110474 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:14.116748 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.119396 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:14.120739 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.129047 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.132381 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:14.136667 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:14.138667 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:14.146273 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:14.150514 10977 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:14.151712 14130 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:14.152137 14130 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:14.152484 14130 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:14.152876 10977 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.156035 14095 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:14.160751 10977 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:14.161939 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 106990us
I20260709 12:21:14.162918 10901 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:14.163915 10901 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:14.165009 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:14.166241 10901 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:14.166797 14077 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:14.166821 14095 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:14.167701 14080 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:14.176987 11008 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:14.186129 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.188977 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.190315 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.190743 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.191478 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.173588 14081 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.197459 14081 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.177508 14080 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:14.200317 14080 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:14.200687 14081 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:14.204113 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.204843 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.173803 14077 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:14.205492 14077 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:14.210706 11657 raft_consensus.cc:1240] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:14.189100 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.218570 14077 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.233989 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:14.203459 14081 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:14.236338 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.236969 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:21:14.238749 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.238807 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.242527 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:14.245050 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:14.246994 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.247140 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:14.218515 14149 consensus_queue.cc:1059] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:21:14.241207 14081 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:14.256134 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.256997 11083 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:21:14.256114 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.261333 11050 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:14.268227 14136 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:14.268674 14136 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:14.269049 14136 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:14.272284 14119 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.274670 14119 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:14.277109 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.277572 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.281796 10934 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
W20260709 12:21:14.277051 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 110863us
I20260709 12:21:14.283835 10901 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:14.243767 14083 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.276392 14079 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.288380 10901 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:14.296748 10901 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:14.298169 14079 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.300261 14079 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:14.300755 14079 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:14.301193 14079 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:14.290278 14083 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.304454 14083 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:14.304865 14083 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:14.305244 14083 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:14.290547 14149 raft_consensus.cc:3055] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:14.294796 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.295326 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.295521 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.289250 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:14.307956 14119 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:14.308135 11078 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:21:14.308401 14119 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:14.308923 14130 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.311115 14130 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.308812 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:14.307178 14149 raft_consensus.cc:740] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:14.313349 14149 consensus_queue.cc:260] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:14.314379 14149 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:14.317689 14080 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.308840 14119 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:14.324963 11050 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.325841 14133 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:14.327247 11050 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.327999 14133 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:14.330044 10936 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 3.
W20260709 12:21:14.336617 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 47779.3us
I20260709 12:21:14.355419 11625 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.358549 11625 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.362166 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.333755 11050 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.365955 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:14.367273 10899 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.319969 14080 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:14.377789 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 44097.8us
I20260709 12:21:14.380402 14158 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:14.380935 11625 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.381705 14153 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:14.382387 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 85704.1us
I20260709 12:21:14.415784 10901 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:14.379097 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:14.416236 10899 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.383708 14134 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:14.373364 14112 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:14.385223 14133 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:14.411211 11050 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.360102 14122 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:14.419272 10899 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.419699 14153 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:14.425194 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 167027us
W20260709 12:21:14.426218 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 45396.1us
I20260709 12:21:14.411286 14077 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.432536 11625 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.424691 14080 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:14.424002 14114 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:14.427543 14132 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:14.424726 14134 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:14.464272 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 53127.9us
I20260709 12:21:14.438709 14115 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:14.441607 14080 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:14.461289 14077 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:14.460745 14114 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:14.469535 14098 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:14.465786 14134 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:14.476994 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.478988 10974 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:14.479380 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.466137 14132 raft_consensus.cc:697] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:14.480949 10974 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.475773 14080 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:14.477411 14114 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:14.476343 14115 raft_consensus.cc:697] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:14.488744 10974 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.489617 14130 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:14.500712 14115 consensus_queue.cc:237] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:14.502079 14105 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:14.502521 14105 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:14.502903 14105 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:14.506598 14136 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.488214 14112 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:14.508726 14112 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:14.509559 14112 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:14.512274 14079 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.508962 14136 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:14.515897 10974 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.514873 14079 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.532887 10974 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:14.524611 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 59171.7us
I20260709 12:21:14.503429 14083 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.499372 14081 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.538848 11009 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:14.544163 14166 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:14.538398 14094 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:14.548105 14081 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.548717 14083 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.549921 14130 raft_consensus.cc:993] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:21:14.550431 14131 raft_consensus.cc:1081] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:21:14.551726 11051 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.544121 10974 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.552925 14130 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:14.553345 14130 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:14.553767 14130 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:14.543380 14119 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.557955 14119 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.542726 14105 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.560505 10974 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.561316 14095 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:14.562741 10974 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.563508 14095 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:14.564739 10974 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:14.565934 14132 consensus_queue.cc:237] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:14.566570 14095 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:14.566967 14095 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:14.567327 14095 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:14.571234 14161 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:14.573995 14114 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:14.575739 10974 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.576565 11051 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.577438 10974 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:14.577478 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 141448us
I20260709 12:21:14.579479 14169 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:14.578830 14131 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:14.581447 14134 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:14.584306 14134 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:14.578965 10901 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:14.585680 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:14.587554 14119 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:14.579877 14080 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.592479 14119 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:14.592978 14119 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:14.579465 14116 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:14.559537 14112 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.590139 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:14.588963 14114 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:14.595207 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 182478us
I20260709 12:21:14.601259 14080 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.603824 14039 tablet_copy_client.cc:538] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:14.604735 14172 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:14.606066 14172 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:14.606474 14172 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:14.607503 11051 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.611405 14164 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:14.578953 10974 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.620623 14114 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:14.621050 14114 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:14.621555 14114 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:14.623026 14130 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.609138 14095 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:14.628062 11008 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:14.628244 14105 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.624686 14170 raft_consensus.cc:993] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:21:14.631496 14080 raft_consensus.cc:1081] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:21:14.629333 11051 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.633131 14164 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:14.633522 14164 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:14.609510 14112 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.633602 14158 consensus_queue.cc:1059] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:14.633987 14164 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:14.633754 11051 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.635039 14133 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:14.620995 10974 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.635485 11051 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.636534 10974 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.636698 14173 raft_consensus.cc:3055] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:14.637151 14173 raft_consensus.cc:740] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:14.622035 10901 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:14.636750 14136 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:14.637815 14136 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:14.638221 14136 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:14.638046 14173 consensus_queue.cc:260] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:14.634989 14095 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:14.639328 14173 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:14.640736 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:14.640993 14170 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:14.641502 10974 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.641757 14116 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:14.642411 14116 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:14.642765 14116 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:14.642853 14130 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.643208 14116 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:14.643474 10974 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.644655 10974 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.644910 14166 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:14.645346 14166 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:14.645696 14166 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:14.649737 14136 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.638756 10901 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:14.651531 14153 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:14.651976 14153 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:14.652344 14153 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:14.660045 14116 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.641425 14170 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:14.661273 14170 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:14.662282 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 243058us
I20260709 12:21:14.663110 10899 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:14.664325 11051 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.664999 10974 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:14.669989 14080 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:14.670507 14080 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:14.670866 14080 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:14.672719 14112 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:14.673161 14174 raft_consensus.cc:993] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:21:14.660048 14153 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.673723 14174 raft_consensus.cc:1081] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Signalling peer 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:21:14.674293 14136 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:14.675384 14153 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.662313 10901 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:14.679932 11051 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.681385 10901 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:14.681658 10974 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.683130 11051 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.683440 10901 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:14.687291 10974 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.679216 14130 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:14.689127 10974 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.689842 14155 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:14.688535 14136 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:14.691102 14095 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:14.686703 14134 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:14.688380 14169 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:14.687505 14153 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:14.693342 14153 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:14.693804 14153 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:14.688388 11051 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.673197 14112 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:14.696297 14112 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:14.696972 14039 tablet_bootstrap.cc:492] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:21:14.697177 10974 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.698704 11051 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.699607 14169 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:14.700057 14169 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:14.700399 14169 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:14.699815 14133 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:14.703349 11657 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:14.688251 14083 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:14.704214 14083 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:14.704587 14083 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:14.704713 14116 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.705510 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.705976 10974 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.679184 14114 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.739684 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.714541 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.737159 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.707227 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:21:14.729592 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.743152 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.706888 11051 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.744619 11011 raft_consensus.cc:1240] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:14.682482 14162 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:14.747553 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.749586 11051 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.748238 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.750756 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.752274 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.745749 10974 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.748370 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.688503 14081 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:14.724767 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.755147 11051 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.698791 14105 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:14.640645 14119 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:14.758150 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 85841.9us
I20260709 12:21:14.757678 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.678326 14166 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.758885 10899 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.756465 10974 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.767092 14170 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.770785 14112 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.773002 14119 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.772780 14172 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.691547 14079 consensus_queue.cc:1059] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:21:14.794211 10929 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:14.777298 10899 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.707672 14116 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:14.777877 10974 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.778282 11051 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.753372 14130 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:14.782856 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.783514 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.757217 14081 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:14.789038 14153 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.758479 14096 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:14.776479 14156 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:14.786897 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.819962 14174 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:14.820360 14174 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:14.787544 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.776505 14162 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:14.758339 14095 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:14.802721 14175 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:14.821813 14175 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:14.822227 14175 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:14.822863 14172 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:14.823028 14114 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.829212 14153 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.829730 14166 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.833492 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.816406 14094 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:14.836982 14112 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.811805 14169 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.838313 14083 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:14.820779 14170 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.841874 10833 catalog_manager.cc:5697] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 5 to 6, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 6 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:14.843703 10833 catalog_manager.cc:5697] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 2 to 3, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 3 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:14.846585 14083 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.801721 10975 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:14.781906 14131 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:14.807610 10899 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.849653 10899 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.850754 10899 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.762758 14105 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:14.852108 14105 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:14.839068 14169 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:14.756660 11006 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37586
I20260709 12:21:14.802151 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:14.800654 14079 raft_consensus.cc:3055] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:14.772781 14080 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:14.699220 14164 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.753628 14133 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:14.814985 10974 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.853403 11006 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:14.854694 11006 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:14.817544 11007 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:14.819520 14081 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:14.819594 14096 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:14.853363 11051 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.855384 14170 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:14.855758 14156 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:14.856694 14169 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:14.856927 14080 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:14.858083 14164 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:14.855417 14131 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:14.855396 14096 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:14.860066 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 58534.3us
I20260709 12:21:14.860486 14077 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:14.860900 14077 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:14.861269 14077 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:14.863982 14105 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.866418 14116 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:14.820708 14174 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:14.867290 14096 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.868739 14116 raft_consensus.cc:697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:14.855427 10974 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.870507 14105 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.870714 14112 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:14.869750 14116 consensus_queue.cc:237] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:14.872354 10899 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.874831 10899 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.874997 10974 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.876060 14153 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:14.876446 14153 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:14.876804 14159 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:14.877028 14083 consensus_queue.cc:1059] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:14.878079 14170 raft_consensus.cc:3055] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:14.878419 14170 raft_consensus.cc:740] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:14.872262 14079 raft_consensus.cc:740] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:14.881681 11003 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:14.882431 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.882809 11010 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:14.880146 14079 consensus_queue.cc:260] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:14.884389 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.884604 14079 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:14.885586 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 67695us
I20260709 12:21:14.889122 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.889400 11051 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.867053 14175 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.894016 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:14.894695 11076 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:14.879245 14170 consensus_queue.cc:260] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.895555 11077 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:14.896135 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:14.896848 11083 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:21:14.897404 11083 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:14.897747 11083 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:14.899089 14170 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:14.900965 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 45957.8us
I20260709 12:21:14.902977 14119 consensus_queue.cc:1059] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:14.903218 14152 consensus_queue.cc:1059] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:14.878430 14112 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:14.904168 14152 raft_consensus.cc:3055] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:14.904537 14152 raft_consensus.cc:740] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:14.903746 11006 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.905346 14152 consensus_queue.cc:260] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.906522 11006 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.906944 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:14.906524 14152 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:14.904104 14119 raft_consensus.cc:3055] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:14.915165 14119 raft_consensus.cc:740] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:14.918295 10899 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.920747 11051 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.921777 11006 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:21:14.869663 14096 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:14.924188 10899 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.924360 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:14.922276 11083 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.926321 11076 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:14.876814 14153 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:14.934059 11083 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:14.927738 11051 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.927843 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:14.928540 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:14.935348 11051 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.931036 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:14.931443 14156 consensus_queue.cc:1059] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:14.931778 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.895592 14175 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:14.935483 11084 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:14.936151 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.939646 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.940378 11011 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:14.940747 11051 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.929760 10899 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.957592 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.958122 11051 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.959036 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.959287 11051 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.960130 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.960407 11051 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.955376 14119 consensus_queue.cc:260] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.963593 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:14.964157 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.964457 14119 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:14.964998 11080 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:14.964982 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:14.965777 14162 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:14.966482 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:14.966763 14098 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:14.966795 14096 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:14.968056 11006 raft_consensus.cc:3055] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:14.973600 11006 raft_consensus.cc:740] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:14.965714 11079 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:14.968822 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:14.969318 11051 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.923466 14169 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:14.970422 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:14.955173 14172 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:14.931143 14133 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:14.971418 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:14.927259 14083 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:14.979105 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 49425.1us
I20260709 12:21:14.976544 11006 consensus_queue.cc:260] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:14.948504 14136 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:14.981248 11006 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:14.981374 10899 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.977228 11051 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:14.950946 14159 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:14.992797 10899 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:14.928169 14164 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:21:14.926206 14115 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:21:14.974730 14163 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:14.978590 14172 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:21:15.009438 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 48872.5us
I20260709 12:21:14.980691 14133 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:15.025797 11006 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:14.980576 14149 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:14.956791 14081 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:14.974923 14112 consensus_queue.cc:1059] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:21:14.981249 14131 consensus_queue.cc:1059] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:21:15.012353 14169 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:14.988466 14105 consensus_queue.cc:1059] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:21:15.038834 14170 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:15.030746 14096 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:15.014587 14172 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:15.016958 14077 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.028028 14133 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:15.014065 14163 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:15.043118 10929 raft_consensus.cc:1240] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:15.044281 11079 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:15.026364 14159 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:15.054761 14163 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:15.050307 11084 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:21:15.054487 10974 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:21:15.058914 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 81769.9us
I20260709 12:21:15.060756 11004 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:15.060869 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:15.057335 14080 raft_consensus.cc:3055] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:15.075481 14080 raft_consensus.cc:740] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:15.076438 14080 consensus_queue.cc:260] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.077893 14080 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:15.078186 14081 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:15.069844 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:15.058007 14174 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.077100 14077 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:15.082010 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 89256.6us
I20260709 12:21:15.082613 11078 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:15.087251 14174 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:15.087990 14094 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:15.084077 10974 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:15.090987 11051 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:15.092914 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.093701 14187 consensus_queue.cc:1059] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:15.094842 14187 raft_consensus.cc:3055] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:15.095208 14187 raft_consensus.cc:740] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:15.100215 14175 consensus_queue.cc:1059] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:15.101382 14175 raft_consensus.cc:3055] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:15.101742 14175 raft_consensus.cc:740] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:15.102638 14175 consensus_queue.cc:260] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.104079 14094 raft_consensus.cc:697] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:15.105068 14094 consensus_queue.cc:237] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.124096 14187 consensus_queue.cc:260] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.126775 11004 raft_consensus.cc:1240] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:15.128146 14130 raft_consensus.cc:3055] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:15.134016 14130 raft_consensus.cc:740] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:15.134352 14187 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:15.135012 14130 consensus_queue.cc:260] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.136292 14130 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:15.115003 14166 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:15.112809  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:15.140232 14166 raft_consensus.cc:697] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:15.130719 14188 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:15.133175 14174 consensus_queue.cc:1059] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:15.141258 14166 consensus_queue.cc:237] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.142138 14174 raft_consensus.cc:3055] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:15.142513 14174 raft_consensus.cc:740] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:15.143574 14174 consensus_queue.cc:260] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.145004 14174 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:15.132359 14116 raft_consensus.cc:3055] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:15.148281 14116 raft_consensus.cc:740] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:15.149228 14116 consensus_queue.cc:260] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.103806 14175 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:15.150486 14116 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:15.132697 14105 consensus_queue.cc:1059] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:21:15.131994 14167 raft_consensus.cc:3055] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:15.154769 14167 raft_consensus.cc:740] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:15.155666 14167 consensus_queue.cc:260] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.157013 14167 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:15.159919 14172 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.160696 14105 raft_consensus.cc:3055] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:15.161106 14105 raft_consensus.cc:740] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:15.161945 14105 consensus_queue.cc:260] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.163255 14105 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:15.131309 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 50623.1us
I20260709 12:21:15.150565 14153 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.130874 11051 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:15.171185 11051 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:15.171428 14136 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:15.179299 11051 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:15.182082 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:15.184508 10930 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:21:15.184702 14083 consensus_queue.cc:1059] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:15.186025 10929 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:15.186661 11051 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:15.189407 11004 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:15.195060 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:15.196686 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:15.195674 10928 raft_consensus.cc:1240] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:15.198915 11078 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:15.198669 14133 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.199769 14169 consensus_queue.cc:1059] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:15.200155 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:15.200824 14169 raft_consensus.cc:3055] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:15.201159 14133 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:15.202075 14172 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:15.188814 14162 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:15.203940 14164 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:15.195348 14173 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:21:15.192499 14136 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:15.208870 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:15.210558 14153 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:15.208917 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:15.212945 11050 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:15.214246 14136 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:15.214495 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:15.216447 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:15.216735 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:15.217064 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:15.212216 11084 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:15.217758 10932 raft_consensus.cc:2393] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 6: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:15.215565 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:15.218287 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:15.220049 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:15.220927 11002 raft_consensus.cc:1240] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:15.226074 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:15.216221 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:15.229153 10929 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 3: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:15.229312 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:15.232108 10977 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:15.236590 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:15.236941 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:15.238449 14130 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:15.231317 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:15.242208 14136 raft_consensus.cc:697] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:15.243122 14039 tablet_bootstrap.cc:492] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:15.243258 14136 consensus_queue.cc:237] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.244151 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:15.244653 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:15.246191 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:15.249743 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:15.251523 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:15.192823 14083 raft_consensus.cc:3055] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:15.252068 14083 raft_consensus.cc:740] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:15.252576 14161 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:15.252852 14083 consensus_queue.cc:260] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.254036 14083 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:15.232195 14132 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:21:15.257889 11009 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:15.262478 10928 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:21:15.264201 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:15.264199 11079 raft_consensus.cc:1240] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:15.265904 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:15.259727 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:15.267490 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:15.268240 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:15.263754 10934 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:21:15.272352 14039 tablet_bootstrap.cc:492] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:21:15.272567 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:15.274104 10927 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:15.276077 11078 raft_consensus.cc:1240] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5. Ops: []
W20260709 12:21:15.276489 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 52383.4us
I20260709 12:21:15.277794 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:15.278970 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:15.279753 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:15.201182 14169 raft_consensus.cc:740] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:15.274724 11622 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:15.283212 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:15.286929 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:15.288934 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:15.297778 10899 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:15.285372 10977 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:15.247534 14163 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.301318 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:15.303162 10899 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:15.304737 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:15.305751 10899 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:15.306959 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:15.307572 11081 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:15.307569 10927 raft_consensus.cc:3055] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:15.305876 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:15.323323 14169 consensus_queue.cc:260] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:15.328176 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:15.329404 10977 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:15.329738 14167 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:15.331544 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:15.332476 14112 consensus_queue.cc:1059] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:15.333623 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:15.334182 14166 raft_consensus.cc:3055] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:15.334596 14166 raft_consensus.cc:740] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:15.335577 14166 consensus_queue.cc:260] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.334796 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:15.337296 14166 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:15.338493 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:15.304610 14175 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:15.341310 11084 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:15.305799 14039 ts_tablet_manager.cc:1403] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 0.609s	user 0.022s	sys 0.020s
I20260709 12:21:15.345633 10977 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:15.346109 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:15.347361 10936 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:15.352596 11082 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:15.353757 14039 raft_consensus.cc:359] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:15.354622 14039 raft_consensus.cc:740] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:21:15.310582 14185 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:15.284343 14081 consensus_queue.cc:1059] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 12:21:15.306849 14080 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:15.356930 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:15.358299 10931 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:15.359480 10931 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:15.362104 10931 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:43556
I20260709 12:21:15.363171 10931 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:15.363965 10931 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:15.365897 10929 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:15.368096 10929 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:15.358929 11077 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:21:15.313699 11622 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:21:15.372552 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 58934.3us
I20260709 12:21:15.306967 14115 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:15.317027 11009 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:15.277216 14132 consensus_queue.cc:1059] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:21:15.322857 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:15.310637 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:15.312493 10927 raft_consensus.cc:740] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:15.324949 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:15.370754 10929 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:15.371214 11076 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:15.359462 10933 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:15.371480 11051 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:15.372784 14161 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:15.308157 10899 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:15.374184 11622 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:21:15.386436 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 78357.5us
I20260709 12:21:15.387583 10899 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:15.377429 11084 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:21:15.377470 11003 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:15.381179 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:15.384866 11051 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:15.392215 10899 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:15.392743 11051 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:15.393494 10899 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:15.394623 11051 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:15.369901 14130 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:15.398082 11051 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:15.400403 10899 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:15.402204 11051 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:15.419822 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 45716.3us
I20260709 12:21:15.374302 14170 consensus_queue.cc:1059] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:21:15.396328 10927 consensus_queue.cc:260] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.386929 14189 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:15.423334 10927 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:15.421465 10899 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:15.391038 14184 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:15.407318 10936 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:15.425244 14185 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:15.401528 14077 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:15.407682 10977 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:15.378876 14081 consensus_queue.cc:1243] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:21:15.395896 14096 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:21:15.469131 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 67008.5us
I20260709 12:21:15.386123 14182 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:15.483850 14164 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:21:15.474643 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 53758.7us
I20260709 12:21:15.401876 14079 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:15.402123 14167 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:15.400221 14098 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:15.417807 14172 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:15.417330 14174 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:15.417305 14115 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:15.390710 14105 consensus_queue.cc:1059] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 12:21:15.582142 14105 raft_consensus.cc:3055] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:15.582552 14105 raft_consensus.cc:740] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:15.582931 10933 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:15.396756 14175 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:15.483914 10934 raft_consensus.cc:1240] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:15.585517 10934 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:15.422540 14158 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:15.401919 14112 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 12:21:15.493893 10936 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10. Ops: []
W20260709 12:21:15.506285 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 84920.2us
W20260709 12:21:15.539052 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:15.572018 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 165783us
I20260709 12:21:15.425174 14039 consensus_queue.cc:260] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:15.490185 14161 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:15.487501 14094 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:15.475914 14131 consensus_queue.cc:1059] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 12:21:15.582645 14191 log.cc:927] Time spent T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.325s	user 0.003s	sys 0.000s
I20260709 12:21:15.422747 14130 raft_consensus.cc:697] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:21:15.585732 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 84376.7us
I20260709 12:21:15.595897 10899 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:15.618366 10899 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:15.619478 10899 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:21:15.611971 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 93515.1us
I20260709 12:21:15.586139 14189 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:15.640228 14189 raft_consensus.cc:697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:15.619203 14161 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:15.641335 14189 consensus_queue.cc:237] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.614735 10936 raft_consensus.cc:1240] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:15.585563 14194 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.630800 14163 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:15.628978 14130 consensus_queue.cc:237] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.646317 14083 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:15.645910 14194 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:15.597370 14158 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:15.650153 14194 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:15.652271 14158 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:15.597640 14136 consensus_queue.cc:1059] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:21:15.530629 14133 consensus_queue.cc:1059] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:21:15.668999 14182 consensus_queue.cc:1059] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:15.669775 14133 raft_consensus.cc:3055] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:15.670166 14133 raft_consensus.cc:740] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:15.671057 14133 consensus_queue.cc:260] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.631553 10899 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:21:15.678367 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 46917.1us
I20260709 12:21:15.679467 10899 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:15.632773 11051 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:15.633416 14081 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:15.636170 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:15.678092 10931 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:15.683002 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 50322.2us
I20260709 12:21:15.686554 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:15.687175 10936 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:15.686671 10899 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:15.638517 10932 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 4. Current term is 5. Ops: []
W20260709 12:21:15.646077 14195 log.cc:927] Time spent T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:21:15.624046 14079 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:15.657912 10930 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:15.664815 14161 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:15.667923 14039 ts_tablet_manager.cc:1434] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.324s	user 0.008s	sys 0.003s
I20260709 12:21:15.724737 14173 raft_consensus.cc:3055] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:15.725185 14173 raft_consensus.cc:740] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:15.726014 14173 consensus_queue.cc:260] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:15.682691 14119 consensus_queue.cc:1059] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:21:15.726994 14173 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:15.668318 14136 raft_consensus.cc:3055] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:15.727773 14119 raft_consensus.cc:3055] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:15.728029 14136 raft_consensus.cc:740] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:15.728884 14136 consensus_queue.cc:260] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.583426 14105 consensus_queue.cc:260] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.680294 10927 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:15.689728 11622 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:15.688508 14077 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:15.682595 14183 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:15.699776 10928 raft_consensus.cc:1240] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:15.670171 14182 raft_consensus.cc:3055] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:15.709024 10899 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:15.709229 10936 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:21:15.682849 14175 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:15.716827 14153 raft_consensus.cc:3055] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:15.699193 14197 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:21:15.695461 14128 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:15.712359 14080 consensus_queue.cc:1059] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:21:15.710511 14170 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:21:15.720302 14192 log.cc:927] Time spent T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.237s	user 0.003s	sys 0.000s
I20260709 12:21:15.720644 11077 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:15.709146 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:15.731850 11080 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:15.738517 11050 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:15.763329 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:21:15.745764 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 56108.7us
I20260709 12:21:15.730020 14136 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:15.747288 11085 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:15.749249 10899 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:15.745645 11656 raft_consensus.cc:1217] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:21:15.750368 10934 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 8. Ops: []
I20260709 12:21:15.730356 14119 raft_consensus.cc:740] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:15.755805 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:15.758394 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:15.750748 14161 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:15.747843 14182 raft_consensus.cc:740] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:15.759255 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:15.773231 11011 raft_consensus.cc:2393] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 9: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:15.758589 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:15.765194 11009 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:21:15.751775 14077 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:15.773393 14182 consensus_queue.cc:260] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.774179 11076 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8.
I20260709 12:21:15.758720 11051 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:15.751751 14153 raft_consensus.cc:740] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:21:15.776268 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.755824 14105 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:15.782580 14169 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:15.784466 11657 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:21:15.788110 14149 raft_consensus.cc:3055] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:15.789824 11009 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:15.791543 10899 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:15.792471 14119 consensus_queue.cc:260] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.790849 14077 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:15.804663 14079 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:15.800596 14149 raft_consensus.cc:740] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:15.807192 14166 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:15.776108 14162 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:21:15.811192 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.814733 10931 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:15.803392 10899 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:15.816143 14183 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:15.807126 14149 consensus_queue.cc:260] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.796782 14098 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:15.818166 10899 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:15.772403 11655 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
W20260709 12:21:15.910136 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 92062.4us
I20260709 12:21:15.911021 10899 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:15.912292 10899 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:21:15.908984 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 116171us
I20260709 12:21:15.828399 14153 consensus_queue.cc:260] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:15.915340 10977 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:21:15.917989 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 99031.1us
I20260709 12:21:15.918452 10977 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:15.919510 10977 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:21:15.916956 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:15.923172 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:15.913866 14205 log.cc:927] Time spent T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260709 12:21:15.925326 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 120864us
I20260709 12:21:15.801378 14130 consensus_queue.cc:1059] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
W20260709 12:21:15.928371 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 167697us
I20260709 12:21:15.933244 10975 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:15.917495 14080 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:15.914145 14079 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:15.920852 14183 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:15.935983 11009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:21:15.920187 14162 raft_consensus.cc:697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:15.935822 14166 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:15.924656 14182 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:15.953330 14187 consensus_queue.cc:1059] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:15.937327 11051 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:15.940801 11009 raft_consensus.cc:606] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:15.925828 14112 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:15.940407 14200 consensus_queue.cc:1059] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:21:15.948668 14133 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:15.944212 14202 raft_consensus.cc:2804] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:15.923189 14206 consensus_queue.cc:1059] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:21:15.927536 14155 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:16.021126 14172 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:21:16.022924 14207 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:21:15.928081 14174 consensus_queue.cc:1059] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 12:21:15.982185 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 44938.3us
I20260709 12:21:15.936590 14096 consensus_queue.cc:1059] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 12:21:15.941147 14080 raft_consensus.cc:697] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:16.035509 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:16.037958 11076 raft_consensus.cc:3055] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:16.038293 11076 raft_consensus.cc:740] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:15.980805 14114 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:16.038908 11083 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:15.983768 14163 raft_consensus.cc:3055] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:16.040902 11076 consensus_queue.cc:260] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.030623 14202 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.983151 14166 raft_consensus.cc:697] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:15.954727 14183 raft_consensus.cc:697] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:15.944691 14164 consensus_queue.cc:1059] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:21:16.034544 14172 raft_consensus.cc:697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:16.057828 14172 consensus_queue.cc:237] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.059499 11077 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:21:16.032583 14112 raft_consensus.cc:697] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:15.940997 14128 consensus_queue.cc:1059] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
W20260709 12:21:15.424575 14159 consensus_queue.cc:1175] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2201bad9e18849b09cf82de29dd032d3" responder_term: 7 status { last_received { term: 7 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:21:16.053897 14080 consensus_queue.cc:237] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.053921 11095 tablet_copy_service.cc:342] P 1abf4b385a2b493ab83f593a1f8c9cd1: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-c1b75831227444d382e9c0fc5b367564 received from {username='slave'} at 127.0.0.1:40200
I20260709 12:21:16.055322 11009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:21:16.070152 11009 raft_consensus.cc:606] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:16.055692 14167 raft_consensus.cc:3055] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:16.052011 14201 raft_consensus.cc:3055] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:16.039215 14155 raft_consensus.cc:697] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:16.068652 11076 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:21:16.072216 14201 raft_consensus.cc:740] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:16.077116 14201 consensus_queue.cc:260] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.078845 14201 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:16.087672 11083 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:16.045753 14163 raft_consensus.cc:740] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:16.081597 14164 raft_consensus.cc:3055] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:16.050781 14202 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:16.072463 14167 raft_consensus.cc:740] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:16.120246 11085 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:21:16.049365 14114 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:16.122285 11076 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
W20260709 12:21:16.129011 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.110785 14164 raft_consensus.cc:740] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:16.131286 10931 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:16.132614 10901 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:16.110707 11095 tablet_copy_service.cc:434] P 1abf4b385a2b493ab83f593a1f8c9cd1: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-c1b75831227444d382e9c0fc5b367564 on tablet c1b75831227444d382e9c0fc5b367564 with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:16.140769 10936 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:16.142752 10934 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:16.137372 11076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83b4e206b7694af695234c0e758055e2"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:21:16.112087 14094 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:21:16.146131 10933 raft_consensus.cc:1240] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:16.145846 14155 consensus_queue.cc:237] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.112337 14130 consensus_queue.cc:1059] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:21:16.136765 14170 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.143894 14079 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:16.178145 10936 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:16.113232 14162 consensus_queue.cc:237] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.182435 10936 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:16.157972 14200 consensus_queue.cc:1059] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:21:16.185396 10933 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:16.174597 14170 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:16.164108 14188 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
W20260709 12:21:16.202822 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.189615 10936 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:21:16.199340 10929 raft_consensus.cc:1240] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:16.193562 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:16.180086 14079 raft_consensus.cc:697] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:16.161330 14096 consensus_queue.cc:1059] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:21:16.175483 14218 consensus_queue.cc:1059] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:21:16.221556 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:16.221035 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:16.222352 10927 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 6: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:16.222357 10935 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
I20260709 12:21:16.160235 14166 consensus_queue.cc:237] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.182734 14175 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:16.228986 14175 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:16.230391 10934 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:21:16.148465 14163 consensus_queue.cc:260] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.181008 14174 consensus_queue.cc:1059] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:21:16.169103 14167 consensus_queue.cc:260] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.217599 14114 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:16.208667 14185 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:16.254223 11625 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:16.173076 14112 consensus_queue.cc:237] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.227448 14212 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.263234 11625 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:16.265802 14167 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:16.266742 14158 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:16.164660 14183 consensus_queue.cc:237] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.189225 14164 consensus_queue.cc:260] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.263199 14130 raft_consensus.cc:3055] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:21:16.328425 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 159749us
I20260709 12:21:16.308270 14161 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:16.302454 14158 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:16.265616 14185 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.309012 14130 raft_consensus.cc:740] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:16.331881 14170 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:16.301098 14212 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:16.347786 14158 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:16.370321 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:16.372084 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:16.372727 11011 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
W20260709 12:21:16.378197 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 266887us
W20260709 12:21:16.399381 14223 log.cc:927] Time spent T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:21:16.400804 14161 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:16.344303 14079 consensus_queue.cc:237] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:16.402362 14105 consensus_meta.cc:287] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.600s	user 0.010s	sys 0.001s
I20260709 12:21:16.404667 14212 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:16.406277 14158 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:16.407992 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.409533 14134 raft_consensus.cc:3055] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:16.414465 11076 raft_consensus.cc:606] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:16.462538 11076 raft_consensus.cc:614] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:16.416123 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:16.463346 11657 raft_consensus.cc:2393] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 4: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:16.417047 14153 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:16.427426 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.460852 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:16.461696 10934 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:16.467118 10934 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:16.468397 10931 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:16.465620 10936 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:21:16.476613 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:16.477227 10931 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 4.
I20260709 12:21:16.479249 14220 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.479926 14230 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:16.479771 14220 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.482669 11084 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:16.375627 14130 consensus_queue.cc:260] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.486832 11625 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:16.462248 14134 raft_consensus.cc:740] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:16.477437 14131 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.497880 14219 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:21:16.500905 14188 raft_consensus.cc:3055] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:16.501329 14188 raft_consensus.cc:740] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:16.502096 14188 consensus_queue.cc:260] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.503403 14188 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:16.509629 14169 raft_consensus.cc:3055] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:16.510115 14220 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:16.480496 14185 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:16.532536 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 57349.7us
I20260709 12:21:16.534662 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:16.534592 11085 raft_consensus.cc:1240] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:16.535014 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:16.525288 14212 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:16.511834 14136 raft_consensus.cc:3055] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:21:16.549011 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.524995 14119 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:16.532718 14130 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:16.531358 14169 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:16.480473 14230 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:16.562095 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.552763 10831 catalog_manager.cc:5697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 9 to 10, leader changed from 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 10 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:16.574259 14174 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:16.586079 11003 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:16.582890 10831 catalog_manager.cc:5697] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 6 to 7, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 7 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:16.589130 11085 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:16.587809 10831 catalog_manager.cc:5697] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 4 to 5, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 5 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:16.590875 11077 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:16.591689 11076 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:16.585677 14155 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.594161 14155 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.595449 14116 raft_consensus.cc:993] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:21:16.595956 14116 raft_consensus.cc:1081] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:21:16.555677 14219 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:16.607412 11076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:21:16.539999 14182 consensus_queue.cc:1059] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:21:16.555831 14172 consensus_queue.cc:1059] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:21:16.615270 10931 raft_consensus.cc:1240] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:16.616997 14231 consensus_queue.cc:1059] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:16.622303 14128 raft_consensus.cc:3055] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:16.622808 14128 raft_consensus.cc:740] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:16.626149 10931 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:16.603132 14174 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:16.628855 14133 consensus_meta.cc:287] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.598s	user 0.007s	sys 0.003s
I20260709 12:21:16.629977 14174 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:16.631963 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:16.632495 14158 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:16.632766 10931 raft_consensus.cc:2393] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:16.634238 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:16.580611 14134 consensus_queue.cc:260] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.635881 14134 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:16.636519 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:16.637079 11084 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:16.639990 14095 consensus_queue.cc:1175] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" responder_term: 8 status { last_received { term: 7 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:21:16.642141 14169 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.643360 14169 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:16.530745 14131 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:16.645241 14203 consensus_queue.cc:1059] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.167s
I20260709 12:21:16.647440 14248 raft_consensus.cc:3055] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:16.648331 14248 raft_consensus.cc:740] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:16.649506 14248 consensus_queue.cc:260] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.650996 14248 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:16.656332 14201 consensus_meta.cc:287] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.577s	user 0.013s	sys 0.000s
I20260709 12:21:16.610472 14219 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.658771 10931 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:16.659099 14219 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:16.662289 10928 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:16.664976 10936 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:16.668251 14174 consensus_queue.cc:1059] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:16.672549 14175 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:16.676565 14164 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:16.677259 10936 raft_consensus.cc:1240] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:16.680605 14215 raft_consensus.cc:3055] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:16.681048 14215 raft_consensus.cc:740] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:16.681912 14215 consensus_queue.cc:260] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.683212 14215 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:16.685192 10901 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:16.693334 14159 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:16.693765 14159 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:16.694101 14159 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:16.699396 11050 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:16.700735 14229 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:16.701260 14182 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:16.702943 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:16.703912 11656 raft_consensus.cc:2393] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 6: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:16.685279 10936 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:21:16.686122 14155 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:16.689298 14174 consensus_queue.cc:1059] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:16.706914 14131 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:16.707795 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:16.708638 11002 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 9: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:16.632567 14230 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:16.690228 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:16.690913 11007 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:16.690908 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:16.721108 14149 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:16.722653 14217 raft_consensus.cc:3055] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:16.722925 11082 raft_consensus.cc:2393] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 4: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:16.723764 11082 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:21:16.724295 11082 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:16.724889 11082 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:16.703116 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:16.726727 11004 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:16.705263 14163 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:16.727515 14244 log.cc:927] Time spent T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:21:16.728649 14096 raft_consensus.cc:3055] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:16.729090 14096 raft_consensus.cc:740] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:16.729990 14096 consensus_queue.cc:260] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.711896 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:16.736653 14194 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:16.737706 14194 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:16.639757 14128 consensus_queue.cc:260] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.739477 11082 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.740262 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:16.740319 14233 consensus_queue.cc:1059] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:16.737299 11007 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:16.742342 11082 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:16.742473 14128 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:16.752007 14182 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:16.555456 14136 raft_consensus.cc:740] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:16.756805 14136 consensus_queue.cc:260] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.690043 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:16.757941 14136 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:16.758270 11079 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:16.713282 10934 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:16.761819 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:16.767948 14217 raft_consensus.cc:740] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:16.768716 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:16.769372 11081 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:21:16.773343 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:16.773994 11003 raft_consensus.cc:3055] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:16.774287 11003 raft_consensus.cc:740] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:16.717610 11085 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:16.786780 10931 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:21:16.718791 14213 raft_consensus.cc:3055] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:16.720242 14175 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:16.787163 11077 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:16.786808 11084 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
I20260709 12:21:16.551275 14212 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:16.783322 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:21:16.811900 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 63360.5us
I20260709 12:21:16.816087 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:16.816681 10928 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:16.826174 10931 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:16.784011 14133 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:16.806083 14202 consensus_meta.cc:287] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.685s	user 0.006s	sys 0.005s
I20260709 12:21:16.793150 14213 raft_consensus.cc:740] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:16.810262 14212 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:16.783947 14194 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:16.861986 14236 consensus_queue.cc:1059] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:21:16.842767 14218 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.811017 14175 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.849139 14224 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.847122 14081 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:16.848161 14220 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:16.851944 14083 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:16.841257 14182 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:21:16.908696 14224 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.906682 14236 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.947381 14236 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.913614 14081 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.952724 10901 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:16.849538 14133 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:16.960181 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.849455 14202 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:16.976857 11081 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:16.970042 11003 consensus_queue.cc:260] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:16.985208 11006 raft_consensus.cc:2368] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7.
I20260709 12:21:16.973127 14184 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:16.987838 11003 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:16.948658 14217 consensus_queue.cc:260] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
W20260709 12:21:16.996497 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 43968.9us
W20260709 12:21:16.997161 10977 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.017s	sys 0.023s
W20260709 12:21:17.000124 10977 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.018s	sys 0.023s
I20260709 12:21:16.961086 10974 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:16.909025 14218 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:17.001891 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 533804us
I20260709 12:21:17.002033 10928 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:21:17.002624 14233 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:16.936486 14220 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.003679 11081 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:16.956054 14083 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:17.008227 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 47233.1us
I20260709 12:21:17.009429 10901 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:17.003083 14201 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.012998 11003 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:21:17.018011 11051 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:17.016841 10934 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
I20260709 12:21:17.020849 11625 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:17.026947 14131 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:17.030649 14234 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:16.984642 14077 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:21:17.038211 14161 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:17.038827 14161 raft_consensus.cc:697] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:17.039783 14161 consensus_queue.cc:237] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:17.027336 14249 log.cc:927] Time spent T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:21:17.031294 14234 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.066582 11076 raft_consensus.cc:606] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:17.067068 11076 raft_consensus.cc:614] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:17.011401 14232 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.022342 14095 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:21:17.031289 14252 log.cc:927] Time spent T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:21:17.024545 14231 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.070981 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:17.072139 14234 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:17.072341 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:17.105916 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:17.025496 14174 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:17.025694 14080 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:17.018011 14096 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:17.025182 14172 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:17.106719 11010 raft_consensus.cc:2393] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 6: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:17.110582 11081 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:17.057303 14116 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:17.018368 14233 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:17.106225 10931 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:17.023438 14189 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:21:17.023751 14201 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.117182 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:17.117929 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:17.077240 14095 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:17.122591 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.057679 14184 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:21:17.105950 14079 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.114254 14080 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.120240 14174 raft_consensus.cc:697] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:21:17.168538 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 150821us
I20260709 12:21:17.176858 10927 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:17.166368 14080 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:17.179361 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:17.181247 14115 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:17.169484 14256 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:21:17.181770 14115 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:17.172255 14201 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:17.173017 14159 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:17.182700 14212 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:17.125321 14170 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.184092 14230 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:17.160784 14095 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:17.184805 14256 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:17.184492 14230 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:17.186467 14230 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:17.186539 14185 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.187119 14185 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:17.171716 14251 log.cc:927] Time spent T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:21:17.180503 14203 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:17.189445 14133 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:17.190806 14236 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:17.191390 14236 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.191831 14236 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.193331 14218 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:17.198453 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:17.198493 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:17.199781 11002 raft_consensus.cc:2393] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 9: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:17.199996 14230 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:17.200755 14134 consensus_meta.cc:287] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.000s
W20260709 12:21:17.201110 14215 consensus_meta.cc:287] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.518s	user 0.006s	sys 0.004s
I20260709 12:21:17.201691 14215 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.202319 11008 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 4.
W20260709 12:21:17.203051 14250 log.cc:927] Time spent T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 12:21:17.203162 14220 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:17.112413 14231 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.184010 14170 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.205447 14083 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:17.206061 14231 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:17.201818 11078 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:17.176584 14174 consensus_queue.cc:237] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.124063 14172 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.106971 14232 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.210438 14159 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:17.180925 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.120407 14237 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.214088 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:17.214231 11051 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:17.216087 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:17.216826 10932 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:17.224896 11051 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:17.226694 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:17.226920 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:17.227617 11077 raft_consensus.cc:2393] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 8: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:17.228617 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:17.229311 11082 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:17.156651 14153 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.258877 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:17.191033 14115 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:17.255777 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 235003us
I20260709 12:21:17.262475 11079 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:21:17.236225 14201 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:17.261312 14166 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.263876 14201 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:17.264379 14201 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:17.264959 14155 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.265445 14155 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.267488 14155 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:17.206248 14170 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:17.267997 14131 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:17.268517 14131 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.127056 14116 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:17.231148 14246 log.cc:927] Time spent T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
I20260709 12:21:17.264004 11655 raft_consensus.cc:2393] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 5: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:17.273429 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:17.274989 10932 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:17.219198 14105 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:21:17.264067 14194 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.202234 14215 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.258039 14128 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:17.211408 14079 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.231745 14218 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.271938 14220 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.282094 14231 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.258957 14153 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:17.307479 14119 consensus_meta.cc:287] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.751s	user 0.009s	sys 0.000s
I20260709 12:21:17.307847 14218 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.309789 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:17.316021 11657 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:17.274027 14166 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.292610 14128 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.282806 14175 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:17.296417 14182 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.287705 14212 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:17.312779 11081 raft_consensus.cc:2393] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 6: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:17.233225 14237 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.288395 14202 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:17.288159 14206 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.317224 14260 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.317440 14236 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:17.313566 14231 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.348347 14260 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:17.349022 14095 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.350237 14231 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:17.329188 14131 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:17.330768 14201 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.330895 14080 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.350539 14260 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:17.351022 14095 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:17.348500 14236 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.352234 14080 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:17.305658 14220 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.352458 14206 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.352972 14213 consensus_queue.cc:260] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.354059 14213 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:17.354535 10928 raft_consensus.cc:2368] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 8. Current term is 9.
I20260709 12:21:17.333441 14153 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:17.293731 14194 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.355608 14233 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:17.351748 14236 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.356415 14194 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:17.354226 14220 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:17.357102 14079 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:17.357940 14236 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:17.334780 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:17.344712 14182 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.359292 14230 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:17.359889 14201 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:17.354650 14206 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:17.360078 14182 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:17.366739 11657 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:17.370936 10975 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:17.338090 14128 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:17.371904 11011 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:17.372593 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:17.380630 11005 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:17.381662 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:17.382197 11005 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:17.384583 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:17.381778 10901 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:17.385274 11011 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:17.387240 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:17.391364 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:17.392115 11085 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 4.
I20260709 12:21:17.395140 11622 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:17.398698 11011 raft_consensus.cc:2368] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9.
I20260709 12:21:17.399937 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:17.400667 10928 raft_consensus.cc:2393] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:17.408260 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:17.408422 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:17.409272 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:17.409673 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:17.409771 10931 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:17.410408 10932 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:17.411489 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:17.409832 10929 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:17.412482 10930 raft_consensus.cc:2393] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 5: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:17.430222 10901 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:17.343982 14232 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:17.360951 14172 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:17.371814 14079 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:17.558332 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 128217us
I20260709 12:21:17.561983 10929 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:17.376994 14206 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.376879 14182 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.376981 14220 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.376897 14230 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:17.574615 10927 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:17.574411 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:17.584841 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.387312 14194 raft_consensus.cc:2804] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:17.576895 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:17.585984 10933 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:21:17.585304 11011 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:17.559103 14161 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:21:17.578924 14229 consensus_meta.cc:287] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.878s	user 0.011s	sys 0.000s
I20260709 12:21:17.596053 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:17.593696 14077 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.580854 14206 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.566159 14175 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.558969 14153 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:17.602720 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:17.608031 14201 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:21:17.608534 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.616812 11011 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:17.608873 14258 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:17.596280 14227 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.609737 14206 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:17.609935 14194 raft_consensus.cc:697] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:17.596087 14172 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:17.565932 14080 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:21:17.594300 14149 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.593982 14159 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.611018 14077 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.611871 14218 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:17.613436 14166 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:17.574795 14170 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.576552 14083 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:17.575178 14095 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.574936 14119 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.558668 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:17.626247 11005 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:21:17.630091 11011 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:21:17.594002 14232 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:17.625960 14229 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:17.597055 14230 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.624017 14153 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:21:17.646410 14248 consensus_meta.cc:287] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.993s	user 0.010s	sys 0.000s
I20260709 12:21:17.640965 14172 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.586719 14182 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:17.636380 14188 consensus_meta.cc:287] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 1.101s	user 0.009s	sys 0.018s
I20260709 12:21:17.605032 10901 leader_election.cc:400] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9.
I20260709 12:21:17.722396 10901 leader_election.cc:403] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:21:17.659529 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.635456 14116 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:17.594709 14220 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.627137 14175 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.596786 14161 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.630472 14201 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:17.633460 14258 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:17.649821 14083 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:17.687988 14119 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.727648 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:17.696940 14153 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:17.726289 14174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.004s	sys 0.010s
W20260709 12:21:17.869508 14174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.004s	sys 0.010s
I20260709 12:21:17.632961 14227 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.871681 14227 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:17.647513 14159 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.693502 14264 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:17.872354 14116 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:17.872924 14264 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.874891 14105 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:17.875336 14264 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:17.838004 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 253331us
I20260709 12:21:17.877192 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:17.877451 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:17.877717 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:17.877818 10933 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:21:17.878290 10927 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:21:17.878404 10929 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:21:17.702081 14215 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:17.729763 14164 consensus_meta.cc:287] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 1.053s	user 0.007s	sys 0.004s
I20260709 12:21:17.740020 11655 raft_consensus.cc:2368] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5.
I20260709 12:21:17.583935 14079 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.649116 14149 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:17.664695 14170 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.684860 14095 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.854744 11006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 2396) took 1471 ms. Trace:
I20260709 12:21:17.836359 14229 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.861943 14083 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:17.890575 11006 rpcz_store.cc:276] 0709 12:21:16.369860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:16.370032 (+   172us) service_pool.cc:224] Handling call
0709 12:21:17.840885 (+1470853us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b54002d9954. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:17.841038 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1412230016}
I20260709 12:21:17.862260 14175 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:17.865067 14077 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:17.879835 14266 log.cc:927] Time spent T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.232s	user 0.000s	sys 0.000s
I20260709 12:21:17.868399 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:17.900864 11083 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:17.901892 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:17.877660 10901 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:17.882539 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:17.902961 11081 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:17.884621 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:17.851195 14080 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:17.866976 14119 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:17.856881 14161 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:17.697420 14232 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:17.878245 14269 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.882210 14164 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.898044 14264 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.905908 11083 raft_consensus.cc:2393] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 7: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:17.882629 14200 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.885325 14079 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:17.877920 14219 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:17.914491 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:17.896054 14227 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:21:17.922070 10975 leader_election.cc:400] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5.
I20260709 12:21:17.933650 10975 leader_election.cc:403] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:21:17.905539 10901 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:17.914043 14077 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:17.732050 14194 consensus_queue.cc:237] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:17.899224 14149 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:17.899722 14175 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.875501 14105 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.931493 11081 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:21:17.894922 14229 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.915164 14174 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.934657 10901 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:17.893479 14116 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:17.964336 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 44189us
I20260709 12:21:17.919642 14119 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:17.955808 14131 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.929710 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:17.936939 14079 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:17.990859 11081 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
W20260709 12:21:17.990810 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 116372us
I20260709 12:21:17.917434 14080 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.966439 14149 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.927260 14269 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.955842 14077 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:17.971038 14283 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.994923 11006 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:21:17.966930 14134 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5.
I20260709 12:21:17.930832 14264 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.996227 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.009967 11005 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:21:18.010267 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.010810 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.011374 11005 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:21:17.928050 14164 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.972419 14277 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:17.933295 14200 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.013276 11011 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:18.005311 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:17.972755 14175 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.015125 11003 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:17.958344 14219 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.006616 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:18.016232 14081 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.016765 14081 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:21:18.017449 14275 log.cc:927] Time spent T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:21:18.017321 14081 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:18.018810 14270 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:21:18.020097 14081 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.020493 14105 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.020663 14081 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:18.021160 14081 raft_consensus.cc:697] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:18.006320 14149 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:18.016721 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.022738 11006 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:18.023176 14149 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.023604 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.022034 14081 consensus_queue.cc:237] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:18.024731 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.025462 11082 raft_consensus.cc:2393] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 8: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:18.026379 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.026917 11082 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:21:18.028052 14269 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.028692 14095 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.029508 14170 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.030793 14172 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.031375 14279 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:18.027771 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.016018 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.007685 10901 leader_election.cc:400] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7.
I20260709 12:21:18.009143 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.038094 10901 leader_election.cc:403] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:18.034387 11082 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:18.034858 11003 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:21:18.041644 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.004989 14077 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:17.963243 14272 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:18.032956 14116 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.052086 14272 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.052946 14159 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:17.992213 14119 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.042268 14182 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.054411 14272 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.055238 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.055449 14119 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.055907 10927 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:18.057947 14153 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:17.993196 14131 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.060623 14153 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.065495 14175 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.066787 14134 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:18.067221 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:18.067538 14130 consensus_meta.cc:287] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 1.482s	user 0.025s	sys 0.004s
I20260709 12:21:18.067337 14134 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.070794 14134 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.071224 11006 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:21:18.071789 11009 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:21:17.983019 14174 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.012192 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.072779 14264 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.073570 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.074323 11005 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:17.994985 14079 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.075235 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.074324 14174 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.076712 14174 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:18.077512 11081 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:21:18.078960 11005 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:21:18.073731 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.080595 11006 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:18.074513 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.081938 11008 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:18.033375 14201 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:18.045955 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.046645 11010 raft_consensus.cc:2393] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 8: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:18.004256 14230 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.046746 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:18.096320 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.011281 14283 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.042868 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:18.076733 14079 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.103147 14283 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.031507 14277 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:18.105520 14277 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:18.105732 14131 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.077252 14174 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:18.109597 14213 consensus_meta.cc:287] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.755s	user 0.009s	sys 0.003s
I20260709 12:21:18.109982 14174 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:18.092864 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:18.023695 14149 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:21:18.089619 14256 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:18.050400 14128 consensus_meta.cc:287] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.654s	user 0.010s	sys 0.000s
I20260709 12:21:18.049212 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.112450 14128 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.113072 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.113276 14080 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.112067 14227 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9.
I20260709 12:21:18.114018 11077 raft_consensus.cc:2368] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10.
I20260709 12:21:18.051362 14170 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:21:18.114496 14128 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.031836 14279 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.087499 11081 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:18.115195 14279 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:18.116381 11077 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:18.089233 14272 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:18.032630 14232 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:18.120445 14272 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.122574 14272 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.093737 10929 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:21:18.122794 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:21:18.094476 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.031406 14220 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.113307 10935 raft_consensus.cc:2393] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 7: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:21:18.128228 14265 log.cc:927] Time spent T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.482s	user 0.002s	sys 0.002s
I20260709 12:21:18.129052 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.129251 14077 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.129688 10935 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:18.096662 11082 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:18.097204 10927 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 4.
I20260709 12:21:18.098693 14134 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.094254 14234 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:18.131206 14077 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.098667 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.131526 14134 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.132222 10933 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:18.133180 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:18.133605 14134 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.098014 14248 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:21:18.134646 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.070923 14219 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.135146 14234 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:18.136264 14096 consensus_meta.cc:287] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 1.014s	user 0.007s	sys 0.004s
I20260709 12:21:18.137166 14234 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.137542 14256 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.138257 14215 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.138754 14215 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.140985 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.143750 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.134459 14248 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.144387 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.144407 10927 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:18.146478 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.147207 10928 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:18.045007 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.148264 11003 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:18.148454 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.149230 10929 raft_consensus.cc:2410] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:21:18.149577 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.150251 10933 raft_consensus.cc:1240] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:18.150626 14224 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.151149 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2248) took 1097 ms. Trace:
I20260709 12:21:18.153396 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.154155 10933 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 6: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:18.154889 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.155349 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:18.155522 10929 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:18.156112 11003 raft_consensus.cc:2393] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 5: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:18.157546 11082 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:18.159911 11004 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:18.160694 10929 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:18.161046 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:18.134573 14217 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:18.162322 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.151520 11080 rpcz_store.cc:276] 0709 12:21:17.043717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.044256 (+   539us) service_pool.cc:224] Handling call
0709 12:21:17.095341 (+ 51085us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:17.118665 (+ 23324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:17.118694 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:17.125985 (+  7291us) log.cc:844] Serialized 26 byte log entry
0709 12:21:17.184920 (+ 58935us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b4800210cd8. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb5e89aa1 00007f9bb5e80b37 00007f9bb5e809ca 00007f9bb5f7826f 00007f9bb5f77f37 00007f9bb5f8c55c 00007f9bb5f8c508 00007f9bb5f8c488 00007f9bb5f8c443 00007f9bb5f8b6ec 00007f9bb4eb5a96
0709 12:21:17.297787 (+112867us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:17.297833 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.297904 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:18.127666 (+829762us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:18.140458 (+ 12792us) raft_consensus.cc:1685] finished
0709 12:21:18.140481 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:18.140619 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12635,"raft.queue_time_us":13087,"raft.run_cpu_time_us":1889,"raft.run_wall_time_us":63158,"spinlock_wait_cycles":9695872,"thread_start_us":126634,"threads_started":1,"wal-append.queue_time_us":485938}
I20260709 12:21:18.165045 10935 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 10: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:18.163508 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:18.131117 14258 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.164300 10933 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:18.168747 11624 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:18.169199 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.127547 14161 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:18.138659 14083 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.165992 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.169781 10933 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:21:18.166254 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.175985 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:18.176306 10929 raft_consensus.cc:2393] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 10: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:18.178726 11624 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:18.180248 10929 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:18.184649 14132 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:18.185590 14256 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.177603 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.184854 14272 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.186589 10935 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:21:18.195607 10933 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:18.168475 14155 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:18.196913 14155 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.197575 14272 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.200400 11657 raft_consensus.cc:2368] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6.
I20260709 12:21:18.184516 14248 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.201880 10936 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:18.171010 14134 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:18.170392 14219 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:18.202732 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.177219 14258 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:18.207573 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.188684 14271 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:18.209285 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:18.209357 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.210814 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.184118 14081 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:18.219367 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.220099 11003 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:18.220922 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.221442 11003 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:21:18.222193 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.222749 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.223729 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.224663 11051 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.225409 11051 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:18.226231 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.226696 11006 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:18.227320 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.227725 11006 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:18.229274 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.211434 10935 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:18.214040 14185 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.236057 10901 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.239611 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.239995 11051 leader_election.cc:400] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 8. Current term is 9.
I20260709 12:21:18.240602 11051 leader_election.cc:403] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:18.240698 11003 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:18.241896 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:18.185889 14279 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.237116 10901 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.246035 11051 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.248010 11051 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.206293 14260 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:18.246695 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:18.252079 11008 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:18.210832 14272 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.253960 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.256403 10899 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:18.251165 11051 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.214761 14220 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.249396 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.239367 14234 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:18.260139 10933 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:21:18.261469 11003 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:18.288744 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.249925 10901 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.288985 10931 raft_consensus.cc:2393] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 10: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:18.246354 14096 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:18.289300 11051 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.210562 14219 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.291311 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.210843 14134 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.244246 14290 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:18.260697 10899 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.302156 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.299283 11051 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.301226 11003 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:18.290038 10901 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.252020 14170 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7.
I20260709 12:21:18.253686 14289 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:18.232199 14081 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:18.247848 14174 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 8. Current term is 9.
I20260709 12:21:18.304883 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.309077 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.309026 11051 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.316250 11051 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.316119 10901 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.261511 14163 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:18.316999 11051 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.293526 14232 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.292148 14256 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:18.258469 14213 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:18.328435 14163 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.301450 14234 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.292687 14220 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.331058 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.261332 14185 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:21:18.318132 14162 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.300438 14096 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:18.298821 14080 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:18.306102 14290 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.305790 14206 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:18.309865 14149 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:21:18.319806 11005 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:18.336159 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.310330 14227 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:18.328949 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.307828 14277 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:18.317339 14079 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:18.312116 14289 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.366641 14079 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.366710 14289 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:18.367100 14079 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:18.366187 14277 raft_consensus.cc:697] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:18.337126 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1885) took 1267 ms. Trace:
I20260709 12:21:18.315083 14128 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.368901 14134 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.368853 10934 rpcz_store.cc:276] 0709 12:21:17.069751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.100847 (+ 31096us) service_pool.cc:224] Handling call
0709 12:21:17.101193 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:17.101599 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:17.101629 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:18.075431 (+973802us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b18000116e0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade412a6 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9baf859a11 00007f9baf869372 00007f9bb0f9ba01 00007f9bb0f6043a
0709 12:21:18.077126 (+  1695us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b2c00057318. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9baf859a11 00007f9baf869372 00007f9bb0f9ba01 00007f9bb0f6043a 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2
0709 12:21:18.077611 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 12:21:18.190119 (+112508us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:18.190156 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.190226 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:18.336378 (+146152us) raft_consensus.cc:1685] finished
0709 12:21:18.336399 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:18.336551 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1429,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":7735,"spinlock_wait_cycles":11178240,"thread_start_us":112154,"threads_started":1,"wal-append.queue_time_us":129131}
I20260709 12:21:18.371239 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.371959 10934 raft_consensus.cc:2393] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 8: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:18.372264 14083 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.372712 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.373309 10934 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:21:18.374096 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.374730 10934 raft_consensus.cc:2393] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:18.257268 14260 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:18.326344 14182 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:18.303438 14272 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:18.338562 11051 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:18.341868 14155 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.392988 14164 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.325167 14136 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:18.332242 14264 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:18.394327 14264 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.394765 14264 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:18.396535 14260 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.395993 14289 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.398944 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.344313 10928 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:18.346531 14080 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.345021 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.332392 14133 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:18.337198 14163 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:18.334215 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.400847 14272 raft_consensus.cc:697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:18.400763 14133 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.401764 14133 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:18.400599 14080 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:18.401156 14155 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:18.403139 14155 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.352084 14279 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.346375 14206 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.404474 14206 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:18.405229 14155 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.338649 14234 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:18.348035 14290 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:18.338315 14201 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:18.347249 14162 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:18.355836 14161 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.347314 14096 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:18.356961 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:18.359018 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.359259 14229 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.415771 14162 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.334694 14232 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.420413 14237 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.411496 14201 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.421198 14201 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:18.360688 11049 leader_election.cc:400] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6.
I20260709 12:21:18.422484 11049 leader_election.cc:403] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:21:18.423228 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 62713.3us
I20260709 12:21:18.411746 14083 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.361069 14219 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.424420 14083 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:18.424886 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 1901) took 1015 ms. Trace:
I20260709 12:21:18.425303 10936 rpcz_store.cc:276] 0709 12:21:17.409237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.884360 (+475123us) service_pool.cc:224] Handling call
0709 12:21:18.424699 (+540339us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b540017a7d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:18.424805 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":685342592}
I20260709 12:21:18.425597 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.337818 14256 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:18.362188 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 1956) took 1658 ms. Trace:
I20260709 12:21:18.363665 14220 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:18.364048 11078 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2515) took 1674 ms (client timeout 2213 ms). Trace:
W20260709 12:21:18.426692 11078 rpcz_store.cc:269] 0709 12:21:16.689438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:16.689919 (+   481us) service_pool.cc:224] Handling call
0709 12:21:18.363819 (+1673900us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b54000c2bd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:18.363943 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1105381760}
I20260709 12:21:18.428020 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.428628 11078 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:18.369218 14277 consensus_queue.cc:237] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.429621 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.430262 11078 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:21:18.431169 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.432669 14256 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.434666 14227 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:18.434928 14232 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.426494 11009 rpcz_store.cc:276] 0709 12:21:16.703905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:16.719686 (+ 15781us) service_pool.cc:224] Handling call
0709 12:21:16.720035 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:18.072478 (+1352443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.361932 (+289454us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b540012b1d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:18.362105 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3107975040}
I20260709 12:21:18.436735 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:18.438120 14231 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:21:18.441494 11010 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:18.376670 11008 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:18.377162 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.334951 14213 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.367590 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60724 (request call id 24) took 1761 ms. Trace:
I20260709 12:21:18.451174 10928 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:18.378994 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.454991 14213 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:18.455282 11081 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:18.456274 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.377812 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.408674 14136 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.457226 14136 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:18.457813 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.458441 11002 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:18.459275 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.381716 11050 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:18.452682 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.461076 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.461674 10936 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 5.
I20260709 12:21:18.463006 10977 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:18.383585 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.383709 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:18.466777 11006 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
W20260709 12:21:18.384895 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 46775.8us
I20260709 12:21:18.386896 10974 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:21:18.468119 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 81255.5us
I20260709 12:21:18.387972 14174 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:18.401858 14272 consensus_queue.cc:237] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.389531 14239 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:18.383071 14182 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.383380 14128 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.400223 14289 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.405097 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:18.481575 11011 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:21:18.354710 14081 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:18.336310 14169 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:18.400854 10929 raft_consensus.cc:2368] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 5. Current term is 6.
I20260709 12:21:18.356180 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.413410 14200 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.418299 11003 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:18.419275 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:18.473227 14217 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.356853 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.493965 11007 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:18.443940 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.435251 14227 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:18.447433 14083 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:18.447718 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:18.449234 14163 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.426256 11083 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:18.450317 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.451431 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:18.454268 11076 rpcz_store.cc:276] 0709 12:21:16.606077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:16.607290 (+  1213us) service_pool.cc:224] Handling call
0709 12:21:18.367381 (+1760091us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54000e1354. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5a853 00007f9bb5f2860a 00007f9baf4ae7d4 00007f9baf4ae762 00007f9baf4ae691 00007f9baf4ae60c 00007f9baf4ad8c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:18.367502 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1053753216}
I20260709 12:21:18.378660 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.496706 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.496950 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.497567 10929 raft_consensus.cc:2393] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 8: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:18.382727 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.466128 11009 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:18.469630 11051 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.389216 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.452812 14079 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.459810 11002 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 3.
I20260709 12:21:18.468892 10974 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:18.437740 14290 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.473753 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.450785 14234 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.484881 10927 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:21:18.418845 10901 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:18.513561 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 94786.7us
I20260709 12:21:18.472609 14206 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.514552 10901 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.482053 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:18.517992 14213 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.521062 14163 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.522109 14215 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.522596 14128 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.524044 11655 raft_consensus.cc:2393] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 6: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:18.474437 14203 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:18.494917 11008 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:18.475943 14155 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:18.498380 11010 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:21:18.526116 14079 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.526623 11082 raft_consensus.cc:2368] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7.
I20260709 12:21:18.527271 14136 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.481320 14182 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:18.496501 11078 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:18.497224 11077 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:18.498123 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.499584 11051 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.498229 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.500481 11625 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:18.545239 11084 raft_consensus.cc:2368] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12.
I20260709 12:21:18.500572 10936 raft_consensus.cc:2393] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 10: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:18.500559 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:18.549187 10929 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 4: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:18.502103 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:18.473102 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 91464.6us
I20260709 12:21:18.505046 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.550207 11076 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:18.505820 14258 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:18.506862 14134 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:18.483160 14237 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:18.451182 14133 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.502863 10974 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:18.482729 14174 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.481243 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:18.557964 10934 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:18.511771 11006 raft_consensus.cc:2410] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:21:18.525178 14203 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:18.529138 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:18.530102 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.471961 10977 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:18.528920 14264 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.477561 14080 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.583824 11081 raft_consensus.cc:2368] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 5. Current term is 6.
I20260709 12:21:18.537482 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.535614 11010 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
W20260709 12:21:18.547348 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 47821.4us
I20260709 12:21:18.552487 10901 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:18.549642 11078 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:18.552939 11050 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:18.548071 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 47665.7us
I20260709 12:21:18.586236 11082 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:21:18.547472 10931 raft_consensus.cc:2368] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12.
I20260709 12:21:18.547307 10928 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 8: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:18.585321 11051 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.549703 11083 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:18.493101 14169 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:18.555707 10932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1902) took 1126 ms. Trace:
I20260709 12:21:18.566843 10833 catalog_manager.cc:5697] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 5 to 6, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 6 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:18.557904 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 55128.6us
I20260709 12:21:18.590170 11050 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:18.475127 14201 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.503888 14217 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:18.534243 14238 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:18.588532 11051 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.559033 14134 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.589608 10932 rpcz_store.cc:276] 0709 12:21:17.429594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.420738 (+991144us) service_pool.cc:224] Handling call
0709 12:21:18.421173 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:18.421372 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:18.421688 (+   316us) log.cc:844] Serialized 14 byte log entry
0709 12:21:18.555378 (+133690us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:18.555436 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:18.555479 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.555543 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:18.555654 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19474,"prepare.queue_time_us":163,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":21390,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":105,"thread_start_us":113804,"threads_started":1}
I20260709 12:21:18.559158 14237 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:18.582257 14203 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:18.607416 10935 raft_consensus.cc:2368] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 8. Current term is 9.
I20260709 12:21:18.610720 11051 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.625852 11051 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:18.606663 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 54091.4us
I20260709 12:21:18.608341 10933 raft_consensus.cc:2393] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 8: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:21:18.582160 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 110334us
I20260709 12:21:18.592752 11050 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:18.544013 14289 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:18.594051 10974 leader_election.cc:400] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10.
I20260709 12:21:18.641918 10974 leader_election.cc:403] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:18.556313 14200 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:18.580173 14083 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:18.585078 14219 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:18.633149 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.634202 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.634454 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.645380 11076 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:18.646379 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.635746 10934 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:21:18.555269 14260 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:18.636646 10977 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:18.641067 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 48391.8us
I20260709 12:21:18.630692 10899 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:18.653659 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 63111.7us
I20260709 12:21:18.647514 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.653436 11625 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.598328 14213 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.693193 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:18.694715 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 67107.1us
I20260709 12:21:18.600896 14194 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:18.560706 14239 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:18.714278 10901 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.592336 14128 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:18.598421 14229 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:18.719143  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:21:18.716691 10901 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.700990 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.721908 11076 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 10: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:18.628446 14172 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:18.708827 14077 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:18.623593 14134 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:18.722141 10901 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.724447 11082 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:18.723246 14283 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:18.629874 14237 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:18.727797 10901 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.728559 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.734998 11079 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:18.628082 14149 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:18.731069 10899 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:18.643500 14083 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:18.639498 14162 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:18.638345 14271 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.638082 14232 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:18.733398 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.654104 14219 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.724859 14128 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:18.734324 10901 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.722597 14239 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:18.743078 10899 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:18.694520 14183 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:18.760344 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:18.761080 11084 raft_consensus.cc:2368] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7.
I20260709 12:21:18.654613 14218 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:18.743978 14220 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:21:18.775892 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 122542us
I20260709 12:21:18.755481 11076 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:21:18.588591 14174 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:18.757397 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.643149 14256 consensus_queue.cc:1059] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.107s
I20260709 12:21:18.743427 14077 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.797456 11622 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:18.798811 14077 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.768270 10901 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.799844 10901 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.800379 14201 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.800918 10901 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.724714 14229 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.792394 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:18.755416 14175 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:18.734223 14172 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.694572 14238 raft_consensus.cc:697] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:18.769040 10899 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:18.745108 14258 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:18.749305 14083 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:18.707808 14131 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:21:18.726977 14079 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:18.655189 14289 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:18.800856 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.803107 11078 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:21:18.772796 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 118139us
I20260709 12:21:18.803445 11083 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 4.
I20260709 12:21:18.749411 14185 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:18.805198 11084 raft_consensus.cc:2393] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 10: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:18.759063 14219 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:18.806296 10901 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:18.750885 14162 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:18.755234 14232 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:18.760110 14128 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:18.760432 14183 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.762089 14239 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:18.799721 14256 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:18.811030 14304 log.cc:927] Time spent T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
W20260709 12:21:18.839037 14309 log.cc:927] Time spent T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:21:18.777627 14149 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:18.811779 14172 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:18.868561 11011 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
W20260709 12:21:18.846889 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 210324us
I20260709 12:21:18.845845 10974 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:18.872968 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.841259 14215 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:18.850090 14175 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:18.874508 14175 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:18.875007 14175 raft_consensus.cc:697] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:18.876003 14248 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10.
I20260709 12:21:18.876525 14175 consensus_queue.cc:237] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.798671 14206 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:18.804934 14306 log.cc:927] Time spent T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:21:18.791666 14224 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.884333 14224 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.886626 14224 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.849375 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:18.778785 14220 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.888798 14080 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.890806 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:18.897658  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:18.898620  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:18.900465 14264 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.901117 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.901760 11076 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:18.901991 14217 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:18.902694 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:18.903110 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:18.903394 11076 raft_consensus.cc:2393] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 6: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:21:18.856702 11050 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.602s (SENT) [suppressed 4 similar messages]
I20260709 12:21:18.774959 14218 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.843716 14079 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.845249 14185 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.775549 14153 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:18.810567 14077 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:18.758211 14271 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:18.851346 14290 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:18.810702 14132 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:18.804598 14229 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:18.804304 14169 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:18.847949 14162 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:18.793162 14174 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:18.913770 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 67994.8us
I20260709 12:21:18.767546 14283 raft_consensus.cc:697] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:21:18.873306 14308 log.cc:927] Time spent T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:21:18.916720 11657 raft_consensus.cc:1275] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:18.799741 14133 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.919348 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.919245 14131 raft_consensus.cc:3055] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:18.921379 14155 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:18.921844 10831 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35614 (request call id 244) took 3136 ms. Trace:
I20260709 12:21:18.992540 14128 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.994913 14128 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.850347 14183 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:18.810240 14119 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:18.932732 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.810555 14277 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:18.848923 14232 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:18.848832 14234 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:18.907123 14220 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:18.925763 14218 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:18.933303 14079 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:18.935000 14077 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.933636 14153 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.934993 14185 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:18.988337 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:18.991955 11655 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:18.959210 14258 raft_consensus.cc:697] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:19.007822 11084 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:18.973031 14132 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:18.992971 10831 rpcz_store.cc:276] 0709 12:21:15.771291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.785353 (+ 14062us) service_pool.cc:224] Handling call
0709 12:21:18.907569 (+3122216us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:16.844506 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:16.845122 (+   616us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:16.845164 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:21:16.845189 (+    25us) tablet.cc:662] Decoding operations
0709 12:21:16.845793 (+   604us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:16.845867 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:16.845893 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:21:16.846237 (+   344us) tablet.cc:701] Row locks acquired
0709 12:21:16.846255 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:21:16.846393 (+   138us) write_op.cc:270] Start()
0709 12:21:16.846505 (+   112us) write_op.cc:276] Timestamp: P: 1783599676846345 usec, L: 0
0709 12:21:16.846527 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:21:16.958493 (+111966us) log.cc:844] Serialized 1303 byte log entry
0709 12:21:17.628979 (+670486us) op_driver.cc:464] REPLICATION: finished
0709 12:21:17.927881 (+298902us) write_op.cc:301] APPLY: starting
0709 12:21:17.933314 (+  5433us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:17.969798 (+ 36484us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:17.989706 (+ 19908us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:18.028788 (+ 39082us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:18.029013 (+   225us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:21:18.029060 (+    47us) write_op.cc:312] APPLY: finished
0709 12:21:18.029267 (+   207us) log.cc:844] Serialized 35 byte log entry
0709 12:21:18.029446 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:18.029543 (+    97us) write_op.cc:454] Released schema lock
0709 12:21:18.029582 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:18.030032 (+   450us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:18.030063 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":36387,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":277706,"apply.run_cpu_time_us":2629,"apply.run_wall_time_us":107771,"num_ops":3,"prepare.queue_time_us":26123,"prepare.run_cpu_time_us":12579,"prepare.run_wall_time_us":321214,"raft.queue_time_us":286955,"raft.run_cpu_time_us":121143,"raft.run_wall_time_us":236469,"replication_time_us":755001,"spinlock_wait_cycles":14720,"thread_start_us":448286,"threads_started":4,"wal-append.queue_time_us":298733}]]}
I20260709 12:21:19.027818 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:21:18.979627 14231 consensus_meta.cc:287] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.002s
I20260709 12:21:18.987393 14131 raft_consensus.cc:740] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:19.037740 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:19.038596 11084 raft_consensus.cc:2368] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8.
I20260709 12:21:19.007337 14277 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:19.031988 14227 consensus_meta.cc:287] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.000s
I20260709 12:21:19.025352 14077 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:19.004196 14271 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:19.059026 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 252770us
I20260709 12:21:19.031634 14132 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:19.036257 14272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.003s	sys 0.010s
W20260709 12:21:19.047721 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 278759us
I20260709 12:21:18.976666 14314 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:21:19.029310 14119 raft_consensus.cc:697] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:18.995270 14083 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:18.996073 14315 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:21:19.071973 10899 leader_election.cc:400] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7.
I20260709 12:21:19.065234 11051 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:19.041708 14231 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6.
I20260709 12:21:19.085248 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:19.060981 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 138105us
I20260709 12:21:19.086771 10977 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:19.026165 14153 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:19.048626 14277 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:19.066093 14256 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:19.072499 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:19.091382 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:19.082222 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:19.070242 14272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.003s	sys 0.010s
I20260709 12:21:19.092002 10927 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:19.092252 10928 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:21:19.084218 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:19.090767 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:19.096275 14136 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:19.099800 14200 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.100385 14200 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:19.073199 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 216527us
I20260709 12:21:19.006536 14316 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:21:19.089625 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:19.083165 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:19.092621 11084 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 10: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:19.002040 14238 consensus_queue.cc:237] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.004904 14283 consensus_queue.cc:237] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.108146 10899 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:19.109805 10927 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:19.086221 14234 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:21:19.114210 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 138029us
W20260709 12:21:19.139739 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 52964.2us
I20260709 12:21:19.140216 10974 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:19.102274 10931 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:19.132815 11077 raft_consensus.cc:1240] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:19.135432 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:19.111016 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:19.134044 10901 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:19.101078 14305 log.cc:927] Time spent T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.479s	user 0.000s	sys 0.001s
I20260709 12:21:19.143963 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:19.143735 10974 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:19.159474 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:19.068806 14227 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.145804 11003 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:19.181282 11076 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:21:19.182610 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:19.166635 10977 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:19.155135 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:19.166345 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:19.183951 11010 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:19.168489 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:19.173750 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:19.185194 11082 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:19.185532 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:19.185772 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:19.186038 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:19.186465 11011 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:21:19.183377 10929 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:19.184001 11006 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:21:19.166836 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:19.187839 11008 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:19.148240 10899 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:21:19.192349 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 44221.5us
I20260709 12:21:19.144971 14234 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:19.202551 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 186921us
I20260709 12:21:19.200932 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:19.204799 11082 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:19.205734 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:19.206292 11082 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:19.207057 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:19.207616 11082 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:21:19.208427 10929 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:19.208796 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:19.209936 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:19.210453 11082 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:21:19.195617 10899 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:19.200716 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:19.159145 14080 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:19.199483 11008 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:19.129419 14155 raft_consensus.cc:697] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:19.144202 14170 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:19.187444 14096 consensus_meta.cc:287] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.736s	user 0.002s	sys 0.008s
I20260709 12:21:19.212150 11084 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:19.113072 14131 consensus_queue.cc:260] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.101408 14119 consensus_queue.cc:237] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.213245 14234 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:19.136874 14239 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.181888 14256 consensus_queue.cc:1048] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:21:19.244583 14096 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.249581 11011 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:19.191742 14290 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:21:19.265450 11006 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:19.243505 14264 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:19.258736 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 115080us
I20260709 12:21:19.255136 14170 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:19.257315 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 54665.2us
I20260709 12:21:19.271473 10974 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:19.264220 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:19.310945 11084 raft_consensus.cc:2410] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:21:19.240226 14080 raft_consensus.cc:697] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:21:19.268607 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 73069.4us
I20260709 12:21:19.313853 10899 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:19.113786 14258 consensus_queue.cc:237] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:19.272265 11082 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:19.312294 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2527) took 1583 ms. Trace:
I20260709 12:21:19.315052 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:19.314646 11085 rpcz_store.cc:276] 0709 12:21:17.728493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.077252 (+348759us) service_pool.cc:224] Handling call
0709 12:21:18.077591 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:18.077918 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:18.077943 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:18.085349 (+  7406us) log.cc:844] Serialized 26 byte log entry
0709 12:21:18.415507 (+330158us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b1800084640. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b 00007f9bb0affd23 00007f9bb0b000d1 00007f9bb0f1ba0f
0709 12:21:18.493446 (+ 77939us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:18.493487 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.493565 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:19.100369 (+606804us) spinlock_profiling.cc:243] Waited 45.2 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:19.311722 (+211353us) raft_consensus.cc:1685] finished
0709 12:21:19.311747 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.312216 (+   469us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23584,"raft.queue_time_us":418,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":9524,"spinlock_wait_cycles":164111488,"thread_start_us":77721,"threads_started":1,"wal-append.queue_time_us":456079}
I20260709 12:21:19.261721 14315 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:21:19.320717 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 49340.7us
I20260709 12:21:19.262930 14329 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.321492 10974 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:19.322464 10977 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:19.272454 14131 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:19.351811 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:19.364675 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:19.361001 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:19.366149 11085 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:19.271571 14316 raft_consensus.cc:2764] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:21:19.383288 14319 log.cc:927] Time spent T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 12:21:19.384603 14320 log.cc:927] Time spent T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.240s	user 0.000s	sys 0.000s
W20260709 12:21:19.388839 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 66466.8us
W20260709 12:21:19.323549 14307 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.509s	user 0.000s	sys 0.004s
W20260709 12:21:19.396274 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 44563.9us
W20260709 12:21:19.321698 14237 consensus_meta.cc:287] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.002s
I20260709 12:21:19.400043 10899 leader_election.cc:400] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8.
I20260709 12:21:19.320421 14315 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.317092 14327 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:19.361307 14328 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:19.387797 14153 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.402490 14264 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:19.402009 14314 raft_consensus.cc:2764] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:21:19.403087 14083 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:19.474288 14172 consensus_meta.cc:287] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.551s	user 0.003s	sys 0.005s
I20260709 12:21:19.363701 14329 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.456367 14315 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:19.476231 14318 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.477819 11004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41098 (request call id 166) took 1277 ms. Trace:
I20260709 12:21:19.479224 14153 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:19.479802 14080 consensus_queue.cc:237] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.387017 14229 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.601760 14229 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:19.484244 14227 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:19.448938 14316 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:19.485476 14096 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:19.485692 14234 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.489221 10934 raft_consensus.cc:2393] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:21:19.473425 14322 log.cc:927] Time spent T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
I20260709 12:21:19.460004 14328 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:19.483777 14182 consensus_meta.cc:287] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.925s	user 0.007s	sys 0.000s
I20260709 12:21:19.563757 11085 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:19.447554 14237 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:19.559580 14079 consensus_meta.cc:287] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.000s
I20260709 12:21:19.465000 14327 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:19.487851 14264 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.591269 11004 rpcz_store.cc:276] 0709 12:21:18.200332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.200881 (+   549us) service_pool.cc:224] Handling call
0709 12:21:18.201367 (+   486us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:18.202139 (+   772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:18.202168 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:18.505192 (+303024us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b4c002a3800. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9baf22ca20 00007f9baf23da29 00007f9baf203644 00007f9baf22af2d 00007f9baf22ab93 00007f9bb0f5b18b 00007f9bb0f5bcb5 00007f9bb0f5d004 00007f9bb0f5c729 00007f9bb0f61d96 00007f9bb0f56adb
0709 12:21:18.506051 (+   859us) log.cc:844] Serialized 582 byte log entry
0709 12:21:18.593351 (+ 87300us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:18.593393 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.593495 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:19.090422 (+496927us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:19.477578 (+387156us) raft_consensus.cc:1685] finished
0709 12:21:19.477601 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.477758 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1447,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":5009,"spinlock_wait_cycles":39530752,"thread_start_us":86923,"threads_started":1,"wal-append.queue_time_us":234058}
I20260709 12:21:19.580449 14172 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.604261 14227 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:19.595067 14318 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.593595 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:19.604523 11079 raft_consensus.cc:2368] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9.
I20260709 12:21:19.401854 14155 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:19.626230 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 304809us
I20260709 12:21:19.565742 14083 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:19.496644 14218 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.566433 14256 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:19.603797 14289 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:19.633930 11082 raft_consensus.cc:2393] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 14: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:19.605540 14316 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.559897 14183 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.644464 14264 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:19.646883 10974 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:19.565429 14077 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.712037 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2545) took 1323 ms. Trace:
W20260709 12:21:19.679751 14132 consensus_meta.cc:287] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.597s	user 0.008s	sys 0.008s
I20260709 12:21:19.650182 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:19.652319 14218 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:19.653033 11078 raft_consensus.cc:2368] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9.
I20260709 12:21:19.661796 14237 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:19.662845 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:19.664659 14134 consensus_meta.cc:287] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.910s	user 0.009s	sys 0.001s
W20260709 12:21:19.665923 14323 log.cc:927] Time spent T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.416s	user 0.000s	sys 0.001s
I20260709 12:21:19.667752 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:19.730099 10929 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:19.630970 14182 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.675257 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:19.675537 11622 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:19.677003 11076 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:19.735378 10935 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:19.713171 14200 consensus_meta.cc:287] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.612s	user 0.007s	sys 0.002s
I20260709 12:21:19.626554 14096 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:19.625454 14231 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:19.742249 14096 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:19.744796 14096 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:19.692756 10899 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:19.709196 11084 raft_consensus.cc:2393] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 9: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:19.627792 14229 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:19.745615 14229 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.745990 14335 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:19.746994 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 54355.5us
I20260709 12:21:19.647945 14239 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:19.712510 11077 rpcz_store.cc:276] 0709 12:21:18.388750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.546436 (+157686us) service_pool.cc:224] Handling call
0709 12:21:18.546700 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:19.141347 (+594647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.711701 (+570354us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b54001680d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:19.711955 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1347512192}
I20260709 12:21:19.641749 14327 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:19.709190 14203 consensus_meta.cc:287] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 1.015s	user 0.010s	sys 0.001s
I20260709 12:21:19.642627 14213 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:19.752007 14203 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.752148 14213 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:19.754344 14203 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:19.727206 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:19.731002 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:21:19.713124 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 66335.1us
I20260709 12:21:19.649888 14227 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.735890 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2294) took 1017 ms. Trace:
I20260709 12:21:19.758395 11076 rpcz_store.cc:276] 0709 12:21:18.718670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.676532 (+957862us) service_pool.cc:224] Handling call
0709 12:21:19.676836 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:19.735647 (+ 58811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.735821 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.758661 10899 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:19.758924 10928 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 10: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:19.760282 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 299) took 1033 ms. Trace:
I20260709 12:21:19.760684 11076 rpcz_store.cc:276] 0709 12:21:18.728605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.759458 (+1030853us) service_pool.cc:224] Handling call
0709 12:21:19.759778 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:19.759976 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:19.760000 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:19.760043 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:19.760073 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.760121 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.760229 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.760875 10899 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:19.736449 10932 raft_consensus.cc:2393] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:21:19.737545 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 62096.7us
I20260709 12:21:19.642832 14079 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.710784 14316 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:19.739166 10933 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:19.736900 14134 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.742292 14231 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.627719 14328 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:19.616020 14219 consensus_meta.cc:287] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.750s	user 0.019s	sys 0.000s
I20260709 12:21:19.781628 10931 raft_consensus.cc:2393] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:19.751014 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:19.751492 11077 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:19.782557 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 298) took 1056 ms. Trace:
I20260709 12:21:19.782895 11077 rpcz_store.cc:276] 0709 12:21:18.726332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.750908 (+1024576us) service_pool.cc:224] Handling call
0709 12:21:19.751196 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:19.782260 (+ 31064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.782496 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.754390 14213 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:19.756994 10974 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:19.712976 14220 consensus_meta.cc:287] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.684s	user 0.010s	sys 0.000s
I20260709 12:21:19.762423 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 301) took 1033 ms. Trace:
I20260709 12:21:19.785135 11076 rpcz_store.cc:276] 0709 12:21:18.729164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.761657 (+1032493us) service_pool.cc:224] Handling call
0709 12:21:19.761945 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:19.762114 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:19.762140 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:19.762180 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:19.762209 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.762256 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.762371 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.768481 11080 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 5: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:19.747728 14229 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:19.734103 14248 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:19.734345 14218 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:21:19.775681 11009 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.006s	sys 0.019s
I20260709 12:21:19.759207 14313 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:19.766610 14333 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:19.766166 10899 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:19.766798 14335 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:19.814208 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 57295us
I20260709 12:21:19.756532 14200 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.843538 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60046 (request call id 2273) took 1130 ms. Trace:
W20260709 12:21:19.846582 14338 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:21:19.850767 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2548) took 1461 ms. Trace:
I20260709 12:21:19.838814 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:19.876415 11080 rpcz_store.cc:276] 0709 12:21:18.389564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.510533 (+120969us) service_pool.cc:224] Handling call
0709 12:21:19.850583 (+1340050us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54000e1d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:19.850705 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2721010944}
W20260709 12:21:19.848660 11009 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.010s	sys 0.019s
I20260709 12:21:19.873243 10974 leader_election.cc:400] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7.
W20260709 12:21:19.873685 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 107603us
W20260709 12:21:19.814913 14277 consensus_meta.cc:287] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.701s	user 0.008s	sys 0.001s
I20260709 12:21:19.737053 14132 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:19.788385 14219 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.813771 14248 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.871974 11082 rpcz_store.cc:276] 0709 12:21:18.713339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.314805 (+601466us) service_pool.cc:224] Handling call
0709 12:21:19.843331 (+528526us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b540011b2d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:19.843475 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":731521280}
I20260709 12:21:19.913064 10935 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
W20260709 12:21:19.957360 10977 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.006s	sys 0.012s
I20260709 12:21:19.845490 14256 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:19.846617 14332 log.cc:927] Time spent T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:21:19.840052 14313 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:19.958702 10977 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.007s	sys 0.012s
W20260709 12:21:19.985159 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 595146us
I20260709 12:21:19.987159 10977 leader_election.cc:400] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 5. Current term is 6.
I20260709 12:21:19.987696 10977 leader_election.cc:403] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:19.801131 14220 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:19.899564 14232 consensus_meta.cc:287] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.865s	user 0.008s	sys 0.000s
W20260709 12:21:19.907169 14162 consensus_meta.cc:287] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.920s	user 0.009s	sys 0.010s
I20260709 12:21:19.884023 14311 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:20.002590 11007 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 10: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:19.879704 10974 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:19.879770 14327 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:19.895115 14077 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:19.890295 14134 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:20.012151 10927 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:21:19.975631 14170 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.012s	sys 0.008s
I20260709 12:21:19.999768 14341 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 5. Current term is 6.
I20260709 12:21:19.872471 14262 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:19.973667 14185 consensus_meta.cc:287] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.940s	user 0.009s	sys 0.001s
I20260709 12:21:19.899772 14317 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:19.889423 14079 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:19.873063 14333 raft_consensus.cc:697] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:19.891569 14231 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:19.902289 14183 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:19.890550 14227 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:19.884745 14318 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:19.901866 14234 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:19.839387 14218 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:20.023355 14333 consensus_queue.cc:237] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:20.025645 14218 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:20.014287 14170 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.012s	sys 0.008s
W20260709 12:21:20.003661 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 124036us
I20260709 12:21:19.900813 14182 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:19.902598 14329 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:20.005597 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:21:19.907161 14131 consensus_meta.cc:287] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.000s
I20260709 12:21:19.989600 14313 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:20.019196 14185 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:20.021366 11653 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:20.036235 10974 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:20.010430 14256 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:20.011549 11655 raft_consensus.cc:1240] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:20.047181 11051 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:20.002274 14232 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:20.056180 11051 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:20.009083 14162 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:20.082512 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:20.010777 14080 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:20.085492 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:20.085639 10974 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:20.086599 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:20.083976 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:20.044759 14329 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:20.088308 11076 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:20.042609 14317 raft_consensus.cc:697] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:20.087711 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:20.098378 11082 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:20.098300 10899 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:19.983590 14277 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:20.056562 14256 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:20.057699 14341 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:20.080202 14218 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:20.053829 14182 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:20.020463 14315 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:20.117244 11076 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:20.113055 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:20.091138 14234 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:21:20.127633 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 186913us
I20260709 12:21:20.027913 14262 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:20.141646 10900 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:20.142866 11082 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:20.142084 10929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1936) took 1009 ms. Trace:
I20260709 12:21:20.099359 14080 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:20.112493 14227 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:20.168627 11051 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:20.158128 11078 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60046 (request call id 2289) took 1440 ms (client timeout 1736 ms). Trace:
I20260709 12:21:20.119604 14256 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:20.172905 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:20.188479 10932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 1920) took 1080 ms. Trace:
I20260709 12:21:20.174291 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:20.190160 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:20.190747 11004 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:21:20.175068 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:20.191754 11006 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:21:20.193442 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 2443) took 1023 ms. Trace:
I20260709 12:21:20.177245 11003 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:21:20.177990 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:20.188875 10932 rpcz_store.cc:276] 0709 12:21:19.083887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.084005 (+   118us) service_pool.cc:224] Handling call
0709 12:21:20.164228 (+1080223us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b5400335754. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:20.164396 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1479424896}
I20260709 12:21:20.195530 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:20.198182 11003 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:21:20.199086 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:20.199609 11003 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:21:20.152202 10929 rpcz_store.cc:276] 0709 12:21:19.132771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.756700 (+623929us) service_pool.cc:224] Handling call
0709 12:21:19.756999 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:19.757193 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:20.092653 (+335460us) log.cc:844] Serialized 14 byte log entry
0709 12:21:20.141726 (+ 49073us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:20.141785 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:20.141829 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:20.141904 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:20.142028 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115,"thread_start_us":369097,"threads_started":2}
I20260709 12:21:20.180249 10934 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 5: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:21:20.116763 14321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.013s	sys 0.029s
I20260709 12:21:20.163520 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2292) took 1445 ms. Trace:
I20260709 12:21:20.208307 11085 rpcz_store.cc:276] 0709 12:21:18.718154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.632321 (+914167us) service_pool.cc:224] Handling call
0709 12:21:19.632608 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:19.805394 (+172786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:19.805425 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:19.805465 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:19.805494 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:20.163254 (+357760us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b540011b7d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:20.163306 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:20.163447 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396904320}
I20260709 12:21:20.210685 11051 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:20.182724 11078 rpcz_store.cc:269] 0709 12:21:18.717434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.849122 (+131688us) service_pool.cc:224] Handling call
0709 12:21:20.157889 (+1308767us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b54001a4ad4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:20.158059 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1759772928}
I20260709 12:21:20.186523 14079 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.187134 14077 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:20.122987 14341 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:20.224731 11010 raft_consensus.cc:1275] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:20.212472 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:20.193881 11007 rpcz_store.cc:276] 0709 12:21:19.144724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.144848 (+   124us) service_pool.cc:224] Handling call
0709 12:21:20.167752 (+1022904us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b54002d8554. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:20.167999 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1875674880}
I20260709 12:21:20.142033 14166 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:20.216002 11051 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:20.142445 14234 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:20.229442 11078 raft_consensus.cc:1275] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:20.233052 11006 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:20.234280 11009 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
W20260709 12:21:20.234666 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 115336us
W20260709 12:21:20.207590 14321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.014s	sys 0.030s
I20260709 12:21:20.156775 14218 raft_consensus.cc:697] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:20.100008 14335 consensus_queue.cc:1059] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.115s
I20260709 12:21:20.240403 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:20.240739 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:20.100363 14329 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:20.241285 11051 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:20.245563 11080 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:20.245604 11085 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:20.248854 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 153132us
I20260709 12:21:20.243911 10974 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:20.207243 14200 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:20.188859 14346 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:20.250362 11078 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:20.223457 14231 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:20.141628 14182 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:20.268139 11078 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:20.235757 14341 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:20.245491 14234 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:20.236752 14166 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:20.219342 14352 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:20.284395 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:20.331573 11010 raft_consensus.cc:2410] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:21:20.266947 14337 raft_consensus.cc:2764] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:21:20.310187 11003 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:20.207706 14183 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:21:20.248149 14229 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:20.313220 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:20.272558 14133 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:20.237783 14077 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:20.223790 14079 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:20.324819 11085 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:20.251209 10974 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:20.316129 14277 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:20.278664 14248 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:20.322598 14327 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:20.351188 14328 consensus_meta.cc:287] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.000s
I20260709 12:21:20.339955 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 302) took 1535 ms. Trace:
I20260709 12:21:20.317390 14335 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:20.351594 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 100434us
I20260709 12:21:20.307998 14333 raft_consensus.cc:3055] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:21:20.352962 14349 log.cc:927] Time spent T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:21:20.356113 14337 raft_consensus.cc:2764] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:21:20.329916 14166 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:20.443117 14220 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:20.316299 14231 raft_consensus.cc:697] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:20.444608 14231 consensus_queue.cc:237] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:20.342196 11079 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60046 (request call id 2278) took 1627 ms (client timeout 1753 ms). Trace:
W20260709 12:21:20.415479 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 139625us
W20260709 12:21:20.446120 11079 rpcz_store.cc:269] 0709 12:21:18.714554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.849745 (+135191us) service_pool.cc:224] Handling call
0709 12:21:20.342025 (+1492280us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b54001a68d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:20.342142 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1656020736}
I20260709 12:21:20.258082 14132 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:20.288326 14317 consensus_queue.cc:237] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:20.449295  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:20.347674 14229 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:20.450572 14229 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:20.453141 10927 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 1938) took 1319 ms (client timeout 1550 ms). Trace:
W20260709 12:21:20.453565 10927 rpcz_store.cc:269] 0709 12:21:19.133295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.135180 (+  1885us) service_pool.cc:224] Handling call
0709 12:21:20.452916 (+1317736us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b5400399c54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:20.453075 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2001856256}
I20260709 12:21:20.458951 14229 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:20.462666 10901 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:20.418835 11077 rpcz_store.cc:276] 0709 12:21:18.804586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.783685 (+979099us) service_pool.cc:224] Handling call
0709 12:21:19.784307 (+   622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:20.026357 (+242050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:20.026392 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:20.026434 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:20.026464 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:20.339695 (+313231us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b540011cbd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:20.339737 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:20.339895 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556196736}
W20260709 12:21:20.419476 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 418412us
I20260709 12:21:20.463498 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:20.464131 10977 leader_election.cc:400] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12.
I20260709 12:21:20.465276 10977 leader_election.cc:400] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 8. Current term is 9.
I20260709 12:21:20.316965 14218 consensus_queue.cc:237] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:20.466967 14219 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:20.421795 10974 leader_election.cc:400] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12.
I20260709 12:21:20.340454 14365 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:20.314456 14260 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
W20260709 12:21:20.416095 14340 log.cc:927] Time spent T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.319s	user 0.001s	sys 0.000s
I20260709 12:21:20.467828 10974 leader_election.cc:403] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:20.468308 14365 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:20.473575 14264 consensus_meta.cc:287] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.745s	user 0.009s	sys 0.000s
I20260709 12:21:20.474033 14264 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:20.475111 14365 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:20.427224 14364 log.cc:927] Time spent T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:21:20.476580 14362 log.cc:927] Time spent T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:21:20.423291 14328 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:20.415843 14363 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:20.477320 14363 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:20.478514 14328 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:20.427887 14313 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:20.479472 14363 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:20.479632 11653 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 7: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:20.480890 14329 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:20.481144 14313 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:20.482223 14182 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:20.423463 14333 raft_consensus.cc:740] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:20.483531 14333 consensus_queue.cc:260] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:20.484385 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 1931) took 1372 ms. Trace:
I20260709 12:21:20.469630 14079 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:20.469683 14162 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:20.467449 14077 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:20.431788 11004 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:20.485208 14315 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:20.484756 10934 rpcz_store.cc:276] 0709 12:21:19.111956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.662556 (+550600us) service_pool.cc:224] Handling call
0709 12:21:20.484192 (+821636us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b540024cf54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:20.484329 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040889600}
I20260709 12:21:20.482280 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:20.491660 11082 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:20.492797 14356 log.cc:927] Time spent T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.172s	user 0.002s	sys 0.000s
I20260709 12:21:20.494055 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2287) took 1777 ms. Trace:
I20260709 12:21:20.494405 11083 rpcz_store.cc:276] 0709 12:21:18.716949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.631186 (+914237us) service_pool.cc:224] Handling call
0709 12:21:19.631557 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:19.643635 (+ 12078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:19.643662 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:19.649116 (+  5454us) log.cc:844] Serialized 26 byte log entry
0709 12:21:20.083243 (+434127us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:20.083282 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:20.083346 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:20.492215 (+408869us) spinlock_profiling.cc:243] Waited 8.09 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:20.493709 (+  1494us) raft_consensus.cc:1685] finished
0709 12:21:20.493735 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:20.493995 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12638,"raft.queue_time_us":14081,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":51683,"spinlock_wait_cycles":18606464,"thread_start_us":355654,"threads_started":1,"wal-append.queue_time_us":530739}
I20260709 12:21:20.484799 14318 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:20.497231 14318 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:20.432004 14335 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:20.417946 14344 log.cc:927] Time spent T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
I20260709 12:21:20.349953 14185 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:20.498427 10901 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:20.476511 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:20.508749 11076 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:20.413914 14133 raft_consensus.cc:697] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:21:20.515067 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 68112.6us
I20260709 12:21:20.517783 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:20.518036 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:20.518749 11085 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
I20260709 12:21:20.518985 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:20.519572 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:20.519820 11077 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 7: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:20.520275 11078 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 7.
I20260709 12:21:20.521458 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:20.522192 11079 raft_consensus.cc:2393] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 11: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:20.528613 14337 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.529497 14080 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:20.502270 11080 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
W20260709 12:21:20.511935 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 45397.1us
I20260709 12:21:20.462642 14229 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:20.512882 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 91227.1us
I20260709 12:21:20.536438 10974 leader_election.cc:400] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 5. Current term is 6.
I20260709 12:21:20.484688 14333 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:20.497650 14318 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:20.497263 14311 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:20.543134 11657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59398 (request call id 294) took 1087 ms. Trace:
W20260709 12:21:20.533528 14347 log.cc:927] Time spent T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 12:21:20.527947 14220 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:20.554741 11076 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:21:20.545579 11657 rpcz_store.cc:276] 0709 12:21:19.445357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.445567 (+   210us) service_pool.cc:224] Handling call
0709 12:21:19.445922 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:19.446276 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:19.446303 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:19.446754 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 12:21:19.787252 (+340498us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:19.787291 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.791316 (+  4025us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:20.532398 (+741082us) raft_consensus.cc:1685] finished
0709 12:21:20.532419 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:20.532573 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":685,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":10747,"thread_start_us":313957,"threads_started":1,"wal-append.queue_time_us":541026}
I20260709 12:21:20.501765 11082 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:20.565519 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:20.555204 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 213738us
I20260709 12:21:20.535158 14219 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:21:20.553854 10901 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:20.539626 14329 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:21:20.566274 11085 raft_consensus.cc:2368] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5.
I20260709 12:21:20.564730 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:20.566470 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:20.567476 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:20.569602 11077 raft_consensus.cc:2368] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 8. Current term is 9.
I20260709 12:21:20.569908 11076 raft_consensus.cc:2393] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 5: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:20.573704 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:20.574381 10901 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:20.536440 14264 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:20.585172 10901 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:20.542285 14262 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:20.582489 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:20.549702 14311 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:20.540319 14132 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:21:20.605651 10901 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:20.565235 14162 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.567975 14185 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:20.529134 14337 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:20.573038 14229 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.610103 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60046 (request call id 2297) took 1534 ms. Trace:
W20260709 12:21:20.615900 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 150669us
I20260709 12:21:20.572643 14220 raft_consensus.cc:697] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:21:20.606571 14316 consensus_meta.cc:287] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.831s	user 0.007s	sys 0.003s
I20260709 12:21:20.588120 14279 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:20.584837 14134 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:20.580183 14290 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:21:20.616017 11084 rpcz_store.cc:276] 0709 12:21:19.076168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.313525 (+237357us) service_pool.cc:224] Handling call
0709 12:21:20.609898 (+1296373us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b540030edd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:20.610042 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":789079296}
I20260709 12:21:20.604460 11082 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:20.615041 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:20.618073 10901 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:20.619714 10899 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:20.583360 14131 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:20.608143 14080 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:20.637853 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:20.644145 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:20.619309 14264 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:20.628580 14337 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:20.632186 10901 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:20.646104 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:20.597340 14079 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:21:20.646081 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:20.657980 11084 raft_consensus.cc:2368] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11.
I20260709 12:21:20.658429 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:20.659029 10932 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:20.659325 11085 raft_consensus.cc:2393] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 7: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:20.660311 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:20.657945 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:20.633561 10899 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:20.621331 14279 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:20.655668 11082 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:20.678035 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:20.679936 10929 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:20.616510 14162 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:20.638573 14185 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:20.620638 14229 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:20.637944 14277 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:20.625308 14316 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:20.682981 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:20.672668 14080 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:20.617588 14354 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:21:20.635772 14134 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:20.640614 14328 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:20.607213 14133 consensus_queue.cc:237] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:20.749209 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.799100 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:20.874608 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:21:20.683192 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 49699us
I20260709 12:21:20.879328 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:20.701745 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:20.764189 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:20.879084 11004 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:21:21.021948 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 65329.6us
I20260709 12:21:20.712020 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:20.838193 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:21.031256 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:20.697274 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:21.032078 10935 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:21:21.032325 11009 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:21:21.029204 11007 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:21.033658 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:20.775961 11082 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:21:21.046734 11082 raft_consensus.cc:606] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:20.919798 14341 consensus_meta.cc:287] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.605s	user 0.005s	sys 0.004s
I20260709 12:21:20.644098 14329 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.973557 11051 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:20.760511 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:20.891796 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:21.050859 10933 raft_consensus.cc:2393] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:20.813027 11622 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:20.682060 14279 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:21.053535 10932 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
W20260709 12:21:20.818971 14350 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.458s	user 0.001s	sys 0.002s
W20260709 12:21:20.910640 14256 consensus_meta.cc:287] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.668s	user 0.009s	sys 0.001s
I20260709 12:21:20.640460 14131 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:21.040343 14077 consensus_queue.cc:1059] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:21:21.061133 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:21.061820 10933 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:21.031515 10936 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:21:20.910543 14318 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.048017 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:20.777992 14368 log.cc:927] Time spent T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 12:21:20.802922 14360 log.cc:927] Time spent T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.446s	user 0.000s	sys 0.001s
W20260709 12:21:20.998435 14367 log.cc:927] Time spent T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.641s	user 0.000s	sys 0.003s
I20260709 12:21:21.201213 10933 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:20.698179 14346 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:21.202329 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:20.692091 14264 raft_consensus.cc:697] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:21.202998 14213 raft_consensus.cc:2764] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:21:21.032399 11084 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 10: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:21:21.203472 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 229980us
I20260709 12:21:21.203879 10934 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:21:21.054683 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:20.857999 14345 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.201459 14077 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.672957 14337 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:21.205688 14337 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:21.205394 14077 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:20.860129 14378 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:21.047183 11082 raft_consensus.cc:614] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:21.206455 11051 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:20.795747 11655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59384 (request call id 422) took 1621 ms. Trace:
I20260709 12:21:21.209364 11655 rpcz_store.cc:276] 0709 12:21:19.174854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.180575 (+  5721us) service_pool.cc:224] Handling call
0709 12:21:19.259611 (+ 79036us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:20.081250 (+821639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:20.795431 (+714181us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b54004ce5d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:20.795658 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1684463360}
I20260709 12:21:20.934873 14290 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:21.210059 11051 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:21.210536 14077 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:21.210445 14290 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:20.912206 14326 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:21:21.056041 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 243066us
I20260709 12:21:20.935783 14149 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.212173 14326 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.212349 14149 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.213541 10931 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:21.214339 14326 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:20.915356 14381 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.214707 14149 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:20.793401 14232 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:21.216077 14232 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:20.746641 14182 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.216439 14232 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:20.815722 14172 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:20.797639 14162 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:21.216862 14232 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:21.217367 14162 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:21.217840 14162 raft_consensus.cc:697] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:20.935633 14079 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:21.218691 14162 consensus_queue.cc:237] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.219223 14079 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:20.778759 14335 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:21.003063 14218 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:21.220317 14218 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:21.221459 14079 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:21.059387 14358 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:21.222110 14358 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:21.222414 14218 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:21.061134 14348 log.cc:927] Time spent T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.783s	user 0.003s	sys 0.000s
I20260709 12:21:21.039502 14328 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:21.107002 14317 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.016s	sys 0.024s
W20260709 12:21:21.223738 14317 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.016s	sys 0.024s
I20260709 12:21:21.053148 14341 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:21.111438 14231 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.023s	sys 0.010s
W20260709 12:21:21.224575 14231 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.023s	sys 0.010s
I20260709 12:21:20.766004 14220 consensus_queue.cc:237] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.057933 14256 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.225929 14341 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:21.226809 11081 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2286) took 2510 ms. Trace:
I20260709 12:21:21.113680 10930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53346 (request call id 262) took 2037 ms. Trace:
I20260709 12:21:21.227416 14256 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:21.122290 14380 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:21.144354 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 108574us
I20260709 12:21:21.228338 14380 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.144343 14238 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:20.801867 14234 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.229332 11006 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:21.227731 11008 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:21.231426 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:21.215075 14381 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.232666 11085 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:21.034439 14342 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:21:21.233762 14381 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:21.234335 14381 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.228618 10930 rpcz_store.cc:276] 0709 12:21:19.076384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.078122 (+  1738us) service_pool.cc:224] Handling call
0709 12:21:19.078445 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:19.078786 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:19.078813 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:19.663402 (+584589us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b2c00057318. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9baf859a11 00007f9baf869372 00007f9bb0f9ba01 00007f9bb0f6043a 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2
0709 12:21:19.663796 (+   394us) log.cc:844] Serialized 26 byte log entry
0709 12:21:20.100131 (+436335us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:20.100177 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:20.100246 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:20.818317 (+718071us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:21.113432 (+295115us) raft_consensus.cc:1685] finished
0709 12:21:21.113453 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:21.113612 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":274,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":9046,"spinlock_wait_cycles":12995200,"thread_start_us":427018,"threads_started":1,"wal-append.queue_time_us":687469}
I20260709 12:21:21.169167 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.172739 11009 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:21:21.224716 14328 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:21.195752 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.229399 10899 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:21.216794 14182 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:21.236644 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.236904 14317 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:21.237528 11004 raft_consensus.cc:2393] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:21.208483 14378 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:21.237660 14317 raft_consensus.cc:697] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:21.238421 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.238866 14317 consensus_queue.cc:237] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:21.239465 14378 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:21.204757 10932 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:21.240741 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:21.241786 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:21.242281 10932 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:20.912118 14384 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.235539 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:21.203132 10933 raft_consensus.cc:2393] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:21.212417 11622 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:21.222517 14358 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:21.233656 14380 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:21.057717 14329 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.239616 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:20.799082 14166 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.244176 14384 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.246323 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.247354 11005 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:21.244460 10930 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:21:21.145774 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:21.244706 11002 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 10: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:21.047820 10935 raft_consensus.cc:2393] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 12: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:21.247205 14363 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:21.229962 14345 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:21.247241 14166 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:21.194304 11007 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:21.250310 14363 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:21.252220 14363 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:21.203564 14264 consensus_queue.cc:237] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.236588 10899 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:21.257751 10899 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:21.227182 11081 rpcz_store.cc:276] 0709 12:21:18.716731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.498218 (+781487us) service_pool.cc:224] Handling call
0709 12:21:19.498521 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:19.559019 (+ 60498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:19.559049 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:19.566169 (+  7120us) log.cc:844] Serialized 26 byte log entry
0709 12:21:20.015051 (+448882us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:20.015091 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:20.015158 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:20.919269 (+904111us) spinlock_profiling.cc:243] Waited 8.15 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:21.226516 (+307247us) raft_consensus.cc:1685] finished
0709 12:21:21.226536 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:21.226747 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":60624,"raft.run_cpu_time_us":4536,"raft.run_wall_time_us":27934,"spinlock_wait_cycles":18755840,"thread_start_us":404115,"threads_started":1,"wal-append.queue_time_us":606572}
I20260709 12:21:21.258598 14149 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:21.259157 14149 raft_consensus.cc:697] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:21.235697 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.262650 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.263252 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:21.245404 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:21.249454 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.265179 10933 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:21.260989 14149 consensus_queue.cc:237] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.264122 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.266019 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.267442 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.269016 14290 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:21.259179 14342 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:21.274451 11007 raft_consensus.cc:2393] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 10: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:21.274782 14342 raft_consensus.cc:697] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:21.275755 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:21.275947 14342 consensus_queue.cc:237] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.277745 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.281383 14290 consensus_queue.cc:1059] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:21.308791 14290 raft_consensus.cc:3055] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:21.244251 10931 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:21:21.310703 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.291289 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.249321 14132 raft_consensus.cc:2955] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:21.247382 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.317595 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.298676 14337 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:21.299964 14182 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:21.297176 14384 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:21.301841 14232 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:21.305044 11006 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:21.309377 14290 raft_consensus.cc:740] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:21.234792 14381 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.315953 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.301615 14329 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:21.364645 11011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2455) took 1194 ms. Trace:
I20260709 12:21:21.317658 11004 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:21.350841 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:21.368228 11011 rpcz_store.cc:276] 0709 12:21:20.170724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.175495 (+  4771us) service_pool.cc:224] Handling call
0709 12:21:20.175803 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:20.176209 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:20.176236 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:20.216676 (+ 40440us) log.cc:844] Serialized 26 byte log entry
0709 12:21:20.416153 (+199477us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:20.416192 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:20.416344 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:21.364395 (+948051us) raft_consensus.cc:1685] finished
0709 12:21:21.364417 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:21.364577 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15235,"raft.queue_time_us":2516,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":26164,"thread_start_us":147117,"threads_started":1,"wal-append.queue_time_us":371005}
I20260709 12:21:21.315629 14079 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.371196 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.368309 11002 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:21:21.369437 10930 raft_consensus.cc:1275] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:21:21.332415 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 72050.3us
I20260709 12:21:21.371680 11005 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:21.318305 11007 raft_consensus.cc:2393] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 7: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:21.372480 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:21.372622 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 316064us
I20260709 12:21:21.372088 11081 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:21:21.376991 10933 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 12:21:21.357715 14227 consensus_meta.cc:287] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 1.150s	user 0.005s	sys 0.007s
I20260709 12:21:21.403095 11009 raft_consensus.cc:2393] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:21.403530 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:21.405676 11076 raft_consensus.cc:2393] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 8: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:21.407944 11004 raft_consensus.cc:2368] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 8.
I20260709 12:21:21.363039 14316 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:21.362130 14131 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:21.444916 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:21.351873 14318 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:21.414521 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.350980 14218 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:21.377435 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:21.454172 10930 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:21.417425 11081 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:21:21.418084 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:21.345827 10932 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:21.455094 11007 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:21.419677 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:21.421231 11083 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:21.422243 11080 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:21.456414 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:21.457038 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:21.457463 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:21.457738 11080 raft_consensus.cc:2368] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9.
I20260709 12:21:21.458695 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:21.458913 11080 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:21:21.416518 14333 consensus_meta.cc:287] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.868s	user 0.014s	sys 0.011s
I20260709 12:21:21.422850 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:21.423830 11077 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:21.427512 11051 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:21.335667 14277 raft_consensus.cc:697] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:21.432749 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.470372 11004 raft_consensus.cc:2393] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:21.372455 14185 raft_consensus.cc:697] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:21.361153 14345 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:21.478770 14277 consensus_queue.cc:237] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.479622 14381 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:21.450397 11002 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:21.452550 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:21.481951 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:21.482733 11083 raft_consensus.cc:2368] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9.
I20260709 12:21:21.452706 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:21.394780 14080 raft_consensus.cc:697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:21.469625 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:21.472672 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 45347.9us
I20260709 12:21:21.488550 11051 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:21.488839 11656 raft_consensus.cc:2393] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 7: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:21.488000 10930 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:21.489912 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:21.494688 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:21.475124 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.495595 11004 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 5: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:21.447252 14134 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:21.496462 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:21.497301 14229 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:21.497716 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.371652 14279 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.498805 14363 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:21.480440 14182 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:21.499931 14182 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:21.500198 11657 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:21.500918 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:21.491600 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:21.503050 14232 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:21.504287 14379 log.cc:927] Time spent T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.505s	user 0.000s	sys 0.004s
I20260709 12:21:21.409209 14227 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:21.472201 11076 raft_consensus.cc:2393] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 5: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:21.500929 10936 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:21.487450 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:21.488405 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.488457 11084 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 5: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:21.491671 14392 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:21.492167 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:21.468863 11007 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
W20260709 12:21:21.475394 14219 consensus_meta.cc:287] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.903s	user 0.011s	sys 0.025s
I20260709 12:21:21.507280 11002 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:21.398023 14079 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.509809 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:21.474177 11079 raft_consensus.cc:2393] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 7: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:21:21.500869 14389 log.cc:927] Time spent T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:21:21.523542 11007 raft_consensus.cc:2393] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 6: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:21.510640 10929 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:21:21.512336 11083 raft_consensus.cc:1240] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:21.515187 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.540407 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:21.496428 14080 consensus_queue.cc:237] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.508234 14363 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:21.634450 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2452) took 1464 ms. Trace:
I20260709 12:21:21.646205 10928 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:21:21.633642 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2560) took 1090 ms. Trace:
I20260709 12:21:21.509369 14182 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:21.645931 11008 rpcz_store.cc:276] 0709 12:21:20.169841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.173460 (+  3619us) service_pool.cc:224] Handling call
0709 12:21:20.173791 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:21.231231 (+1057440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.634237 (+403006us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000dd9d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:21.634396 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2423442176}
I20260709 12:21:21.647837 11078 rpcz_store.cc:276] 0709 12:21:20.543070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.544077 (+  1007us) service_pool.cc:224] Handling call
0709 12:21:20.544404 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:20.547763 (+  3359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:20.547796 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:20.564953 (+ 17157us) log.cc:844] Serialized 26 byte log entry
0709 12:21:20.770804 (+205851us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:20.770850 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:20.772962 (+  2112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:21.503734 (+730772us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:21.633298 (+129564us) raft_consensus.cc:1685] finished
0709 12:21:21.633322 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:21.633561 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2169,"raft.queue_time_us":19823,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":6590,"spinlock_wait_cycles":11609472,"thread_start_us":167147,"threads_started":1,"wal-append.queue_time_us":334131}
I20260709 12:21:21.657620 11051 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:21.659024 11051 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:21.660156 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:21.660807 11004 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:21.664075 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:21.681104 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:21.681872 10933 raft_consensus.cc:2368] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7.
I20260709 12:21:21.581269 11084 raft_consensus.cc:2955] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:21.687693 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:21.470695 14218 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:21.692564 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.702565 11002 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:21.697741 11004 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:21.634359 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:21.703457 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:21.451490 14290 consensus_queue.cc:260] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:21.705191 14363 consensus_queue.cc:1059] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:21.688695 14229 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:21.708580 11002 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:21.702032 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:21.708775 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:21.535995 14219 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12.
I20260709 12:21:21.536177 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:21.580470 14392 raft_consensus.cc:697] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:21.713639 11004 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 10: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:21.715906 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:21.687964 14081 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.496399 14185 consensus_queue.cc:237] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.729382 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:21.723424 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:21.731809 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.699407 14400 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:21:21.720165 14311 consensus_meta.cc:287] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 1.100s	user 0.006s	sys 0.007s
I20260709 12:21:21.711830 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:21.741593 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:21.742822 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:21.715363 14229 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:21.743785 11004 raft_consensus.cc:2410] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:21:21.800834 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:21.801659 11004 raft_consensus.cc:2368] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7.
I20260709 12:21:21.802456 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:21.803522 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:21.804083 11004 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:21.761337 11653 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 7: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:21.744092 14400 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:21.811256 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:21.811973 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:21.815755 10931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 1952) took 1051 ms. Trace:
I20260709 12:21:21.818532 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:21.820886 10933 raft_consensus.cc:2368] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11.
I20260709 12:21:21.733882 14081 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.823065 11076 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:21.816226 10931 rpcz_store.cc:276] 0709 12:21:20.764107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.030997 (+266890us) service_pool.cc:224] Handling call
0709 12:21:21.815564 (+784567us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54001a81d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:21.815689 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":417186048}
I20260709 12:21:21.825527 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:21.826164 10931 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:21:21.737711 14358 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:21.829191 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:21.832454 10931 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:21:21.829627 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:21.801368 14229 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:21.834060 10928 raft_consensus.cc:2368] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11.
I20260709 12:21:21.834370 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:21.766975 14311 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.835191 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:21.833811 10899 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:21.839618 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:21.840272 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:21.840963 10933 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 7: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:21.819905 14262 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:21.842538 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:21.822113 14400 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:21.845209 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:21.847201 10899 leader_election.cc:400] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9.
I20260709 12:21:21.847324 10928 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 10: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:21:21.836800 14411 log.cc:927] Time spent T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:21:21.846371 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:21.852586 10933 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 7: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:21.849225 10899 leader_election.cc:400] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9.
I20260709 12:21:21.842175 14317 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:21.856564 11011 raft_consensus.cc:2393] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:21.827831 14219 consensus_queue.cc:1059] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:21:21.865029 10928 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12. Ops: []
W20260709 12:21:21.857434 14410 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:21:21.869897 11004 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:21.860657 11655 raft_consensus.cc:1240] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:21.861754 14317 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:21.855119 14077 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:21:21.880285 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:21.886564 10928 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:21.850040 14149 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:21:21.852089 14397 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:21:21.851954 14318 consensus_queue.cc:1059] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:21:21.890487 11004 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:21.830760 14392 consensus_queue.cc:237] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:21.851017 14262 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:21.857452 14391 consensus_queue.cc:1059] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:21:21.863821 14333 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:21:21.903646 11004 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 7.
I20260709 12:21:21.919510 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.920725 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.921769 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:21.922302 11004 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:21.891149 14317 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:21.928777 10928 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
W20260709 12:21:21.930454 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 75658.1us
I20260709 12:21:21.932886 11002 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:21.933947 11076 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:21.933947 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:21.934942 11002 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 5: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:21.893980 14218 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:21.936735 11076 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:21:21.936874 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.937508 11002 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:21.936336 11004 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:21:21.940181 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:21.940759 11004 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:21.941612 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:21.942546 11002 raft_consensus.cc:2393] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 7: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:21.943281 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:21.943794 11002 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:21:21.930392 14227 raft_consensus.cc:3055] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:21.935012 14183 raft_consensus.cc:3055] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:21.957446 11004 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:21.962445 11002 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:21:21.972651 14262 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:21.973683 14415 log.cc:927] Time spent T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:21:21.959399 11653 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEARNER]: Advancing to term 5
I20260709 12:21:21.981269 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:21.981981 11076 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8.
W20260709 12:21:21.986479 11050 leader_election.cc:336] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.602s (SENT)
I20260709 12:21:21.987079 11050 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:21.988722 11653 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 LEARNER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:21:21.941686 14220 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:21.950374 14183 raft_consensus.cc:740] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:22.010759 10931 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:21:21.984064 14413 log.cc:927] Time spent T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:21:22.002981 14416 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:22.003638 14077 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:21:22.007472 14418 log.cc:927] Time spent T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:21:22.016573 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:22.013203 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:21.950163 14227 raft_consensus.cc:740] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:22.015734 14081 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:22.018725 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:22.019776 11004 raft_consensus.cc:2393] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:22.020081 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:22.021420 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.022486 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.023224 11002 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:22.024092 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.026281 11004 raft_consensus.cc:2393] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:22.027622 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:22.029460 11004 raft_consensus.cc:2376] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11. Re-sending same reply.
I20260709 12:21:22.030392 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.031132 11004 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 10: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:22.013887 14358 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:22.034569 14227 consensus_queue.cc:260] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:22.035794 14227 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:22.038298 14182 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:22.019083 14218 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.040620 14182 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:22.043470 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.044167 14317 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:22.047050 14219 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.047199 14384 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.047631 14219 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:22.047758 14384 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:22.048552 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.049316 11010 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 5: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:22.049787 14219 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:22.049937 14384 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:22.050101 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:22.051244 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.052716 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:22.054036 14317 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:22.017439 14220 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:22.057233 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 1987) took 1090 ms. Trace:
I20260709 12:21:22.057657 11009 rpcz_store.cc:276] 0709 12:21:20.966659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.263838 (+297179us) service_pool.cc:224] Handling call
0709 12:21:22.057028 (+793190us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b5400243954. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:22.057171 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313820032}
I20260709 12:21:22.058045 14220 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:22.058924 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.060544 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41098 (request call id 169) took 1179 ms. Trace:
I20260709 12:21:22.060990 11003 rpcz_store.cc:276] 0709 12:21:20.880785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.880973 (+   188us) service_pool.cc:224] Handling call
0709 12:21:20.881234 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:21.227585 (+346351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:21.227615 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:21.227652 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:21.227681 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.060315 (+832634us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b5400473954. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:22.060365 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:22.060491 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":796053376}
I20260709 12:21:22.062251 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.062391 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:22.063027 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 2469) took 1130 ms. Trace:
I20260709 12:21:22.063385 11003 rpcz_store.cc:276] 0709 12:21:20.932771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.062017 (+1129246us) service_pool.cc:224] Handling call
0709 12:21:22.062973 (+   956us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:22.063782 14183 consensus_queue.cc:260] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:22.096007 11007 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:22.065485 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:22.022501 14175 raft_consensus.cc:3055] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:22.068809 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:22.040544 14218 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:22.072921 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1959) took 1058 ms. Trace:
I20260709 12:21:22.101332 10936 rpcz_store.cc:276] 0709 12:21:21.014888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.249104 (+234216us) service_pool.cc:224] Handling call
0709 12:21:21.249361 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:21.506198 (+256837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.072674 (+566476us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54000609d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:22.072862 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578116864}
I20260709 12:21:22.075913 14079 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:22.076252 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:22.076431 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:22.104046 11009 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 7: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:22.081261 14400 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:22.079131 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:22.082064 10928 raft_consensus.cc:1240] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:22.082369 14172 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.063385 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:22.092973 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.044229 11006 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:22.106837 10936 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:21:22.133308 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.071291 14229 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:22.136626 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.137918 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:22.138477 11006 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:22.097026 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.097481 11079 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:22.139668 11007 raft_consensus.cc:2393] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:22.140528 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.099772 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:22.141244 11007 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 5: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:22.022606 14311 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:22.141989 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.143296 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:22.144076 11007 raft_consensus.cc:2393] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 10: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:22.144881 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.145568 11007 raft_consensus.cc:2393] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:22.103098 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:22.101928 10977 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:22.085793 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:22.132344 11003 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:22.099021 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.146927 14172 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:22.217495 11082 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:22.219655 14172 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:22.197175 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.146315 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.098428 14175 raft_consensus.cc:740] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:22.245503 11006 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:22.252137 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.256616 11006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "970339bba6a8454e8c722b4367924db8"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:21:22.257357 11006 raft_consensus.cc:606] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:22.150440 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.258572 11077 raft_consensus.cc:2393] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 6: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:22.258837 11009 raft_consensus.cc:2393] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:22.242440 11079 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8.
I20260709 12:21:22.235831 11010 raft_consensus.cc:2376] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14. Re-sending same reply.
I20260709 12:21:22.223985 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:22.260080 11003 raft_consensus.cc:2393] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 6: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:22.260818 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.260144 11004 raft_consensus.cc:2376] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8. Re-sending same reply.
I20260709 12:21:22.241662 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.262019 11007 raft_consensus.cc:2368] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 8.
I20260709 12:21:22.260967 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:22.263181 11010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41098 (request call id 171) took 1362 ms. Trace:
I20260709 12:21:22.263904 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41098 (request call id 176) took 1335 ms. Trace:
I20260709 12:21:22.261099 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.264432 11007 rpcz_store.cc:276] 0709 12:21:20.928624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.263158 (+1334534us) service_pool.cc:224] Handling call
0709 12:21:22.263432 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:22.263608 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:22.263628 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:22.263665 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:22.263701 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.263754 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:22.263836 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:22.264596 11003 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:22.265604 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2470) took 1332 ms. Trace:
I20260709 12:21:22.265955 11003 rpcz_store.cc:276] 0709 12:21:20.933001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.264056 (+1331055us) service_pool.cc:224] Handling call
0709 12:21:22.264303 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:22.265371 (+  1068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.265548 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:22.263590 11010 rpcz_store.cc:276] 0709 12:21:20.900984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.262425 (+1361441us) service_pool.cc:224] Handling call
0709 12:21:22.262731 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:22.262892 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:22.262917 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:22.262956 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:22.262986 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.263036 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:22.263129 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:22.266904 11004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41098 (request call id 175) took 1343 ms. Trace:
I20260709 12:21:22.215474 11651 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:22.268069 11004 rpcz_store.cc:276] 0709 12:21:20.923876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.266157 (+1342281us) service_pool.cc:224] Handling call
0709 12:21:22.266416 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:22.266609 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:22.266633 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:22.266670 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:22.266708 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.266762 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:22.266854 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:22.269798 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.221614 14311 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.271163 11009 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8. Ops: []
W20260709 12:21:22.257970 14412 log.cc:927] Time spent T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.389s	user 0.000s	sys 0.003s
I20260709 12:21:22.274267 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2474) took 1262 ms. Trace:
I20260709 12:21:22.276209 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:22.277055 11006 raft_consensus.cc:2376] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7. Re-sending same reply.
I20260709 12:21:22.272732 11004 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:22.278177 11004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2478) took 1239 ms. Trace:
I20260709 12:21:22.278507 11004 rpcz_store.cc:276] 0709 12:21:21.038777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.272266 (+1233489us) service_pool.cc:224] Handling call
0709 12:21:22.272576 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:22.277951 (+  5375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.278125 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:22.276301 11009 rpcz_store.cc:276] 0709 12:21:21.011486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.270718 (+1259232us) service_pool.cc:224] Handling call
0709 12:21:22.270983 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:22.274037 (+  3054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.274213 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:22.105212 14337 consensus_queue.cc:1059] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.165s
I20260709 12:21:22.281507 11004 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:22.268468 14378 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:22.105158 14219 consensus_queue.cc:1048] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.177s
I20260709 12:21:22.284715 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:22.290051 11004 raft_consensus.cc:2376] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12. Re-sending same reply.
I20260709 12:21:22.295389 11004 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:21:22.297276 14229 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:22.299381 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.299636 11004 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:21:22.301756 14404 log.cc:927] Time spent T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.559s	user 0.000s	sys 0.001s
I20260709 12:21:22.302380 14397 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.302924 14397 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:22.305857 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2561) took 1762 ms. Trace:
I20260709 12:21:22.306475 11085 rpcz_store.cc:276] 0709 12:21:20.543341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.661825 (+118484us) service_pool.cc:224] Handling call
0709 12:21:20.662125 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:21.233072 (+570947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.305440 (+1072368us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b5400217354. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:22.305766 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1311709952}
I20260709 12:21:22.277020 14311 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:22.308643 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:22.309165 14311 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:22.309638 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:22.309937 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:22.310494 10934 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:22.311089 10901 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:22.311384 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:22.309170 14397 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:22.312577 14218 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:22.312882 14327 raft_consensus.cc:3055] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:22.313290 14327 raft_consensus.cc:740] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:22.314404 10934 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:22.310770 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:22.321856 11004 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:21:22.328889 11009 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 12:21:22.377044 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 88867.6us
I20260709 12:21:22.329779 14397 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:22.283901 14175 consensus_queue.cc:260] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:22.314100 14327 consensus_queue.cc:260] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:22.357501 14218 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:21:22.521946 14430 log.cc:927] Time spent T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.143s	user 0.003s	sys 0.009s
I20260709 12:21:22.427765 11006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 1994) took 1370 ms. Trace:
I20260709 12:21:22.573372 14175 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:22.584098 14400 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:22.489066 11655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59398 (request call id 297) took 1086 ms. Trace:
W20260709 12:21:22.487183 11005 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 2459) took 2315 ms (client timeout 1573 ms). Trace:
I20260709 12:21:22.537269 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.590718 11008 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 7: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:22.531813 11011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 1998) took 1195 ms. Trace:
I20260709 12:21:22.576437 11078 raft_consensus.cc:1240] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:22.591231 11011 rpcz_store.cc:276] 0709 12:21:21.336213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.370945 (+ 34732us) service_pool.cc:224] Handling call
0709 12:21:22.531541 (+1160596us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b540029c2d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:22.531737 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1106777984}
I20260709 12:21:22.592203 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:22.592442 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:22.576812 14327 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:22.429293 11081 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 313) took 1005 ms. Trace:
I20260709 12:21:22.594887 11081 rpcz_store.cc:276] 0709 12:21:21.423526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.459839 (+ 36313us) service_pool.cc:224] Handling call
0709 12:21:21.460178 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:21.720349 (+260171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:21.720382 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:21.720422 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:21.720453 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.429018 (+708565us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b54002788d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:22.429070 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:22.429224 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":597817216}
I20260709 12:21:22.577688 11084 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:22.597019 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:22.597720 11084 raft_consensus.cc:2368] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 8. Current term is 9.
I20260709 12:21:22.598559 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:22.579142 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:22.579996 11083 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:21:22.600225 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:22.580287 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:22.602002 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:22.376294 14412 log.cc:927] Time spent T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:21:22.531991 11002 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:22.379990 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:22.616495 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:22.617434 11077 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 5: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:22.586338 14378 raft_consensus.cc:697] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:22.626466 14378 consensus_queue.cc:237] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:22.629325 14279 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:22.572202 11050 leader_election.cc:336] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.537s (SENT)
I20260709 12:21:22.385948 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:22.586397 11006 rpcz_store.cc:276] 0709 12:21:21.057191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.278021 (+1220830us) service_pool.cc:224] Handling call
0709 12:21:22.278332 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:22.427336 (+149004us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:22.427370 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:22.427419 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:22.427459 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.427545 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:22.427687 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4573,"raft.queue_time_us":282692,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"thread_start_us":140822,"threads_started":1}
I20260709 12:21:22.630719 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.630887 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.631358 11006 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:22.631978 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:22.512713 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:22.593513 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:22.561991 14234 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:22.633410 11009 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:21:22.594498 11078 raft_consensus.cc:2393] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 9: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:22.634461 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:22.635197 11078 raft_consensus.cc:2393] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 8: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:21:22.589635 11005 rpcz_store.cc:269] 0709 12:21:20.171770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.177734 (+  5964us) service_pool.cc:224] Handling call
0709 12:21:22.486923 (+2309189us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002d9454. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:22.487065 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2417164672}
I20260709 12:21:22.635736 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:22.636492 11082 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 7: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:22.607620 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:22.637028 11076 raft_consensus.cc:2368] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14.
I20260709 12:21:22.637480 11082 raft_consensus.cc:1240] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:22.638084 11076 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:21:22.608801 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2011) took 1193 ms. Trace:
I20260709 12:21:22.638836 11008 rpcz_store.cc:276] 0709 12:21:21.415747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.536965 (+1121218us) service_pool.cc:224] Handling call
0709 12:21:22.608744 (+ 71779us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:22.600857 11083 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:22.613118 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:22.613948 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:22.620872 11004 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 10: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:22.512689 11625 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:22.640734 14290 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:22.641040 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 128443us
W20260709 12:21:22.641427 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 69264.5us
I20260709 12:21:22.641812 11625 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:22.642046 11050 leader_election.cc:336] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.550s (SENT)
I20260709 12:21:22.642467 11050 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:22.639899 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:22.643960 14262 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:22.644594 14234 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:22.584728 14384 consensus_queue.cc:1175] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" responder_term: 11 status { last_received { term: 10 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:21:22.598937 11655 rpcz_store.cc:276] 0709 12:21:21.402276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.407521 (+  5245us) service_pool.cc:224] Handling call
0709 12:21:21.491842 (+ 84321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:21.891323 (+399481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.488728 (+597405us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b540053b454. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:22.488990 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":811482880}
I20260709 12:21:22.619566 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:22.587605 14218 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:22.652892 11079 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:21:22.648582 11077 raft_consensus.cc:2368] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11.
W20260709 12:21:22.653302 11050 leader_election.cc:336] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.579s (SENT)
I20260709 12:21:22.658828 11050 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:22.660873 11050 leader_election.cc:336] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.588s (SENT)
I20260709 12:21:22.661331 11050 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:22.644622 14262 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:22.667785 14234 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:22.665848 14133 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:22.759347 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2299) took 1390 ms. Trace:
I20260709 12:21:22.760403 10935 rpcz_store.cc:276] 0709 12:21:21.368575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.369579 (+  1004us) service_pool.cc:224] Handling call
0709 12:21:21.369891 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:21.370263 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:21.370292 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:21.406503 (+ 36211us) log.cc:844] Serialized 26 byte log entry
0709 12:21:21.728981 (+322478us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:21.740069 (+ 11088us) log.cc:844] Serialized 14 byte log entry
0709 12:21:21.740450 (+   381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.740523 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:22.219382 (+478859us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:22.631699 (+412317us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b1800035740. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade73522 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:21:22.758381 (+126682us) raft_consensus.cc:1685] finished
0709 12:21:22.758458 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:22.758944 (+   486us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10518,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":932,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":29345,"spinlock_wait_cycles":40737664,"thread_start_us":258966,"threads_started":1,"wal-append.queue_time_us":388919}
W20260709 12:21:22.515401 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 204415us
W20260709 12:21:22.382018 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 280131us
I20260709 12:21:22.769006 10977 leader_election.cc:400] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7.
I20260709 12:21:22.769548 10977 leader_election.cc:403] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:21:22.770470 10901 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:22.774705 10901 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:22.774858 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:22.777951 10901 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:22.780896 10901 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:22.783237 11010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2476) took 1765 ms. Trace:
I20260709 12:21:22.783742 11010 rpcz_store.cc:276] 0709 12:21:21.017631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.272794 (+1255163us) service_pool.cc:224] Handling call
0709 12:21:22.273104 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:22.273431 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:22.273457 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:22.277664 (+  4207us) log.cc:844] Serialized 26 byte log entry
0709 12:21:22.653224 (+375560us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:22.653261 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.653336 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:22.782563 (+129227us) raft_consensus.cc:1685] finished
0709 12:21:22.782603 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:22.783000 (+   397us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":36361,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":323236,"threads_started":1,"wal-append.queue_time_us":436910}
W20260709 12:21:22.663003 11050 leader_election.cc:336] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.596s (SENT)
I20260709 12:21:22.787290 11085 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:22.787631 11050 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:22.788435 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 145030us
I20260709 12:21:22.789230 14162 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:22.790096 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 127115us
I20260709 12:21:22.799183 11082 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:22.800441 14337 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7.
W20260709 12:21:22.800640 11050 leader_election.cc:336] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.624s (SENT)
I20260709 12:21:22.817528 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:22.819824 14262 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:22.821805 14436 consensus_queue.cc:1059] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:22.822072 14439 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:22.822912 14439 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:22.823583 14337 raft_consensus.cc:3055] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:21:22.828480 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 47794us
I20260709 12:21:22.840449 14399 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:22.826777 14337 raft_consensus.cc:740] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:22.842638 14337 consensus_queue.cc:260] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:22.844000 14277 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:22.846590 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:22.848433 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 73821us
I20260709 12:21:22.848712 14399 raft_consensus.cc:697] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:22.850363 14399 consensus_queue.cc:237] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:22.854101 14277 raft_consensus.cc:1064] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
W20260709 12:21:22.854637 14277 raft_consensus.cc:1068] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697: Unable to promote non-voter 0b171b6aaedc4f809f2753dcfadb14ce: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:21:22.858121 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:22.856398 14337 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:22.860886 14218 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:22.861696 14333 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:22.868470 14395 consensus_queue.cc:1059] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:22.823599 14439 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:22.876303 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 73003.5us
I20260709 12:21:22.823822 14394 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:22.879832 10977 leader_election.cc:400] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11.
I20260709 12:21:22.892688 10977 leader_election.cc:403] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 12:21:22.896291 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 93728.9us
I20260709 12:21:22.908753 14337 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11.
I20260709 12:21:22.912441 10901 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:21:22.915956 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.926859 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:22.929270 10977 leader_election.cc:400] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11.
I20260709 12:21:22.929639 10977 leader_election.cc:403] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 12:21:22.930192 10929 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 1946) took 2247 ms (client timeout 2045 ms). Trace:
W20260709 12:21:22.930689 10929 rpcz_store.cc:269] 0709 12:21:20.682594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.682724 (+   130us) service_pool.cc:224] Handling call
0709 12:21:22.929678 (+2246954us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b5400205dd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:22.929925 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1029448960}
I20260709 12:21:22.932124 14433 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11.
I20260709 12:21:22.930789 14436 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:22.940752 14436 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:22.941278 14436 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:22.941560 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.944705 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:22.946275 14359 raft_consensus.cc:3055] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:22.946712 14359 raft_consensus.cc:740] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:22.947340 11084 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:21:22.948092 14359 consensus_queue.cc:260] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:22.941380 11078 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:21:22.949795 11081 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:21:22.950002 14311 raft_consensus.cc:3055] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:22.950861 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:22.948035 11050 leader_election.cc:336] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.646s (SENT)
I20260709 12:21:22.956774 14311 raft_consensus.cc:740] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:22.966161 14311 consensus_queue.cc:260] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:22.968302 14394 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:22.968906 14394 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:22.969336 14394 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:22.972467 14133 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.973429 14133 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:22.975306 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.980422 14359 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:22.986174 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 51317.7us
W20260709 12:21:22.987175 11050 leader_election.cc:336] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.651s (SENT)
I20260709 12:21:22.987754 11050 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:22.988850 14218 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:22.990252 10974 leader_election.cc:400] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5.
I20260709 12:21:22.990677 10974 leader_election.cc:403] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:22.991451 14337 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 4. Current term is 5.
I20260709 12:21:22.992321 10974 leader_election.cc:400] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 8. Current term is 9.
I20260709 12:21:22.992657 10974 leader_election.cc:403] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:22.993330 14337 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 8. Current term is 9.
W20260709 12:21:22.996605 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 99636.8us
I20260709 12:21:22.997730 10901 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:22.996619 10974 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:22.999706 14337 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:23.010567 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2475) took 1997 ms. Trace:
I20260709 12:21:23.010394 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:23.012732 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2316) took 1617 ms. Trace:
I20260709 12:21:23.013193 10928 rpcz_store.cc:276] 0709 12:21:21.395263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.930740 (+535477us) service_pool.cc:224] Handling call
0709 12:21:21.941193 (+ 10453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:22.135251 (+194058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.012269 (+877018us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b540024d454. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:23.012571 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323564416}
I20260709 12:21:23.014277 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2477) took 1978 ms. Trace:
I20260709 12:21:23.014788 11002 rpcz_store.cc:276] 0709 12:21:21.035989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.272515 (+1236526us) service_pool.cc:224] Handling call
0709 12:21:22.531751 (+259236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:22.615756 (+ 84005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.013866 (+398110us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b540029c2d0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:23.014078 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591243520}
I20260709 12:21:23.017071 14290 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:23.019380 14238 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:23.019702 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 64948.3us
I20260709 12:21:23.020136 14238 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.022661 10977 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:23.012987 10901 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:23.011098 11007 rpcz_store.cc:276] 0709 12:21:21.011767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.280062 (+1268295us) service_pool.cc:224] Handling call
0709 12:21:22.280467 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:22.585576 (+305109us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:22.585598 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:22.585975 (+   377us) log.cc:844] Serialized 26 byte log entry
0709 12:21:23.002538 (+416563us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:23.004120 (+  1582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.008092 (+  3972us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:23.008140 (+    48us) raft_consensus.cc:1685] finished
0709 12:21:23.008151 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:23.009589 (+  1438us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29201,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":65,"thread_start_us":562269,"threads_started":2,"wal-append.queue_time_us":316923}
I20260709 12:21:23.031639 14133 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:23.032457 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:23.033221 14311 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:23.033316 11084 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:23.030042 10974 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:23.032868 14238 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:23.035777 10930 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 7.
W20260709 12:21:23.053287 10930 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53346 (request call id 272) took 1592 ms (client timeout 1664 ms). Trace:
W20260709 12:21:23.053711 10930 rpcz_store.cc:269] 0709 12:21:21.461092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.500691 (+ 39599us) service_pool.cc:224] Handling call
0709 12:21:23.053041 (+1552350us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b540024c054. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:23.053191 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3341937920}
I20260709 12:21:23.036365 14081 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:23.038168 10901 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:23.048288 14342 raft_consensus.cc:3055] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:23.054729 14081 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:23.055544 14081 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:23.056635 10901 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:23.054930 14342 raft_consensus.cc:740] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:23.060014 14342 consensus_queue.cc:260] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.061389 14342 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:23.054667 10830 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 110) took 6483 ms. Trace:
I20260709 12:21:23.050431 10829 catalog_manager.cc:5697] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 6 to 7, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 7 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:23.049485 10833 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35620 (request call id 244) took 7015 ms. Trace:
I20260709 12:21:23.066188 14317 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:23.064129 10830 rpcz_store.cc:276] 0709 12:21:16.571183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:16.571895 (+   712us) service_pool.cc:224] Handling call
0709 12:21:23.054475 (+6482580us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1899900,"reported_tablets":2}
W20260709 12:21:23.067628 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 45084.3us
I20260709 12:21:23.071061 14220 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:23.072109 14327 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:23.073681 14335 consensus_queue.cc:1059] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:21:23.071494 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 46944.3us
W20260709 12:21:23.075455 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 44507.5us
I20260709 12:21:23.076118 14337 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:23.076920 14220 raft_consensus.cc:697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:23.068357 14399 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:21:23.086897 14183 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:23.084213 10931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53346 (request call id 277) took 1268 ms. Trace:
I20260709 12:21:23.092514 10931 rpcz_store.cc:276] 0709 12:21:21.814942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.012606 (+197664us) service_pool.cc:224] Handling call
0709 12:21:22.012846 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:22.085264 (+ 72418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:22.085293 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:22.085335 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:22.085367 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.080898 (+995531us) spinlock_profiling.cc:243] Waited 72.2 ms on lock 0x7b5400204ed4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:23.082823 (+  1925us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:23.083418 (+   595us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166086528}
I20260709 12:21:23.082721 14220 consensus_queue.cc:237] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.084713 14232 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:23.085007 10829 catalog_manager.cc:5697] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 3 to 4, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 4 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:23.089823 11622 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:23.083731 10974 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:23.084388 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.101222 10977 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:23.102646 11085 raft_consensus.cc:1240] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:23.102165 10829 catalog_manager.cc:5697] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 6 to 8, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 8 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:23.099207 14232 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:23.112375 14337 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:23.114085 10974 leader_election.cc:400] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11.
I20260709 12:21:23.114514 10974 leader_election.cc:403] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:21:23.115235 14337 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11.
I20260709 12:21:23.064749 10833 rpcz_store.cc:276] 0709 12:21:16.033839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:16.033965 (+   126us) service_pool.cc:224] Handling call
0709 12:21:23.049202 (+7015237us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:19.145096 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:19.317858 (+172762us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:19.320060 (+  2202us) write_op.cc:435] Acquired schema lock
0709 12:21:19.323693 (+  3633us) tablet.cc:662] Decoding operations
0709 12:21:19.461343 (+137650us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:19.462615 (+  1272us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:19.471891 (+  9276us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:21:19.565006 (+ 93115us) tablet.cc:701] Row locks acquired
0709 12:21:19.567161 (+  2155us) write_op.cc:260] PREPARE: finished
0709 12:21:19.600105 (+ 32944us) write_op.cc:270] Start()
0709 12:21:19.600234 (+   129us) write_op.cc:276] Timestamp: P: 1783599679600042 usec, L: 0
0709 12:21:19.600257 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:21:19.600914 (+   657us) log.cc:844] Serialized 538 byte log entry
0709 12:21:20.948702 (+1347788us) op_driver.cc:464] REPLICATION: finished
0709 12:21:21.144870 (+196168us) write_op.cc:301] APPLY: starting
0709 12:21:21.144960 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:21.145064 (+   104us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:21.145180 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:21.145395 (+   215us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:21.145575 (+   180us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:21:21.145619 (+    44us) write_op.cc:312] APPLY: finished
0709 12:21:21.145799 (+   180us) log.cc:844] Serialized 23 byte log entry
0709 12:21:21.145961 (+   162us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:21.146050 (+    89us) write_op.cc:454] Released schema lock
0709 12:21:21.146085 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:21.156657 (+ 10572us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:21.156689 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":513053,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":195898,"apply.run_cpu_time_us":1571,"apply.run_wall_time_us":1575,"num_ops":1,"prepare.queue_time_us":185799,"prepare.run_cpu_time_us":47367,"prepare.run_wall_time_us":1165223,"raft.queue_time_us":310187,"raft.run_cpu_time_us":11390,"raft.run_wall_time_us":241375,"replication_time_us":1334426,"thread_start_us":1111161,"threads_started":4,"wal-append.queue_time_us":646894,"wal-append.run_cpu_time_us":35474,"wal-append.run_wall_time_us":1944580}]]}
I20260709 12:21:23.118688 14358 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:23.118652 10974 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:23.159919 11050 leader_election.cc:336] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.725s (SENT)
I20260709 12:21:23.158625 14081 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:23.163662 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:23.164279 14133 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:23.166702 11007 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:21:23.167567 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.125034 14335 consensus_queue.cc:1059] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:21:23.168816 14290 raft_consensus.cc:3055] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:23.163206 11050 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:23.169245 14290 raft_consensus.cc:740] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:23.172310 14290 consensus_queue.cc:260] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.173671 14290 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:23.176410 14133 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:23.178079 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:23.180392 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:23.180712 11007 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:21:23.181181 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:23.181600 11050 leader_election.cc:336] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.782s (SENT)
I20260709 12:21:23.139034 14358 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:23.183821 11050 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:23.184391 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 105990us
I20260709 12:21:23.145586 14232 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:23.186024 11010 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:23.188758 14337 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:23.185489 11622 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:23.194013 14232 consensus_queue.cc:1059] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:23.195293 14133 raft_consensus.cc:3055] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:23.195734 14133 raft_consensus.cc:740] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:23.197750 14133 consensus_queue.cc:260] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:23.199304 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 80746.3us
I20260709 12:21:23.200096 14327 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:23.186455 14358 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:23.202037 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.205458 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:23.207020 14335 raft_consensus.cc:1064] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:21:23.207144 14317 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:23.207577 14335 raft_consensus.cc:1068] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697: Unable to promote non-voter 0b171b6aaedc4f809f2753dcfadb14ce: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:21:23.199327 14133 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:23.209794 14394 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:23.214272 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 68285us
I20260709 12:21:23.215286 14262 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:23.213337 14220 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:21:23.220343 14262 raft_consensus.cc:697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:23.222291 14262 consensus_queue.cc:237] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:23.215644 14232 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:23.215435 14394 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:23.193255 14436 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:23.237160 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:23.239475 14327 raft_consensus.cc:993] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:21:23.240064 14327 raft_consensus.cc:1081] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:21:23.229470 14081 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:23.245229 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:23.246930 14439 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:23.249610 14311 consensus_queue.cc:1059] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:23.253333 14337 consensus_queue.cc:1059] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:23.254738 10974 leader_election.cc:400] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 8. Current term is 9.
I20260709 12:21:23.263883 10974 leader_election.cc:403] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:21:23.264333 14337 raft_consensus.cc:3055] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:23.264870 14384 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 8. Current term is 9.
I20260709 12:21:23.265486 14311 raft_consensus.cc:3055] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:23.265909 14311 raft_consensus.cc:740] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:23.266141 10899 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:23.259788 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:23.266755 14394 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:23.267233 14433 consensus_queue.cc:1059] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:23.264834 14337 raft_consensus.cc:740] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:23.269076 14384 raft_consensus.cc:3055] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:23.268918 14337 consensus_queue.cc:260] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.253475 14219 consensus_queue.cc:1059] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:21:23.269606 14384 raft_consensus.cc:740] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:23.270215 14219 raft_consensus.cc:3055] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:23.271694 10977 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:23.270638 14219 raft_consensus.cc:740] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:23.273869 14311 consensus_queue.cc:260] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.274561 14219 consensus_queue.cc:260] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.273319 14384 consensus_queue.cc:260] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.276001 14337 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:23.276719 14384 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:23.277112 14219 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:23.279356 14394 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:23.279834 14394 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.280474 14394 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:23.289811 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 108303us
W20260709 12:21:23.293329 11050 leader_election.cc:336] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.841s (SENT)
I20260709 12:21:23.294010 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:23.293952 11050 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:23.294823 11003 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:23.295200 14232 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:23.279384 14311 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:23.296645 11050 leader_election.cc:336] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.850s (SENT)
I20260709 12:21:23.297099 11050 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:23.297478 11006 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:21:23.297864 14232 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:23.296581 11051 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:23.300168 14232 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:23.300472 11003 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:21:23.300688 14232 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:23.301230 14232 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:23.270795 14436 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:23.305233 11051 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:23.307618 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 71495.5us
I20260709 12:21:23.291672 10974 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:23.319988 14218 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:23.320264 11006 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:21:23.324118 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:23.330374 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 45006.5us
I20260709 12:21:23.333678 14358 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:23.334317 11004 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:21:23.335359 11010 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:23.337396 14358 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:23.338655 14218 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:23.339443 14218 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:23.321658 14384 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:23.316601 14436 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:21:23.345310 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 84830.2us
I20260709 12:21:23.345266 11007 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:23.350236 14396 consensus_queue.cc:1059] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:23.357697 10974 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:23.370888 14277 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.371083 14279 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:23.371475 14436 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:23.372139 14079 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:23.372790 14079 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.376439 14439 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:23.377604 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
W20260709 12:21:23.377741 14464 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:21:23.360109 14238 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:21:23.371675 14277 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.384577 14277 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:23.389518 10931 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:21:23.389844 14279 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:23.389369 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:23.396736 14342 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:23.397408 14342 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.399456 14342 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:23.408008 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:23.412070 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 58512.9us
W20260709 12:21:23.411499 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 89927.4us
I20260709 12:21:23.403425 14232 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:23.391362 14218 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:23.417264 14218 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:23.417881 14079 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:23.417935 14218 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.417284 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:23.417584 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:23.424283 10931 raft_consensus.cc:2376] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5. Re-sending same reply.
I20260709 12:21:23.424482 10930 raft_consensus.cc:2376] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5. Re-sending same reply.
I20260709 12:21:23.425550 14133 raft_consensus.cc:3055] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:21:23.430151 14461 log.cc:927] Time spent T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:21:23.437638 14133 raft_consensus.cc:740] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:23.438640 14079 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.439169 14079 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.443491 14079 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:23.439556 14133 consensus_queue.cc:260] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.445521 14133 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:23.447402 14219 consensus_queue.cc:1059] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:23.449376 14439 raft_consensus.cc:3055] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:23.450752 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:23.451313 10929 raft_consensus.cc:1240] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:23.449625 10931 raft_consensus.cc:2955] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:23.452062 11050 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:23.448498 10930 raft_consensus.cc:1240] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:23.457877 14439 raft_consensus.cc:740] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:23.459007 14439 consensus_queue.cc:260] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.459473 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:23.460084 14439 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:23.460892 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:23.461675 10932 raft_consensus.cc:2393] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 6: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:23.462219 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:23.462334 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:23.462463 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:23.462909 10929 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:23.463300 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:23.463616 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:23.464313 10933 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:23.460240 10927 raft_consensus.cc:2376] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14. Re-sending same reply.
I20260709 12:21:23.463384 10932 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:23.467105 14397 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.467249 14337 consensus_queue.cc:1059] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:23.455658 10928 raft_consensus.cc:2376] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 7. Re-sending same reply.
I20260709 12:21:23.467692 14397 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.468158 14436 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:23.468770 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:23.440999 14394 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.471897 10935 raft_consensus.cc:2393] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 10: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:23.471804 14397 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:23.472890 14394 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:23.472784 10974 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:23.479612 14232 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:23.479787 14337 consensus_queue.cc:1059] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:23.479926 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:23.480792 14337 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:23.481734 14337 raft_consensus.cc:3055] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:23.481812 10974 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:23.482933 14436 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:21:23.484355 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:23.485332 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 44903.2us
I20260709 12:21:23.486933 11050 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:23.489789 14469 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:23.490605 14469 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:23.491094 10933 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:23.491890 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:23.484434 14311 raft_consensus.cc:3055] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:23.492611 14218 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:23.496517 14311 raft_consensus.cc:740] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:23.497570 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:23.499151 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:23.485224 10974 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:23.523516 10932 raft_consensus.cc:2410] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:21:23.525032 10928 raft_consensus.cc:2376] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7. Re-sending same reply.
I20260709 12:21:23.525209 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:23.525695 11010 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:23.526343 11078 raft_consensus.cc:1240] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:23.527361 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:23.527724 11625 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:23.528832 10934 raft_consensus.cc:2393] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 7: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:23.528661 14262 consensus_queue.cc:1059] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:23.529466 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:23.495957 14337 raft_consensus.cc:740] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:23.521659 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:23.491789 14077 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.535952 11006 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:23.537040 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 50220.5us
I20260709 12:21:23.543897 11003 raft_consensus.cc:2410] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:21:23.546036 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:23.548277 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:23.549083 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 63994.8us
I20260709 12:21:23.551146 11051 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:23.530704 14219 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:23.553619 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:23.554951 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:23.563089 11007 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:23.563326 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:23.563035 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:23.568135 14462 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:23.568794 14462 raft_consensus.cc:697] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:23.568626 14337 consensus_queue.cc:260] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:23.569829 14474 log.cc:927] Time spent T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:21:23.570080 14337 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:23.570560 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:23.571192 11011 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:23.572374 11002 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:23.569802 14462 consensus_queue.cc:237] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:23.574033 11051 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:23.575007 11051 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:23.575804 14396 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:23.576373 14396 raft_consensus.cc:697] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:23.576712 11656 raft_consensus.cc:1240] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:23.577304 14396 consensus_queue.cc:237] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.577769 14469 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:23.579571 14384 consensus_queue.cc:1059] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:23.580700 14384 raft_consensus.cc:3055] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:23.581056 14384 raft_consensus.cc:740] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:23.581627 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:23.581856 14384 consensus_queue.cc:260] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:23.583308 14384 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:23.582302 11010 raft_consensus.cc:2376] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 7. Re-sending same reply.
I20260709 12:21:23.570344 14359 raft_consensus.cc:3055] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:23.585031 14359 raft_consensus.cc:740] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:23.564497 14218 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:23.586045 14359 consensus_queue.cc:260] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:23.566633 14311 consensus_queue.cc:260] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.587271 14359 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:23.587675 14311 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:23.592613 11003 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:21:23.584892 10974 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:23.546715 14077 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:23.601274 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 48037.6us
I20260709 12:21:23.599246 11051 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:23.597421 10901 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:23.595549 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:23.592140 14471 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:21:23.614408 14439 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:23.617425 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 53079.1us
I20260709 12:21:23.613339 14218 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:23.618316 14218 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.618742 14218 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:23.619556 10974 leader_election.cc:400] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14.
I20260709 12:21:23.620025 10974 leader_election.cc:403] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:23.620755 14439 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14.
I20260709 12:21:23.622202 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:21:23.622846 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.613818 11006 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:23.630977 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:23.625113 14079 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:23.637069 11050 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:23.638517 11004 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 11.
W20260709 12:21:23.638765 14477 log.cc:927] Time spent T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:21:23.646683 14394 raft_consensus.cc:1064] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
W20260709 12:21:23.647240 14394 raft_consensus.cc:1068] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697: Unable to promote non-voter 0b171b6aaedc4f809f2753dcfadb14ce: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:21:23.648396 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.650290 11050 leader_election.cc:400] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 8.
I20260709 12:21:23.651957 11050 leader_election.cc:403] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:23.651293 14277 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:23.650785 10901 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:23.656282 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:23.656896 14471 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:23.658386 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 51992.6us
I20260709 12:21:23.658711 10901 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:23.659584 11051 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:23.659636 14399 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:21:23.662058 14472 log.cc:927] Time spent T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:21:23.662791 14232 consensus_queue.cc:1059] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:23.661036 14133 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 8.
I20260709 12:21:23.664255 14232 raft_consensus.cc:3055] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:23.664655 14232 raft_consensus.cc:740] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:23.665132 14079 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:23.665509 14232 consensus_queue.cc:260] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.666730 14232 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:23.667263 11010 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8.
I20260709 12:21:23.672691 11051 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:23.661993 14471 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:23.661082 14439 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:21:23.677253 11084 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:21:23.675257 14133 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:23.684158 10974 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:23.659654 14077 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:23.690343 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:23.690052 14397 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:23.695350 14397 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:23.680107 14471 raft_consensus.cc:697] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:23.695812 14397 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:23.696060 11078 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:23.695268 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:23.696650 14471 consensus_queue.cc:237] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.697540 11085 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:23.700317 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:23.701563 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 51434.6us
I20260709 12:21:23.702422 11050 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:23.704670 14396 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:23.704420 14397 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.710878 14337 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:23.711831 14337 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.712276 14337 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:23.694784 14469 raft_consensus.cc:697] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:21:23.720643 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 46600.3us
I20260709 12:21:23.721694 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:23.722555 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:23.723543 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:23.724625 10935 raft_consensus.cc:2393] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 7: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:23.725832 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:23.725008 10901 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:23.729542 10931 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:23.735234 11078 raft_consensus.cc:1275] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:21:23.731881 10974 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:23.733526 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:23.737299 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:23.711980 14218 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.741228 10934 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:21:23.747145 14290 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:23.744557 14436 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:21:23.747769 14394 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:23.738862 14439 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:23.738734 14219 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:23.748643 14394 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.740965 14399 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:23.738906 14311 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:23.758873 14279 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:21:23.760352 14238 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:23.753921 14317 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:21:23.755648 14399 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.763531 14399 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:23.766848 14317 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:23.769411 10901 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:23.783880 10901 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:23.786958 10901 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:23.788568 10901 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:23.780758 14317 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:21:23.805814 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 54730.8us
W20260709 12:21:23.805660 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 73862us
W20260709 12:21:23.807518 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.805269 10901 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:23.770802 14439 consensus_queue.cc:1059] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:21:23.812403 11084 raft_consensus.cc:2410] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:21:23.811903 10901 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:23.789391 14279 raft_consensus.cc:2764] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:21:23.789224 14277 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:21:23.818068 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 66770.4us
I20260709 12:21:23.780205 14290 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:23.808341 14220 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:23.785749 14238 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:21:23.808341 14317 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:23.829715 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.832212 11010 raft_consensus.cc:1275] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:21:23.817276 14081 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:23.812764 14358 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:23.837710 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:23.840363 10974 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:23.810436 14335 consensus_queue.cc:1059] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:21:23.843421 11003 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:23.826356 14279 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:23.847779 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:23.826552 14220 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.833386 14317 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:23.854720 11003 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:21:23.851627 11002 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:23.839195 14081 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.861060 14220 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:23.869828 11624 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.850s (SENT) [suppressed 62 similar messages]
I20260709 12:21:23.860716 14397 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:23.813967 14469 consensus_queue.cc:237] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.859400 14219 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:23.867296 14081 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:23.892041 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 68626.5us
I20260709 12:21:23.848093 14358 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:23.895579 14218 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:23.917613 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:23.928094 11084 raft_consensus.cc:2393] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 6: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:23.900130 11003 raft_consensus.cc:2955] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:23.912560 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:23.901369 14133 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:21:23.942406 11011 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
I20260709 12:21:23.898736 14482 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:21:23.946949 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:23.948305 11085 raft_consensus.cc:2393] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 10: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:23.948761 14446 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
W20260709 12:21:23.950645 14488 log.cc:927] Time spent T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:21:23.948304 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:23.953442 11005 raft_consensus.cc:2376] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 11. Re-sending same reply.
I20260709 12:21:23.954468 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:23.954998 11005 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:23.958526 14337 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:23.962822 10974 leader_election.cc:400] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11.
I20260709 12:21:23.935206 14277 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:23.943439 14483 log.cc:927] Time spent T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:21:23.962386 11624 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:24.026371 10974 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:24.040886 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 78608.3us
I20260709 12:21:24.047431 14279 raft_consensus.cc:697] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:21:24.048137 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.033274 14462 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:24.050786 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:24.052616 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.035948 14290 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:24.024044 14277 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.057039 10974 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:24.044209 14384 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:24.040534 14079 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.068332 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:24.068784 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:24.069402 14495 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:24.069957 14495 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.071879 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:24.072080 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:24.072613 11078 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:24.073545 11622 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:24.074128 14262 consensus_queue.cc:1059] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:24.075110 14359 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:21:24.077227 14492 log.cc:927] Time spent T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:21:24.080339 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:24.072530 11081 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:24.085222 11084 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:24.080344 14358 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:24.086763 14337 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:24.066222 14462 raft_consensus.cc:697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:24.092821 14462 consensus_queue.cc:237] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:24.093921 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:24.096344 11085 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:24.098533 14502 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:24.099112 11005 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:24.087617 14238 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:21:24.100813 11083 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:24.101528 14342 consensus_queue.cc:1048] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:24.102066 14262 raft_consensus.cc:3055] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:24.102475 14262 raft_consensus.cc:740] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:24.101408 14277 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:24.104434 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 52199.2us
I20260709 12:21:24.108110 10974 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:24.104597 14399 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.112416 14396 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:24.113049 14396 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.114236 14399 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:24.112241 11083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:21:24.115113 11083 raft_consensus.cc:606] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:24.115571 11083 raft_consensus.cc:614] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:21:24.119443 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.127058 11084 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:24.124361 10901 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:24.104576 14219 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:24.145516 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:24.146194 11011 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:24.146481 11081 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:21:24.147157 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:24.131911 14220 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.142462 14384 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:24.133448 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:24.148561 11656 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:24.111680 14495 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:24.150573 14220 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:24.128386 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:24.151738 10935 raft_consensus.cc:2393] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 10: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:24.141623 11006 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 12:21:24.153825 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 45808.2us
I20260709 12:21:24.152694 10901 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:24.103332 14262 consensus_queue.cc:260] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:24.139703 14081 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.085978 14079 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.143831 11051 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:24.147746 11011 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:24.146195 11005 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:24.190330 10901 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:24.191476 10901 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:24.193681 14317 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.196547 14317 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:24.142421 14399 consensus_queue.cc:1048] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 12:21:24.200208 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 56480.7us
I20260709 12:21:24.205024 11051 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:24.197198 14220 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:24.208957 10974 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
W20260709 12:21:24.206497 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 131848us
I20260709 12:21:24.162053 14502 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:24.189234 14396 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:24.207518 14220 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.216511 14220 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:24.217941 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 113563us
I20260709 12:21:24.218930 10899 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:24.220391 10899 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:24.204258 14290 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:24.204195 14482 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:24.208209 14311 raft_consensus.cc:3055] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:21:24.232268 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 78267.5us
I20260709 12:21:24.215436 14502 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:24.227897 14133 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:24.227780 14384 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:24.252295 14384 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:24.252758 14384 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.244082 10974 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:24.245409 11051 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:24.229907 14311 raft_consensus.cc:740] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:24.257644 11002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:21:24.261116 11002 raft_consensus.cc:606] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:24.258419 10935 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:21:24.261547 11002 raft_consensus.cc:614] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:21:24.272217 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 74330.4us
I20260709 12:21:24.272401 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:24.273303 10900 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:24.200771 14279 consensus_queue.cc:237] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.244683 14502 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:24.242830 14482 raft_consensus.cc:697] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:24.286253 11051 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:24.291087 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:24.277680 14501 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:24.307981 14519 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:24.308609 14519 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:24.309060 14519 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:24.308466 14220 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.301043 14232 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:24.313617 14220 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:24.315593 14502 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.286844 14218 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:24.319555 14502 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:24.286047 14317 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:24.327054 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 106751us
W20260709 12:21:24.361375 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 61098.4us
I20260709 12:21:24.362109 14290 raft_consensus.cc:697] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:24.300810 14501 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:24.364861 11003 raft_consensus.cc:1240] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 3. Current term is 4. Ops: []
W20260709 12:21:24.402858 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 50237.7us
I20260709 12:21:24.405627 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:24.405851 14514 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:24.363755 14081 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:24.367269 14501 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:24.364188 14335 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:21:24.414588 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 141379us
W20260709 12:21:24.420255 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 57856us
I20260709 12:21:24.422729 10935 raft_consensus.cc:1240] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:24.420475 10933 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:24.427377 10934 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:24.431108 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:24.431924 10933 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:24.413344 14335 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:24.437196 14335 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.440088 14133 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:24.446797 14133 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.437255 14081 consensus_queue.cc:1059] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:21:24.442507 14501 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.446669 14335 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:24.448503 14133 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.367444 14311 consensus_queue.cc:260] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.452392 14311 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:24.453797 14133 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:24.455426 14501 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:24.455654 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:24.460606 14262 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:24.461347 11656 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:24.450583 14077 raft_consensus.cc:3055] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:24.464771 14384 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:24.465152 10900 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:24.466671 14394 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:24.467068 14384 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:24.470438 11051 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:24.477062 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:24.478088 10933 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:24.477749 10936 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:21:24.472421 14232 consensus_queue.cc:1059] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:21:24.481490 11051 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:24.482107 14232 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:24.468398 14077 raft_consensus.cc:740] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:24.482620 14497 raft_consensus.cc:3055] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:24.483079 14497 raft_consensus.cc:740] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:24.483539 14232 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:24.484583 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:24.471360 14335 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:24.468493 14079 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:24.479590 14133 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:24.436699 14482 consensus_queue.cc:237] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:24.486445 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 117087us
I20260709 12:21:24.526695 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:24.527359 11003 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:24.527998 11006 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:24.528066 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:24.528676 11005 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:24.529757 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:24.530344 11007 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.471557 14519 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.536031 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:24.536716 11011 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:24.496104 14394 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:24.539431 14527 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.487000 14232 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.542527 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:24.543241 11010 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:24.547158 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:24.490217 14133 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:24.552407 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 81486.3us
I20260709 12:21:24.481035 14290 consensus_queue.cc:237] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:24.558635 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 130950us
I20260709 12:21:24.493219 14525 consensus_queue.cc:1059] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 12:21:24.563457 10931 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:24.562477 14277 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:21:24.545533 14232 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.545347 11082 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "970339bba6a8454e8c722b4367924db8"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:21:24.565869 14394 raft_consensus.cc:697] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:24.551791 14133 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:24.554714 11081 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:21:24.549091 14311 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:24.585834 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:24.614972 14311 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.579298 10901 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:24.617197 14311 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:24.617985 14529 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:24.618455 14529 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.618809 14529 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:24.588862 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:24.600961 11005 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:24.593966 14342 consensus_queue.cc:1059] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:21:24.601949 14394 consensus_queue.cc:237] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:24.604450 14531 log.cc:927] Time spent T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:21:24.607067 11006 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:24.587204 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:24.565351 10899 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:24.581611 14536 consensus_queue.cc:1059] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:24.624323 11010 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:24.637460 11003 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:24.628568 11007 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:24.629841 11011 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:24.632223 11004 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:24.635330 11079 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:24.485005 14497 consensus_queue.cc:260] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.639602 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:24.646724 11080 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:21:24.656668 10974 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:24.657629 14311 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:24.658064 14311 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:24.658463 14311 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.673350 14311 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.676298 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:24.677709 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:24.678449 11009 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 5: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:24.679291 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:24.680260 11009 raft_consensus.cc:2393] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 6: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:24.681471 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:24.682940 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:24.683698 11009 raft_consensus.cc:2393] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:24.684821 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:24.686816 10829 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35608 (request call id 261) took 7657 ms. Trace:
I20260709 12:21:24.687253 10829 rpcz_store.cc:276] 0709 12:21:17.029857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.030102 (+   245us) service_pool.cc:224] Handling call
0709 12:21:18.078240 (+1048138us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400096d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0eca090 00007f9bb0f68f3a 00007f9bb6d1ee9c 00007f9bb6e1d04e 00007f9bb52de2a4 00007f9bb52de232 00007f9bb52de161 00007f9bb52de0dc 00007f9bb52dd392 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:24.686749 (+6608509us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:23.141291 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:23.141806 (+   515us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:23.141854 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:21:23.141866 (+    12us) tablet.cc:662] Decoding operations
0709 12:21:23.142294 (+   428us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:23.142376 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:23.142394 (+    18us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:21:23.142769 (+   375us) tablet.cc:701] Row locks acquired
0709 12:21:23.142808 (+    39us) write_op.cc:260] PREPARE: finished
0709 12:21:23.142945 (+   137us) write_op.cc:270] Start()
0709 12:21:23.143064 (+   119us) write_op.cc:276] Timestamp: P: 1783599683142894 usec, L: 0
0709 12:21:23.143094 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:21:23.222725 (+ 79631us) log.cc:844] Serialized 1308 byte log entry
0709 12:21:23.419491 (+196766us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b5400096d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5be28 00007f9bb4996581 00007f9bb4995d58 00007f9bb499a9f1 00007f9bb499a9a9 00007f9bb499a939 00007f9bb499a901 00007f9bb4999b2d 0000000000388634 0000000000388479
0709 12:21:23.641989 (+222498us) op_driver.cc:464] REPLICATION: finished
0709 12:21:23.716251 (+ 74262us) write_op.cc:301] APPLY: starting
0709 12:21:23.716363 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:23.725424 (+  9061us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:23.729859 (+  4435us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:23.860481 (+130622us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:23.906354 (+ 45873us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:21:23.914794 (+  8440us) write_op.cc:312] APPLY: finished
0709 12:21:23.959302 (+ 44508us) log.cc:844] Serialized 35 byte log entry
0709 12:21:23.959517 (+   215us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:23.959615 (+    98us) write_op.cc:454] Released schema lock
0709 12:21:23.959670 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:23.960218 (+   548us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:23.960249 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1522814,"reported_tablets":6,"spinlock_wait_cycles":297409792,"child_traces":[["op",{"apply.queue_time_us":73908,"apply.run_cpu_time_us":3618,"apply.run_wall_time_us":243960,"num_ops":3,"prepare.queue_time_us":32061,"prepare.run_cpu_time_us":48382,"prepare.run_wall_time_us":278419,"raft.queue_time_us":131209,"raft.run_cpu_time_us":10627,"raft.run_wall_time_us":47819,"replication_time_us":493314,"spinlock_wait_cycles":63352704,"thread_start_us":186325,"threads_started":4,"wal-append.queue_time_us":123004}]]}
I20260709 12:21:24.695176 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:24.697465 14510 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
W20260709 12:21:24.699081 14494 log.cc:927] Time spent T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:21:24.702927 14519 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:24.703765 14536 raft_consensus.cc:3055] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:24.704206 14536 raft_consensus.cc:740] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:24.630056 14471 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.706133 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:21:24.714202 11050 leader_election.cc:336] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 2.124s (SENT)
I20260709 12:21:24.714756 11050 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:24.722407 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:24.723233 11011 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 10: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:24.724722 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:24.729341 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 44298.7us
I20260709 12:21:24.731066 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:24.547611 14527 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.731920 11009 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:21:24.738185 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:24.739008 11009 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 7: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:24.745818 11007 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:24.748430 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:24.749120 11011 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:24.753304 11085 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:24.753685 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:24.754390 11005 raft_consensus.cc:2368] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13.
I20260709 12:21:24.730182 14220 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:24.754938 14220 raft_consensus.cc:697] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:24.755223 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:24.755847 14220 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.756649 14524 raft_consensus.cc:3055] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:24.757064 14524 raft_consensus.cc:740] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:24.757890 14524 consensus_queue.cc:260] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.759604 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:24.651808 14277 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 12:21:24.767565 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:24.770264 11078 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:24.770634 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:24.770539 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:24.772751 10974 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:24.771432 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:24.776401 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:24.777233 11010 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 7: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:24.705025 14536 consensus_queue.cc:260] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:24.778083 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:24.778841 14469 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:24.779115 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:24.781529 14524 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:24.784430 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:24.774247 14501 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:24.785197 11004 raft_consensus.cc:2393] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 7: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:24.779702 11010 raft_consensus.cc:2376] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9. Re-sending same reply.
W20260709 12:21:24.790066 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.790120 11005 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:24.678905 14311 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:24.776466 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:24.794214 11007 raft_consensus.cc:2368] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6.
I20260709 12:21:24.814316 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:24.818547 11003 raft_consensus.cc:2376] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9. Re-sending same reply.
I20260709 12:21:24.817337 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:24.795884 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:24.830932 11011 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 8: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:24.831187 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:24.751765 14446 consensus_queue.cc:1059] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:21:24.728921 14471 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.844609 11008 raft_consensus.cc:2368] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10.
I20260709 12:21:24.832680 11009 raft_consensus.cc:2376] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14. Re-sending same reply.
I20260709 12:21:24.871275 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:24.873512 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:24.874661 11008 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
W20260709 12:21:24.879583 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.877403 11082 raft_consensus.cc:476] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Not starting forced leader election -- already a leader
I20260709 12:21:24.882757 11084 raft_consensus.cc:1240] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:24.880617 11007 raft_consensus.cc:2410] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:21:24.899420 11050 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:24.910234 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 344931us
I20260709 12:21:24.911347 11085 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:21:24.914891 11625 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:24.898286 14495 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.927232 11007 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:24.929979 10977 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:24.925693 10830 catalog_manager.cc:5697] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 3 to 5, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 5 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:21:24.930459 11007 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:24.938098 11007 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:21:24.926385 14446 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:24.952960 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 53651.6us
I20260709 12:21:24.953761 11050 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:24.945111 10830 catalog_manager.cc:5697] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:24.957847 11079 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:24.958074 11050 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:24.959396 10974 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:24.929888 14552 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:24.936264 14311 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:24.964860 14525 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:21:24.965778 14554 log.cc:927] Time spent T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:21:24.967087 14558 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:24.968518 14545 log.cc:927] Time spent T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:21:24.969399 14077 consensus_queue.cc:260] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.952821 14546 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.927510 14547 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:21:24.945657 14277 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.930441 14495 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:24.960644 10830 catalog_manager.cc:5697] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 7 to 8, term changed from 8 to 9, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:25.001160 14546 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
W20260709 12:21:25.003820 14550 log.cc:927] Time spent T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:21:25.005798 14546 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:25.006595 11050 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:25.007746 14495 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:25.008574 11050 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:25.009362 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:25.009757 11050 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:25.010658 14469 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:25.011301 14469 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:25.012058 14471 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:25.012599 14471 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:25.014170 14133 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.014456 14232 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.008327 14277 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:25.016918 14277 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:24.976280 14527 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:25.021155 14077 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:25.021281 14548 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.021936 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:25.021961 14548 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.022814 11085 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 10: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:25.023803 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:25.023964 14552 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:25.024520 11010 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:25.025266 11076 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:24.976346 14525 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:25.025964 14525 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:25.026242 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:25.026404 14548 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:25.026835 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:25.026875 11076 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:25.028085 10830 catalog_manager.cc:5697] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:25.025897 11010 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:25.024528 11085 raft_consensus.cc:2393] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 6: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:25.011011 11050 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:25.051182 10934 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:25.053242 10830 catalog_manager.cc:5697] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:21:25.003895 14559 log.cc:927] Time spent T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:21:25.002048 14311 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:25.060590 10927 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:21:25.054910 11008 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:21:25.063452 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:25.066351 14564 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:25.064805 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:25.067350 10936 raft_consensus.cc:2393] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 6: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:25.067046 14564 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.068409 14133 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:24.984015 14384 consensus_queue.cc:1059] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 12:21:25.054373 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:25.040705 14471 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:25.165107 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 65336.6us
I20260709 12:21:25.100016 10935 raft_consensus.cc:2393] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 6: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:25.066702 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:25.064677 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:25.168712 11085 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:25.019759 14529 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.069618 14552 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:25.217142 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 206205us
I20260709 12:21:25.217955 11050 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:25.219085 11050 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:25.227411 11085 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:25.176730 14524 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.238068 11081 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:21:25.239526 10974 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:25.242676 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:21:25.256381 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:25.278342 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 59316.8us
I20260709 12:21:25.222539 14558 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:25.288806 11050 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:25.178843 14471 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.292232 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:25.225705 14556 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:25.299994 11081 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:25.237665 14232 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:25.286594 14548 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:25.311489 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:25.278508 14533 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:25.317435 11083 raft_consensus.cc:2393] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 6: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:25.289530 14262 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.294638 14384 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.328912 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:25.329586 11083 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:25.300084 14552 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:25.331965 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:25.277931 14524 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.311466 14469 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:25.341166 14133 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:25.341771 14133 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.343823 14133 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:25.344357 14232 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:25.345607 14232 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.347676 14232 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:25.349298 14232 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:25.351773 14232 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.358830 14232 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:25.334643 14552 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:25.361066 14552 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:25.361409 14569 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.361984 14569 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:25.364842 14561 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 12:21:25.366647 11050 leader_election.cc:400] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13.
I20260709 12:21:25.367029 11050 leader_election.cc:403] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:21:25.368590 14564 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:25.370060 14564 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:25.370573 14564 raft_consensus.cc:697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:25.330787 14384 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.373100 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:25.373757 11081 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:25.374969 14384 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:25.316294 14556 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:25.360493 11085 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 10: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:25.377750 14556 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:25.379520 14569 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:25.380985 14574 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:25.330467 14262 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:25.382943 14570 log.cc:927] Time spent T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:21:25.338024 14436 raft_consensus.cc:3055] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:25.384068 14529 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:25.385402 14548 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:25.387570 14562 log.cc:927] Time spent T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 12:21:25.387825 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:25.389681 11050 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:25.392763 11083 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:25.394318 11081 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:25.360384 14524 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:25.379431 14471 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:25.404754 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:25.406239 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:25.406335 10931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 1999) took 1169 ms. Trace:
I20260709 12:21:25.407272 10931 rpcz_store.cc:276] 0709 12:21:24.236538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.236662 (+   124us) service_pool.cc:224] Handling call
0709 12:21:24.254936 (+ 18274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:24.577121 (+322185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:25.406085 (+828964us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b5400060ed4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:25.406276 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":683311872}
I20260709 12:21:25.408210 11081 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:25.396543 14436 raft_consensus.cc:740] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:25.322949 14533 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.419415 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:25.371433 14564 consensus_queue.cc:237] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.421603 11083 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:25.401892 14232 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13.
I20260709 12:21:25.414494 14556 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:25.416337 14548 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:25.426110 14548 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:25.427966 14533 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:25.429469 14262 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:25.430526 14262 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.430992 14262 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:25.434196 14534 raft_consensus.cc:3055] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:25.434669 14534 raft_consensus.cc:740] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:25.434945 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:25.397233 14574 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:25.435966 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 46360.8us
I20260709 12:21:25.438910 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:25.439617 11009 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 7.
I20260709 12:21:25.433813 14436 consensus_queue.cc:260] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.442509 11009 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260709 12:21:25.434470 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:25.437884 11050 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:25.447890 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:25.448988 11081 raft_consensus.cc:2410] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
W20260709 12:21:25.426352 14560 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.457s	user 0.000s	sys 0.001s
W20260709 12:21:25.451138 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:25.452297 14577 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.452565 14523 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:25.452961 14577 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:25.455475 14577 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:25.458139 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:25.458877 11004 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 7.
I20260709 12:21:25.460213 11624 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:25.461731 14262 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:25.461635 14578 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:25.464232 14578 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:25.464610 14578 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:25.415268 14525 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.469823 14525 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:25.452785 11050 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:25.441237 14497 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:25.471942 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:25.476581 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:25.452198 14569 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.445312 14529 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:21:25.481053 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 240027us
I20260709 12:21:25.472880 14525 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:25.472801 14436 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:25.472718 14533 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:25.474995 14565 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.472421 14575 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:25.499845 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 47133.9us
I20260709 12:21:25.500885 11050 leader_election.cc:400] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 5 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6.
I20260709 12:21:25.492563 14311 raft_consensus.cc:697] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:25.508756 11050 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:25.510202 11081 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 7.
I20260709 12:21:25.435627 14534 consensus_queue.cc:260] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:25.489629 14529 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:25.493680 14569 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:25.527626 14529 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:25.528179 14569 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:25.507596 14575 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.532709 14552 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.533686 14575 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:25.534060 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:25.534744 11656 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:25.526213 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:25.535576 11076 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 7.
I20260709 12:21:25.536026 14534 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:25.536193 11077 raft_consensus.cc:2410] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 12:21:25.538084 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:25.521883 14580 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.540241 10900 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:25.507373 14565 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.534853 14552 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:25.543475 14220 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:25.542917 14482 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:21:25.572481 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 63812.2us
I20260709 12:21:25.573683 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:25.583531 10936 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:21:25.586848 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2007) took 1116 ms. Trace:
I20260709 12:21:25.587275 10934 rpcz_store.cc:276] 0709 12:21:24.470101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.470207 (+   106us) service_pool.cc:224] Handling call
0709 12:21:24.477382 (+  7175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:25.051751 (+574369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:25.586594 (+534843us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b5400451354. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:25.586780 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1319173376}
I20260709 12:21:25.590427 11078 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:25.598868 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:25.602044 11002 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:21:25.568866 14575 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:25.542477 14580 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.571473 14564 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.569334 14220 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:25.623683 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:25.626523 11076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:21:25.598716 14529 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:25.632484 11622 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:25.622290 14077 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.628235 14220 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:25.648468 11006 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:25.627498 14574 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:25.650640 11076 raft_consensus.cc:606] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:25.654951 11076 raft_consensus.cc:614] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:25.657612 14569 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:25.610018 14585 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:21:25.634326 14533 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:25.634832 14525 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:25.633643 14523 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:21:25.642916 14542 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:25.632325 14575 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.628378 14564 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.654316 14524 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:25.639948 14529 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:25.609664 14311 consensus_queue.cc:237] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.640386 14482 consensus_queue.cc:1059] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:21:25.695483 10901 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:25.680601 14501 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.679348 14584 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.689222 14290 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.649619 14077 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.691653 14542 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:25.714687 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:25.689079 14525 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.690985 14533 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.682361 14569 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:25.703907 14501 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.722708 14077 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:25.723208 14501 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:25.723491 14077 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:25.705933 14542 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:25.716694 14574 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:25.718245 14439 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:25.718400 14436 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:25.723656 14587 log.cc:927] Time spent T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:21:25.699024 14524 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:25.739425 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 44061.4us
I20260709 12:21:25.707429 14290 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.704607 14584 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.743515 10901 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:25.748628 10901 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:25.754339 14290 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:25.755391 14290 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:25.757061 11077 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:21:25.734673 14436 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:25.731542 14077 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:25.765693 11050 leader_election.cc:336] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.591s (SENT)
I20260709 12:21:25.732870 14439 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.733026 14574 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.755846 14290 raft_consensus.cc:697] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:25.785346 11050 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:25.787349 10901 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:25.790203 10901 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:25.791170 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:25.792306 14482 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:25.789551 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:25.793999 14482 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.794874 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:25.795077 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:25.795625 11009 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:25.796435 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:25.797986 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2602) took 1249 ms. Trace:
I20260709 12:21:25.797830 14290 consensus_queue.cc:237] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.798369 11084 rpcz_store.cc:276] 0709 12:21:24.554717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.584908 (+ 30191us) service_pool.cc:224] Handling call
0709 12:21:24.585208 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:24.883184 (+297976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:25.797183 (+913999us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b540044d4d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:25.797364 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":683805440}
I20260709 12:21:25.800323 14525 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:25.800843 14525 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:25.783915 14580 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:25.797019 14603 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:21:25.804423 14599 log.cc:927] Time spent T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:21:25.804571 14603 raft_consensus.cc:697] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:25.800971 14608 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:25.792989 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:25.756304 14596 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:25.792536 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:25.820537 11653 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:25.821067 11656 raft_consensus.cc:2393] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:25.805528 14603 consensus_queue.cc:237] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.797394 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:25.823794 11011 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:25.808203 11009 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:25.792327 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:25.786674 14575 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:25.827924 10901 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:25.831326 11049 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:25.840626 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:25.838759 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:25.841531 11010 raft_consensus.cc:2410] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:21:25.826742 14608 raft_consensus.cc:697] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:25.848268 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:25.848815 11007 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:25.834523 14517 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:25.832790 14482 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:25.853761 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:60030 (request call id 2600) took 1312 ms. Trace:
I20260709 12:21:25.871419 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:25.872532 11011 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:25.873696 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:25.874569 11011 raft_consensus.cc:2393] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:25.854143 11082 rpcz_store.cc:276] 0709 12:21:24.537630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.537762 (+   132us) service_pool.cc:224] Handling call
0709 12:21:25.849975 (+1312213us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b540044d4d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f57a3d 00007f9bb5f27cd0 00007f9baf4ac254 00007f9baf4ac1e2 00007f9baf4ac111 00007f9baf4ac08c 00007f9baf4ab342 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:25.850054 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":664621440}
I20260709 12:21:25.871507 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:25.877298 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:25.875520 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:25.842130 14529 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:25.846102 14552 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:25.878827 11010 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 8: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:25.877089 10901 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:25.853241 14517 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:25.881465 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:25.851975 14564 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:25.882540 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:25.852270 14077 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:25.851982 14596 raft_consensus.cc:697] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:25.883175 11011 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:25.884581 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:25.887497 14542 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:25.888841 14608 consensus_queue.cc:237] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:25.889365 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:25.889802 14542 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:25.890209 11002 raft_consensus.cc:2410] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:21:25.892182 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:25.878958 14611 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:25.896363 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:25.896903 14584 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:25.902944 11085 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:25.892819 11002 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:25.897159 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:25.900724 14534 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.900889 14533 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:25.901600 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:25.903962 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:25.912258 11002 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:25.906881 11010 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:21:25.904286 11653 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:21:25.915232 10975 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:25.910518 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:25.916216 14584 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:25.880781 14552 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:25.916653 14584 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:25.917140 14584 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:25.916689 11006 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:21:25.884841 14517 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:25.882876 14436 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:25.934111 11079 raft_consensus.cc:2410] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:21:25.884176 14529 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:25.908473 11011 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:25.924209 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:25.929032 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:25.937206 14220 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:25.948689 11008 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:25.947834 11085 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8.
I20260709 12:21:25.917099 14552 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:25.915442 11010 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:21:25.924887 14532 raft_consensus.cc:3055] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:25.938974 14548 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.957710 11622 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:25.963562 11004 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:25.949498 14611 raft_consensus.cc:697] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:25.919622 14534 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:25.954346 14529 raft_consensus.cc:697] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:25.982123 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:25.938963 14578 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:25.957459 14532 raft_consensus.cc:740] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:25.981943 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:25.997611 11084 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:25.995272 11009 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:25.964778 14462 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:25.962725 14548 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:26.072438 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 170734us
I20260709 12:21:26.030470 14611 consensus_queue.cc:237] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:26.094053 11084 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:26.092227 11082 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:21:26.095461 11082 pending_rounds.cc:85] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 5
I20260709 12:21:26.095968 11085 raft_consensus.cc:3055] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:26.096380 11085 raft_consensus.cc:740] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:21:26.098416 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 215235us
W20260709 12:21:26.099047 11050 leader_election.cc:336] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 2.054s (SENT)
I20260709 12:21:26.095705 11082 pending_rounds.cc:107] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:21:26.100735 11082 raft_consensus.cc:2889] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:26.119719 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:26.120689 11084 raft_consensus.cc:2368] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8.
I20260709 12:21:26.121883 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:26.097760 14617 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:26.124504 11050 leader_election.cc:336] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 2.064s (SENT)
I20260709 12:21:26.100651 14522 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.099889 14436 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:26.120571 11085 consensus_queue.cc:260] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:26.153302 11085 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:26.104696 14238 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:26.155390 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:25.967331 14596 consensus_queue.cc:237] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:26.171937 14529 consensus_queue.cc:237] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:26.173930 14532 consensus_queue.cc:260] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:26.187387 14532 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:26.188772 14220 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:26.189687 14220 raft_consensus.cc:1064] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:21:26.156576 14522 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:26.193316 14522 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:26.174985 14578 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:26.176316 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:26.202373 11078 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:26.204706 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:26.206271 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:26.180635 11084 raft_consensus.cc:2393] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 8: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:26.147943 14617 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:26.185405 14077 raft_consensus.cc:1064] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:21:26.200341 11085 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:21:26.201141 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 76763.9us
I20260709 12:21:26.210551 11050 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:26.210974 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:26.211967 11010 raft_consensus.cc:2410] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:21:26.204491 14567 log.cc:927] Time spent T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.810s	user 0.000s	sys 0.010s
I20260709 12:21:26.213675 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:26.215553 14584 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:26.216678 14617 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:26.218186 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:26.194808 14622 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:26.220650 11076 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
W20260709 12:21:26.204782 14614 log.cc:927] Time spent T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.316s	user 0.000s	sys 0.004s
I20260709 12:21:26.222453 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:26.224341 11050 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:26.160400 14436 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:26.228350 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:26.225638 11084 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:26.229228 11078 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:26.230669 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:26.230741 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:26.232837 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:26.233825 11084 raft_consensus.cc:2393] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 13: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:26.231585 11078 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8.
I20260709 12:21:26.241044 11005 raft_consensus.cc:1240] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:26.240996 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 141882us
I20260709 12:21:26.180438 14238 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:26.248104 14584 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:26.220371 14525 raft_consensus.cc:2764] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:21:26.251989 14238 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:26.252595 14436 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:26.243681 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:26.258646 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.264529 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:26.265323 11084 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:26.265887 11010 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:26.266149 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:26.267838 11084 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:21:26.222113 14462 raft_consensus.cc:697] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:26.240447 14482 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:26.272305 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:26.273398 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:26.274663 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:26.273586 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:26.274794 11076 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:26.277539 11084 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:26.279034 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:26.279647 11010 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
W20260709 12:21:26.280051 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.252542 14525 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:21:26.281570 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:26.229125 14622 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:26.286403 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:26.307358 11010 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:21:26.309755 11010 pending_rounds.cc:85] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 4
I20260709 12:21:26.311026 11010 pending_rounds.cc:107] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:21:26.312201 11010 raft_consensus.cc:2889] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:26.317009 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.258261 14517 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:26.287643 11651 raft_consensus.cc:2393] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 8: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:26.348577 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:26.355062 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:26.355894 11076 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:26.373556 10974 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:26.380257 10935 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:21:26.369683 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:26.381011 10936 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:26.375026 10974 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:26.382213 10974 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:26.382931 14575 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:26.383319 14575 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:26.383635 14575 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:26.383989 14584 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:26.384383 14584 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:26.384727 14584 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:26.385324 14399 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.383671 10974 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:26.396054 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:26.389855 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:26.395803 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:26.398006 10933 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:26.395802 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:26.404923 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:26.405622 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:26.411194 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:26.411840 11003 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
W20260709 12:21:26.413667 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.385885 14399 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:26.413977 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:26.417570 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:26.417711 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.418573 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:26.419364 11003 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:21:26.389694 14628 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.421687 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:26.422112 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:26.419729 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 175364us
I20260709 12:21:26.388221 14436 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:26.458993 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:26.412838 14564 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:26.462697 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:26.474963 10932 raft_consensus.cc:2393] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 10: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:26.420006 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:26.476533 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.528082 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:26.458191 14436 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:26.532359 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:26.474541 14564 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:26.576725 10935 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:26.545360 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:26.411221 14631 consensus_queue.cc:1059] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.134s
I20260709 12:21:26.367805 14462 consensus_queue.cc:237] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:26.533725 14552 consensus_meta.cc:287] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.000s
I20260709 12:21:26.527684 14317 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.537503 14436 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:26.459039 14482 raft_consensus.cc:697] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:26.457698 14628 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:26.582671 14564 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:26.615097 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:26.651803 11009 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:26.615978 14359 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.616372 14622 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:26.616679 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:26.617415 11011 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:26.614549 14311 consensus_queue.cc:1059] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
W20260709 12:21:26.624344 14634 log.cc:927] Time spent T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:21:26.628324 14637 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:26.628810 14640 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:26.630057 14399 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:26.629695 14482 consensus_queue.cc:237] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:26.630842 14517 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:26.580729 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 317574us
I20260709 12:21:26.641734 14533 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.664032 11009 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
W20260709 12:21:26.666354 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.669358 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 281615us
W20260709 12:21:26.669836 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 164431us
I20260709 12:21:26.676725 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:26.674455 10899 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:26.677462 11009 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:26.678215 10899 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:26.601796 14552 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:26.672431 14592 log.cc:927] Time spent T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 1.022s	user 0.004s	sys 0.001s
I20260709 12:21:26.684877 10899 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:26.690012 14635 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:26.609949 14317 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:26.716439 10936 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:26.665197 14359 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:26.705149 14529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.015s	sys 0.012s
I20260709 12:21:26.717514 11009 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:26.719269 11077 raft_consensus.cc:1240] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:26.690773 14631 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:21:26.719681 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 322105us
I20260709 12:21:26.720276 11051 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:26.672864 14533 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:26.671321 14436 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:26.676416 14584 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:26.724565 11050 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:26.722684 10974 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:26.722790 14631 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:26.740410 11002 raft_consensus.cc:2393] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 10: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:26.713405 14641 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:21:26.723425 14501 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:26.744125 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2387) took 1711 ms. Trace:
I20260709 12:21:26.743939 14532 consensus_queue.cc:1059] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:21:26.766464 14532 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:26.735147 14399 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:26.737360 14637 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:26.746527 11080 rpcz_store.cc:276] 0709 12:21:25.033064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.526596 (+493532us) service_pool.cc:224] Handling call
0709 12:21:25.526896 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:25.538862 (+ 11966us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:25.538892 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:25.541667 (+  2775us) log.cc:844] Serialized 26 byte log entry
0709 12:21:25.650432 (+108765us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:25.650478 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:25.651179 (+   701us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:26.644235 (+993056us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b2400201b48. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badcf99c4 00007f9badcf7acb 00007f9badeb2dc9 00007f9badeb2a55 00007f9badeb209d 00007f9bb0ae410e 00007f9bb0afb88c 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221
0709 12:21:26.738638 (+ 94403us) raft_consensus.cc:1685] finished
0709 12:21:26.738663 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:26.744032 (+  5369us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11566,"raft.queue_time_us":12338,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":1117,"spinlock_wait_cycles":4450176,"thread_start_us":95955,"threads_started":1,"wal-append.queue_time_us":107016}
I20260709 12:21:26.743161 14631 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:26.770269 14399 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:26.731781 14647 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:21:26.780386 10934 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:26.783042 14596 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.783512 14596 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:26.784070 14359 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:26.796648 14436 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:26.797370 14436 raft_consensus.cc:3055] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:26.797724 14436 raft_consensus.cc:740] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:26.798471 14436 consensus_queue.cc:260] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:26.799386 14436 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:26.801311 14584 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:26.802281 14584 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:26.802637 14584 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:26.802938 14584 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:26.806267 14552 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:26.769557 14501 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:26.772024 14637 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:26.814661 14637 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:26.816519 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:26.776592 14399 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:26.816519 14575 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:26.856266 14613 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.970s	user 0.004s	sys 0.012s
I20260709 12:21:26.860347 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:26.861415 11080 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
W20260709 12:21:26.866981 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.871932 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.891383 14534 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:26.906843 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.907675 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.924224 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 238824us
I20260709 12:21:26.921723 14644 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.924638 14533 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:26.924595 14575 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:26.938486 14644 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:26.943445 14644 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:26.947664 14462 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:26.948303 14462 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:26.950587 14462 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:26.951848 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:26.934752 14643 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.937758 14524 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:26.976459 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:26.938681 14628 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:26.984596 10899 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:21:26.982381 14612 log.cc:927] Time spent T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 1.086s	user 0.007s	sys 0.011s
I20260709 12:21:26.990213 11006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2554) took 1363 ms. Trace:
I20260709 12:21:26.982916 11651 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:26.992813 11006 rpcz_store.cc:276] 0709 12:21:25.620587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.918215 (+297628us) service_pool.cc:224] Handling call
0709 12:21:25.918506 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:25.918703 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:25.951528 (+ 32825us) log.cc:844] Serialized 14 byte log entry
0709 12:21:26.750233 (+798705us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b18002aab40. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b 00007f9bb0affd23 00007f9bb0b0023a 00007f9bb0f6aa2a
0709 12:21:26.983414 (+233181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:26.983480 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:26.983531 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.983603 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:26.983733 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10125,"prepare.queue_time_us":32122,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":1222,"spinlock_wait_cycles":3720448,"thread_start_us":206757,"threads_started":1}
I20260709 12:21:26.981935 14641 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.971397 14649 consensus_queue.cc:1059] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:21:26.994091 14628 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:27.000231 14501 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.008173 11051 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:27.000473 14641 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.012940 11651 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:27.001119 10899 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:26.975322 14643 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.019780 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:27.042879 14439 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.042577 14631 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:27.046845 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.048259 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:27.048763 11083 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:27.015125 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:27.020308 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.048082 14218 raft_consensus.cc:3055] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:27.020375 11004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2548) took 1427 ms. Trace:
I20260709 12:21:27.024101 10899 leader_election.cc:400] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8.
I20260709 12:21:27.024451 11005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2557) took 1392 ms. Trace:
I20260709 12:21:27.020812 11049 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
W20260709 12:21:27.025317 11079 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60046 (request call id 2392) took 1959 ms (client timeout 1647 ms). Trace:
I20260709 12:21:27.059698 10901 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:27.062132 11010 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:21:27.062388 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:27.052980 11009 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
W20260709 12:21:27.069090 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 45135.8us
I20260709 12:21:27.013888 11051 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:27.069667 11004 rpcz_store.cc:276] 0709 12:21:25.592922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.593059 (+   137us) service_pool.cc:224] Handling call
0709 12:21:25.593353 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:25.966006 (+372653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:27.020130 (+1054124us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b540012c0d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:27.020318 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":850921344}
I20260709 12:21:27.070897 10901 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:27.073391 10899 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:27.069993 11079 rpcz_store.cc:269] 0709 12:21:25.065413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.066444 (+  1031us) service_pool.cc:224] Handling call
0709 12:21:27.025069 (+1958625us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b5400218754. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:27.025191 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1764154112}
I20260709 12:21:27.068867 11005 rpcz_store.cc:276] 0709 12:21:25.632121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.944217 (+312096us) service_pool.cc:224] Handling call
0709 12:21:25.954292 (+ 10075us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:26.241657 (+287365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:27.024202 (+782545us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54002d9e54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:27.024387 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659036544}
I20260709 12:21:27.078787 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:27.079068 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 65268.2us
I20260709 12:21:27.079703 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:27.079181 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 58466.9us
I20260709 12:21:27.081431 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:27.082082 11009 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:27.082553 10901 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:27.029289 14643 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.089670 11083 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:21:27.023744 14652 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:27.016245 14565 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.040009 14633 raft_consensus.cc:3055] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:27.040131 14617 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:27.014395 14654 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:27.094242 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.095021 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:27.018031 14641 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:27.100081 11007 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:21:27.093369 11009 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8.
I20260709 12:21:27.097474 10928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:43546
I20260709 12:21:27.081020 14653 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.068563 14218 raft_consensus.cc:740] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:27.107520 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:27.069067 14439 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:27.034821 14596 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.098510 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:27.098541 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.091217 14608 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:27.100744 10901 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:27.121951 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:27.079466 11010 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
I20260709 12:21:27.122325 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.103418 11624 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:27.013180 14399 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:27.082456 14436 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.023679 14529 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:21:27.100050 10932 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 7.
I20260709 12:21:27.085609 14533 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:27.085527 14603 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:27.107975 14652 raft_consensus.cc:697] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:27.120534 10933 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:27.025022 14564 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.088749 14232 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:27.146705 14649 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:27.152582 11006 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 9: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:27.152058 14652 consensus_queue.cc:237] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.153692 14232 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:27.125823 14439 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.156000 14232 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:27.156248 14218 consensus_queue.cc:260] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.121752 14608 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.163139 14631 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.162993 14608 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:27.153587 14629 log.cc:927] Time spent T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.733s	user 0.000s	sys 0.007s
I20260709 12:21:27.038929 14637 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.124168 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.126673 14616 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:27.101853 14633 raft_consensus.cc:740] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:27.092458 14658 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:27.022571 14584 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.146864 10934 raft_consensus.cc:1240] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:21:27.147145 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.145236 14603 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.148377 14533 raft_consensus.cc:697] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:27.178134 14533 consensus_queue.cc:237] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:27.178625 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 454137us
I20260709 12:21:27.179391 11050 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:27.148659 11657 raft_consensus.cc:1240] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:27.169293 14524 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:21:27.181485 14335 raft_consensus.cc:3055] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:27.181864 14335 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:27.180812 14658 raft_consensus.cc:697] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:27.182694 14335 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.183375 14658 consensus_queue.cc:237] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:27.184166 11008 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2108) took 1578 ms (client timeout 1950 ms). Trace:
W20260709 12:21:27.184558 11008 rpcz_store.cc:269] 0709 12:21:25.606062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.606204 (+   142us) service_pool.cc:224] Handling call
0709 12:21:27.183986 (+1577782us) spinlock_profiling.cc:243] Waited 71.5 ms on lock 0x7b54002dbc54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:27.184091 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164402944}
I20260709 12:21:27.185715 14649 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:27.126847 14542 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:27.188246 14542 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.188634 14542 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:27.189946 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:27.190121 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.190706 11079 raft_consensus.cc:2368] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8.
I20260709 12:21:27.191274 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.191999 14603 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:27.192274 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:27.149118 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:27.193760 14637 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:27.141608 14565 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:27.194069 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:27.194545 14565 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.195171 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:27.195737 10927 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:27.195976 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:27.196573 11079 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:27.151837 14564 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.150512 14399 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:27.197934 14564 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:27.198349 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:27.198418 14564 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.198999 11079 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:27.200218 10931 raft_consensus.cc:2410] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:21:27.200587 14564 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.201277 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.202425 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.203153 10931 raft_consensus.cc:2410] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:21:27.123407 10930 raft_consensus.cc:2410] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:21:27.159958 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.160555 10933 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8.
I20260709 12:21:27.209509 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.210312 11050 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:27.157336 14218 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:27.120880 14653 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.162992 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:27.123749 11624 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:27.076870 14628 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:27.078154 14501 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.083027 14635 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:21:27.196693 14565 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.174817 14633 consensus_queue.cc:260] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.196362 14631 consensus_queue.cc:1059] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:27.108516 14654 raft_consensus.cc:697] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:27.203827 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:27.205344 11083 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:21:27.211476 14637 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:27.208067 10927 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:27.208582 11081 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:21:27.211450 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:21:27.236737 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 50207.2us
I20260709 12:21:27.212397 11050 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:27.212819 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:21:27.213191 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 112784us
W20260709 12:21:27.214478 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 90809.4us
I20260709 12:21:27.238206 10930 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:27.215204 14544 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:27.242215 11050 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:27.242419 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:27.211915 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 48277.1us
I20260709 12:21:27.217133 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:27.219998 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.230064 14335 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:27.102243 14617 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:27.144568 14436 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.254211 10901 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:27.255702 14436 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.227777 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:27.256569 14631 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:27.257071 14631 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.257431 14631 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:27.171694 14439 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.193786 14317 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.188762 14584 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.263927 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:27.231913 10935 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 7.
I20260709 12:21:27.206928 11082 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:21:27.218044 14482 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:27.267248 11082 pending_rounds.cc:85] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 6
I20260709 12:21:27.267549 11082 pending_rounds.cc:107] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:21:27.267805 11082 raft_consensus.cc:2889] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:27.269160 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:27.269418 14482 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.269838 14482 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:27.270530 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:27.239333 11624 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:27.272688 14639 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:27.273263 14523 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:27.273672 14523 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.274001 14523 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:27.276806 14624 log.cc:927] Time spent T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 1.062s	user 0.010s	sys 0.010s
I20260709 12:21:27.277781 14439 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.245951 11050 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:27.278359 14439 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.278757 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:27.278976 14640 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:27.279199 11050 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:27.279742 14662 raft_consensus.cc:3055] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:27.279996 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:27.280474 14439 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.280586 11076 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:21:27.281630 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:27.281991 10974 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:27.282629 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:27.284884 14637 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:27.286729 11050 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:27.271718 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:27.247417 14232 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:27.287686 14637 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:27.288130 14637 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:27.288504 14637 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:27.290445 14569 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:27.291479 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:27.292250 14548 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:27.292481 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2415) took 1297 ms. Trace:
I20260709 12:21:27.292831 11077 rpcz_store.cc:276] 0709 12:21:25.994674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.994816 (+   142us) service_pool.cc:224] Handling call
0709 12:21:26.013504 (+ 18688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:26.721567 (+708063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:27.292221 (+570654us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b540044cad4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:27.292424 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1442824960}
I20260709 12:21:27.290344 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:27.295039 14536 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:27.269052 14654 consensus_queue.cc:237] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.217638 11079 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:27.248206 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.299732 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.299089 14523 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:27.300956 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.227303 14501 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.302063 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.302763 10927 raft_consensus.cc:2393] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 7: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:27.303269 14501 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:27.250811 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:27.304312 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.252046 14617 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:27.253001 14544 raft_consensus.cc:697] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:27.253755 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:27.257983 10929 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 3.
I20260709 12:21:27.307487 14662 raft_consensus.cc:740] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:27.261112 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:27.307312 14544 consensus_queue.cc:237] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:27.308476 14662 consensus_queue.cc:260] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:27.308429 11080 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:27.255378 10901 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:27.310856 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 55549.9us
I20260709 12:21:27.301110 11085 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:27.312075 10901 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:27.261435 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:27.240392 14633 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:27.316473 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:27.318324 14653 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.321461 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:27.324102 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.263434 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:27.316238 14639 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:27.233171 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.255368 14524 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:27.244316 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.313097 11084 raft_consensus.cc:2410] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:21:27.313311 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:27.314002 14574 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.313715 14220 consensus_queue.cc:237] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:27.325294 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.340164 10975 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:27.309705 14662 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:27.341687 10929 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:27.327960 11656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59384 (request call id 449) took 1133 ms. Trace:
I20260709 12:21:27.342629 14529 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:27.328774 14639 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.329386 10935 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:27.330902 14617 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:27.328322 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.345170 14617 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:27.345613 14617 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:27.343048 14524 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:27.342327 10901 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:27.346167 14639 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:27.346724 10901 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:27.348376 14628 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:27.348860 14628 raft_consensus.cc:697] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:27.349152 11653 consensus_queue.cc:237] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:27.349984 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:27.349687 14628 consensus_queue.cc:237] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.350569 11077 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:27.352029 14317 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:27.352427 14317 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.352581 14517 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:27.352741 10833 catalog_manager.cc:5697] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 7 to 9, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 9 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:27.354576 10901 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:27.333653 10933 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:27.355415 14622 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:27.321447 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:27.356280 11085 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:27.343400 11656 rpcz_store.cc:276] 0709 12:21:26.195042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.195163 (+   121us) service_pool.cc:224] Handling call
0709 12:21:27.327737 (+1132574us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b54001374d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:27.327874 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1647433984}
I20260709 12:21:27.335194 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:27.359036 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 72373us
I20260709 12:21:27.336017 11622 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:27.359721 11050 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:27.361445 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:27.362048 11006 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:27.362609 11080 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:21:27.303495 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.364259 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:27.364862 11005 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:27.368543 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:27.368969 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:27.369699 11050 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:27.367219 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 85287.4us
I20260709 12:21:27.330282 14542 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:27.373556 11009 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:21:27.374199 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.375193 11007 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:27.376515 11010 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 4: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:27.376821 10830 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 111) took 3871 ms. Trace:
I20260709 12:21:27.378499 10977 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:27.379132 11006 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:27.379258 11050 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:27.379467 11084 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:21:27.428385 11084 pending_rounds.cc:85] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 3
I20260709 12:21:27.428638 11084 pending_rounds.cc:107] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:21:27.380834 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.428869 11084 raft_consensus.cc:2889] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:27.381659 11080 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:21:27.430254 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 51076.2us
I20260709 12:21:27.430989 11050 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:27.431105 11080 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:27.382512 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.363761 10833 catalog_manager.cc:5697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 8 to 9, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 9 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:27.384158 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:27.385035 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.376925 14642 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:21:27.384385 11622 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:27.383165 14529 consensus_queue.cc:1059] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:21:27.396603 10974 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:21:27.400832 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 60758.7us
W20260709 12:21:27.438396 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.439004 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:27.439719 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 55418.9us
I20260709 12:21:27.440141 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.441689 10833 catalog_manager.cc:5697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 4 to 5, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 5 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:27.442878 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.442757 10833 catalog_manager.cc:5697] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 3 to 4, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 4 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:27.306174 14523 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.405673 11011 raft_consensus.cc:1240] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:21:27.358551 14622 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.368386 14317 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:27.411815 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.381441 14439 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:27.415115 11005 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
I20260709 12:21:27.387293 14639 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:27.407272 14574 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:27.418140 14665 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:27.418393 14530 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:27.436460 14548 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:27.419508 14632 consensus_queue.cc:1059] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:21:27.420513 14514 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:27.421631 14663 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:27.422672 10929 raft_consensus.cc:1275] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:27.407886 14603 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.423715 10901 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:27.444761 14311 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:21:27.473417 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 49790.3us
I20260709 12:21:27.474628 10901 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:27.424816 14482 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.386544 14640 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:27.377552 10830 rpcz_store.cc:276] 0709 12:21:23.487189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.487407 (+   218us) service_pool.cc:224] Handling call
0709 12:21:27.358920 (+3871513us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:25.333728 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:25.356466 (+ 22738us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:25.356503 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:21:25.356521 (+    18us) tablet.cc:662] Decoding operations
0709 12:21:25.357211 (+   690us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:25.357271 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:25.357300 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:21:25.357825 (+   525us) tablet.cc:701] Row locks acquired
0709 12:21:25.357845 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:21:25.357994 (+   149us) write_op.cc:270] Start()
0709 12:21:25.358120 (+   126us) write_op.cc:276] Timestamp: P: 1783599685357941 usec, L: 0
0709 12:21:25.358146 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:21:25.358824 (+   678us) log.cc:844] Serialized 2178 byte log entry
0709 12:21:25.625278 (+266454us) op_driver.cc:464] REPLICATION: finished
0709 12:21:25.684360 (+ 59082us) write_op.cc:301] APPLY: starting
0709 12:21:25.684453 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:25.684625 (+   172us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:25.684750 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:25.685500 (+   750us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:25.685739 (+   239us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:21:25.685784 (+    45us) write_op.cc:312] APPLY: finished
0709 12:21:25.686028 (+   244us) log.cc:844] Serialized 47 byte log entry
0709 12:21:25.686204 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:25.686320 (+   116us) write_op.cc:454] Released schema lock
0709 12:21:25.686370 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:25.686806 (+   436us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:25.686833 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13567,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":58816,"apply.run_cpu_time_us":2422,"apply.run_wall_time_us":2421,"num_ops":5,"prepare.queue_time_us":230239,"prepare.run_cpu_time_us":24882,"prepare.run_wall_time_us":177316,"raft.queue_time_us":93980,"raft.run_cpu_time_us":20436,"raft.run_wall_time_us":64292,"replication_time_us":266984,"thread_start_us":435832,"threads_started":4,"wal-append.queue_time_us":169950,"wal-append.run_cpu_time_us":32888,"wal-append.run_wall_time_us":1160282}]]}
I20260709 12:21:27.434764 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.390427 11085 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:27.372196 10930 raft_consensus.cc:2410] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:21:27.437440 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:27.481738 10933 raft_consensus.cc:2368] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10.
I20260709 12:21:27.482481 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.483485 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:27.444897 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:27.447273 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 50735.6us
I20260709 12:21:27.484607 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.447535 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.485589 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.485749 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.486379 10934 raft_consensus.cc:2410] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:21:27.487232 10934 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:27.444497 10833 catalog_manager.cc:5697] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 8 to 10, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 10 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
W20260709 12:21:27.447722 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 69308.7us
I20260709 12:21:27.439224 14501 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:27.470613 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.448467 14622 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:27.488548 10977 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:27.450474 11050 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:27.428135 14631 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:27.482658 11051 leader_election.cc:400] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10.
I20260709 12:21:27.489759 11051 leader_election.cc:403] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:21:27.488618 10833 catalog_manager.cc:5697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 5 to 7, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 7 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:27.491140 14631 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:27.491074 10833 catalog_manager.cc:5697] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 8 to 9, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 9 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:27.492375 10833 catalog_manager.cc:5697] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 7 to 8, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 8 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:27.449185 14534 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:27.494728 10933 raft_consensus.cc:2410] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:21:27.495241 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:27.505174 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:27.461225 14639 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:27.493418 10833 catalog_manager.cc:5697] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 5 to 7, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 7 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:27.505412 11078 raft_consensus.cc:2393] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 9: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:27.465126 14232 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:21:27.508133 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 57749.1us
I20260709 12:21:27.512235 10974 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:27.464761 14530 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.527604 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:27.528333 11083 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:21:27.529179 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:27.529788 11083 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:21:27.512176 10977 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:27.495379 14640 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:27.504312 14529 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:27.508878 14524 consensus_queue.cc:1059] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:21:27.516630 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:27.524425 10833 catalog_manager.cc:5697] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 6 to 8, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 8 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:27.539695 11011 raft_consensus.cc:2393] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 8: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:27.540566 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:27.464037 14439 raft_consensus.cc:697] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:21:27.517505 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.520756 11051 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:27.522238 11076 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:27.517072 14501 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:27.550774 10929 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:27.545220 11050 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:27.532689 10974 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:27.534991 10977 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:27.518601 14639 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:27.522899 14584 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:21:27.460840 14446 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:21:27.478245 14662 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:27.540083 10833 catalog_manager.cc:5697] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:27.538090 14530 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:27.541170 11085 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:27.517092 14510 raft_consensus.cc:3055] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:27.462463 14608 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.480731 14548 raft_consensus.cc:697] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:27.517459 14641 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:27.477178 14311 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.554504 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:27.552820 10974 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:27.523377 14658 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10.
I20260709 12:21:27.557937 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:27.541867 14643 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:27.537145 14569 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:27.560345 10833 catalog_manager.cc:5697] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 7 to 8, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 8 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:27.517817 10931 raft_consensus.cc:2393] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:27.537549 14640 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:27.479525 14665 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:27.565053 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.568861 14510 raft_consensus.cc:740] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:27.576553 14564 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.559041 14522 raft_consensus.cc:1027] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: attempt to promote peer 0b171b6aaedc4f809f2753dcfadb14ce: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:21:27.559223 14654 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:27.644043 10928 raft_consensus.cc:606] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Received request to transfer leadership
I20260709 12:21:27.585117 10932 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:21:27.588642 11077 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:27.554016 11655 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:21:27.562271 14565 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:27.617866 14501 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:27.556610 14637 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:27.618815 10936 raft_consensus.cc:2393] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 15: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:27.618367 10833 catalog_manager.cc:5697] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:27.565840 14529 raft_consensus.cc:697] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:27.560432 14436 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:27.522782 14533 consensus_queue.cc:1048] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:21:27.599980 14311 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:27.645279 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 178706us
I20260709 12:21:27.674551 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:27.647012 14576 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.672524 11656 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 LEARNER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:21:27.646489 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 88641.2us
I20260709 12:21:27.576644 14523 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:21:27.565908 14542 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.619768 14574 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:21:27.658465 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 105611us
I20260709 12:21:27.632293 14643 raft_consensus.cc:697] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:27.658553 10833 catalog_manager.cc:5697] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 4 to 6, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 6 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:27.685386 10974 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:27.641214 14482 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:27.641863 14641 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:21:27.678574 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 129435us
I20260709 12:21:27.657085 14501 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.681005 10899 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:27.692843 10974 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:27.682804 11079 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:27.696094 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 150957us
I20260709 12:21:27.584729 14439 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.652359 14232 raft_consensus.cc:697] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:27.686720 10833 catalog_manager.cc:5697] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:27.648586 14564 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.709772 14564 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.699476 14238 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:27.716817 14482 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.717284 14238 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.696312 14501 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:27.717796 14238 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:27.703333 14628 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:21:27.669709 14565 raft_consensus.cc:697] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:27.721607 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:27.721844 14565 consensus_queue.cc:237] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.701472 14574 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:27.723937 14574 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.724321 14574 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:27.685479 10977 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:27.686419 14514 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:27.671931 14436 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:27.705655 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:27.741972 11077 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:27.705940 14679 log.cc:927] Time spent T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:21:27.706578 14674 log.cc:927] Time spent T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:21:27.705725  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:27.717433 14482 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.733634 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:27.701119 10899 leader_election.cc:400] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8.
I20260709 12:21:27.756168 10899 leader_election.cc:403] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:21:27.756935 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 55965.4us
I20260709 12:21:27.757720 10899 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:21:27.734982 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 49611.4us
I20260709 12:21:27.737776 11079 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
I20260709 12:21:27.740622 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:27.753319 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:27.701684 14584 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.740859 14569 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:27.686829 14576 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:27.688858 14633 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:21:27.744719 14564 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:27.745615 14436 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:27.694226 14510 consensus_queue.cc:260] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:27.775087 14482 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:27.765190 14628 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8.
I20260709 12:21:27.767620 14693 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.744848 14603 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.779645 10899 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:27.781360 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:27.692051 14548 consensus_queue.cc:237] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.766342 14514 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:27.828050 14232 consensus_queue.cc:237] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.830449 14637 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:27.770372 14569 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.770027 14584 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.835975 14622 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:27.836639 14681 log.cc:927] Time spent T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:21:27.850566 11009 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:21:27.850770 11003 raft_consensus.cc:2368] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10.
W20260709 12:21:27.864816 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 85247.6us
I20260709 12:21:27.752583 14529 consensus_queue.cc:237] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.880502 10899 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:27.877660  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:27.882318 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:27.884855 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:27.785393 14524 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 12:21:27.756012 14643 consensus_queue.cc:237] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.888078 10899 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:27.891108 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:27.891898 11003 raft_consensus.cc:2393] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:27.873042 14569 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:27.894543 14622 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.870779 14608 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.898237 14517 raft_consensus.cc:3055] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:27.867547 14482 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:27.872370 14220 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:27.900537 10927 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:21:27.894878 10977 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:27.861011 14617 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.913105 11008 raft_consensus.cc:1275] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:27.913791 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:27.912258 14317 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.888926 14631 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:27.863035 14693 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:27.918367 10977 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:27.900651 14662 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:27.926777 14317 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.927404 14693 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.902921 14663 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:27.924929 10977 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:27.886193 14603 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:21:27.883781 14510 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:27.943307 10934 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:27.943011 11008 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:27.907662 14517 raft_consensus.cc:740] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:27.915319 14665 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:27.917907 14694 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:27.977675  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:27.922307 14439 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:27.909495 14642 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:21:27.946039 10977 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:27.934006 14564 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:27.945072 11622 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:27.919517 14482 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:27.942358 14608 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
W20260709 12:21:27.984862 14695 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:21:28.009624 14482 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:28.011270 11655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59398 (request call id 321) took 2473 ms (client timeout 2105 ms). Trace:
W20260709 12:21:28.012326 14699 log.cc:927] Time spent T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:21:28.018157 11077 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 7.
I20260709 12:21:27.999825 14439 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.985473 14311 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:28.021277 14693 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:28.002075 14501 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:28.035948 14439 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:28.049407 14698 log.cc:927] Time spent T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:21:28.050153 14501 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:28.011689 11655 rpcz_store.cc:269] 0709 12:21:25.537574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.540803 (+  3229us) service_pool.cc:224] Handling call
0709 12:21:28.011072 (+2470269us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b5400528854. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:28.011182 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4533958400}
I20260709 12:21:28.052891 14639 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:28.055087 14639 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:28.058828 14584 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:28.059300 14439 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:28.059887 14617 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:28.064571 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 118568us
W20260709 12:21:28.047456 14697 log.cc:927] Time spent T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 12:21:28.073539 11003 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 8. Current term is 9. Ops: []
W20260709 12:21:28.073796 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 167720us
I20260709 12:21:28.038300 14238 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:28.042985 14530 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:28.088431 14693 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:28.206106 14439 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:28.206848 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 129511us
I20260709 12:21:28.210283 14530 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:28.211431 14705 log.cc:927] Time spent T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.003s
I20260709 12:21:28.211727 14311 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:28.212807 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:28.213660 10935 raft_consensus.cc:2393] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 8: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:28.217401 11077 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:28.218142 14436 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:28.219733 14439 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.206710 14569 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:28.208319 10977 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:28.228820 10977 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:28.226608 14238 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:28.233541 10977 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:28.236804 11077 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:28.234890 14653 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:28.240263 14700 log.cc:927] Time spent T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.240s	user 0.007s	sys 0.000s
W20260709 12:21:28.240598 14077 raft_consensus.cc:1068] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697: Unable to promote non-voter 0b171b6aaedc4f809f2753dcfadb14ce: Service unavailable: leader transfer in progress
I20260709 12:21:28.225759 14436 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:28.220381 14702 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:28.242031 14712 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:28.224408 14439 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:28.245262 11077 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:28.243748 10977 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:28.246619 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 301605us
I20260709 12:21:28.247543 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:28.288587 11653 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:28.248378 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:28.289273 10977 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:28.291642 11622 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:28.293545 10936 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:28.247951 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:28.295358 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:28.296061 10934 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:28.244850 14640 consensus_meta.cc:287] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.601s	user 0.014s	sys 0.003s
I20260709 12:21:28.263741 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:28.276702 10932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 2359) took 1097 ms. Trace:
W20260709 12:21:28.278427 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.306007 14712 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:28.243837 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:28.313020 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:28.313412 11085 raft_consensus.cc:2393] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 11: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:28.244823 14436 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:28.315279 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:28.308367 14077 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:21:28.249406 11081 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:21:28.318470 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:28.308497 14617 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:21:28.304010 14482 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:28.308097 14530 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:21:28.321779 14482 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:28.314218 14640 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:28.310209 10932 rpcz_store.cc:276] 0709 12:21:27.178783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.217077 (+ 38294us) service_pool.cc:224] Handling call
0709 12:21:28.276521 (+1059444us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b54001a7cd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:28.276639 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":587135360}
I20260709 12:21:28.307600 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:28.309468 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:28.325773 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:28.326589 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:28.327145 10930 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:28.260206 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:28.292865 14653 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:28.315248 11655 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 8: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:28.333238 11084 raft_consensus.cc:1240] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:21:28.333400 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:28.334039 11077 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:21:28.327160 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:28.335283 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:28.335889 11006 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:28.336408 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:28.328637 10936 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:21:28.329591 11081 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:28.331288 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:28.307404 14510 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:28.331725 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2632) took 1064 ms. Trace:
I20260709 12:21:28.256807 14523 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:28.342392 11011 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:28.344558 11078 rpcz_store.cc:276] 0709 12:21:27.267060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.291255 (+ 24195us) service_pool.cc:224] Handling call
0709 12:21:28.331503 (+1040248us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400215f54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:28.331662 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490163584}
I20260709 12:21:28.343554 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:28.355633 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:28.355795 10936 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:21:28.263409 14439 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:28.344925 11006 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 7.
I20260709 12:21:28.348253 10930 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:21:28.352259 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:28.361780 10934 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8.
I20260709 12:21:28.363772 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:28.364548 11006 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:28.365217 10977 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:28.331045 14482 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:28.330525 14712 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:28.343000 14574 consensus_meta.cc:287] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.618s	user 0.005s	sys 0.011s
I20260709 12:21:28.378350 11077 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:28.383186 11006 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8.
I20260709 12:21:28.340481 14436 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.388715 10977 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:28.327239 14311 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:21:28.393201 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:28.400144 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:28.384749 14439 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.403141 11002 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:21:28.405081 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:28.405647 11009 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:28.401077 10975 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:28.408344 14643 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:28.388043 14523 raft_consensus.cc:697] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:28.410480 11011 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:21:28.390005 14510 raft_consensus.cc:697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:28.414423 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:28.413276 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:28.413379 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:28.385450 14544 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:21:28.417075 10901 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:28.394121 14693 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:28.397706 14653 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:28.424388 14653 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:28.424788 14653 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:28.429842 14693 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:28.430301 14693 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:28.436334 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:28.437290 10935 raft_consensus.cc:2410] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:21:28.438290 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:28.438881 14693 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:28.419176 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:28.408784 14642 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:28.421803 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:28.441052 14642 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:28.442621 10936 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:28.443166 14642 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:28.444355 10936 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:28.400906 14710 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:28.446218 14710 raft_consensus.cc:697] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:28.401238 14565 consensus_queue.cc:1059] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:21:28.389732 14436 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:28.388307 14712 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:28.415767 11009 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:28.440697 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:28.423659 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:28.461444 11009 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:28.465664 14712 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:28.466907 14576 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:28.451367 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:28.469108 11006 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:28.472950 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2034) took 1064 ms. Trace:
I20260709 12:21:28.473371 10927 rpcz_store.cc:276] 0709 12:21:27.408696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.486726 (+ 78030us) service_pool.cc:224] Handling call
0709 12:21:27.900297 (+413571us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:27.916253 (+ 15956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:28.472758 (+556505us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b5400370ad0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:28.472889 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":950421888}
I20260709 12:21:28.451715 14523 consensus_queue.cc:237] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:28.475771 14680 log.cc:927] Time spent T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.718s	user 0.000s	sys 0.002s
I20260709 12:21:28.478082 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2599) took 1103 ms. Trace:
I20260709 12:21:28.386451 14574 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:28.409672 14439 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:28.444365 14640 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:28.478528 11007 rpcz_store.cc:276] 0709 12:21:27.374585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.376768 (+  2183us) service_pool.cc:224] Handling call
0709 12:21:27.377129 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:27.401470 (+ 24341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:27.401499 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:27.407661 (+  6162us) log.cc:844] Serialized 26 byte log entry
0709 12:21:27.460184 (+ 52523us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:27.460233 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:27.460321 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:28.226506 (+766185us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b4800130158. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb5e89aa1 00007f9bb5e80b37 00007f9bb5e809ca 00007f9bb5f7826f 00007f9bb5f77f37 00007f9bb5f8c55c 00007f9bb5f8c508 00007f9bb5f8c488 00007f9bb5f8c443 00007f9bb5f8b6ec 00007f9bb4eb5a96
0709 12:21:28.475151 (+248645us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:28.477847 (+  2696us) raft_consensus.cc:1685] finished
0709 12:21:28.477875 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:28.478014 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24441,"raft.queue_time_us":25633,"raft.run_cpu_time_us":4941,"raft.run_wall_time_us":819421,"spinlock_wait_cycles":13936768,"thread_start_us":41749,"threads_started":1,"wal-append.queue_time_us":241352}
I20260709 12:21:28.480669 14649 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:28.480708 14663 consensus_queue.cc:1059] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:28.482133 14663 consensus_queue.cc:1243] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 11.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:28.482471 14574 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:28.482640 14663 raft_consensus.cc:3055] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:28.483070 14663 raft_consensus.cc:740] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:28.483382 11010 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:28.484215 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:28.485241 14617 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:28.487424 14710 consensus_queue.cc:237] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:28.489190 10931 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 2370) took 1301 ms (client timeout 1651 ms). Trace:
I20260709 12:21:28.489964 11079 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:28.490768 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2448) took 1035 ms. Trace:
I20260709 12:21:28.491266 11084 rpcz_store.cc:276] 0709 12:21:27.455850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.456033 (+   183us) service_pool.cc:224] Handling call
0709 12:21:28.331730 (+875697us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:28.338850 (+  7120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:28.490596 (+151746us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b5400215f50. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:28.490716 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2012989312}
I20260709 12:21:28.467726 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:28.493736 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:28.494244 10933 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 5: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:21:28.489609 10931 rpcz_store.cc:269] 0709 12:21:27.187496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.203608 (+ 16112us) service_pool.cc:224] Handling call
0709 12:21:28.489010 (+1285402us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b540017b6d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:28.489135 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":631747840}
I20260709 12:21:28.495829 10899 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:28.498237 11009 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:28.499049 11653 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:21:28.498939 11006 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:28.511744 11008 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:28.451907 14643 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.512974 14643 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:28.514751 14643 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:28.493310 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:28.454737 14686 log.cc:927] Time spent T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.699s	user 0.001s	sys 0.005s
I20260709 12:21:28.540319 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:28.546407 10932 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:28.450003 14569 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:28.543705 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 47954us
I20260709 12:21:28.521075 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:28.480772 14565 raft_consensus.cc:3055] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:28.555172 11008 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:28.467710 14436 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:28.522598 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:28.511000 14641 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:28.520928 14639 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.521207 14640 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:28.571841 10936 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:28.575098 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:28.577970 10932 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:28.561934 14603 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:28.562826 14565 raft_consensus.cc:740] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:28.581486 14693 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:28.571326 14524 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.469321 14510 consensus_queue.cc:237] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:28.544691 14482 consensus_queue.cc:1059] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:21:28.562664 14642 consensus_queue.cc:1059] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:21:28.594621 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:28.451390 14653 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:28.572947 14633 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:21:28.601248 11005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2601) took 1120 ms. Trace:
I20260709 12:21:28.483847 14663 consensus_queue.cc:260] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:28.573097 14290 consensus_queue.cc:1059] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:21:28.601649 11005 rpcz_store.cc:276] 0709 12:21:27.480779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.480940 (+   161us) service_pool.cc:224] Handling call
0709 12:21:27.481290 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:27.504014 (+ 22724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:27.504049 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:27.514984 (+ 10935us) log.cc:844] Serialized 52 byte log entry
0709 12:21:27.671351 (+156367us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:27.671388 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:27.671459 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:28.015622 (+344163us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:28.454340 (+438718us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b24002b7d98. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badcf99c4 00007f9badcf7acb 00007f9badeb2dc9 00007f9badeb2a55 00007f9badeb209d 00007f9bb0ae410e 00007f9bb0afb88c 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221
0709 12:21:28.601020 (+146680us) raft_consensus.cc:1685] finished
0709 12:21:28.601046 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:28.601191 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23007,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":8286,"spinlock_wait_cycles":13698176,"thread_start_us":155955,"threads_started":1,"wal-append.queue_time_us":188244}
I20260709 12:21:28.576228 14617 consensus_queue.cc:1059] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:21:28.586952 14603 raft_consensus.cc:697] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:28.593178 14611 raft_consensus.cc:3055] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:28.614935 10932 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:21:28.615226 11050 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:28.608908 14077 consensus_queue.cc:1059] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:28.576663 14641 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:28.617980 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:28.618216 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:28.618934 11005 raft_consensus.cc:2368] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10.
I20260709 12:21:28.619359 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:28.618884 11010 raft_consensus.cc:2410] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:21:28.619982 11011 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:28.620010 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:28.622324 11050 leader_election.cc:400] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10.
I20260709 12:21:28.623327 11050 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:28.626516 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:28.600839 14482 raft_consensus.cc:3055] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:28.627513 11005 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:28.580006 14639 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:28.628849 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:28.633459 10932 raft_consensus.cc:2393] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 7: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:28.583772 14640 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:28.609609 14436 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:28.645287 11005 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:28.619257 14611 raft_consensus.cc:740] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:21:28.652709 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.690673 11084 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:28.691227 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:28.691968 11077 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:28.627218 14708 raft_consensus.cc:3055] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:28.654230 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:28.694916 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:28.695329 14723 log.cc:927] Time spent T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:21:28.660491 14232 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:28.664451 11011 raft_consensus.cc:1240] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:28.674031 14635 raft_consensus.cc:3055] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:28.677147 11625 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:28.716658 11625 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:28.650480 14517 consensus_queue.cc:260] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:28.678421 10977 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:28.722997 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 44657.2us
I20260709 12:21:28.684628 14709 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:28.624588 14643 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.624918 14658 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:28.605664 14524 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:28.709446 14684 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:28.700699 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:28.701858 10932 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:21:28.717919 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.630256 14482 raft_consensus.cc:740] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:28.731364 14536 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:28.696084 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:28.641857 14534 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.720191 14576 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:21:28.739970 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 169527us
I20260709 12:21:28.741091 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:28.713444 14708 raft_consensus.cc:740] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:28.748692 10974 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:28.757028 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 133788us
I20260709 12:21:28.715632 14635 raft_consensus.cc:740] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:28.717949 11084 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8.
I20260709 12:21:28.724093 10977 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:28.734019 14693 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:28.770891 14693 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:28.771311 14693 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:28.772241 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43546 (request call id 80) took 1691 ms. Trace:
I20260709 12:21:28.772667 10928 rpcz_store.cc:276] 0709 12:21:27.097225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.097359 (+   134us) service_pool.cc:224] Handling call
0709 12:21:28.081612 (+984253us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b54001e67a0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0edd520 00007f9bb0f5a652 00007f9bb5f2860a 00007f9baf4ae7d4 00007f9baf4ae762 00007f9baf4ae691 00007f9baf4ae60c 00007f9baf4ad8c2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:28.772043 (+690431us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b540024cf54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5a853 00007f9bb5f2860a 00007f9baf4ae7d4 00007f9baf4ae762 00007f9baf4ae691 00007f9baf4ae60c 00007f9baf4ad8c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:28.772135 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1249147648}
I20260709 12:21:28.630082 14565 consensus_queue.cc:260] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:28.742792 14439 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:28.776542 14311 consensus_queue.cc:1175] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" responder_term: 6 status { last_received { term: 6 index: 6 } last_committed_idx: 5 last_received_current_leader { term: 6 index: 6 } }
I20260709 12:21:28.738350 14446 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:21:28.777951 14635 consensus_queue.cc:260] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:28.779064 14635 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:28.780285 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:28.781486 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:28.782109 11077 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:28.783433 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:28.784013 11077 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:28.784833 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 60817.1us
I20260709 12:21:28.705971 14436 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:28.754321 14517 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:28.763433 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:28.758701 10901 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:28.752962 14684 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:28.768761 14708 consensus_queue.cc:260] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:28.762910 14534 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:28.770414 14710 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:28.785554 10977 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:28.760315 11050 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:28.760540 10974 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:28.822220 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:28.841946 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 83401.3us
W20260709 12:21:28.856482 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 71007.1us
I20260709 12:21:28.857079 10901 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:28.742494 14643 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:28.858283 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:28.861292 11081 raft_consensus.cc:2393] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 13: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:28.862648 11081 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:21:28.734457 14709 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:28.863792 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 103329us
I20260709 12:21:28.867903 10974 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:28.841737 14576 raft_consensus.cc:697] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:28.843343 14735 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:28.820566 14232 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:28.867096 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:28.734694 14603 consensus_queue.cc:237] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:28.837922 14439 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:28.856076 14710 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:28.864688 11077 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:28.863181 14569 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:28.864615 11009 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
W20260709 12:21:28.869365 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 109223us
I20260709 12:21:28.899127 10928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:43546
I20260709 12:21:28.867197 14708 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:28.859337 14730 log.cc:927] Time spent T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:21:28.866030 14608 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.866017 14574 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:28.932839 10928 raft_consensus.cc:606] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Received request to transfer leadership
I20260709 12:21:28.762987 14611 consensus_queue.cc:260] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:28.934099 11082 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:28.871524 14734 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:28.944427 11657 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:28.893186 14653 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:28.925436 14710 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:28.866937 14702 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:21:28.918349 14690 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:28.914278 14439 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:28.863722 14482 consensus_queue.cc:260] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:29.056418 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 199403us
I20260709 12:21:29.057122 11082 raft_consensus.cc:1240] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:29.061305 11011 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:28.919250 14232 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.066058 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:29.068048 10927 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:28.934262 14654 consensus_queue.cc:1059] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.123s
I20260709 12:21:28.933643 14689 consensus_queue.cc:1048] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.123s
I20260709 12:21:29.067351 10901 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:21:29.068878 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 201100us
I20260709 12:21:29.072962 10974 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:29.073693 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 144060us
I20260709 12:21:29.075932 10974 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:29.079581 11050 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:29.080051 10936 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:29.058589 14616 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:28.953414 14608 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:29.070634 14574 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:29.069298 14290 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:29.067893 14439 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:28.849782 14446 raft_consensus.cc:2955] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 LEADER]: Committing config change with OpId 9.10: config changed from index 8 to 10, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:21:29.107780 10821 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for c1b75831227444d382e9c0fc5b367564 already in progress [suppressed 9 similar messages]
I20260709 12:21:29.110185 11082 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:29.114866 10927 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:29.115774 11082 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:21:29.134456 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 50359.8us
I20260709 12:21:29.107065 14584 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:29.078858 14529 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:21:29.102476 14524 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:29.103941 14574 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.104941 14658 raft_consensus.cc:3055] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:29.105561 14482 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:29.076272 14734 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:21:29.101171 14745 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:21:29.140939 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 61456.9us
I20260709 12:21:29.116709 14548 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:29.074510 14690 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:29.089972 14740 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:21:29.138629 10901 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:29.124714 14712 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:29.167766 11050 leader_election.cc:400] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10.
I20260709 12:21:29.151257 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 358) took 1215 ms. Trace:
I20260709 12:21:29.170327 11050 leader_election.cc:403] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:21:29.158020 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:21:29.177462 10821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 108192us
I20260709 12:21:29.170480 11076 rpcz_store.cc:276] 0709 12:21:27.936195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.936377 (+   182us) service_pool.cc:224] Handling call
0709 12:21:27.939563 (+  3186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:28.010335 (+ 70772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:28.010363 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:28.010402 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:28.010430 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:29.150977 (+1140547us) spinlock_profiling.cc:243] Waited 70.6 ms on lock 0x7b54002788d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:29.151026 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:29.151190 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162318080}
W20260709 12:21:29.180771 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:29.181255 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.111498 14290 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.177026 11050 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:21:29.154927 14738 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 12:21:29.144081 14574 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:29.147619 14658 raft_consensus.cc:740] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:29.150607 14747 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.149636 14639 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:29.158418 14684 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:29.154426 14436 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:29.155342 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:29.101610 14576 consensus_queue.cc:237] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:29.161598 14608 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:29.180260 14569 raft_consensus.cc:697] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:29.135313 14746 consensus_queue.cc:1059] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
W20260709 12:21:29.191597 14736 log.cc:927] Time spent T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.130s	user 0.000s	sys 0.002s
I20260709 12:21:29.180038 14750 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:21:29.187297 14534 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:29.184202 14691 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10.
W20260709 12:21:29.212406 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 73878.4us
I20260709 12:21:29.200552 14709 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:29.208250 14616 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:29.228026 10901 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:21:29.268781 14736 log.cc:927] Time spent T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:21:29.205152 14747 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.440274 14710 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.345242 14232 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:29.436808 14761 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:29.233078 14658 consensus_queue.cc:260] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.442487 14658 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:29.442895 11006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2620) took 1039 ms. Trace:
I20260709 12:21:29.443429 11006 rpcz_store.cc:276] 0709 12:21:28.402859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.471261 (+ 68402us) service_pool.cc:224] Handling call
0709 12:21:28.498747 (+ 27486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:28.507117 (+  8370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:29.233739 (+726622us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b540012bbd0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:29.442734 (+208995us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62481152}
W20260709 12:21:29.445114 14708 consensus_meta.cc:287] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.511s	user 0.004s	sys 0.004s
I20260709 12:21:29.441278 14747 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:29.212189 14639 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:21:29.427626 14741 log.cc:927] Time spent T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.238s	user 0.008s	sys 0.016s
W20260709 12:21:29.428504 14748 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.221s	user 0.003s	sys 0.021s
I20260709 12:21:29.428719 14290 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:29.429252 14754 log.cc:927] Time spent T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.211s	user 0.003s	sys 0.000s
W20260709 12:21:29.429623 14693 consensus_meta.cc:287] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.658s	user 0.012s	sys 0.000s
I20260709 12:21:29.431238 14709 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:21:29.432716 14517 consensus_meta.cc:287] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.584s	user 0.010s	sys 0.001s
I20260709 12:21:29.359638 14569 consensus_queue.cc:237] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.343513 14745 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:21:29.458588 14746 raft_consensus.cc:3055] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:29.234072 14734 consensus_queue.cc:1059] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.117s
I20260709 12:21:29.213011 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:21:29.447547 14635 consensus_meta.cc:287] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.668s	user 0.007s	sys 0.005s
I20260709 12:21:29.463604 10930 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:43546
W20260709 12:21:29.470204 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 275709us
I20260709 12:21:29.442425 14710 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:29.474279 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.448730 14639 raft_consensus.cc:697] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:21:29.436962 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 209019us
I20260709 12:21:29.486554 10930 raft_consensus.cc:606] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Received request to transfer leadership
I20260709 12:21:29.470791 14747 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:29.475983 14758 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:29.531774 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.530365 10901 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:29.483355 14746 raft_consensus.cc:740] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:29.547151 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2469) took 1064 ms. Trace:
I20260709 12:21:29.547646 11080 rpcz_store.cc:276] 0709 12:21:28.482474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.497017 (+ 14543us) service_pool.cc:224] Handling call
0709 12:21:28.497334 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:28.545463 (+ 48129us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:28.570905 (+ 25442us) log.cc:844] Serialized 14 byte log entry
0709 12:21:28.784126 (+213221us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:28.832666 (+ 48540us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b1800417400. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:21:28.844671 (+ 12005us) log.cc:844] Serialized 26 byte log entry
0709 12:21:28.844845 (+   174us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:28.844877 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:28.844949 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:29.531094 (+686145us) raft_consensus.cc:1685] finished
0709 12:21:29.546924 (+ 15830us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:29.547087 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24117,"prepare.queue_time_us":25422,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":87596,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":41093,"spinlock_wait_cycles":4411264,"thread_start_us":196861,"threads_started":1,"wal-append.queue_time_us":335669}
I20260709 12:21:29.474865 14693 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.480511 14709 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:29.542764 14749 log.cc:927] Time spent T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.250s	user 0.002s	sys 0.006s
I20260709 12:21:29.557253 11653 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:29.563385 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:29.563331 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:29.565819 11006 raft_consensus.cc:1240] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:29.566759 11011 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 8: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:29.564435 11010 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:21:29.567487 10927 raft_consensus.cc:1240] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:29.571630 10934 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:21:29.572037 10934 pending_rounds.cc:85] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 7
I20260709 12:21:29.572217 10934 pending_rounds.cc:107] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:21:29.572402 10934 raft_consensus.cc:2889] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:29.538537 14747 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.576560 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:29.565641 14335 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.584064 14752 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:29.587610 14756 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.589546 14693 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:29.573952 14548 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:29.544289 14758 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:29.593925 14765 log.cc:927] Time spent T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:21:29.594573 14758 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:29.596088 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:29.597210 11076 raft_consensus.cc:3055] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:29.597558 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:29.597596 11076 raft_consensus.cc:740] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:29.598309 11081 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:29.598650 11076 consensus_queue.cc:260] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.599148 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:29.599586 11076 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:29.600345 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:29.601500 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:29.602654 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:29.606905 14709 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:29.608718 10974 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:29.610447 14663 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:29.610800 14709 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:29.569093 14653 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:29.613571 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40200 (request call id 360) took 1091 ms. Trace:
I20260709 12:21:29.573467 14710 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:21:29.612188 14639 consensus_queue.cc:237] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.615955 14756 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.624341 14756 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:29.616161 14574 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:29.625348 14726 log.cc:927] Time spent T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.907s	user 0.000s	sys 0.012s
I20260709 12:21:29.626459 14574 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:29.573663 14746 consensus_queue.cc:260] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.617501 11084 rpcz_store.cc:276] 0709 12:21:28.521798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.522363 (+   565us) service_pool.cc:224] Handling call
0709 12:21:29.595846 (+1073483us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b5400218c54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:29.613489 (+ 17643us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":290828032}
I20260709 12:21:29.610492 10974 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:29.618459 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:29.618809 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2141) took 1873 ms. Trace:
I20260709 12:21:29.619801 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:29.627815 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2147) took 1009 ms. Trace:
I20260709 12:21:29.628250 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2049) took 1213 ms. Trace:
I20260709 12:21:29.633761 10974 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:29.634690 11081 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:29.643993 10935 rpcz_store.cc:276] 0709 12:21:28.415252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.440592 (+ 25340us) service_pool.cc:224] Handling call
0709 12:21:28.440871 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:28.441448 (+   577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:28.441475 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:28.442057 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 12:21:28.565214 (+123157us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:28.565254 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:28.565512 (+   258us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:29.624620 (+1059108us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:29.627949 (+  3329us) raft_consensus.cc:1685] finished
0709 12:21:29.627970 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:29.628189 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":7284992,"thread_start_us":122622,"threads_started":1,"wal-append.queue_time_us":177222}
I20260709 12:21:29.634814 11003 rpcz_store.cc:276] 0709 12:21:27.745650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.894789 (+149139us) service_pool.cc:224] Handling call
0709 12:21:27.895092 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:28.074812 (+179720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:29.618561 (+1543749us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54000dd9d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:29.618746 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409883904}
I20260709 12:21:29.645761 11009 rpcz_store.cc:276] 0709 12:21:28.617891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.619749 (+  1858us) service_pool.cc:224] Handling call
0709 12:21:29.627545 (+1007796us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b5400470754. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:29.627726 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":559874816}
I20260709 12:21:29.649106 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:29.650820 11076 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:21:29.651217 11076 pending_rounds.cc:85] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 7
I20260709 12:21:29.651453 11076 pending_rounds.cc:107] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:21:29.651784 11076 raft_consensus.cc:2889] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:29.640949 14517 raft_consensus.cc:993] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 0b171b6aaedc4f809f2753dcfadb14ce to start an election
W20260709 12:21:29.635389 14439 consensus_meta.cc:287] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.000s
I20260709 12:21:29.617081 14752 raft_consensus.cc:697] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:29.661607 14574 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:29.662389 10974 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:29.662943 14758 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:29.634646 14311 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:29.629093 14746 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:29.632809 14565 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:29.630079 14641 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:29.630362 14747 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:29.633765 14643 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:29.620468 14335 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.622097 14653 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:29.694448 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.675366 10974 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:29.672722 14710 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:29.700174 14335 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:29.661469 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:29.679508 14752 consensus_queue.cc:237] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.700551 14710 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.701002 11654 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:29.702526 14710 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:29.675117 14658 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.703083 14710 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:29.678669 14311 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:29.668757 14439 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.704496 14311 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:21:29.681993 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.690752 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:29.703745 14658 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.691274 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:29.691951 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:29.707825 10934 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 8: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:29.708381 14641 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.708953 14482 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:29.709010 14641 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.709694 14482 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.707407 14654 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:29.711748 14482 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:29.711684 14654 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.713933 14654 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:29.714247 14690 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:29.695600 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2477) took 1006 ms. Trace:
W20260709 12:21:29.696640 14759 log.cc:927] Time spent T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.486s	user 0.000s	sys 0.007s
I20260709 12:21:29.705971 14439 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:29.708508 14658 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:29.707437 10935 raft_consensus.cc:2393] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 8: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:29.714815 11077 rpcz_store.cc:276] 0709 12:21:28.689194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.921073 (+231879us) service_pool.cc:224] Handling call
0709 12:21:28.921382 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:29.067251 (+145869us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:29.084646 (+ 17395us) log.cc:844] Serialized 14 byte log entry
0709 12:21:29.468441 (+383795us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:29.468905 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 12:21:29.469056 (+   151us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:29.469086 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:29.694121 (+225035us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b18003e5420. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade412a6 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419
0709 12:21:29.695288 (+  1167us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400218754. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:29.695344 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:29.695394 (+    50us) raft_consensus.cc:1685] finished
0709 12:21:29.695407 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:29.695542 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12147,"prepare.queue_time_us":34650,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":4174,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":13727,"spinlock_wait_cycles":336003200,"thread_start_us":383422,"threads_started":1,"wal-append.queue_time_us":395416}
W20260709 12:21:29.703915 10882 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:21:29.717758 10882 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for c1b75831227444d382e9c0fc5b367564 already in progress
W20260709 12:21:29.718092 10882 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for c1b75831227444d382e9c0fc5b367564 already in progress
I20260709 12:21:29.719316 14641 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:29.699523 10974 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:29.717100 14658 consensus_queue.cc:1059] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:29.716255 11050 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:29.688676 11656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59414 (request call id 241) took 1441 ms. Trace:
I20260709 12:21:29.731516 11656 rpcz_store.cc:276] 0709 12:21:28.247568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.247697 (+   129us) service_pool.cc:224] Handling call
0709 12:21:29.688431 (+1440734us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b54004b3a54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:29.688605 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1804566784}
I20260709 12:21:29.695216 14653 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:29.728248 10930 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:29.721028 10974 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:29.729148 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:29.729290 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:29.729286 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:21:29.719657 14757 log.cc:927] Time spent T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.269s	user 0.002s	sys 0.000s
I20260709 12:21:29.723176 11049 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:29.752166 10929 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:29.748126 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:29.753172 10933 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 7.
I20260709 12:21:29.753966 10974 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:29.754362 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:29.755350 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:29.756562 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:29.757695 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:29.748692 10928 raft_consensus.cc:2955] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Committing config change with OpId 9.10: config changed from index 8 to 10, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:29.760957 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:29.700217 14643 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:29.730427 14758 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:29.765015 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:29.766938 11009 raft_consensus.cc:2393] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 6: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:29.766772 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:29.752300 11049 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:29.767668 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:29.769986 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:29.771178 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:29.771739 10931 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:29.772218 10974 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:29.755204 14335 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:29.774636 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:29.775121 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.731122 14238 raft_consensus.cc:1081] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Signalling peer 0b171b6aaedc4f809f2753dcfadb14ce to start an election
I20260709 12:21:29.778793 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:29.755312 14762 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.759001 14439 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:29.733980 14690 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.759040 14482 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:29.778128 14574 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:29.778219 14335 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.778510 14232 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:29.781052 14584 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:21:29.765544 14533 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:29.801539 14533 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:29.802004 14533 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:29.806916 14653 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:29.809588 14652 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:29.811156 14652 consensus_queue.cc:1059] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:29.815632 11051 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:29.816762 14750 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:29.816952 11051 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:29.817363 14750 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:29.817983 14734 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:29.818717 14753 raft_consensus.cc:3055] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:29.819202 14753 raft_consensus.cc:740] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:29.818715 14643 raft_consensus.cc:697] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:29.821174 14643 consensus_queue.cc:237] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.769830 14640 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:29.799940 14232 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.824923  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:21:29.833019 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 60859.7us
I20260709 12:21:29.835489 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:29.836602 10932 raft_consensus.cc:2393] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 7: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:29.830245 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:29.779369 14689 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:29.831274 10931 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:21:29.799062 10977 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:29.832062 11051 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:29.840528 10935 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:29.846804 14750 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:29.870800 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 71826.4us
I20260709 12:21:29.797044 14439 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.873098 10977 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:29.901680 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 69705.3us
I20260709 12:21:29.902925 11051 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:29.834681 14548 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:29.903538 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:29.869987 14689 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:29.871438 14584 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:29.905685 14439 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:29.875094 14710 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:21:29.948158 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 43522.6us
I20260709 12:21:29.906536 10977 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:29.914901 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.814838 14649 raft_consensus.cc:2955] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 4 to 6, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:29.824856 14690 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.948724 14747 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:29.964156 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 57694.1us
I20260709 12:21:29.908684 14654 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:29.906813 14640 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:29.908390 14689 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:29.905632 11655 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564"
dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
 from {username='slave'} at 127.0.0.1:59384
I20260709 12:21:29.912832 14565 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:29.797273 14762 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:29.952260 14768 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:29.962824 14584 raft_consensus.cc:697] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:29.950313 14446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:55644 (request call id 3) took 2600 ms. Trace:
I20260709 12:21:29.973589 14616 raft_consensus.cc:3055] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:29.975533 14335 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:29.966462 14758 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:29.952275 14750 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:29.950775 14734 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:29.981307 10977 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:29.960855 14569 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:29.988883 14710 raft_consensus.cc:697] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:29.985050 14640 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:29.988236 14658 consensus_queue.cc:1059] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:21:30.003109 11655 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:29.982910 14747 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:30.034886 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 53671.7us
I20260709 12:21:29.873919 14753 consensus_queue.cc:260] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.033933 10934 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:21:30.028224 14616 raft_consensus.cc:740] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:29.988018 14548 consensus_queue.cc:1059] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:21:30.036870 14335 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.990375 14482 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:30.040012 14565 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:30.088737 11050 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:30.119098 10927 raft_consensus.cc:1240] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:30.065495 14768 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:21:30.134253 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 45633.5us
W20260709 12:21:30.135226 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 57482.2us
I20260709 12:21:30.079026 11655 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:30.157015 14689 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:30.160343 14584 consensus_queue.cc:237] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:30.161633 14663 consensus_meta.cc:287] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.000s
I20260709 12:21:30.160337 14689 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:30.138929 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:30.138622 11625 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:30.141152 14653 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:30.172408 10932 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 12:21:30.172205 14653 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.172791 10932 pending_rounds.cc:85] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 4
I20260709 12:21:30.173058 10932 pending_rounds.cc:107] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 12:21:30.173296 10932 raft_consensus.cc:2889] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:30.039255 14734 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.174573 14653 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:30.175709 14734 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:30.181169 14746 consensus_queue.cc:1059] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:30.186857 11004 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:30.187170 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
W20260709 12:21:30.187135 14733 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 1.263s	user 0.000s	sys 0.008s
I20260709 12:21:30.189188 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41098 (request call id 216) took 1696 ms. Trace:
I20260709 12:21:30.189572 11007 rpcz_store.cc:276] 0709 12:21:28.492877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.494685 (+  1808us) service_pool.cc:224] Handling call
0709 12:21:28.495162 (+   477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:28.495510 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:28.495537 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:28.496482 (+   945us) log.cc:844] Serialized 494 byte log entry
0709 12:21:28.730148 (+233666us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:28.730194 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:28.730267 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:30.186465 (+1456198us) spinlock_profiling.cc:243] Waited 7.74 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:30.188889 (+  2424us) raft_consensus.cc:1685] finished
0709 12:21:30.188909 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:30.189121 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17790848,"thread_start_us":233316,"threads_started":1,"wal-append.queue_time_us":362907}
I20260709 12:21:30.192883 11011 raft_consensus.cc:1240] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:21:30.118935 14752 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:21:30.142402 14779 log.cc:927] Time spent T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:21:30.143582 14690 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:30.145440 14747 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:30.080511 14574 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.216104 14747 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.216244 14574 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.218717 14574 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:30.138639 14709 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:30.220180 14709 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.220687 14747 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:30.222532 14709 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:30.150134 14639 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:30.150734 14565 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.150913 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:30.133464 14693 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.152415 14616 consensus_queue.cc:260] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.153334 14768 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:30.131063 14436 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:30.168298 14548 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:30.039407 14750 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:30.131821 14335 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.132485 14758 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:30.169502 14710 consensus_queue.cc:237] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.170406 14232 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:30.038142 14569 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:30.141325 14776 log.cc:927] Time spent T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:21:30.197315 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:30.302515 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:30.167531 10935 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:30.207185 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:30.303821 11010 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:30.208747 11006 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
W20260709 12:21:30.189172 14760 log.cc:927] Time spent T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.739s	user 0.000s	sys 0.002s
I20260709 12:21:30.215282 14761 consensus_queue.cc:1059] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:21:30.232785 14775 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:21:30.213138 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:30.223547 14439 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.156983 14762 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:30.187598 14756 raft_consensus.cc:3055] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:30.313843 11008 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:21:30.255275 14548 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:30.236354 14752 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:30.263164 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.320451 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:30.323006 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:30.323685 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:30.325049 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:30.326071 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:30.327839 10901 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:30.138015 14482 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.308904 11011 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:30.247349 14565 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.253479 11653 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:30.258808 14574 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:30.254608 14693 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.316978 11002 raft_consensus.cc:1240] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:30.204252 14753 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:30.316140 14756 raft_consensus.cc:740] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:30.300833 14747 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:30.274439 14734 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:30.386780 14335 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:30.395983 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:30.396636 11008 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:30.247711 14639 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.333050 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:30.336119 11049 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:30.311685 11010 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 12:21:30.344909 11009 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:30.378919 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:30.346314 14746 raft_consensus.cc:3055] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:21:30.382452 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.316170 14616 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:30.319566 14548 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:30.246697 14533 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.323837 11080 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:30.344291 11011 raft_consensus.cc:2955] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Committing config change with OpId 9.10: config changed from index 8 to 10, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:30.260066 14436 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:21:30.379040 14574 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.386483 14439 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:30.387414 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 418664us
I20260709 12:21:30.418236 11051 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:30.321812 14232 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:30.381554 11651 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.007s	sys 0.007s
I20260709 12:21:30.280874 14758 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.396716 11078 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:30.273998 14782 consensus_queue.cc:1059] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.130s
W20260709 12:21:30.403504 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:30.403926 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 67915.3us
I20260709 12:21:30.308245 14642 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.401413 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:30.386675 14693 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:30.408130 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:30.391088 14708 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:30.385211 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:30.407181 14684 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:30.028420 14446 rpcz_store.cc:276] 0709 12:21:27.347229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.347366 (+   137us) service_pool.cc:224] Handling call
0709 12:21:27.351635 (+  4269us) log.cc:844] Serialized 494 byte log entry
0709 12:21:28.237877 (+886242us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b180040cba0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9baddedc0a 00007f9bb752d219 00007f9bade75a40 00007f9bade704e4 00007f9bade70455 00007f9bb0eb9b0b 00007f9bb0f3eb63 00007f9bb0f66752 00007f9bb0f5e9fa
0709 12:21:29.947392 (+1709515us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":542135,"raft.queue_time_us":551684,"raft.run_cpu_time_us":1354,"raft.run_wall_time_us":10104,"spinlock_wait_cycles":6789504,"thread_start_us":325729,"threads_started":1,"wal-append.queue_time_us":411068,"wal-append.run_cpu_time_us":9029,"wal-append.run_wall_time_us":1314484}
I20260709 12:21:30.402525 14746 raft_consensus.cc:740] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:30.487901 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:30.490732 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:30.488036 14770 log.cc:927] Time spent T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:21:30.498329 11080 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:30.415200 14689 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:30.501869 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:30.515839 11010 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:30.505460 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:30.517606 11078 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:21:30.402504 14734 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.508900 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:30.436352 11651 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.007s	sys 0.007s
I20260709 12:21:30.518988 11076 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 10: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:30.432600 14640 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:30.513895 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:30.532998 11007 raft_consensus.cc:1240] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:21:30.519840 11010 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:21:30.499886 14708 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:30.522130 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:21:30.522599 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 104430us
I20260709 12:21:30.488812 14542 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:30.524820 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:30.540645 11082 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:21:30.526674 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:30.529071 14569 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:30.531091 11077 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:30.513844 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:30.540997 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 207216us
I20260709 12:21:30.504029 14762 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.536343 11010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:21:30.542948 11010 raft_consensus.cc:606] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:30.543349 11010 raft_consensus.cc:614] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:30.538561 11078 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:30.547194 14780 log.cc:927] Time spent T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
W20260709 12:21:30.548466 14789 log.cc:927] Time spent T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
W20260709 12:21:30.549861 14787 log.cc:927] Time spent T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 12:21:30.555100 14785 log.cc:927] Time spent T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 12:21:30.541703 11080 raft_consensus.cc:2410] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:21:30.499819 14642 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:30.564594 14783 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 12:21:30.565528 14642 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:30.566232 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2481) took 1816 ms. Trace:
I20260709 12:21:30.567090 10819 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6aa58b8bde194f658aced897744b4d35 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:30.557341 11655 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:30.567521 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:30.568065 14750 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:30.568408 11656 raft_consensus.cc:2410] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:21:30.568526 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:30.569144 14565 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:30.570379 14436 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:30.571110 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:30.571480 14752 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:30.571139 14482 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:30.572629 14482 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:30.573097 14482 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.573866 14734 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:30.575174 14482 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:30.575495 11659 raft_consensus.cc:1240] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:30.435786 14790 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 12:21:30.579905 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:30.433635 14232 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:30.545826 10901 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:30.582369 14077 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:30.582780 14077 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:30.583357 14077 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:30.566599 11083 rpcz_store.cc:276] 0709 12:21:28.749466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.114212 (+364746us) service_pool.cc:224] Handling call
0709 12:21:29.114567 (+   355us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:29.125054 (+ 10487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:29.125084 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:29.138570 (+ 13486us) log.cc:844] Serialized 52 byte log entry
0709 12:21:29.698096 (+559526us) spinlock_profiling.cc:243] Waited 6.64 ms on lock 0x7b1800255e80. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b 00007f9bb0affd23 00007f9bb0b000d1 00007f9bb0f1ba0f
0709 12:21:30.036107 (+338011us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:30.036148 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:30.036220 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:30.565926 (+529706us) raft_consensus.cc:1685] finished
0709 12:21:30.565957 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:30.566169 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10075,"raft.queue_time_us":37195,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":10486,"spinlock_wait_cycles":15281536,"thread_start_us":337814,"threads_started":1,"wal-append.queue_time_us":1110767}
I20260709 12:21:30.539830 14708 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:30.588586 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:30.622905 11083 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:30.589838 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:30.624358 11011 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:30.557652 14542 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:30.592154 14768 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:30.597573 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:30.647209 11010 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:30.647452 10901 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:30.647745 11083 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:30.649963 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:30.650507 11010 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:30.535558 14798 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:30.625892 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:30.589643 11078 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:30.633452 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:30.582432 14746 consensus_queue.cc:260] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.593480 14752 consensus_queue.cc:1059] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:21:30.561687 14782 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:21:30.562130 14762 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.676334 10901 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:30.638255 14788 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:21:30.644212 14077 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.645551 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:30.645790 10974 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:30.654964 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:30.682041 11011 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:30.682729 10974 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:30.659482 11082 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:30.684113 11011 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 12:21:30.685416 14784 log.cc:927] Time spent T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 12:21:30.672951 14642 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:30.686277 14642 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.686640 14642 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:30.663125 11005 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:21:30.687525 11005 raft_consensus.cc:606] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:30.687899 11005 raft_consensus.cc:614] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:30.688109 11651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59398 (request call id 336) took 1019 ms. Trace:
I20260709 12:21:30.688520 11651 rpcz_store.cc:276] 0709 12:21:29.668865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.669834 (+   969us) service_pool.cc:224] Handling call
0709 12:21:29.680999 (+ 11165us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:29.681428 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:29.681461 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:29.682022 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 12:21:29.976893 (+294871us) spinlock_profiling.cc:243] Waited 41.7 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bade560ac 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b
0709 12:21:30.543920 (+567027us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:30.563004 (+ 19084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:30.586807 (+ 23803us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:30.687781 (+100974us) raft_consensus.cc:1685] finished
0709 12:21:30.687809 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:30.688043 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2381,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":99,"spinlock_wait_cycles":95938944,"thread_start_us":842253,"threads_started":1,"wal-append.queue_time_us":822947}
I20260709 12:21:30.690001 14752 raft_consensus.cc:3055] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:30.690433 14752 raft_consensus.cc:740] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:30.681231 11656 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:30.691042 10901 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:30.691395 11078 raft_consensus.cc:1240] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:30.692850 11078 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 12:21:30.649011 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:30.693085 14077 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:30.671245 11010 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:21:30.435048 14756 consensus_queue.cc:260] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.687041 14533 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:30.686828 11082 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:21:30.645398 14734 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:30.694856 11083 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:30.678802 14807 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:30.690687 14335 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:30.654038 11655 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:30.703951 10974 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:30.696552 11078 raft_consensus.cc:2955] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:30.695274 14746 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:30.723886 14649 consensus_meta.cc:287] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.643s	user 0.006s	sys 0.005s
I20260709 12:21:30.658955 14689 raft_consensus.cc:697] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:30.730538 10974 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:30.708076 14761 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:30.769009 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:30.718163 14796 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:30.755971 11085 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:30.757057 10929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:21:30.758450 14642 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:30.715692 14639 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:30.717787 14439 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:30.725099 14335 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.769887 11010 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:30.732906 14643 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:30.777463 11085 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:30.780201 14077 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:30.780519 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.792176 14077 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.793169 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:30.793419 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:30.794296 10928 raft_consensus.cc:2393] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 7: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:30.794503 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:30.794834 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:30.795235 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:30.795433 10932 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:30.723618 14734 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.691282 14752 consensus_queue.cc:260] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.846658 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:30.771004 14761 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.763370 14640 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.853154 14077 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:30.857002 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:30.857427 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:30.791558 14335 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:30.863299 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.791496 14522 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.880338 10930 raft_consensus.cc:2393] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 8: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:30.801486 14758 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:30.726704 14807 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.845861 14804 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.800896 14796 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:30.908541 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:30.896754 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 176628us
W20260709 12:21:30.950914 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.959491 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:30.854022 14761 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:30.976104 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:30.769876 14641 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.943959 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:30.981117 10929 raft_consensus.cc:606] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:30.980846 11010 raft_consensus.cc:2410] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:21:30.974891 14752 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:31.041288 14238 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:31.053402 14238 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:31.055071 14807 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:30.884845 14689 consensus_queue.cc:237] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:30.858568 14640 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:31.059197 14640 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:31.045409 14799 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:30.986692 14641 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:30.881559 14522 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:31.055641 14238 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:31.071449 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2066) took 1343 ms. Trace:
I20260709 12:21:31.071913 10927 rpcz_store.cc:276] 0709 12:21:29.728060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.728185 (+   125us) service_pool.cc:224] Handling call
0709 12:21:29.728459 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:30.132056 (+403597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:31.071210 (+939154us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b540024d454. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:31.071390 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":834087168}
I20260709 12:21:31.073176 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:31.077242 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:31.078249 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:31.062619 14542 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:30.985208 14762 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:31.064230 14232 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:31.079818 14548 consensus_meta.cc:287] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.663s	user 0.007s	sys 0.003s
I20260709 12:21:31.098174 10933 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
W20260709 12:21:31.105064 14816 log.cc:927] Time spent T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:21:31.112428 14642 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:31.113476 14654 raft_consensus.cc:3055] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:31.113909 14654 raft_consensus.cc:740] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:31.114735 14654 consensus_queue.cc:260] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:31.062105 14799 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:31.118691 14803 log.cc:927] Time spent T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 12:21:31.119275 14799 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:31.092496 14796 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:31.121840 14796 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:31.125388 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:31.126080 11651 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:21:31.131047 14611 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:31.112493 14813 log.cc:927] Time spent T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 12:21:31.099283 14633 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.144690 14633 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:31.146772 14633 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:31.146950 14708 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:31.133684 14548 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:31.149510 14548 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:31.149744 11082 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:30.977689 14804 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:31.154719 14804 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:31.115703 14654 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:31.155483 14796 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:31.156121 14753 consensus_meta.cc:287] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.765s	user 0.006s	sys 0.005s
I20260709 12:21:31.169171 14641 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:31.176143 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53346 (request call id 312) took 1428 ms. Trace:
I20260709 12:21:31.176582 10934 rpcz_store.cc:276] 0709 12:21:29.747358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.751514 (+  4156us) service_pool.cc:224] Handling call
0709 12:21:31.175935 (+1424421us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54002044d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:31.176073 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":612706688}
W20260709 12:21:31.176066 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 107262us
I20260709 12:21:31.179119 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:31.181046 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:31.182199 14740 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:31.183825 14641 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.184430 14641 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:31.186527 14641 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:31.187100 14335 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:31.177793 14522 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:31.188459 14740 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:31.201993 14740 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:31.240801 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.182192 14761 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:31.332501 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.189339 14734 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:31.338562 10974 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.006s	sys 0.013s
W20260709 12:21:31.333400 14710 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.009s	sys 0.004s
W20260709 12:21:31.339138 10974 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.006s	sys 0.013s
I20260709 12:21:31.340883 10932 raft_consensus.cc:2368] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11.
W20260709 12:21:31.341542 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 611054us
I20260709 12:21:31.342255 10974 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:31.331830 14616 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:31.343210 10974 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:31.334769 14804 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:31.352536 14804 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:31.354797 14804 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:31.334025 14522 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:31.349718 14565 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:31.363111 14565 raft_consensus.cc:697] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:31.362987 14522 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:31.350557 14616 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:31.351038 14756 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:31.355038 14335 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:31.366721 14522 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:31.362567 14761 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:31.368212 14565 consensus_queue.cc:237] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:31.369982 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2638) took 1165 ms. Trace:
I20260709 12:21:31.370362 11008 rpcz_store.cc:276] 0709 12:21:30.205059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.314694 (+109635us) service_pool.cc:224] Handling call
0709 12:21:30.314973 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:30.397060 (+ 82087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:31.369737 (+972677us) spinlock_profiling.cc:243] Waited 81.3 ms on lock 0x7b5400243954. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:31.369923 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187073920}
I20260709 12:21:31.351414 11651 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:31.351876 14708 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:31.347956 14643 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:31.344457 10974 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:31.359702 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:31.362264 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:31.335282 14569 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:31.375756 10974 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:21:31.386368 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.387295 10974 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:31.388852 10900 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:31.398344 10899 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:31.399621 10899 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:21:31.395936 14584 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.232s	user 0.008s	sys 0.002s
I20260709 12:21:31.401306 14611 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:31.401582 14584 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.237s	user 0.008s	sys 0.002s
I20260709 12:21:31.402078 10928 raft_consensus.cc:3055] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:31.402439 10928 raft_consensus.cc:740] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:31.403203 10928 consensus_queue.cc:260] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:31.372293 14643 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:31.384258 14710 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:31.407038 10928 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:31.390026 14758 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:31.392367 14826 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:31.393999 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:31.396034 14335 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.406497 14290 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:31.411443 14643 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:31.446597 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:31.447260 10930 raft_consensus.cc:3055] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:31.447551 10930 raft_consensus.cc:740] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:31.448607 10927 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:31.449607 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:31.426507 10928 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:21:31.388525 14569 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:31.453583 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:31.418175 14758 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:31.411994 14710 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:31.448338 10930 consensus_queue.cc:260] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:31.416607 14611 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:31.460475 10930 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:31.450213 10927 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 5.
I20260709 12:21:31.481223 14569 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:31.469851 14290 raft_consensus.cc:697] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:21:31.488335 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.489243 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:31.490429 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:31.471658 14758 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:31.471788 14611 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:31.492697 11049 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:31.483649 14290 consensus_queue.cc:237] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:31.501045 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.498915 10930 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:21:31.504731 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:31.507223 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:31.471328 14710 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:31.509413 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:31.510541 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:31.517179 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:31.517866 10930 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:31.444741 14335 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:31.494786 14611 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:31.494896 14746 consensus_queue.cc:1059] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:21:31.502552 14654 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:31.525108 14654 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:31.525213 14652 raft_consensus.cc:3055] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:31.525651 14652 raft_consensus.cc:740] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:31.525869 14616 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:31.526472 14652 consensus_queue.cc:260] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:31.532783 14603 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:21:31.538025 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2625) took 1355 ms. Trace:
I20260709 12:21:31.538463 11002 rpcz_store.cc:276] 0709 12:21:30.182708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.207640 (+ 24932us) service_pool.cc:224] Handling call
0709 12:21:30.207935 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:30.389821 (+181886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:31.537761 (+1147940us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54002d8a54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:31.537958 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250203392}
W20260709 12:21:31.549140 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:31.555533 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 143482us
I20260709 12:21:31.525563 14654 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:31.605298 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:31.561945 14756 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.607168 14756 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:31.570117 14683 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.393s	user 0.013s	sys 0.013s
W20260709 12:21:31.653776 14683 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.476s	user 0.013s	sys 0.013s
I20260709 12:21:31.682564 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:31.710459 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:31.670439 14739 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.001s	sys 0.009s
I20260709 12:21:31.760497 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:31.762284 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:31.771203 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:31.772214 10934 raft_consensus.cc:2393] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:31.670845 14761 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:21:31.752821 14739 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.001s	sys 0.010s
I20260709 12:21:31.800360 14826 raft_consensus.cc:697] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:31.794029 14311 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.785754 14833 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:31.804126 14843 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.794317 14761 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:31.811779 14536 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.828367 11051 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:31.838601 11051 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:31.820106 10977 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:21:31.844100 10931 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.003s	sys 0.024s
W20260709 12:21:31.845513 10931 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.004s	sys 0.024s
I20260709 12:21:31.846856 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:31.851769 14833 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:31.858330 14756 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:31.842819 14734 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:21:31.859346 14839 log.cc:927] Time spent T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:21:31.859652 14794 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:31.860065 14794 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:31.860292 14833 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:31.865633 14652 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:31.869066 10933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 2071) took 1075 ms. Trace:
I20260709 12:21:31.869472 10933 rpcz_store.cc:276] 0709 12:21:30.793963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.795007 (+  1044us) service_pool.cc:224] Handling call
0709 12:21:31.868881 (+1073874us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54001a7cd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:31.869004 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":695273344}
I20260709 12:21:31.870901 10933 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:21:31.872074 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.872740 14684 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:31.873207 14684 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:31.859066 14734 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:31.876511 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.878247 14734 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:31.879082 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.860473 14794 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:31.882507 14616 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:31.884832 14608 consensus_queue.cc:1059] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:31.885677 14608 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:31.886530 14617 raft_consensus.cc:3055] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:31.886902 14617 raft_consensus.cc:740] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:31.887671 14617 consensus_queue.cc:260] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:31.888739 14617 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:31.892346 11659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59384 (request call id 467) took 1584 ms. Trace:
I20260709 12:21:31.892752 11659 rpcz_store.cc:276] 0709 12:21:30.308184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.308580 (+   396us) service_pool.cc:224] Handling call
0709 12:21:30.322312 (+ 13732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:30.575893 (+253581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:31.892071 (+1316178us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54007debd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:31.892261 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581530496}
I20260709 12:21:31.894215 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 364) took 1251 ms. Trace:
I20260709 12:21:31.894608 11082 rpcz_store.cc:276] 0709 12:21:30.642265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.708676 (+ 66411us) service_pool.cc:224] Handling call
0709 12:21:30.708962 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:31.150141 (+441179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:31.893996 (+743855us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b540044c5d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:31.894159 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1013293312}
I20260709 12:21:31.896104 10933 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:21:31.858724 14837 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
W20260709 12:21:31.901829 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 81786.5us
I20260709 12:21:31.904122 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:31.909940 10933 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
W20260709 12:21:31.911448 10974 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.003s	sys 0.023s
W20260709 12:21:31.912436 10974 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.004s	sys 0.023s
W20260709 12:21:31.912849 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 517549us
I20260709 12:21:31.913759 10974 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:31.843180 14750 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:31.824324 14311 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:31.860704 14840 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:21:31.920621 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:31.821018 14710 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:31.946061 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:31.946666 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.953845 11006 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:31.929430 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:31.938035 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:31.787546 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:31.956224 10932 raft_consensus.cc:2393] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 15: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:21:31.957343 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 43677.2us
I20260709 12:21:31.843730 14482 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 12:21:31.838217 14843 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:31.934279 14690 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.917143 14845 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:31.969976 14761 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:31.971616 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:31.919785 14758 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:31.842968 14536 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:31.977414 14530 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:31.979575 14335 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:31.967198 14611 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:31.985092 14643 consensus_meta.cc:287] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
I20260709 12:21:31.938808 14565 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:21:32.113173 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:31.989024 14794 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:31.990396 14710 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:31.934690 14750 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:31.990826 10977 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:31.917306 14734 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:32.195668 14734 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:31.987648 14654 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:31.806747 14826 consensus_queue.cc:237] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:31.993569 14756 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.994632 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:31.998847 11081 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2676) took 1663 ms. Trace:
W20260709 12:21:32.000406 14849 log.cc:927] Time spent T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:21:32.015668 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.214880 11082 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:31.991959 14311 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:32.067202 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 56101.3us
I20260709 12:21:32.099939 14845 raft_consensus.cc:697] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:32.015574 10931 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 6: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:32.071825 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.218670 11002 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:32.098492 14652 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.219739 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.068655 14690 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.221246 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:32.198479 14750 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:32.221846 11002 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:32.072065 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:32.098030 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.224277 11007 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:21:32.225252 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:32.224174 11008 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:32.225792 11007 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:32.158895 14850 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:32.073573 11006 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:32.114763 10899 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:32.105044 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:32.200915 14747 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.138242 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:32.105638 10933 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:32.233719 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:32.234455 10933 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:32.235447 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:31.988224 14855 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:32.098542 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.242533 11010 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:21:32.191802 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.191932 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:32.104398 11004 raft_consensus.cc:1240] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:21:32.089624 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.194423 10934 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:21:32.245941 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.246089 11082 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:21:32.070822 14842 log.cc:927] Time spent T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.092s	user 0.001s	sys 0.006s
I20260709 12:21:32.253229 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.253660 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:32.253832 11078 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
W20260709 12:21:32.197697 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 206916us
I20260709 12:21:32.058511 14684 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:32.208570 14569 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:32.208882 14856 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:32.135885 14761 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.213063 11081 rpcz_store.cc:276] 0709 12:21:30.335506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.336428 (+   922us) service_pool.cc:224] Handling call
0709 12:21:30.336916 (+   488us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:30.337295 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:30.337332 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:31.175199 (+837867us) spinlock_profiling.cc:243] Waited 6.03 ms on lock 0x7b2c000040c8. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9baf859a11 00007f9baf869372 00007f9bb0f9ba01 00007f9bb0f6043a 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2
0709 12:21:31.175792 (+   593us) log.cc:844] Serialized 52 byte log entry
0709 12:21:31.461373 (+285581us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:31.461412 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:31.461480 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:31.876420 (+414940us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b4800210cd8. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb5e89aa1 00007f9bb5e80b37 00007f9bb5e809ca 00007f9bb5f7826f 00007f9bb5f77f37 00007f9bb5f8c55c 00007f9bb5f8c508 00007f9bb5f8c488 00007f9bb5f8c443 00007f9bb5f8b6ec 00007f9bb4eb5a96
0709 12:21:31.998617 (+122197us) raft_consensus.cc:1685] finished
0709 12:21:31.998642 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:31.998784 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":65902,"raft.run_cpu_time_us":17192,"raft.run_wall_time_us":1469555,"spinlock_wait_cycles":25549824,"thread_start_us":128368,"threads_started":1,"wal-append.queue_time_us":299011}
I20260709 12:21:32.139205 11011 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:32.240711 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:32.211031 14335 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.239606 10930 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
W20260709 12:21:32.245265 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 130591us
I20260709 12:21:32.246908 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.248325 11079 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:21:32.248354 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:32.246865 11080 raft_consensus.cc:2410] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:21:32.249615 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.213826 14794 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:32.213656 14482 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:32.219151 14710 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:32.252887 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.264765 11076 raft_consensus.cc:2410] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:21:32.265189 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 333675us
I20260709 12:21:32.251713 11008 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:32.262689 11084 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:21:32.261967 11077 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:21:32.172472 14643 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.249935 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.256946 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:32.277483 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.277611 10977 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:32.279279 10977 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:32.281225 11007 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:32.216369 14756 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.241958 14855 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:32.285429 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.286499 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:21:32.287213 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.293776 11083 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:32.260823 14841 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.261138 14635 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:32.295061 11084 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:32.294584 11076 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:32.297307 11004 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:32.259994 14335 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.299889 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.301520 11076 raft_consensus.cc:2410] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:21:32.230334 14652 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.303499 10935 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:21:32.296489 14855 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:32.306427 11002 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:32.292428 14311 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:32.260892 14856 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.332719 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.281949 14482 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:32.313990 14574 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:32.315040 14611 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:32.317368 14335 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:32.317816 10927 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:32.318861 14654 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:32.320286 14734 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:32.321122 11083 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:21:32.322090 14643 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:32.276290 14710 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.333720 14311 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:32.323110 14855 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.350730 11009 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:32.322130 14690 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:32.308279 14845 consensus_queue.cc:237] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.345929 14311 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:32.315697 14758 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:32.324899 14843 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:32.264120 14761 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.356396 14761 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:32.326699 14684 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:32.358855 10830 catalog_manager.cc:5697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 10 to 11, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 11 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:32.360610 10830 catalog_manager.cc:5697] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:32.288043 14565 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:21:32.342783 14734 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:32.283244 14653 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 12:21:32.330662 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:32.364333 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.362663 10830 catalog_manager.cc:5697] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:32.366051 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 368538us
W20260709 12:21:32.349027 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 394323us
I20260709 12:21:32.241807 14850 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.253218 14747 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.282155 14851 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:32.281260 14794 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.335345 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.282969 14844 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:32.288807 14522 consensus_queue.cc:1059] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:21:32.292402 14633 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:21:32.344879 14536 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:32.301222 14841 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.349129 10929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57884 (request call id 22) took 1592 ms. Trace:
I20260709 12:21:32.392254 10929 rpcz_store.cc:276] 0709 12:21:30.756742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.756910 (+   168us) service_pool.cc:224] Handling call
0709 12:21:32.348980 (+1592070us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b540024cf54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5a853 00007f9bb5f2860a 00007f9baf4ae7d4 00007f9baf4ae762 00007f9baf4ae691 00007f9baf4ae60c 00007f9baf4ad8c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:32.349070 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":481874560}
I20260709 12:21:32.392937 10901 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:32.368414 11010 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:32.374166 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.363459 14734 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:32.376328 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:32.480273 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 87397us
I20260709 12:21:32.392680 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.481675 11011 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:32.481494 10901 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:21:32.484601 10935 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 2077) took 1607 ms (client timeout 1528 ms). Trace:
I20260709 12:21:32.458706 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.409350 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:21:32.485749 10935 rpcz_store.cc:269] 0709 12:21:30.877560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.877686 (+   126us) service_pool.cc:224] Handling call
0709 12:21:31.994476 (+1116790us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b5800002d98. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f260a0 00007f9bb5f25984 00007f9baf4a06d4 00007f9baf4a0662
0709 12:21:32.484386 (+489910us) spinlock_profiling.cc:243] Waited 90.5 ms on lock 0x7b54002035d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:32.484525 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300374272}
I20260709 12:21:32.438807 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.487710 11083 raft_consensus.cc:2410] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:21:32.495326 11659 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:21:32.496177 10901 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:32.497021 14761 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:32.497416 14761 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.497740 14761 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:32.499621 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:32.500823 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.501879 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.502442 11082 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:32.503214 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.504187 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.505064 11085 raft_consensus.cc:2410] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:21:32.505913 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.506516 11085 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:32.503804 11082 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:32.507545 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.482239 14663 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.398772 14683 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.114s
I20260709 12:21:32.513197 11008 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:32.513741 11005 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:21:32.398814 11009 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:32.396937 11006 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:21:32.457584 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.484380 14517 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:32.390616 14794 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.523450 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:32.427702 14654 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:32.419991 14690 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:32.527115 11084 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:32.487421 14752 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:32.520711 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.524466 10901 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:32.533607 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.537001 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:32.537814 11083 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:21:32.494887 14522 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.494052 14746 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.559288 10901 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:32.541046 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.485476 14536 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:21:32.509943 14653 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:32.573936 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.574600 11004 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:32.575496 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.531392 14584 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:32.576989 10901 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:32.532039 14517 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:32.579243 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.580403 11081 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:21:32.586347 11081 pending_rounds.cc:85] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 4
I20260709 12:21:32.586696 11081 pending_rounds.cc:107] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:21:32.586968 11081 raft_consensus.cc:2889] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:32.581459 11004 raft_consensus.cc:2393] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 14: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:32.574023 14335 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:32.531050 14617 consensus_queue.cc:1059] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:21:32.540210 14866 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.572023 14752 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:32.568923 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:32.573062 14756 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:32.596517 14756 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.597121 14794 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:32.596987 14756 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:32.599056 14756 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:32.599159 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2410) took 2850 ms. Trace:
I20260709 12:21:32.580953 14750 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.600520 14617 raft_consensus.cc:3055] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:32.600921 14617 raft_consensus.cc:740] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:32.601336 11085 raft_consensus.cc:2393] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 8: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:32.587970 11006 raft_consensus.cc:2393] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:32.601732 14750 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:32.602535 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.603243 11006 raft_consensus.cc:2368] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11.
I20260709 12:21:32.584421 14482 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:32.593672 14856 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:32.527745 14635 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:21:32.528173 14663 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.608135 14663 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:32.569712 14796 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:32.592469 10899 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:32.608954 14796 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:32.610268 10899 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:32.611068 14796 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:32.568434 14746 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.612089 14710 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:32.612686 14866 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.613620 14746 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:32.614266 14746 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:32.614876 14746 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:32.589143 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:32.587421 14517 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:32.619503 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.620126 14850 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:32.593529 14734 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:32.591374 14335 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.621902 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.576027 14522 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.622542 11006 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 5.
I20260709 12:21:32.623415 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.621919 14335 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:32.601693 14617 consensus_queue.cc:260] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.625506 14617 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:32.623908 14522 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:32.599501 10936 rpcz_store.cc:276] 0709 12:21:29.749026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.986649 (+237623us) service_pool.cc:224] Handling call
0709 12:21:29.991609 (+  4960us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:30.664247 (+672638us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:30.664276 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:30.675312 (+ 11036us) log.cc:844] Serialized 26 byte log entry
0709 12:21:31.406216 (+730904us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b180041d220. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b 00007f9bb0affd23 00007f9bb0b000d1 00007f9bb0f1ba0f
0709 12:21:31.749876 (+343660us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:31.749916 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.598840 (+848924us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b540017b6d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:32.598907 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:32.598949 (+    42us) raft_consensus.cc:1685] finished
0709 12:21:32.598961 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.599084 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22175,"raft.queue_time_us":29042,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":14994,"spinlock_wait_cycles":1527400064,"thread_start_us":343469,"threads_started":1,"wal-append.queue_time_us":1251428}
I20260709 12:21:32.588166 14584 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.629070 14569 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:32.629719 10899 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:32.630465 14663 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:32.630734 14584 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:32.620621 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.633430 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:32.594671 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.635043 11082 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:32.635838 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:32.636343 11082 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:32.558207 14690 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.640906 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.577812 14653 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.631430 14855 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:32.642465 14747 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:32.634687 14633 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:32.558226 14654 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.630841 14663 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.587965 14863 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.664098 14863 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.614924 14866 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:32.656584 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.670794 11006 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:32.671667 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.672432 11006 raft_consensus.cc:2393] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:21:32.675259 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 390123us
I20260709 12:21:32.679414 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.680646 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.681663 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.682267 11008 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:32.683068 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.676921 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:32.686086 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.686491 11006 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:21:32.687258 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:32.619526 14311 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.666628 14663 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:32.689543 14690 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:32.690347 10935 raft_consensus.cc:2410] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:21:32.676388 14633 raft_consensus.cc:697] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:32.692610 14633 consensus_queue.cc:237] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.694290 14517 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.694962 10935 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:32.699216 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:32.699806 11085 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:21:32.700136 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:21:32.704960 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.706981 11085 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:32.707932 11008 raft_consensus.cc:2410] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 12:21:32.709482 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:32.666136 11084 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:32.646202 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:32.669648 11082 raft_consensus.cc:2410] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:21:32.709601 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:32.715472 14766 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:32.717198 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:32.717052 14766 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.717772 10934 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:32.717931 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:32.716275 14863 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:32.718792 11085 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:32.719169 14766 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:32.716018 10932 raft_consensus.cc:2410] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:21:32.717329 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:32.720142 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:32.720885 10927 raft_consensus.cc:2393] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 8: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:32.721916 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.723050 11082 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:21:32.725478 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.728037 11082 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:32.689765 14653 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:32.729180 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:32.729250 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:32.733853 11082 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:21:32.743639 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.660722 11083 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:32.741606 14844 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:32.745591 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:32.747555 11082 raft_consensus.cc:1240] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:32.749455 11082 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:32.751542 10934 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:32.762755 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:32.763514 10927 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 4.
I20260709 12:21:32.764474 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:32.766574 11004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:21:32.767225 11004 raft_consensus.cc:606] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:32.767555 11004 raft_consensus.cc:614] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:32.777390 10927 raft_consensus.cc:2410] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:21:32.779255 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:32.779958 10927 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
W20260709 12:21:32.780807 11625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.011s	sys 0.021s
W20260709 12:21:32.782308 11625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.012s	sys 0.021s
I20260709 12:21:32.784780 14652 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:32.787742 11659 raft_consensus.cc:1240] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:32.757519 14654 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:32.703825 14663 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.792110 11085 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:21:32.794382 10936 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:32.795538 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:32.797390 14335 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.797905 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:32.781297 14826 consensus_queue.cc:1059] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:21:32.800117 10830 catalog_manager.cc:5697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 7 to 8, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 8 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:32.801899 14311 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:32.795426 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.805222 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:32.781549 14517 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:32.825973 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.826895 11081 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:21:32.809716 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.811702 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.791278 10977 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:32.755940 14867 consensus_queue.cc:1059] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 12:21:32.745628 14844 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.828044 11085 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:32.827766 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:32.843114 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 473614us
I20260709 12:21:32.843537 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:32.828575 11082 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:32.844311 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:32.845527 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.846309 11085 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:32.855716 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 64489.3us
W20260709 12:21:32.846940 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 269017us
I20260709 12:21:32.846119 11625 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:32.849285 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:32.866307 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 289363us
I20260709 12:21:32.867092 10901 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:32.867416 10974 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:32.869217 10901 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:32.880264 11079 raft_consensus.cc:2410] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:21:32.881291 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:32.882755 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:21:32.889770 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 43732.2us
I20260709 12:21:32.890923 11625 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:32.865947 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.901410 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:32.842257 14517 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.906304 11082 raft_consensus.cc:2393] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 7: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:21:32.914943 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 47627.7us
I20260709 12:21:32.915212 11085 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:21:32.917328 11085 raft_consensus.cc:1240] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:32.846191 14872 raft_consensus.cc:3055] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:32.916270 10974 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:32.878388 14826 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:32.878556 14766 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:32.884897 14522 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:32.938376 11051 leader_election.cc:400] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11.
I20260709 12:21:32.959978 11051 leader_election.cc:403] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:32.878574 14869 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:32.884595 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:21:32.961014 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 44809.4us
I20260709 12:21:32.960999 11051 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:32.936581 14683 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:32.936352 14684 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:32.953680 14643 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:32.937384 14872 raft_consensus.cc:740] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:32.956468 14826 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:21:32.984306 14874 log.cc:927] Time spent T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:21:32.918926 14867 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:21:32.966606 14876 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:32.970152 14482 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11.
I20260709 12:21:32.956176 14866 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:21:32.955824 14311 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 12:21:32.999599 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 82619.7us
I20260709 12:21:32.975391 14643 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:32.972729 14683 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:32.980931 14756 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:32.975589 14522 raft_consensus.cc:697] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:32.990975 14826 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:32.981482 14868 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:21:32.987236 14872 consensus_queue.cc:260] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:32.938071 14517 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.005149 14876 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:21:33.037314 14870 log.cc:927] Time spent T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 12:21:32.992751 14654 consensus_queue.cc:1059] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:21:33.039292 14794 raft_consensus.cc:3055] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:33.024128 14756 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.039892 14522 consensus_queue.cc:237] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.039832 14794 raft_consensus.cc:740] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:33.044598 14794 consensus_queue.cc:260] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.045845 14794 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:33.018399 14643 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:32.971426 14869 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.022801 14683 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:33.022131 14663 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:33.096800 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 182243us
I20260709 12:21:33.106249 10933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2091) took 1001 ms. Trace:
I20260709 12:21:33.109025 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:33.108834 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:32.972898 10974 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:33.114274 11006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d263972b0e844fa281354fac07ccef80"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:21:32.976507 11051 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:33.249634 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:33.120088 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:33.122530 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:33.135637 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 204644us
I20260709 12:21:33.252329 14654 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:33.252833 14654 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.139302 14290 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:33.249575 11006 raft_consensus.cc:606] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:33.254413 11006 raft_consensus.cc:614] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:33.248080 10933 rpcz_store.cc:276] 0709 12:21:32.105059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.260242 (+155183us) service_pool.cc:224] Handling call
0709 12:21:32.262947 (+  2705us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:32.266042 (+  3095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:32.266073 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:32.266495 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 12:21:32.578283 (+311788us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:32.883566 (+305283us) log.cc:844] Serialized 14 byte log entry
0709 12:21:32.883772 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.883847 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:33.105496 (+221649us) raft_consensus.cc:1685] finished
0709 12:21:33.105577 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:33.105977 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10792,"prepare.queue_time_us":480679,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":1041,"raft.queue_time_us":71511,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":12895,"thread_start_us":607310,"threads_started":2,"wal-append.queue_time_us":542312}
I20260709 12:21:33.253135 11625 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:33.253265 14654 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:33.253966 11002 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:21:33.250612 10930 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:33.261091 14663 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.262112 10930 raft_consensus.cc:1240] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:33.269923 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:33.159296 11005 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:33.161016 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 2669) took 1024 ms. Trace:
I20260709 12:21:33.166190 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:33.169056 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.172734 10901 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:33.203015 14335 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:33.206519 14517 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:33.209350 14611 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.214103 14603 raft_consensus.cc:3055] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:33.278281 14603 raft_consensus.cc:740] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:33.278412 14611 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.067057 14869 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:33.229282 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:33.229383 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:33.231251 14635 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.232883 14633 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.251462 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:33.250620 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 274103us
I20260709 12:21:33.262002 14663 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:33.263954 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 291004us
I20260709 12:21:33.301712 10974 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:33.264938 14653 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:33.302100 14750 consensus_queue.cc:1059] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:21:33.253952 14290 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:33.156566 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:33.141144 14311 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.051756 14756 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:33.304459 14311 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:33.276515 10930 raft_consensus.cc:2393] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 9: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:21:33.277015 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 104691us
I20260709 12:21:33.307734 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:33.308979 10901 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:33.277199 14335 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:33.309983 14335 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.310492 14335 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:33.311384 10934 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:33.271037 11009 rpcz_store.cc:276] 0709 12:21:32.136354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.157838 (+ 21484us) service_pool.cc:224] Handling call
0709 12:21:33.160484 (+1002646us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540012acd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:33.160779 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245981440}
I20260709 12:21:33.053898 14871 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.059779 14872 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:33.051182 14876 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:33.069336 14883 log.cc:927] Time spent T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:21:33.309782 10930 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11. Ops: [9.8-10.9]
I20260709 12:21:33.314395 14871 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:33.317145 14860 log.cc:927] Time spent T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.822s	user 0.002s	sys 0.000s
I20260709 12:21:33.317471 10930 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:21:33.279497 14603 consensus_queue.cc:260] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.322166  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:33.322405 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:33.324342 14290 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:33.325124 14311 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:33.307603 11004 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
W20260709 12:21:33.326472 14894 log.cc:927] Time spent T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 12:21:33.326826 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:33.224928 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:33.154667 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:33.303488 14750 raft_consensus.cc:3055] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:21:33.312544 14906 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.241s	user 0.001s	sys 0.004s
W20260709 12:21:33.315516 14859 log.cc:927] Time spent T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.797s	user 0.001s	sys 0.001s
I20260709 12:21:33.328184 10932 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:33.314371 14903 log.cc:927] Time spent T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 12:21:33.350303 11656 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:21:33.350796 11051 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:33.350356 14635 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.352260 14633 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:33.353956 10934 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 12:21:33.354352 10934 pending_rounds.cc:85] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 3
W20260709 12:21:33.318794 14861 log.cc:927] Time spent T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.955s	user 0.002s	sys 0.002s
I20260709 12:21:33.311640 14841 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:33.322250 14663 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:33.362517 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 53710.7us
I20260709 12:21:33.354568 10934 pending_rounds.cc:107] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:21:33.309917 14611 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:33.062595 14844 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:33.329762 14750 raft_consensus.cc:740] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:33.385074 10934 raft_consensus.cc:2889] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:33.393424 10931 raft_consensus.cc:2410] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:21:33.393911 14863 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:33.394485 14863 raft_consensus.cc:697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:33.393525 11051 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:33.449633 10934 pending_rounds.cc:107] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:21:33.450093 10934 raft_consensus.cc:2889] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:33.455632 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.456362 10833 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35620 (request call id 245) took 10223 ms. Trace:
W20260709 12:21:33.457110 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 85821.7us
I20260709 12:21:33.459182 14643 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.460086 14869 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:33.395550 14863 consensus_queue.cc:237] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.460451 14750 consensus_queue.cc:260] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:33.355187 14654 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:33.509117 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 207624us
I20260709 12:21:33.504136 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2679) took 1216 ms. Trace:
I20260709 12:21:33.509056 10932 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:33.514153 10927 raft_consensus.cc:1240] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:33.456768 10833 rpcz_store.cc:276] 0709 12:21:23.238764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.239068 (+   304us) service_pool.cc:224] Handling call
0709 12:21:23.313075 (+ 74007us) spinlock_profiling.cc:243] Waited 48.4 ms on lock 0x7b5400096d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0eca090 00007f9bb0f68f3a 00007f9bb6d1ee9c 00007f9bb6e1d04e 00007f9bb52de2a4 00007f9bb52de232 00007f9bb52de161 00007f9bb52de0dc 00007f9bb52dd392 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:33.456084 (+10143009us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:27.938203 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:28.055655 (+117452us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:28.055695 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:21:28.055714 (+    19us) tablet.cc:662] Decoding operations
0709 12:21:28.056995 (+  1281us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:28.057049 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:28.057075 (+    26us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:21:28.058130 (+  1055us) tablet.cc:701] Row locks acquired
0709 12:21:28.058149 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:21:28.058295 (+   146us) write_op.cc:270] Start()
0709 12:21:28.058410 (+   115us) write_op.cc:276] Timestamp: P: 1783599688058246 usec, L: 0
0709 12:21:28.058432 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:21:28.159180 (+100748us) log.cc:844] Serialized 5925 byte log entry
0709 12:21:28.694302 (+535122us) op_driver.cc:464] REPLICATION: finished
0709 12:21:29.057976 (+363674us) write_op.cc:301] APPLY: starting
0709 12:21:29.064537 (+  6561us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:29.124508 (+ 59971us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:29.144458 (+ 19950us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:30.854775 (+1710317us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5c0025fe8c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb7152331 00007f9bb7152221 00007f9bb714cf6c 00007f9bb48ad30b 00007f9bb48acfd3 00007f9bb49abe34 00007f9bb499797c 00007f9bb499bd61 00007f9bb499bd19 00007f9bb499bca9 00007f9bb499bc71
0709 12:21:31.117300 (+262525us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:31.117596 (+   296us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 12:21:31.117645 (+    49us) write_op.cc:312] APPLY: finished
0709 12:21:31.117987 (+   342us) log.cc:844] Serialized 107 byte log entry
0709 12:21:31.492396 (+374409us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bade560ac 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b
0709 12:21:31.801932 (+309536us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:31.812437 (+ 10505us) write_op.cc:454] Released schema lock
0709 12:21:31.819392 (+  6955us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:31.856666 (+ 37274us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:31.887579 (+ 30913us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":57026,"reported_tablets":26,"spinlock_wait_cycles":111325568,"child_traces":[["op",{"apply.queue_time_us":252538,"apply.run_cpu_time_us":31626,"apply.run_wall_time_us":2855270,"num_ops":15,"prepare.queue_time_us":124789,"prepare.run_cpu_time_us":76402,"prepare.run_wall_time_us":437093,"raft.queue_time_us":246314,"raft.run_cpu_time_us":43373,"raft.run_wall_time_us":149033,"replication_time_us":631718,"spinlock_wait_cycles":67696640,"thread_start_us":1114818,"threads_started":5,"wal-append.queue_time_us":892623,"wal-append.run_cpu_time_us":25035,"wal-append.run_wall_time_us":2227733}]]}
I20260709 12:21:33.514009 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:33.457962 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 64669.8us
I20260709 12:21:33.460764 14869 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.476043 10901 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:33.460601  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:21:33.478674 14892 log.cc:927] Time spent T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:21:33.520462 10936 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:21:33.525463 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2520) took 1021 ms. Trace:
I20260709 12:21:33.502934 14335 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.525906 11083 rpcz_store.cc:276] 0709 12:21:32.502336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.744705 (+242369us) service_pool.cc:224] Handling call
0709 12:21:32.745038 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:32.803505 (+ 58467us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:32.803839 (+   334us) log.cc:844] Serialized 14 byte log entry
0709 12:21:33.178218 (+374379us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b180023c020. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b 00007f9bb0affd23 00007f9bb0b0023a 00007f9bb0f6aa2a
0709 12:21:33.383403 (+205185us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:33.399798 (+ 16395us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:33.434363 (+ 34565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:33.505635 (+ 71272us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:33.524112 (+ 18477us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":107,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":854,"raft.queue_time_us":55250,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":145,"spinlock_wait_cycles":5831936,"thread_start_us":115411,"threads_started":1}
I20260709 12:21:33.528805 14871 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:33.512928 11007 rpcz_store.cc:276] 0709 12:21:32.287781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.337595 (+ 49814us) service_pool.cc:224] Handling call
0709 12:21:32.337919 (+   324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:32.732215 (+394296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:32.732248 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:32.752895 (+ 20647us) log.cc:844] Serialized 52 byte log entry
0709 12:21:33.117173 (+364278us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:33.117802 (+   629us) log.cc:844] Serialized 14 byte log entry
0709 12:21:33.118165 (+   363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:33.118285 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:33.247648 (+129363us) spinlock_profiling.cc:243] Waited 38.6 ms on lock 0x7b4800130158. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb5e89aa1 00007f9bb5e80b37 00007f9bb5e809ca 00007f9bb5f7826f 00007f9bb5f77f37 00007f9bb5f8c55c 00007f9bb5f8c508 00007f9bb5f8c488 00007f9bb5f8c443 00007f9bb5f8b6ec 00007f9bb4eb5a96
0709 12:21:33.325505 (+ 77857us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:33.503609 (+178104us) raft_consensus.cc:1685] finished
0709 12:21:33.503635 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:33.503937 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":169209,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":2548,"raft.queue_time_us":93467,"raft.run_cpu_time_us":3846,"raft.run_wall_time_us":41651,"spinlock_wait_cycles":97980544,"thread_start_us":721827,"threads_started":2,"wal-append.queue_time_us":290407}
I20260709 12:21:33.530846 14750 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:33.531980 14880 raft_consensus.cc:3055] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:33.532449 14880 raft_consensus.cc:740] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:33.533510 14880 consensus_queue.cc:260] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:33.534924 14880 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:33.536016 14536 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:33.519562 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:33.539090 11009 raft_consensus.cc:1240] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 9. Current term is 10. Ops: []
W20260709 12:21:33.544324 14911 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.373s	user 0.015s	sys 0.005s
I20260709 12:21:33.514331 14311 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:33.472589 14752 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:33.537681 11051 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:33.531062 14906 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.078s	user 0.001s	sys 0.001s
I20260709 12:21:33.552629 14868 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:33.524952 14869 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:33.471544 14907 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
W20260709 12:21:33.555980 14617 consensus_meta.cc:287] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.823s	user 0.009s	sys 0.015s
I20260709 12:21:33.550474 14311 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:33.556252 14635 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:33.524250 14603 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:33.560505 14909 log.cc:927] Time spent T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.315s	user 0.001s	sys 0.005s
W20260709 12:21:33.562808 14761 consensus_meta.cc:287] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 1.065s	user 0.002s	sys 0.012s
I20260709 12:21:33.589968 14761 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.539215 14643 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:33.567050 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 154814us
I20260709 12:21:33.567999 14766 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:33.596410 10928 raft_consensus.cc:2368] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7.
I20260709 12:21:33.455677 14826 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.568161 14868 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:33.599596 14761 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:33.601634 14868 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:33.572697 14876 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.573330 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:33.573750 14311 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:33.578389 14896 log.cc:927] Time spent T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:21:33.580205 14683 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:33.580647 10929 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:21:33.579615 14756 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.621786 14756 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:33.584200 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 168270us
W20260709 12:21:33.587024 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 49491.8us
I20260709 12:21:33.597503 14766 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.588626 10974 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:33.607002 11011 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:33.598340 14635 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:21:33.612088 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:33.613263 14752 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.613875 11659 raft_consensus.cc:1240] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:33.615712 14887 consensus_queue.cc:1059] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:33.650295 14887 raft_consensus.cc:3055] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:33.650736 14887 raft_consensus.cc:740] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:33.652081 14887 consensus_queue.cc:260] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.653836 14887 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:33.616771 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.625717 14876 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:33.646888 14766 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:33.622445 14617 consensus_queue.cc:1059] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:21:33.639483 14683 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:33.658491 14611 raft_consensus.cc:3055] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:33.658900 14611 raft_consensus.cc:740] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:33.660006 14611 consensus_queue.cc:260] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.660566 11625 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:33.661177 14611 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:33.633183 14335 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:33.622218 14633 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:33.663177 14876 consensus_queue.cc:1059] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:33.664487 14643 raft_consensus.cc:3055] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:21:33.664706 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 110013us
I20260709 12:21:33.665247 14752 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:33.667158 14876 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:33.618532 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:33.668784 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:33.552626 14654 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:33.669132 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:33.669584 10928 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8.
W20260709 12:21:33.646946 14684 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.010s	sys 0.035s
I20260709 12:21:33.665002 14643 raft_consensus.cc:740] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:33.619488 14761 consensus_queue.cc:1059] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:33.670473 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:33.651319 14311 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.671036 14761 raft_consensus.cc:3055] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:33.623786 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:33.671510 14761 raft_consensus.cc:740] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:33.672437 14643 consensus_queue.cc:260] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:33.672657 14761 consensus_queue.cc:260] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:33.673795 14684 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.010s	sys 0.036s
I20260709 12:21:33.674146 14684 raft_consensus.cc:697] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:33.674381 14761 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:33.674657 14643 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:33.670225 14876 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:33.617373 11050 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:33.676120 11010 raft_consensus.cc:2393] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 9: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:21:33.678740 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 61485us
I20260709 12:21:33.678957 14684 consensus_queue.cc:237] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:33.679750 11050 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:33.680948 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.681288 11050 leader_election.cc:400] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11.
I20260709 12:21:33.682794 14683 consensus_queue.cc:1059] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:33.684333 14918 raft_consensus.cc:3055] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:33.684684 14918 raft_consensus.cc:740] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:33.685580 14918 consensus_queue.cc:260] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:33.686575 14918 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:33.688071 14654 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:33.688517 11050 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:33.690099 14654 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:33.690675 11050 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:33.676126 14876 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:33.631965 14750 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:33.682698 14756 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:33.695920 10974 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:33.705633 10977 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:33.708309 10901 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:33.703922 11625 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:33.710448 11011 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
W20260709 12:21:33.615731 14794 consensus_meta.cc:287] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.569s	user 0.013s	sys 0.003s
I20260709 12:21:33.633437 14826 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:33.708783 11622 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:33.714181 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.705540 14654 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:33.712811 14756 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:33.710069 14750 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:33.725740 14872 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:33.723281 14880 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:33.703068 14766 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.727566 14335 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:33.744334 10899 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:33.746397 14335 raft_consensus.cc:697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:33.746886 14633 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:33.747249  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:33.727734 14750 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:33.752086 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.751971 10901 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:33.751539 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:33.752871 14635 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:33.753286 14635 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.753744 10977 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:33.755533 14868 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:33.756173 14868 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:33.747453 14335 consensus_queue.cc:237] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.756721 14868 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:33.756224 14633 consensus_queue.cc:1059] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:33.758309 14633 raft_consensus.cc:3055] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:33.758675 14633 raft_consensus.cc:740] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:33.753693 14635 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:33.759508 14633 consensus_queue.cc:260] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.761834 14633 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:33.724608 14756 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:33.728416 14826 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:33.730652 14683 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:21:33.778214 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 82755us
W20260709 12:21:33.774385 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.783989 14517 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:33.784634 14517 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:33.786710 14517 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:33.740953 14311 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:33.807024 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:21:33.810874 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 71830.6us
I20260709 12:21:33.816957 10901 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:33.807333 14826 raft_consensus.cc:697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 8 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:33.808365 14887 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:33.834452 11622 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:33.835378 14918 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:33.835212 14887 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:33.839540 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:33.843303 14918 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:33.844529 14826 consensus_queue.cc:237] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:33.847776 11050 connection.cc:256] RPC call timeout handler was delayed by -1.3233530519999022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
W20260709 12:21:33.848222 11050 connection.cc:256] RPC call timeout handler was delayed by -1.3194930580000346s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19390000000000002s for a response
I20260709 12:21:33.818646 14311 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:21:33.854545 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:33.855198 10974 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:33.858705 14746 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:33.859232 14746 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:33.861528 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:33.862319 11008 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:33.862643 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:33.863288 11006 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:21:33.859122 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:33.863933 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 112524us
I20260709 12:21:33.864476 11002 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:33.808279 14872 consensus_queue.cc:1059] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:21:33.865017 10899 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:33.865670 14872 raft_consensus.cc:3055] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:33.866080 14872 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:33.839321 14876 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.862162 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:33.872053 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:33.868072 14633 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:33.859735 14746 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:33.852659 14887 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:33.877663 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:33.881927 11007 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:33.882352 11004 raft_consensus.cc:2410] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:21:33.880496 11006 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:33.856994 14653 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:33.872586 14335 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:33.886992 11010 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:33.853322 14752 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.893229 14868 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.893230 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:33.867072 14872 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.868034 14869 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.869544 14841 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:21:33.897357 10899 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:33.876362 14311 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:21:33.899451 11009 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:33.887321 14633 raft_consensus.cc:697] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:33.901832 14855 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:33.902082 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:33.902467 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:33.902590 11083 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
W20260709 12:21:33.902136 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.903247 14885 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:21:33.903100 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:33.908473 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:33.908730 11080 raft_consensus.cc:1240] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:33.902084 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:33.914319 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 65718.3us
W20260709 12:21:33.915907 11050 connection.cc:256] RPC call timeout handler was delayed by -1.1313930580001852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21480000000000002s for a response
W20260709 12:21:33.916710 11050 connection.cc:256] RPC call timeout handler was delayed by -1.0864771840001595s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2121s for a response
W20260709 12:21:33.916936 11050 connection.cc:256] RPC call timeout handler was delayed by -1.0449930580000455s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22440000000000004s for a response
I20260709 12:21:33.909488 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:33.920964 11085 raft_consensus.cc:2393] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 14: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:33.914654 14855 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:33.895732 14653 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.924430 14855 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:33.925843 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:33.926688 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:33.927278 11080 raft_consensus.cc:2376] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11. Re-sending same reply.
I20260709 12:21:33.928215 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:33.920490 11076 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:33.922766 11077 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:33.928812 11079 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
W20260709 12:21:33.933944 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 107798us
I20260709 12:21:33.935983 11082 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 12:21:33.938310 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 52029.3us
I20260709 12:21:33.936467 11080 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:33.923166 14766 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:33.939029 10974 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:33.943709 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:33.944550 11085 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:33.930400 14603 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:33.945798 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:33.935848 14923 log.cc:927] Time spent T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:21:33.946432 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:33.947570 14633 consensus_queue.cc:237] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.948613 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:33.953167 14635 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.961977 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:33.962630 11082 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 7: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:33.954756 11655 raft_consensus.cc:2393] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 8: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
W20260709 12:21:33.961153 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 66114.5us
I20260709 12:21:33.966720 14766 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:33.964287 11077 raft_consensus.cc:2410] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:21:33.968106 11076 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:21:33.965057 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:33.969106 11085 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:33.972237 11083 raft_consensus.cc:2393] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 9: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:33.972517 14653 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:33.973541 14752 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:33.976527 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:33.976990 10974 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:33.977334 11083 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 12: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:33.977603 14841 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:33.979908 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:33.980964 11083 raft_consensus.cc:2410] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:21:33.982666 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:33.984504 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:33.986474 11007 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:33.985248 11085 raft_consensus.cc:2376] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11. Re-sending same reply.
I20260709 12:21:33.983035 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:33.952594 14872 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:33.991073 11081 raft_consensus.cc:2410] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:21:33.992895 14635 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:33.994514 14855 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:33.995208 14868 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:33.982514 14869 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:33.963160 14756 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:33.996416 11080 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:21:33.996186 14746 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:34.001890 14756 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:33.996894 14880 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:33.994396 14663 consensus_queue.cc:1059] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:21:34.002351 11079 raft_consensus.cc:1240] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:33.988564 14841 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:34.004014 11076 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:21:33.977730 14750 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.005383 14880 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:34.011932 11076 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:34.015141 10974 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:34.018326 11084 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:21:34.015760 14311 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:21:34.019249 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:34.010924 14841 raft_consensus.cc:697] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:34.021174 14653 raft_consensus.cc:2764] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:21:34.021667 14841 consensus_queue.cc:237] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.021845 14683 raft_consensus.cc:2955] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:34.024071 10930 raft_consensus.cc:2955] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:21:34.028240 11652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59414 (request call id 261) took 1206 ms (client timeout 1602 ms). Trace:
W20260709 12:21:34.028703 11652 rpcz_store.cc:269] 0709 12:21:32.822256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.822605 (+   349us) service_pool.cc:224] Handling call
0709 12:21:34.027908 (+1205303us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b54007debd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:34.028063 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2137407744}
I20260709 12:21:34.035559 10977 leader_election.cc:400] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7.
I20260709 12:21:34.036322 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:34.041319 10929 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 6: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:34.036609 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:34.043919 10899 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:34.037256 10927 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:21:34.044867 14663 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:34.045629 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:34.046743 10931 raft_consensus.cc:2393] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 8: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:34.049640 14855 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:34.050220 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:34.056154 11652 raft_consensus.cc:1240] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:34.057370 11010 raft_consensus.cc:1240] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:34.058815 14663 consensus_queue.cc:1059] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:34.063067 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:34.064204 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:34.065091 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:34.065414 14746 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:34.068109 10899 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:34.073593 14617 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:34.073349 10899 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:34.076095 10974 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:34.078299 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:34.079286 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:34.081740 10930 raft_consensus.cc:2410] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:21:34.084669 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.085336 14872 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.085855 14872 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.087432 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:34.088023 14855 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:34.088620 14855 raft_consensus.cc:697] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:34.089543 14855 consensus_queue.cc:237] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.089998 10974 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:34.090482 14635 raft_consensus.cc:3055] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:34.094283 14635 raft_consensus.cc:740] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:34.095712 14635 consensus_queue.cc:260] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:34.096509 14746 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:34.098026 10899 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:34.099690 14872 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:34.099906 14617 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:34.045704 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:34.094923 10974 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:34.103736 14617 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:34.114149 14617 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:34.110842 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.120798 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:34.121577 10930 raft_consensus.cc:2368] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12.
I20260709 12:21:34.105638 11076 raft_consensus.cc:2376] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6. Re-sending same reply.
I20260709 12:21:34.098256 14746 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.129074 11010 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:21:34.138204 14876 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:34.138378 10899 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:21:34.139146 11050 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 2.076s (SENT) [suppressed 21 similar messages]
I20260709 12:21:34.136283 14872 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:34.140637 14872 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:34.140162 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 45570us
I20260709 12:21:34.141039 14872 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:34.164562 10899 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:34.165529 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:34.106120 14750 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:34.136570 14746 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:34.168262 10931 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 7: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:34.173552 10974 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:34.183043 11051 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:34.169308 14663 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:34.183478 11624 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:34.170493 14536 consensus_queue.cc:1059] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:21:34.175748 14635 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:34.182921 14876 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:34.191234 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:34.192515 10931 raft_consensus.cc:2393] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 14: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:34.193925 11051 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:34.187431 11010 raft_consensus.cc:2955] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:34.193847 10974 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:34.195314 10930 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:34.186779 14311 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:34.189057 14750 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:34.187608 14663 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:34.202159 11051 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:34.204348 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 60348.5us
I20260709 12:21:34.205139 10899 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:34.189790 10831 catalog_manager.cc:5697] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 9 to 11, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 11 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:34.196770 14887 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:34.210719 10899 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:34.214550 10899 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:34.200137 14750 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:34.265511 14750 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:34.202661 14684 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:34.267771 14684 raft_consensus.cc:697] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:34.268857 14684 consensus_queue.cc:237] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:34.201279 14311 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:34.272356 14311 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:34.206210 14663 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:34.198082 14756 consensus_queue.cc:1059] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:21:34.197144 14876 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.220947 14335 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:34.278316 14335 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:34.222815 14616 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:34.279772 14616 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:34.280196 14616 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:34.280591 14335 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:34.211259 14868 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:34.282434 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:34.283795 14887 raft_consensus.cc:3055] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:34.284207 14887 raft_consensus.cc:740] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:34.285080 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:34.285770 11009 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:21:34.286172 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:34.286904 11003 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:34.222896 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:34.223421 10830 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 112) took 5855 ms. Trace:
W20260709 12:21:34.286876 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 72385us
I20260709 12:21:34.211514 14766 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:34.219209 10974 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:34.209352 14844 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:34.288164 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:34.288461 14879 raft_consensus.cc:3055] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:34.288822 11008 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:34.285060 14876 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:34.290436 14879 raft_consensus.cc:740] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:34.240626 11051 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:34.286746 11004 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:34.291626 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 51085.2us
I20260709 12:21:34.241500 14866 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:34.285683 11005 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:34.290196 14752 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:34.242321 14936 log.cc:927] Time spent T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:21:34.225638 14617 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.297329 14617 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:34.285068 14887 consensus_queue.cc:260] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.218449 14517 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:21:34.299180 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 80056.1us
I20260709 12:21:34.291311 14879 consensus_queue.cc:260] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:34.299769 14844 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.300436 14879 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:34.300339 14844 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.302498 14887 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:34.288790 14766 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.303445 14766 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:34.264672 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:34.305500 10930 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 12: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:34.287948 10830 rpcz_store.cc:276] 0709 12:21:28.316830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.317151 (+   321us) service_pool.cc:224] Handling call
0709 12:21:28.589234 (+272083us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b5400096d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0eca090 00007f9bb0f68f3a 00007f9bb6d1ee9c 00007f9bb6e1d04e 00007f9bb52de2a4 00007f9bb52de232 00007f9bb52de161 00007f9bb52de0dc 00007f9bb52dd392 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:34.172036 (+5582802us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:33.223986 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:33.231421 (+  7435us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:33.231489 (+    68us) write_op.cc:435] Acquired schema lock
0709 12:21:33.231522 (+    33us) tablet.cc:662] Decoding operations
0709 12:21:33.232442 (+   920us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:33.232559 (+   117us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:33.232591 (+    32us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:21:33.233242 (+   651us) tablet.cc:701] Row locks acquired
0709 12:21:33.233298 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:21:33.233493 (+   195us) write_op.cc:270] Start()
0709 12:21:33.233640 (+   147us) write_op.cc:276] Timestamp: P: 1783599693233403 usec, L: 0
0709 12:21:33.233675 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:21:33.269765 (+ 36090us) log.cc:844] Serialized 1674 byte log entry
0709 12:21:33.327439 (+ 57674us) spinlock_profiling.cc:243] Waited 9.77 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bade560ac 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b
0709 12:21:33.847284 (+519845us) op_driver.cc:464] REPLICATION: finished
0709 12:21:33.933407 (+ 86123us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b5400096d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5be28 00007f9bb4996581 00007f9bb4995d58 00007f9bb499a9f1 00007f9bb499a9a9 00007f9bb499a939 00007f9bb499a901 00007f9bb4999b2d 0000000000388634 0000000000388479
0709 12:21:33.953231 (+ 19824us) write_op.cc:301] APPLY: starting
0709 12:21:33.953347 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:33.953546 (+   199us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:33.953584 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:33.954332 (+   748us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:34.003242 (+ 48910us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:21:34.003307 (+    65us) write_op.cc:312] APPLY: finished
0709 12:21:34.014343 (+ 11036us) log.cc:844] Serialized 41 byte log entry
0709 12:21:34.017468 (+  3125us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:34.019054 (+  1586us) write_op.cc:454] Released schema lock
0709 12:21:34.023820 (+  4766us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:34.024298 (+   478us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:34.024328 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1174923,"reported_tablets":6,"spinlock_wait_cycles":65097856,"child_traces":[["op",{"apply.queue_time_us":105623,"apply.run_cpu_time_us":3295,"apply.run_wall_time_us":71059,"num_ops":4,"prepare.queue_time_us":2588,"prepare.run_cpu_time_us":31277,"prepare.run_wall_time_us":712028,"raft.queue_time_us":119832,"raft.run_cpu_time_us":12189,"raft.run_wall_time_us":68893,"replication_time_us":613451,"spinlock_wait_cycles":103352960,"thread_start_us":565861,"threads_started":4,"wal-append.queue_time_us":451619}]]}
I20260709 12:21:34.293222 14866 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:34.306995 14866 raft_consensus.cc:697] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:34.246068 10831 catalog_manager.cc:5697] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.310475 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:34.286118 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:34.315057 11051 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:34.311146 11078 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:34.323834 11007 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:34.325739 10901 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:34.328577 10901 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:34.328824 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:34.329784 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:34.330572 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:34.331166 11077 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:21:34.333030 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:34.333726 11081 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:34.339761 10901 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:34.302546 14844 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:34.351056 11051 leader_election.cc:400] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12.
I20260709 12:21:34.351478 11051 leader_election.cc:403] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:34.348771 11085 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:34.354331 10901 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:34.347532 10831 catalog_manager.cc:5697] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 5 to 7, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 7 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.355250 11084 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:21:34.357795 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 49007.3us
I20260709 12:21:34.325237 14876 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.323338 14517 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.361340 10974 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:34.307963 14866 consensus_queue.cc:237] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:34.341452 14617 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:34.361320 14761 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:34.343216 14756 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:34.344769 14633 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:34.337759 14869 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:21:34.337426 14871 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:21:34.362846 14335 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:21:34.388367 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.385033 10901 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:34.373721 14617 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:34.402482 11085 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
W20260709 12:21:34.403273 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 44852.4us
I20260709 12:21:34.368218 14611 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:21:34.382416 14633 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.409925 10899 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:21:34.410602 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 49377.6us
I20260709 12:21:34.376701 14517 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.416759 14880 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:34.422358 11077 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
W20260709 12:21:34.423668 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 58816.6us
I20260709 12:21:34.376415 14876 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.428156 11655 raft_consensus.cc:1240] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:34.418906 14880 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:34.436939 14752 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:34.401070 14794 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:34.407591 14617 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:34.416771 14944 log.cc:927] Time spent T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:21:34.403317 14826 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:34.462904 11081 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:21:34.408776 14335 raft_consensus.cc:697] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:34.410351 14885 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:34.424288 14654 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12.
I20260709 12:21:34.420168 14633 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:34.423532 14603 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 12:21:34.474295 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 49296.7us
I20260709 12:21:34.424144 14756 consensus_queue.cc:1059] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:21:34.469273 14517 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:34.484011 10974 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:34.477149 14952 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:34.488874 10931 raft_consensus.cc:1240] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:34.490828 11008 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:34.469200 14752 consensus_queue.cc:1059] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
W20260709 12:21:34.500664 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 73516.3us
W20260709 12:21:34.502804 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.511343 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:34.512097 10928 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:34.495170 14761 consensus_queue.cc:1059] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:21:34.496408 14952 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:34.479346 14603 consensus_queue.cc:1243] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 1abf4b385a2b493ab83f593a1f8c9cd1 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:21:34.518078 14952 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:34.521243 14517 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:34.522073 14663 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.528862 14876 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:34.480118 14794 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.534184 14794 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:34.535019 14826 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:34.492439 14863 consensus_queue.cc:1059] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:21:34.485421 14885 raft_consensus.cc:697] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:34.536139 14918 consensus_queue.cc:1059] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:21:34.536909 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 53072.7us
I20260709 12:21:34.537477 14918 raft_consensus.cc:3055] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:34.538074 14918 raft_consensus.cc:740] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:34.477726 14872 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.539007 14918 consensus_queue.cc:260] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:34.485281 14335 consensus_queue.cc:237] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.539503 14756 raft_consensus.cc:3055] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:34.537142 14885 consensus_queue.cc:237] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.548108 11076 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:34.550601 11005 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:21:34.553314 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:34.566696 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:34.550074 11004 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
W20260709 12:21:34.522769 14947 log.cc:927] Time spent T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.056s	user 0.003s	sys 0.000s
I20260709 12:21:34.573639 11082 raft_consensus.cc:2955] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:34.575578 14887 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.576143 14887 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.576556 14311 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:34.578599 14887 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:34.578837 14311 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:34.580765 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:34.582487 14633 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:34.583267 11085 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:34.583660 10931 raft_consensus.cc:1240] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:34.584653 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:34.585459 11084 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:34.585668 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:34.586829 14949 raft_consensus.cc:3055] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:34.587245 14949 raft_consensus.cc:740] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:34.592309 14868 raft_consensus.cc:2764] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:21:34.618798 11004 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:34.550926 14756 raft_consensus.cc:740] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:34.638783 14756 consensus_queue.cc:260] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:34.650157 10928 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
I20260709 12:21:34.641495 14918 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:34.624611 14887 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:34.650070 14952 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.671483 14941 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:21:34.673355 14746 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.675496 14746 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:34.677053 14616 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.679221 14616 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:34.683568 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:34.685606 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:34.687307 14633 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:34.687992 14942 consensus_queue.cc:1059] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:21:34.701586 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:34.704975 14794 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:34.659039 14663 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:34.709544 11084 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:34.632308 14949 consensus_queue.cc:260] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.739900 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:34.705123 14952 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.743757 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:34.751060 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 284324us
I20260709 12:21:34.754719 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:34.698539 14887 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:34.757053 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 262051us
I20260709 12:21:34.770241 10928 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:34.773471 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:34.774003 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:34.774443 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:34.774827 10930 raft_consensus.cc:2393] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 15: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:34.772233 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:34.740226 14956 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.774271 10901 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:34.777801 10928 raft_consensus.cc:1240] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:34.751827 14653 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:34.778167 10901 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:34.737733 14750 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:34.743331 14766 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.785969 11084 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:21:34.785339 10901 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:34.794063 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:34.794898 11005 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 6: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:34.795804 11051 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:34.798074 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:34.787815 11084 pending_rounds.cc:85] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 8
I20260709 12:21:34.803026 11084 pending_rounds.cc:107] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:21:34.803308 11084 raft_consensus.cc:2889] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:34.824466 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.830621 11077 raft_consensus.cc:1240] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:34.781198 14616 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:34.787612 14517 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:34.788688 14872 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:34.786206 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:34.837534 10927 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:21:34.804979 14635 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:34.844640 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:34.845427 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:34.876663 11005 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:34.876806 11004 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:34.833360 14794 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:34.829821 14952 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:34.776968 14963 consensus_queue.cc:1059] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:21:34.785707 14653 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:34.781309 14956 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.872642 14616 raft_consensus.cc:697] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:21:34.878334 14950 log.cc:927] Time spent T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:21:34.908968 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:34.903209 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.903702 11084 pending_rounds.cc:85] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 3
I20260709 12:21:34.910153 11084 pending_rounds.cc:107] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:21:34.910882 11084 raft_consensus.cc:2889] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:34.906381 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:34.909648 11080 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:34.911952 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:21:34.884652 14951 log.cc:927] Time spent T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:21:34.934006 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:34.935094 11004 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:21:34.939553 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:34.940236 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:34.946554 14963 raft_consensus.cc:3055] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:34.946992 14963 raft_consensus.cc:740] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:34.947424 14653 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:34.947842 14963 consensus_queue.cc:260] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.948770 14766 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:34.949098 14963 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:34.949925 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:34.950321 14750 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:34.950551 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:34.951189 10933 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
W20260709 12:21:34.954243 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.904001 14517 raft_consensus.cc:697] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:34.956544 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:34.957024 10927 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:21:34.957341 11051 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:34.958146 14794 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:34.958570 14794 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:34.958894 10935 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 12:21:34.959003 14794 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:34.959611 14616 consensus_queue.cc:237] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.960513 14887 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:34.962271 14611 raft_consensus.cc:3055] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:34.962706 14611 raft_consensus.cc:740] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:34.918023 14603 raft_consensus.cc:3055] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:21:34.964610 14959 log.cc:927] Time spent T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:21:34.965238 14956 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:34.917201 14635 raft_consensus.cc:697] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:34.966032 14746 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:34.966548 14746 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:34.968678 14746 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:34.969188 14794 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.970796 10931 raft_consensus.cc:1240] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 8. Current term is 9. Ops: [7.8-8.9]
I20260709 12:21:34.971272 14794 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:34.965157 10901 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:34.973126 10901 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:34.973855 14948 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:34.976239 14761 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:34.956707 14517 consensus_queue.cc:237] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.976647 14761 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.977061 14761 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:34.977485 10935 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:34.978488 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:34.979063 10935 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:34.979630 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:34.966429 14635 consensus_queue.cc:237] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:34.981552 14948 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:34.958045 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:34.982810 10927 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
W20260709 12:21:34.983181 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.963603 14603 raft_consensus.cc:740] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:34.986243 14766 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:34.986819 11080 pending_rounds.cc:85] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 6
I20260709 12:21:34.957209 10936 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:21:34.993104 11080 pending_rounds.cc:107] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:21:34.993422 11080 raft_consensus.cc:2889] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:34.957975 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:34.983757 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:34.995086 10935 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:35.009205 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:34.936064 14866 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.010905 10977 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:35.012455 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:35.012426 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:35.019743 10930 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:35.020315 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:35.020946 11085 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:35.023761 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:35.024724 10935 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12. Ops: []
W20260709 12:21:34.988158 14617 consensus_meta.cc:287] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
I20260709 12:21:35.027984 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:35.033061 10936 raft_consensus.cc:2393] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:35.028024 10931 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:35.031692 11081 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:35.039666 11079 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:21:35.033361 10977 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:35.043972 10899 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:35.044467 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:35.045068 10935 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:35.045496 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:35.046147 10931 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:35.048646 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.048803 11085 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:35.013260 14683 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.012022 14746 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.053778 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:35.053902 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.058208 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:35.060578 11085 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:35.061527 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:35.063517 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.024186 14335 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.065670 14311 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:35.063153 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:35.067952 11077 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:35.040638 14872 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:34.963483 14611 consensus_queue.cc:260] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.040789 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:35.025904 14866 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.071394 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.072815 14311 consensus_queue.cc:1059] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:35.052481 14826 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:35.079825 11010 raft_consensus.cc:2393] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 10: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:35.114730 11085 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:35.058820 14962 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:21:35.133180 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 67478.2us
I20260709 12:21:35.044378 14617 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.138598 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.135080 14653 raft_consensus.cc:3055] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:35.130509 14872 raft_consensus.cc:697] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:35.187343 14653 raft_consensus.cc:740] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:35.196573 14872 consensus_queue.cc:237] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.196928 14653 consensus_queue.cc:260] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.198007 14653 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:35.199522 10931 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:21:35.067327 14603 consensus_queue.cc:260] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.069765 14868 consensus_queue.cc:1059] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:21:35.063755 14683 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:35.138634 14960 log.cc:927] Time spent T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 12:21:35.153172 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.154594 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:35.212858 11004 raft_consensus.cc:2410] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:21:35.155654 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:35.213505 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.213655 10932 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: []
W20260709 12:21:35.156244 14964 log.cc:927] Time spent T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:21:35.067679 14746 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.073611 14335 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.141227 14611 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:35.179469 11077 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:35.183960 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:35.187845 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 131817us
I20260709 12:21:35.221573 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:35.187750 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.189313 14984 consensus_queue.cc:1059] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:35.183333 14962 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:35.194213 14866 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:35.064368 14663 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:21:35.201905 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:35.217430 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:35.222810 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.221783 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:35.230654 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:35.220553 14826 raft_consensus.cc:3055] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:35.232226 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.234714 11006 raft_consensus.cc:2368] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15.
I20260709 12:21:35.227116 14603 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:35.236945 11050 leader_election.cc:336] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.528s (SENT)
I20260709 12:21:35.226528 14962 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:35.240185 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.241056 11010 raft_consensus.cc:2368] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15.
I20260709 12:21:35.237529 11085 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:35.244216 10899 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:35.246860 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:35.247882 11085 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:35.251112 11077 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
W20260709 12:21:35.251612 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.233353 14517 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:35.253958 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.256640 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:35.256223 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.258136 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:35.234367 14826 raft_consensus.cc:740] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:35.256124 10899 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:35.261108 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:21:35.262864 11050 leader_election.cc:336] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.557s (SENT)
I20260709 12:21:35.262769 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:35.264112 14982 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:35.267652 11050 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:35.275960 14794 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:35.278460 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.279285 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.279791 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:35.281126 11003 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 7: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:35.282073 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:35.282915 14946 raft_consensus.cc:3055] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:35.283408 14946 raft_consensus.cc:740] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:35.284373 14946 consensus_queue.cc:260] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:35.285414 14946 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:35.286617 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:35.252745 14866 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.289716 11011 raft_consensus.cc:2368] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12.
I20260709 12:21:35.290593 11010 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:35.290726 10977 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:35.280181 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.292256 11002 raft_consensus.cc:2410] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:21:35.255252 14984 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.289999 11652 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:21:35.294840 10977 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:35.259440 14958 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:35.297458 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.298451 11007 raft_consensus.cc:2410] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:21:35.298512 11085 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
W20260709 12:21:35.299665 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.304344 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:35.306908 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:35.305047 11083 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:35.276448 14663 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:35.313855 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.314538 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.316030 11011 raft_consensus.cc:2393] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:35.311952 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:35.311532 14653 consensus_queue.cc:1059] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:21:35.316807 11009 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:35.323118 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:35.323302 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:35.323446 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:35.316504 11007 raft_consensus.cc:1240] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:35.329479 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:35.312781 14958 raft_consensus.cc:697] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:35.294950 14826 consensus_queue.cc:260] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.332618 11006 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 12: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:35.331185 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.334002 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:35.300913 14866 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.322188 14663 raft_consensus.cc:697] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:35.340945 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.341349 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:35.343385 14980 log.cc:927] Time spent T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:21:35.343721 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.344535 11006 raft_consensus.cc:2393] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 13: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:21:35.345057 14981 log.cc:927] Time spent T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 12:21:35.345474 14977 log.cc:927] Time spent T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 12:21:35.347277 14983 log.cc:927] Time spent T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:21:35.348572 14872 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:35.348973 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:35.349015 14872 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.350472 14872 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:35.337029 14963 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.352830 14949 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:35.352702 14963 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.354840 14963 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:35.356225 14976 log.cc:927] Time spent T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:21:35.357000 14866 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:35.358515 14872 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.360139 14990 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:35.360611 14990 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:35.360867 14985 log.cc:927] Time spent T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:21:35.361974 14990 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:35.344383 14978 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:21:35.363209 14683 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:35.363886 14335 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:35.364710 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:35.368649 11655 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:35.370479 14761 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.352341 14958 consensus_queue.cc:237] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.371906 14826 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:35.303031 14984 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.376771 11003 raft_consensus.cc:2410] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:21:35.377700 14984 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:35.382570 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.383780 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.384501 11011 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 11: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:35.348474 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:35.376698 10933 raft_consensus.cc:2368] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12.
I20260709 12:21:35.388629 10930 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:35.393831 11625 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:21:35.397316 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.397759 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.395206 11051 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:35.402302 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.403218 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:35.403898 11079 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 12.
I20260709 12:21:35.406637 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:35.407238 11011 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:35.407012 10901 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:35.409538 10901 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:35.413617 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:35.413758 14948 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:35.414350 14536 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:35.414909 14536 raft_consensus.cc:697] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
W20260709 12:21:35.416531 14969 log.cc:927] Time spent T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.471s	user 0.006s	sys 0.002s
I20260709 12:21:35.402348 14880 consensus_queue.cc:1059] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:21:35.417958 14761 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:35.418195 14880 raft_consensus.cc:3055] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:35.418640 14880 raft_consensus.cc:740] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:35.416734 14982 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:35.420779 11006 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:35.422227 14826 consensus_queue.cc:1059] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:35.422987 11082 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:35.417488 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.423834 11010 raft_consensus.cc:2393] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:21:35.424074 11050 leader_election.cc:336] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.683s (SENT)
I20260709 12:21:35.421533 14311 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:35.424726 11050 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:35.405267 11051 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:35.425760 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.427420 11009 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:35.424304 11082 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:21:35.429850 11051 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:35.339649 14617 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:35.433609 11011 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:35.435249 14880 consensus_queue.cc:260] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:35.425269 14952 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:35.436502 14952 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.436842 14880 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:35.398540 14750 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:21:35.439648 14872 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:35.436846 14952 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:35.440480 14750 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:35.441454 14663 consensus_queue.cc:237] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.435822 11076 raft_consensus.cc:1240] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:21:35.424702 14517 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:35.395414 14866 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.402403 14794 consensus_queue.cc:1059] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:21:35.424266 14973 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:21:35.449457 11076 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:35.457785 11080 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
W20260709 12:21:35.459347 11050 leader_election.cc:336] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.741s (SENT)
I20260709 12:21:35.461449 11002 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:35.462255 14311 raft_consensus.cc:3055] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:35.462589 14311 raft_consensus.cc:740] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:35.456060 14866 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.466290 11083 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:35.467334 14866 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:35.479912 14311 consensus_queue.cc:260] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.481783 11079 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:21:35.482887 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 53139.4us
I20260709 12:21:35.484120 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:35.488020 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.490118 11005 raft_consensus.cc:2393] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 7: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:35.491050 14311 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:35.492929 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:35.493525 10928 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:35.497051 11082 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:35.448127 14948 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:21:35.455331 14990 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.514315 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:35.515048 11009 raft_consensus.cc:2368] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15.
I20260709 12:21:35.515168 14990 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:35.514315 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.517719 11007 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:35.499781 11051 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:35.528537 11051 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:35.531239 14866 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:35.531423 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:35.454329 14869 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:35.531880 10934 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:35.532279 14750 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:35.532840 14750 raft_consensus.cc:697] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:35.533737 14750 consensus_queue.cc:237] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.503736 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:35.537528 11004 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:35.505427 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:35.538393 10932 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:21:35.505942 14974 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:35.548082 10899 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:35.510468 14952 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.545429 11622 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:35.550551 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:35.551342 10928 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:21:35.552115 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:35.553481 11079 raft_consensus.cc:1240] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:35.461971 14683 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 12:21:35.560921 11082 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:35.561264 10899 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:35.562674 10899 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:35.415875 14536 consensus_queue.cc:237] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:35.569851 10934 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:21:35.570581 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.542104 14869 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.536072 14866 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.573904 11005 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 12: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:35.574270 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:35.613758 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:35.614480 11050 leader_election.cc:336] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.870s (SENT)
I20260709 12:21:35.447769 14962 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:35.500545 14872 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:21:35.560092 14880 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:35.546361 14794 consensus_queue.cc:1059] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:21:35.625590 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.631018 11004 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:35.574469 14617 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:35.574328 14633 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:35.577315 14869 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:35.621068 14866 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:35.660925 14952 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:35.661725 14866 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.665719 14866 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:35.668010 14633 raft_consensus.cc:697] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:35.670571 11002 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:21:35.569379 14335 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:21:35.643078 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 226434us
I20260709 12:21:35.621461 14957 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:35.645884 11050 leader_election.cc:336] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.888s (SENT)
I20260709 12:21:35.557631 14611 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:21:35.646461 14868 raft_consensus.cc:3055] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:35.625651 14880 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.636346 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.679271 11007 raft_consensus.cc:2393] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 8: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:35.677172 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.637967 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.686568 11004 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:21:35.687573 11050 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:35.635965 14746 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:35.690327 11002 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:35.682854 10975 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:35.717988 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.719494 11005 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:21:35.652509 14974 raft_consensus.cc:3055] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:35.719501 11078 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:35.683171 14868 raft_consensus.cc:740] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:35.683354 14880 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:35.682516 14617 raft_consensus.cc:697] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:35.728441 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.768563 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:35.722470 14998 raft_consensus.cc:2764] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:21:35.721500 14335 raft_consensus.cc:697] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:35.728722 14973 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:35.726171 11652 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:35.796363 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.816053 14984 raft_consensus.cc:3055] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:35.816594 14984 raft_consensus.cc:740] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:35.817457 14984 consensus_queue.cc:260] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.818320 14616 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.818670 14984 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:35.821578 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2713) took 1136 ms. Trace:
I20260709 12:21:35.822024 11078 rpcz_store.cc:276] 0709 12:21:34.685223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.685370 (+   147us) service_pool.cc:224] Handling call
0709 12:21:35.821386 (+1136016us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b5400114254. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:35.821487 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2217652992}
I20260709 12:21:35.823467 11076 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:35.827893 14633 consensus_queue.cc:237] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.818912 14616 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.832158 11049 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:35.832824 14962 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:35.833676 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.778679 11002 raft_consensus.cc:1240] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:35.722630 14974 raft_consensus.cc:740] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:35.685588 14957 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:35.849071 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.852172 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:35.853751 15000 log.cc:927] Time spent T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:21:35.833601 14616 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:35.856918 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 211055us
I20260709 12:21:35.833482 14973 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:35.863590 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:35.868302 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:35.879700 11007 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:35.880776 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.868577 11005 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:35.869164 11081 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:35.856726 14335 consensus_queue.cc:237] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.845790 14868 consensus_queue.cc:260] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.868276 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:35.873797 11009 raft_consensus.cc:1240] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:35.870443 11084 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:21:35.886034 11003 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:21:35.891458 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.893771 10901 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:35.894805 10901 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:35.899328 11083 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:35.901028 11079 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:35.910866 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.928457 11005 raft_consensus.cc:2410] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:21:35.855839 14957 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:35.907577 14517 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:35.932901 14963 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.944979 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:35.949651 11006 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:35.956845 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:35.957579 10931 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:35.907397 14885 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:35.898973 14973 raft_consensus.cc:697] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:35.960119 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.856637 14617 consensus_queue.cc:237] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:35.964751 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.965158 11007 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:35.948763 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.965721 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:35.966449 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:35.966658 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:35.967269 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:35.968065 11080 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:35.973260 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:35.975134 10899 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:35.979471 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:35.981652 14998 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:35.907742 14766 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:21:35.988137 14869 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.948204 14963 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:35.965301 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:36.119014 11081 raft_consensus.cc:2410] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
W20260709 12:21:35.933923 14603 consensus_meta.cc:287] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.690s	user 0.011s	sys 0.000s
I20260709 12:21:35.996483 11050 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:36.067628 11085 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:35.909852 14616 consensus_queue.cc:1059] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:21:36.073001 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:36.078135 10931 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:21:36.008441 11010 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 12.
I20260709 12:21:36.120081 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:35.959283 14868 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:36.096247 10933 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:35.961018 14517 raft_consensus.cc:697] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:35.964811 14885 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.942505 14635 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 12:21:36.114665 11652 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:36.162683 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:36.110077 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:36.110234 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:36.111951 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 100982us
I20260709 12:21:36.163985 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:36.164628 11081 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:36.113716 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 138673us
I20260709 12:21:35.856426 14974 consensus_queue.cc:260] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:36.165241 10900 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:35.573599  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:36.124764 11006 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:21:36.112071 15004 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:36.166451 15004 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:36.130019 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:36.168290 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:36.168663 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.169385 10977 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:36.126197 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:36.170217 10977 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:36.171108 10977 leader_election.cc:400] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12.
I20260709 12:21:36.171407 10977 leader_election.cc:403] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:21:36.132589 14986 log.cc:927] Time spent T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.805s	user 0.006s	sys 0.000s
I20260709 12:21:36.172556 14826 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:36.173035 14826 raft_consensus.cc:697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:36.173362 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2727) took 1328 ms. Trace:
I20260709 12:21:36.173992 14826 consensus_queue.cc:237] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:36.174974 15004 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:36.144640 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:36.175804 11080 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:21:36.176024 14994 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12.
I20260709 12:21:36.170933 14984 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:36.177927 14984 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.178280 14984 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:36.149057 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:36.164507 10901 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:36.177529 11080 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:36.136929 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:36.181617 11078 raft_consensus.cc:2393] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 12: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:36.068167 14942 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 12:21:36.184072 11084 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:36.183826 11011 raft_consensus.cc:2368] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12.
I20260709 12:21:36.115617 14998 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:36.173738 11008 rpcz_store.cc:276] 0709 12:21:34.845107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.902546 (+ 57439us) service_pool.cc:224] Handling call
0709 12:21:34.931913 (+ 29367us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:21:34.944807 (+ 12894us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:34.944840 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:21:34.982285 (+ 37445us) log.cc:844] Serialized 78 byte log entry
0709 12:21:35.226760 (+244475us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:35.226802 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:35.226862 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:36.011075 (+784213us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:36.173047 (+161972us) raft_consensus.cc:1685] finished
0709 12:21:36.173068 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:36.173295 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12540,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":11357,"spinlock_wait_cycles":7006592,"thread_start_us":157043,"threads_started":1,"wal-append.queue_time_us":257895}
I20260709 12:21:36.193776 11006 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:21:36.196175 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:36.124218 14958 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:36.197064 14958 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:36.197499 14958 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:36.201390 14517 consensus_queue.cc:237] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:36.196887 11085 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:36.205348 15002 log.cc:927] Time spent T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:21:36.206646 14974 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:36.207023 14996 log.cc:927] Time spent T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:21:36.125670 14683 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.212383 14683 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:36.214816 14683 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:36.215323 14885 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:36.220355 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 223958us
W20260709 12:21:36.221566 11050 leader_election.cc:336] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.760s (SENT)
I20260709 12:21:36.221982 11050 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:36.223183 11050 leader_election.cc:336] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.939s (SENT)
I20260709 12:21:36.223593 11050 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:36.223834 14794 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:36.228358 14866 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:36.229794 11050 leader_election.cc:336] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 2.175s (SENT)
I20260709 12:21:36.230237 11050 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:36.231038 14866 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:36.232816 14957 raft_consensus.cc:3055] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:36.233219 14957 raft_consensus.cc:740] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:36.234092 14957 consensus_queue.cc:260] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:36.154105 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:36.235311 14957 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:36.159157 14973 consensus_queue.cc:237] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:36.234706 11050 leader_election.cc:336] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 2.092s (SENT)
I20260709 12:21:36.240320 11050 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:36.241111 14866 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:36.175974 14663 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:21:36.244923 11084 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:21:36.245433 15010 log.cc:927] Time spent T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:21:36.247664 14869 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:36.248665 11085 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:36.249636 14963 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:36.162565 11651 raft_consensus.cc:2393] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 8: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
W20260709 12:21:36.251210 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 85914.1us
W20260709 12:21:36.251309 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 86169.3us
W20260709 12:21:36.243175 11050 leader_election.cc:336] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 2.121s (SENT)
W20260709 12:21:36.257601 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 93175.2us
I20260709 12:21:36.259481 11079 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:36.223591 11081 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:21:36.253253 11050 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:36.256275 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:36.266276 11006 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
I20260709 12:21:36.239115 14984 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:36.274228 14746 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:36.274909 15003 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:36.275315 15003 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.275696 15003 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:36.275393 10974 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:36.276557 14991 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:36.277916 14991 raft_consensus.cc:2764] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:21:36.252024 14945 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.279273 14945 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:36.281653 11050 leader_election.cc:336] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 2.148s (SENT)
I20260709 12:21:36.283227 11050 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:36.282843 10933 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:21:36.280985 11008 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:21:36.280036 10974 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:36.268889 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:36.305752 11005 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:36.307289 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:36.259976 14794 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:36.281836 14952 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:36.253290 14879 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:36.334448 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 54473.3us
I20260709 12:21:36.335315 10974 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:36.338660 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 86796.1us
I20260709 12:21:36.321306 14756 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:36.320956 14948 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:36.352818 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 71191.9us
I20260709 12:21:36.329016 14635 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:36.360299 10974 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:36.361965 10974 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:36.345345 14872 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:36.371017 14311 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:36.371481 10974 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:36.346966 14974 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:36.376894 10974 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:36.372764 11050 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:36.379633 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:36.389685 11051 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:36.373783 14991 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:36.345986 14879 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:36.389474 14868 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:36.380643 14994 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:36.370045 14952 consensus_queue.cc:1059] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:21:36.384217 14973 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:21:36.389663 14872 raft_consensus.cc:697] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:36.404580 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:36.405242 11004 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:36.377416 14766 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:21:36.377096 14603 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:21:36.393612 14962 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:36.406514 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.376504 14635 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:36.396858 14866 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:36.363534 14948 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:36.399982 14974 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:36.421954 11004 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:36.463634 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:21:36.480347 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.486920 10935 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:36.496701 10927 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:36.521028 10934 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:36.498338 15006 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:36.394169 14982 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:21:36.422837 10929 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:36.552570 14948 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:36.502316 14880 consensus_meta.cc:287] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.729s	user 0.009s	sys 0.002s
I20260709 12:21:36.399931 15024 consensus_queue.cc:1059] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.127s
I20260709 12:21:36.421408 14962 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:36.502600 14974 raft_consensus.cc:697] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:36.456787 14633 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.125s
W20260709 12:21:36.563107 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.549407 14866 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.498873 15004 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.083s
W20260709 12:21:36.575906 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 199031us
W20260709 12:21:36.577608 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 166390us
W20260709 12:21:36.566816 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 194130us
I20260709 12:21:36.546876 14826 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.582906 10974 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:36.587953 10901 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:36.590167 11050 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:36.590682 10901 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:36.595129 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:36.610487 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 220853us
I20260709 12:21:36.563115 14880 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:36.611599 11004 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:36.612373 11051 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:36.566304 14941 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:21:36.581781 15024 raft_consensus.cc:3055] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:36.629868 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:36.613052 15021 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:21:36.661568 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:36.663600 11004 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:36.592818 10974 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:36.663470 11079 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:36.667048 11082 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:36.592689 14335 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:36.665031 11083 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:36.576721 14866 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:36.611491 15006 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:36.613472 14948 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:36.673501 11079 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:36.613690 14982 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
W20260709 12:21:36.660604 15030 log.cc:927] Time spent T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 12:21:36.684273 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 102912us
W20260709 12:21:36.689481 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 96722.6us
I20260709 12:21:36.591770 14826 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:36.655843 15024 raft_consensus.cc:740] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:36.674674 14998 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:36.579473 14872 consensus_queue.cc:237] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:36.699729 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:36.718827 11082 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8.
I20260709 12:21:36.625694 14958 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:36.710057 10974 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:36.710067 11050 leader_election.cc:400] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15.
I20260709 12:21:36.720042 11050 leader_election.cc:403] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:21:36.720789 10974 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:36.819200 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 98508.4us
I20260709 12:21:36.697661 14948 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.698055 14994 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:36.700357 14611 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:36.843953 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 134036us
I20260709 12:21:36.844838 11050 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:36.844928 14880 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:36.710035 14635 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:36.700063 15034 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:36.816450 15032 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:36.686892 14974 consensus_queue.cc:237] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:36.824934 14868 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:36.824152 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:36.838129 14948 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:36.844003 15035 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:21:36.838392 15043 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:36.864055 15008 log.cc:927] Time spent T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 12:21:36.884495 10974 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:36.877365 15020 log.cc:927] Time spent T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.397s	user 0.001s	sys 0.000s
W20260709 12:21:36.879315 14885 consensus_meta.cc:287] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.663s	user 0.010s	sys 0.000s
I20260709 12:21:36.853163 14611 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:36.924785 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:36.928555 11082 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:36.876046 14942 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:36.885294 15025 log.cc:927] Time spent T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
I20260709 12:21:36.880689 15034 raft_consensus.cc:697] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:36.938154 10934 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:36.889460 14962 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:36.931120 15026 log.cc:927] Time spent T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.365s	user 0.000s	sys 0.001s
I20260709 12:21:36.932444 14991 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:36.887205 14990 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:21:36.931664 14885 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:36.976325 15027 log.cc:927] Time spent T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.351s	user 0.001s	sys 0.000s
I20260709 12:21:36.979233 15043 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:36.981416 14826 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:36.982803 14958 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:36.943137 14635 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.984817 14635 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:36.986919 14635 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:36.976258 15003 consensus_meta.cc:287] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.700s	user 0.008s	sys 0.002s
I20260709 12:21:36.987843 15003 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:36.990716 14885 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:36.991549 14756 consensus_meta.cc:287] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.634s	user 0.007s	sys 0.002s
I20260709 12:21:36.992115 14949 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.992681 14949 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:36.994046 11079 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:37.006131 15003 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:36.929144 14982 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:37.009670 14982 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.011018 14611 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:37.011312 15023 log.cc:927] Time spent T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.335s	user 0.000s	sys 0.002s
I20260709 12:21:36.891455 11651 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:36.962946 11082 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 13.
I20260709 12:21:36.934103 14942 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:37.012554 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2597) took 1102 ms. Trace:
I20260709 12:21:37.012957 11076 rpcz_store.cc:276] 0709 12:21:35.910523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.922314 (+ 11791us) service_pool.cc:224] Handling call
0709 12:21:35.948508 (+ 26194us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:35.964443 (+ 15935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:35.964474 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:36.013565 (+ 49091us) log.cc:844] Serialized 26 byte log entry
0709 12:21:36.369747 (+356182us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:36.369787 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.369853 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:37.010597 (+640744us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:37.012250 (+  1653us) raft_consensus.cc:1685] finished
0709 12:21:37.012268 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:37.012495 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24577,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":127,"spinlock_wait_cycles":24273792,"thread_start_us":256834,"threads_started":1,"wal-append.queue_time_us":471528}
I20260709 12:21:37.014328 14942 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:36.947075 15028 log.cc:927] Time spent T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 12:21:37.014860 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:37.015560 11076 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 7.
I20260709 12:21:36.944413 15034 consensus_queue.cc:237] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:36.942965 15041 log.cc:927] Time spent T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:21:36.967796 11080 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:36.929400 15024 consensus_queue.cc:260] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:36.970466 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2583) took 1649 ms. Trace:
I20260709 12:21:36.971581 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2751) took 1110 ms. Trace:
W20260709 12:21:36.973510 15037 log.cc:927] Time spent T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 12:21:36.973706 14957 consensus_meta.cc:287] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.738s	user 0.014s	sys 0.000s
I20260709 12:21:36.974432 14984 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:36.975097 15033 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15.
I20260709 12:21:37.008379 14945 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:36.943845 14879 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:36.887916 14998 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:21:37.018898 14982 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:36.938984 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 54564.4us
I20260709 12:21:37.026252 11624 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:37.045037 15049 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.045269 11651 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:37.046130 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:37.046607 10899 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:37.085356 11008 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:37.086725 10899 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:37.035292 11077 rpcz_store.cc:276] 0709 12:21:35.320836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.614499 (+293663us) service_pool.cc:224] Handling call
0709 12:21:35.633295 (+ 18796us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:35.930299 (+297004us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:35.930335 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:35.931567 (+  1232us) log.cc:844] Serialized 26 byte log entry
0709 12:21:36.356467 (+424900us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:36.356512 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.356576 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:36.970240 (+613664us) raft_consensus.cc:1685] finished
0709 12:21:36.970260 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:36.970386 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3318,"raft.queue_time_us":16687,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":22869,"thread_start_us":637255,"threads_started":2,"wal-append.queue_time_us":495979}
I20260709 12:21:37.088093 10899 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
W20260709 12:21:37.051399 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.064862 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:37.090193 11004 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8.
I20260709 12:21:37.036068 11002 rpcz_store.cc:276] 0709 12:21:35.861437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.861587 (+   150us) service_pool.cc:224] Handling call
0709 12:21:35.865787 (+  4200us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:35.870779 (+  4992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:35.870809 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:35.871400 (+   591us) log.cc:844] Serialized 52 byte log entry
0709 12:21:36.357214 (+485814us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:36.357255 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.357321 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:36.971378 (+614057us) raft_consensus.cc:1685] finished
0709 12:21:36.971397 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:36.971527 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5174,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":116,"thread_start_us":485451,"threads_started":1,"wal-append.queue_time_us":548379}
W20260709 12:21:37.066987 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.046509 14826 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:37.046228 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
W20260709 12:21:37.079259 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 53102.7us
I20260709 12:21:37.084497 10974 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:37.096279 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:37.096989 11085 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:37.056710 15043 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:37.095252 10899 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:37.077714 15024 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:37.108065 11082 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:21:37.109201 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:37.070327 15003 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:21:37.069975 14990 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:21:37.089125 14879 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:37.112979 10974 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:37.094210 14957 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:37.120646 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:37.086207 14991 raft_consensus.cc:697] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:37.093865 14611 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:37.096937 14617 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:37.124256 11008 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 13.
I20260709 12:21:37.125273 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:37.126747 11076 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8.
W20260709 12:21:37.127707 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 80262.7us
I20260709 12:21:37.137240 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:37.100791 11652 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:37.141033 11082 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 12:21:37.142055 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:37.142575 11082 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:21:37.101948 14868 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:21:37.145190 11624 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:37.145987 14868 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:37.146140 11624 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:37.146903 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:37.147490 14683 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:37.148008 14683 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.148487 14683 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:37.131358 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:37.131886 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:37.151427 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:37.151813 10927 raft_consensus.cc:2393] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 8: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:37.152815 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:37.153719 10928 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:37.154106 10927 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:37.131335 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:37.155001 10936 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:37.156286 15031 log.cc:927] Time spent T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.657s	user 0.007s	sys 0.010s
W20260709 12:21:37.157002 15029 log.cc:927] Time spent T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.675s	user 0.001s	sys 0.003s
I20260709 12:21:37.096825 14826 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.159829 14826 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:37.125926 14761 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:37.160835 14761 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.161206 14761 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:37.166206 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:37.166934 11081 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:37.125351 14752 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:21:37.139144 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:37.130857 15057 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.171617 15057 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:37.130167 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 285387us
I20260709 12:21:37.148198 15045 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:21:37.120172 14879 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.133735 15032 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:37.171808 10936 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:21:37.179004 15032 raft_consensus.cc:697] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:37.180059 15032 consensus_queue.cc:237] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.148139 14945 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:37.181028 11050 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:37.181571 14998 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.241895 14998 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.242682 14945 raft_consensus.cc:697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:37.173839 11082 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:37.243651 14945 consensus_queue.cc:237] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:37.244589 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:37.245338 11082 raft_consensus.cc:2393] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 10: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:37.241798 15003 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:37.245954 15003 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:37.246268 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:37.246882 11082 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:37.247748 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:37.248425 11082 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:37.249893 15003 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:37.251629 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:37.182621 14683 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:37.110476 15043 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:37.253333 10974 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:37.253896 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:37.254084 14683 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:37.254528 11083 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:37.254763 15043 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:37.088869 15049 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:37.255427 14826 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:37.255846 14826 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.256237 14826 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:37.257030 15049 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:37.127954 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:37.185957 14617 raft_consensus.cc:697] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:37.258627 11076 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:21:37.174690 15057 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:37.178347 14879 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:37.139050 14994 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:21:37.147617 11011 raft_consensus.cc:2368] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15.
I20260709 12:21:37.094602 15006 consensus_queue.cc:1059] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 12:21:37.146554 14868 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:37.198976 14949 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:37.236119 11081 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:37.240527 10928 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:21:37.241122 10930 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 7: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:37.108560 14872 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:37.258507 11085 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 6.
I20260709 12:21:37.274717 11082 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:21:37.295127 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:37.298838 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:37.302641 11083 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
W20260709 12:21:37.299023 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 118145us
I20260709 12:21:37.303035 11078 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:37.302439 10974 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:37.258129 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:37.300704 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:37.306066 11081 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:37.298835 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:37.312270 11622 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:37.313301 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:37.314031 11050 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:37.318977 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:37.317502 11659 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:37.319615 11085 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:37.322243 11622 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:37.329810 10899 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:37.331234 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:37.331914 10936 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:37.304418 14952 raft_consensus.cc:3055] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:37.334259 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:37.335034 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:37.339308 11081 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:37.341804 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:37.342425 11010 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:37.344489 10936 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:21:37.351164 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:37.344429 14633 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:21:37.354848 14752 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:37.337342 14952 raft_consensus.cc:740] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:37.357614 11050 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:37.359995 14988 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.360769 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:37.361723 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:37.390595 11085 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:21:37.340909 15048 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:37.365453 14683 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:37.396968 14683 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.398545 14761 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.400734 14761 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:37.401298 11652 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:37.401433 14868 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:37.402212 14880 raft_consensus.cc:2764] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:21:37.403045 14879 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:37.411633 14879 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:37.362387 14962 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:37.317663 14948 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.369239 11083 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12. Ops: [10.6-11.7]
I20260709 12:21:37.345593 14982 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:37.374024 15057 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:37.395290 10927 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 7: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:37.325474 14617 consensus_queue.cc:237] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:37.404343 14952 consensus_queue.cc:260] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.405236 10900 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:37.374152 14984 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:37.337620 14991 consensus_queue.cc:237] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.398073 14988 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:37.409303 15060 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.346606 15055 raft_consensus.cc:2764] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:21:37.440006 14982 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:37.412211 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 54653.8us
I20260709 12:21:37.415069 11051 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:37.440491 15060 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.443626 11051 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:37.437770 15057 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.444782 15043 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:37.445261 15043 raft_consensus.cc:697] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:37.445994 15057 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:37.446462 14948 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:37.446137 15043 consensus_queue.cc:237] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.447048 14869 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:37.447430 15060 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:37.447568 14869 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.448014 15011 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:37.449432 14982 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:37.449540 14869 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:37.412844 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 60794.1us
W20260709 12:21:37.450445 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 128269us
I20260709 12:21:37.398476 14683 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:37.420449 11085 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
I20260709 12:21:37.452320 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:37.452852 11085 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:21:37.453112 14517 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:37.367132 11010 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
I20260709 12:21:37.458140 11050 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:37.442325 10935 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:37.451040 10899 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:37.461454 10899 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:37.462294 10899 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:37.463449 10899 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:37.450343 14952 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:37.435048 11083 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:21:37.456379 14879 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:21:37.439324 14984 raft_consensus.cc:697] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:37.468832 14984 consensus_queue.cc:237] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.431924 14826 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.441885 14766 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:37.473809 14826 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:37.442073 15048 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:37.431881 14962 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:37.474586 14962 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:37.456771 14949 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:37.450102 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:37.475657 11050 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:37.441720 14988 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:37.474152 11622 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
W20260709 12:21:37.414752 14746 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.018s	user 0.023s	sys 0.016s
W20260709 12:21:37.423776 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 99100.3us
I20260709 12:21:37.477872 10899 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:37.481581 14766 raft_consensus.cc:697] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:37.486928 11050 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:37.497851 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 195505us
I20260709 12:21:37.487396 14633 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:37.498780 11050 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:37.481891 14746 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.088s	user 0.024s	sys 0.016s
W20260709 12:21:37.500303 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 62006.6us
I20260709 12:21:37.487146 14517 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:37.487519 14635 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:37.487273 14948 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:37.486794 14879 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:37.492357 15024 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:37.524619 11050 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:37.519596 10899 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:37.537843 11050 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:37.538892 15033 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:37.537846 15045 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:37.501837 14974 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:37.501664 14752 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:37.539844 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:37.503144 14633 raft_consensus.cc:697] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:37.508538 14517 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:37.560384 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 179528us
I20260709 12:21:37.560810 14517 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:37.543452 14879 raft_consensus.cc:697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:37.562573 14879 consensus_queue.cc:237] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:37.562963 14994 consensus_queue.cc:1059] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:37.564014 14994 consensus_queue.cc:1059] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:37.564818 15006 raft_consensus.cc:3055] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:37.565150 15006 raft_consensus.cc:740] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:37.565111 15032 raft_consensus.cc:3055] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:37.565992 15006 consensus_queue.cc:260] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.566561 15032 raft_consensus.cc:740] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:37.544378 15033 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:37.534588 14948 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.501649 14746 raft_consensus.cc:697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:37.545293 14885 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.569928 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:37.570407 14885 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:37.546522 10899 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:37.569947 14948 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:37.573061 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:37.586570 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:37.587260 11076 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:37.593622 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:37.502660 14988 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:21:37.546957 11050 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:37.542714 11085 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
I20260709 12:21:37.497264 14869 consensus_queue.cc:1059] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:21:37.546737 15067 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:37.572992 11003 raft_consensus.cc:3055] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:37.574414 14746 consensus_queue.cc:237] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.544816 14635 raft_consensus.cc:697] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:21:37.630909 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 84453.1us
I20260709 12:21:37.567404 15032 consensus_queue.cc:260] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.590936 15006 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:37.652699 11622 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:37.655462 11007 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 4. (term mismatch)
W20260709 12:21:37.655923 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 109081us
I20260709 12:21:37.594326 15073 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.657603 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:37.682293 11004 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:37.658054 11003 raft_consensus.cc:740] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:37.663633 10974 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:37.556105 14752 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:21:37.683524 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.564363 14766 consensus_queue.cc:237] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:37.666814 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:37.655172 15055 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:37.678798 11007 pending_rounds.cc:85] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 3
I20260709 12:21:37.691241 11007 pending_rounds.cc:107] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 9.4
I20260709 12:21:37.691556 11007 raft_consensus.cc:2889] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:37.692276 11002 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:21:37.667248 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:37.675014 11076 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:21:37.679337 11050 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:37.688596 11011 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:37.657795 14973 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:37.683542 11003 consensus_queue.cc:260] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.657591 15033 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.657496 15067 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.683629 15048 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:37.701668 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:37.703804 11050 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:37.710662 11003 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:37.710690 14617 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:37.697355 11004 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:21:37.686381 14752 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:37.689078 14684 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:37.722298 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:37.729223 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:37.705793 15032 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:37.714720 15067 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:37.688231 15073 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.756822 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:37.765409 11011 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:37.767800 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:37.747001 14684 raft_consensus.cc:697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:37.697980 14633 consensus_queue.cc:237] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.714923 15033 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.753233 14988 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:37.747002 15060 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:37.730924 14962 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.800215 11004 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:37.764986 15048 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:37.802928 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.789368 14991 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.790720 15024 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:37.817246 11081 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:21:37.807844 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:37.876284 11009 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:37.818449 11008 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:21:37.747603 14635 consensus_queue.cc:237] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:37.832293 15075 log.cc:927] Time spent T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:21:37.805938 15056 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.844245 14684 consensus_queue.cc:237] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:37.802301 15078 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.792352 14683 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:37.878332 14991 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.804952 15060 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:37.912679 15086 log.cc:927] Time spent T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:21:37.912977 14962 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:37.889483 14872 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:21:37.944989 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:37.946684 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:37.947122 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:37.944985 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:37.809603 14988 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.946067 15060 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:37.953588 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:37.954453 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:37.956169 10931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2504) took 1482 ms. Trace:
I20260709 12:21:37.952968 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:37.953660 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:37.982910 10932 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:37.983969 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:37.984282 11004 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:37.984819 11003 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:37.987979 15072 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:37.988545 15072 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:37.976943 10931 rpcz_store.cc:276] 0709 12:21:36.463726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.496042 (+ 32316us) service_pool.cc:224] Handling call
0709 12:21:37.575888 (+1079846us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b5800002d98. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f39fc0 00007f9bb5f24929 00007f9bb5f243d2 00007f9baf49bbd4
0709 12:21:37.576091 (+   203us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:37.576468 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:37.576496 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:37.593383 (+ 16887us) log.cc:844] Serialized 52 byte log entry
0709 12:21:37.693869 (+100486us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:37.693991 (+   122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.694054 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:37.914706 (+220652us) raft_consensus.cc:1685] finished
0709 12:21:37.914731 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:37.945673 (+ 30942us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31064,"raft.queue_time_us":9194,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":59146,"spinlock_wait_cycles":8668032,"thread_start_us":25383,"threads_started":1,"wal-append.queue_time_us":106083}
W20260709 12:21:37.990090 15079 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.284s	user 0.002s	sys 0.000s
I20260709 12:21:37.990890 15072 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:37.988858 15093 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:37.996250 15033 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:37.996568 11003 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:21:37.998831 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:37.996802 15082 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
I20260709 12:21:37.915058 15056 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:37.963591 14984 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:21:38.045463 14991 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:38.047938 14988 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:38.049746 14683 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:38.052601 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:38.053267 11083 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:21:38.055153 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:38.034090 14962 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:37.950996 15078 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:38.052754 15083 log.cc:927] Time spent T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:21:38.095925 15070 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:38.101378 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:38.103819 15011 raft_consensus.cc:3055] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:38.106290 14866 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:38.085058 15091 log.cc:927] Time spent T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:21:38.096310 15024 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.114449 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:38.138381 11003 raft_consensus.cc:2393] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 7: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:21:38.125710 15052 log.cc:927] Time spent T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.929s	user 0.000s	sys 0.005s
I20260709 12:21:38.004762 15093 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:38.063784 14962 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:38.129355 15011 raft_consensus.cc:740] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:38.132402 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:38.144925 11008 raft_consensus.cc:2410] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:21:38.132906 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2749) took 1009 ms. Trace:
I20260709 12:21:38.146522 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2608) took 1481 ms. Trace:
I20260709 12:21:38.145287 11078 rpcz_store.cc:276] 0709 12:21:37.123386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.303630 (+180244us) service_pool.cc:224] Handling call
0709 12:21:37.317419 (+ 13789us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:37.326035 (+  8616us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:37.352299 (+ 26264us) log.cc:844] Serialized 14 byte log entry
0709 12:21:37.456839 (+104540us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:37.457286 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 12:21:37.457424 (+   138us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:37.457624 (+   200us) log.cc:844] Serialized 14 byte log entry
0709 12:21:37.460596 (+  2972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.460674 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:38.132694 (+672020us) raft_consensus.cc:1685] finished
0709 12:21:38.132713 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:38.132846 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28867,"prepare.queue_time_us":15986,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":2216,"raft.queue_time_us":38676,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":12873,"thread_start_us":86188,"threads_started":1,"wal-append.queue_time_us":157892}
I20260709 12:21:38.148617 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:38.152240 11078 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:38.146943 11084 rpcz_store.cc:276] 0709 12:21:36.665289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.665452 (+   163us) service_pool.cc:224] Handling call
0709 12:21:36.665804 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:36.865746 (+199942us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:36.866096 (+   350us) log.cc:844] Serialized 14 byte log entry
0709 12:21:37.080413 (+214317us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:37.085765 (+  5352us) log.cc:844] Serialized 26 byte log entry
0709 12:21:37.085900 (+   135us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:37.085931 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.085999 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:38.124098 (+1038099us) spinlock_profiling.cc:243] Waited 63.1 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:38.146214 (+ 22116us) raft_consensus.cc:1685] finished
0709 12:21:38.146354 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:38.146468 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21931,"prepare.queue_time_us":169,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":165523,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":31346,"spinlock_wait_cycles":145224448,"thread_start_us":391632,"threads_started":2,"wal-append.queue_time_us":252132}
I20260709 12:21:38.154500 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:38.162004 11009 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
W20260709 12:21:38.232307 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.155124 11084 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
W20260709 12:21:38.315690 14517 consensus_meta.cc:287] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.754s	user 0.004s	sys 0.008s
I20260709 12:21:38.316478 14517 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:38.318936 14948 consensus_meta.cc:287] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.746s	user 0.007s	sys 0.007s
I20260709 12:21:38.322027 15078 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:38.324613 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 168448us
I20260709 12:21:38.326151 10899 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:38.151082 15024 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:38.145040 15011 consensus_queue.cc:260] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:38.159736 15056 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:38.360713 14611 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:38.361485 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:38.363710 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2747) took 2252 ms. Trace:
I20260709 12:21:38.113508 15073 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:38.414697 14611 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:38.415241 14611 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:38.415437 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:38.418121 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:38.409696 11080 rpcz_store.cc:276] 0709 12:21:36.111459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.180963 (+ 69504us) service_pool.cc:224] Handling call
0709 12:21:36.181195 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:37.030981 (+849786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.363420 (+1332439us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b54001a4fd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:38.363614 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1808556928}
I20260709 12:21:38.143659 15093 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:38.429363 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2624) took 1135 ms. Trace:
I20260709 12:21:38.438685 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:38.439674 11080 raft_consensus.cc:2410] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:21:38.435747 11079 rpcz_store.cc:276] 0709 12:21:37.294415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.429781 (+135366us) service_pool.cc:224] Handling call
0709 12:21:37.430056 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:37.437848 (+  7792us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:37.437884 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:37.456139 (+ 18255us) log.cc:844] Serialized 26 byte log entry
0709 12:21:37.554997 (+ 98858us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:37.555037 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.555111 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:38.429131 (+874020us) raft_consensus.cc:1685] finished
0709 12:21:38.429152 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:38.429297 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10668,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":77,"thread_start_us":98482,"threads_started":1,"wal-append.queue_time_us":291034}
I20260709 12:21:38.444535 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:38.446718 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.319550 14948 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:38.450260 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:38.450935 11080 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:38.451613 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:38.453310 15078 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.465745 15078 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:38.452998 15073 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:38.479339 10902 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.020s	sys 0.051s
W20260709 12:21:38.481084 11007 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.031s	sys 0.032s
I20260709 12:21:38.446357 15093 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:38.463721 15011 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:38.480067 14752 consensus_meta.cc:287] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.735s	user 0.001s	sys 0.014s
I20260709 12:21:38.464200 14517 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:38.467806 15078 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:38.483840 10902 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.020s	sys 0.051s
W20260709 12:21:38.484287 11007 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.032s	sys 0.032s
I20260709 12:21:38.507474 11078 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:38.510548 10899 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:38.506492 14879 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.026s	sys 0.059s
W20260709 12:21:38.524207 10977 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.009s	sys 0.059s
W20260709 12:21:38.529417 10977 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.009s	sys 0.059s
W20260709 12:21:38.529666 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 705092us
I20260709 12:21:38.533845 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:38.534617 11081 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2762) took 1034 ms. Trace:
I20260709 12:21:38.533248 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:38.537549 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:38.539673 10936 raft_consensus.cc:1240] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:21:38.484730 15073 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:38.543262 10932 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:38.546841 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:38.542109 15097 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:21:38.528528 14879 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.026s	sys 0.059s
I20260709 12:21:38.544688 10930 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:38.501017 14752 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:38.535032 11081 rpcz_store.cc:276] 0709 12:21:37.500077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.655455 (+155378us) service_pool.cc:224] Handling call
0709 12:21:38.534443 (+878988us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54000dff54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:38.534557 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298241408}
W20260709 12:21:38.548339 10975 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.017s	sys 0.038s
W20260709 12:21:38.551200 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:38.543005 10974 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.025s	sys 0.065s
I20260709 12:21:38.494812 15093 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:38.526540 15049 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.551947 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:38.557394 10936 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:21:38.560155 10974 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.025s	sys 0.065s
W20260709 12:21:38.559412 10975 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.017s	sys 0.038s
W20260709 12:21:38.576936 11085 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.883s	user 0.021s	sys 0.048s
W20260709 12:21:38.577421 11085 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.021s	sys 0.049s
I20260709 12:21:38.586484 10929 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:38.588140 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:38.588500 11081 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:38.588894 11078 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:38.545629 11011 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.027s	sys 0.021s
I20260709 12:21:38.555723 14948 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:38.592003 11011 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.028s	sys 0.021s
I20260709 12:21:38.595201 11080 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
W20260709 12:21:38.596900 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.546634 14880 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:21:38.601117 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:38.575017 15047 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:38.590781 14766 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.007s	sys 0.009s
I20260709 12:21:38.575950 15097 raft_consensus.cc:697] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:38.576188 15078 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:38.610317 15109 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:38.575382 15049 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:38.612568 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:38.644730 11081 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:38.597770 14879 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:38.620150 15102 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:38.624985 15101 log.cc:927] Time spent T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:21:38.637012 11083 consensus_meta.cc:287] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.576s	user 0.004s	sys 0.005s
W20260709 12:21:38.641149 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.584086 15064 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:38.607748 15032 consensus_meta.cc:287] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.858s	user 0.010s	sys 0.004s
I20260709 12:21:38.680753 15073 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:38.681506 15032 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:38.681898 15049 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:38.616881 14616 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:38.682928 14616 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:38.640507 14766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.008s	sys 0.009s
I20260709 12:21:38.675611 11083 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:21:38.674017 15056 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.680713 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:38.688755 11081 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
W20260709 12:21:38.675032 15006 consensus_meta.cc:287] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.993s	user 0.006s	sys 0.007s
W20260709 12:21:38.695313 11076 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.004s	sys 0.025s
W20260709 12:21:38.700011 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 86073.3us
W20260709 12:21:38.716352 11076 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.004s	sys 0.025s
W20260709 12:21:38.709241 14746 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.019s	sys 0.019s
I20260709 12:21:38.714501 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:38.606505 14982 consensus_queue.cc:1059] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:21:38.724931 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:38.725340 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:38.725997 11083 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:38.726898 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:38.686816 11050 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.962s	user 0.000s	sys 0.095s
I20260709 12:21:38.731040 11002 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
W20260709 12:21:38.731765 11050 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.000s	sys 0.095s
I20260709 12:21:38.739280 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:38.740204 11083 raft_consensus.cc:2393] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 12: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:38.743438 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:38.744567 11081 raft_consensus.cc:2410] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:21:38.750695 15108 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:38.751305 15093 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:38.646137 15078 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:38.753854 15078 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:38.754246 15067 consensus_meta.cc:287] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.962s	user 0.008s	sys 0.001s
I20260709 12:21:38.754419 15078 consensus_queue.cc:1059] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:38.755177 14752 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:38.715191 15024 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:38.677095 14879 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:38.714109 15056 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:38.757555 14879 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:38.758054 15056 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:38.761539 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:38.689509 15049 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:38.764423 10930 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:21:38.680627 15064 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:38.727730 14746 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.020s	sys 0.019s
W20260709 12:21:38.718919 14684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.016s	sys 0.024s
W20260709 12:21:38.770592 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 1.06563e+06us
I20260709 12:21:38.766919 11078 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:38.767407 10933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2155) took 1182 ms. Trace:
I20260709 12:21:38.655987 15109 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:38.771654 11050 leader_election.cc:400] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12.
I20260709 12:21:38.771492 10933 rpcz_store.cc:276] 0709 12:21:37.586374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.630633 (+ 44259us) service_pool.cc:224] Handling call
0709 12:21:37.657889 (+ 27256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:37.696373 (+ 38484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:37.696404 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:37.707614 (+ 11210us) log.cc:844] Serialized 26 byte log entry
0709 12:21:37.909492 (+201878us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:37.909528 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.909587 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:38.767169 (+857582us) raft_consensus.cc:1685] finished
0709 12:21:38.767200 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:38.767348 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38137,"raft.queue_time_us":39700,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":7950,"thread_start_us":162622,"threads_started":1,"wal-append.queue_time_us":775969}
I20260709 12:21:38.755409 15078 consensus_queue.cc:1059] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.009s
W20260709 12:21:38.779955 11010 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.018s	sys 0.019s
W20260709 12:21:38.781138 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 171868us
W20260709 12:21:38.772349 15081 log.cc:927] Time spent T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 1.015s	user 0.000s	sys 0.011s
I20260709 12:21:38.761595 15093 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:38.766830 14635 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.010s	sys 0.006s
W20260709 12:21:38.780567 11010 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.018s	sys 0.019s
W20260709 12:21:38.773157 14684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.017s	sys 0.024s
I20260709 12:21:38.688861 15102 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:38.769941 14616 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:38.795367 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:21:38.792685 14635 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.010s	sys 0.006s
I20260709 12:21:38.766140 15067 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:38.836328 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 113097us
I20260709 12:21:38.774974 15049 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:38.751319 15108 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:38.801527 11050 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:38.880389 10935 raft_consensus.cc:2368] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11.
I20260709 12:21:38.878953 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2627) took 1177 ms. Trace:
I20260709 12:21:38.756050 15097 consensus_queue.cc:237] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:38.892621 15118 log.cc:927] Time spent T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:21:38.894348 15109 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:38.888934 11079 rpcz_store.cc:276] 0709 12:21:37.700521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.464435 (+763914us) service_pool.cc:224] Handling call
0709 12:21:38.464787 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:38.465026 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:38.741347 (+276321us) log.cc:844] Serialized 14 byte log entry
0709 12:21:38.869442 (+128095us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:38.877094 (+  7652us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:38.877155 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.877776 (+   621us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:38.877927 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":362955,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":42,"raft.queue_time_us":889,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":125,"thread_start_us":380276,"threads_started":2}
I20260709 12:21:38.830799 15100 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.828576 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:38.840281 14616 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.826428 14998 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:38.897065 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:38.816720 15093 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:38.906844 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2756) took 1712 ms. Trace:
I20260709 12:21:38.914505 11077 rpcz_store.cc:276] 0709 12:21:37.194018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.375971 (+181953us) service_pool.cc:224] Handling call
0709 12:21:37.376302 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:37.376667 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:37.376695 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:37.377185 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:21:37.632469 (+255284us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:37.632512 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.632580 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:38.758169 (+1125589us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:38.890871 (+132702us) raft_consensus.cc:1685] finished
0709 12:21:38.890897 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:38.906757 (+ 15860us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1058,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":16174,"spinlock_wait_cycles":9065856,"thread_start_us":254606,"threads_started":1,"wal-append.queue_time_us":320433}
I20260709 12:21:38.925483 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:38.938784 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:38.896588 15129 raft_consensus.cc:3055] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:38.796329 15110 consensus_queue.cc:1059] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
W20260709 12:21:38.903194 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 101752us
I20260709 12:21:38.842710 14611 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:38.916630 15117 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:21:38.838922 15130 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 12:21:38.905972 15111 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:38.941023 15116 log.cc:927] Time spent T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:21:38.953761 11050 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:38.944804 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 228198us
I20260709 12:21:38.941094 15109 raft_consensus.cc:3055] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:38.962211 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:38.970970 15109 raft_consensus.cc:740] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:38.975723 11010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2777) took 1311 ms. Trace:
I20260709 12:21:38.947523 15129 raft_consensus.cc:740] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:38.976209 11010 rpcz_store.cc:276] 0709 12:21:37.664153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.664322 (+   169us) service_pool.cc:224] Handling call
0709 12:21:37.687047 (+ 22725us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:37.907593 (+220546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:37.907649 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:37.908415 (+   766us) log.cc:844] Serialized 26 byte log entry
0709 12:21:38.790630 (+882215us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:38.790673 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.790740 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:38.975508 (+184768us) raft_consensus.cc:1685] finished
0709 12:21:38.975528 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:38.975660 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":60211,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":12246,"thread_start_us":1101920,"threads_started":2,"wal-append.queue_time_us":935476}
I20260709 12:21:38.929347 14616 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:38.996780 15107 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
W20260709 12:21:39.001643 15121 log.cc:927] Time spent T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:21:39.006266 14611 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:39.016556 15108 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:39.017437 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2764) took 1331 ms. Trace:
I20260709 12:21:39.017849 11076 rpcz_store.cc:276] 0709 12:21:37.685847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.716426 (+ 30579us) service_pool.cc:224] Handling call
0709 12:21:37.716768 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:37.908972 (+192204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:37.909006 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:37.937711 (+ 28705us) log.cc:844] Serialized 26 byte log entry
0709 12:21:38.716800 (+779089us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:38.716841 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.716933 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:39.017185 (+300252us) raft_consensus.cc:1685] finished
0709 12:21:39.017210 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.017365 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":47549,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":13192,"thread_start_us":939351,"threads_started":2,"wal-append.queue_time_us":1026216}
I20260709 12:21:39.021565 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 413) took 1546 ms. Trace:
I20260709 12:21:39.021857 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:39.022229 11085 rpcz_store.cc:276] 0709 12:21:37.475046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.693538 (+218492us) service_pool.cc:224] Handling call
0709 12:21:37.693901 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:38.577842 (+883941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:38.577880 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:38.578309 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 12:21:38.777022 (+198713us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:38.777284 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.777372 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:39.021322 (+243950us) raft_consensus.cc:1685] finished
0709 12:21:39.021348 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.021502 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33372,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":15631,"thread_start_us":1071618,"threads_started":2,"wal-append.queue_time_us":349006}
I20260709 12:21:39.024021 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:39.024219 15064 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:39.024675 11085 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
W20260709 12:21:39.023663 15011 consensus_meta.cc:287] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.001s
I20260709 12:21:39.025594 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:39.026261 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 2516) took 1083 ms. Trace:
I20260709 12:21:39.026683 10935 rpcz_store.cc:276] 0709 12:21:37.942850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.943206 (+   356us) service_pool.cc:224] Handling call
0709 12:21:39.026031 (+1082825us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b540023afd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:39.026178 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2128463872}
I20260709 12:21:39.027235 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2638) took 1321 ms. Trace:
I20260709 12:21:39.027601 11085 rpcz_store.cc:276] 0709 12:21:37.706165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.026491 (+1320326us) service_pool.cc:224] Handling call
0709 12:21:39.026758 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.026930 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:39.026954 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:39.026992 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:39.027027 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.027076 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.027176 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.029125 11084 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:39.029379 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2639) took 1323 ms. Trace:
I20260709 12:21:39.033017 11080 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:38.994326 15099 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:38.997987 15111 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:39.019570 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:39.036670 15115 log.cc:927] Time spent T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
W20260709 12:21:39.032639 15060 consensus_meta.cc:287] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 1.056s	user 0.008s	sys 0.006s
I20260709 12:21:39.042376 14517 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.054590 15055 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:39.029808 11085 rpcz_store.cc:276] 0709 12:21:37.706421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.028507 (+1322086us) service_pool.cc:224] Handling call
0709 12:21:39.028825 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.029002 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:39.029029 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:39.029072 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:39.029102 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.029210 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.029325 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:39.051939 15098 log.cc:927] Time spent T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 1.058s	user 0.007s	sys 0.017s
I20260709 12:21:39.066852 11011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2789) took 1264 ms. Trace:
I20260709 12:21:39.045650 14962 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:39.059414 11076 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:39.076120 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2765) took 1324 ms. Trace:
I20260709 12:21:39.076541 11076 rpcz_store.cc:276] 0709 12:21:37.751923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.058892 (+1306969us) service_pool.cc:224] Handling call
0709 12:21:39.059211 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.075820 (+ 16609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.076063 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:38.943212 15100 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:39.064064 15066 log.cc:927] Time spent T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 1.686s	user 0.001s	sys 0.011s
I20260709 12:21:39.071051 11085 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:21:39.072604 15055 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:39.073117 15049 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:39.073563 15102 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:39.067327 11011 rpcz_store.cc:276] 0709 12:21:37.802699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.802839 (+   140us) service_pool.cc:224] Handling call
0709 12:21:37.803168 (+   329us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:37.804497 (+  1329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:37.804529 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:37.825764 (+ 21235us) log.cc:844] Serialized 52 byte log entry
0709 12:21:38.600534 (+774770us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:38.600595 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.600671 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:39.066609 (+465938us) raft_consensus.cc:1685] finished
0709 12:21:39.066631 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.066785 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":909,"raft.queue_time_us":42853,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":41109,"thread_start_us":753484,"threads_started":1,"wal-append.queue_time_us":938375}
W20260709 12:21:39.078986 15127 log.cc:927] Time spent T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:21:39.056951 15099 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:39.083418 15093 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:39.087795 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2766) took 1287 ms. Trace:
I20260709 12:21:39.085440 14616 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:39.098209 11085 rpcz_store.cc:276] 0709 12:21:37.800504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.060623 (+1260119us) service_pool.cc:224] Handling call
0709 12:21:39.060918 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.087485 (+ 26567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.087731 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.096916 15099 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:39.099761 15085 log.cc:927] Time spent T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 1.252s	user 0.004s	sys 0.006s
I20260709 12:21:39.100744 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2790) took 1281 ms. Trace:
I20260709 12:21:39.108180 11655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59414 (request call id 274) took 1932 ms. Trace:
I20260709 12:21:39.121850 14766 raft_consensus.cc:3055] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:39.122622 15055 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:39.057140 14517 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:39.159734 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:39.161387 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:39.161916 14517 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:39.074685 14335 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:39.162796 14335 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:39.165421 14335 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:39.058320 15129 consensus_queue.cc:260] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:39.166996 15129 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:39.128180 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 189438us
I20260709 12:21:39.128903 15110 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:39.131790 14946 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.132045 15078 raft_consensus.cc:3055] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:39.136615 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:39.135474 10974 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:39.137105 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:39.137300 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:39.138145 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:39.138314 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:39.170380 11003 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:39.152046 11007 rpcz_store.cc:276] 0709 12:21:37.819436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.825333 (+  5897us) service_pool.cc:224] Handling call
0709 12:21:37.825671 (+   338us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:38.523588 (+697917us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:38.523619 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:38.548946 (+ 25327us) log.cc:844] Serialized 52 byte log entry
0709 12:21:38.699670 (+150724us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:38.699722 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.699801 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:39.100520 (+400719us) raft_consensus.cc:1685] finished
0709 12:21:39.100538 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.100684 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39560,"raft.queue_time_us":166342,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":14431,"thread_start_us":745822,"threads_started":2,"wal-append.queue_time_us":394092}
I20260709 12:21:39.155910 14766 raft_consensus.cc:740] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:39.172868 11011 raft_consensus.cc:2393] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 5: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:39.173283 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:39.138926 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 46451.4us
I20260709 12:21:39.174015 10933 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
I20260709 12:21:39.061980 15060 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:39.171736 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:39.173974 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:39.180930 11011 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:39.181910 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:39.170954 11085 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:21:39.184863 10901 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:21:39.188249 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 52865.5us
I20260709 12:21:39.189082 10977 leader_election.cc:400] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11.
I20260709 12:21:39.189908 10977 leader_election.cc:403] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:39.187790 11625 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:39.172820 15110 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:39.190482 14335 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:39.176446 15143 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:39.192960 11008 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:21:39.193908 10901 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:39.191434 15143 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:39.195134 15067 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:39.172916 15078 raft_consensus.cc:740] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:39.199618 14617 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:39.202221 14617 raft_consensus.cc:697] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:39.199661 14941 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:39.190793 15110 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:39.187151 14663 consensus_queue.cc:1059] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:21:39.198330 10901 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:39.200429 10974 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:39.200634 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:39.200956 11003 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:39.199396 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:39.208638 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 301392us
I20260709 12:21:39.213581 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:39.215026 10936 raft_consensus.cc:1240] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:21:39.216310 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:39.222334 11004 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 2785) took 1480 ms (client timeout 1551 ms). Trace:
W20260709 12:21:39.222841 11004 rpcz_store.cc:269] 0709 12:21:37.726318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.726626 (+   308us) service_pool.cc:224] Handling call
0709 12:21:39.205746 (+1479120us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b540012c5d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:39.205860 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161540864}
I20260709 12:21:39.216972 10929 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:21:39.183013 14616 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:21:39.226765 10974 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:39.223654 11624 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:39.188037 15099 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:21:39.180091 14946 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:39.222518 14663 consensus_queue.cc:1243] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:39.222625 15093 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:21:39.203601 14941 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:39.198740 15070 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:39.244982 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2632) took 1542 ms. Trace:
W20260709 12:21:39.248766 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:39.254688 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:39.222829 14603 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:39.260864 14994 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:39.262338 10974 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:39.270576 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 316856us
I20260709 12:21:39.271430 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2637) took 1565 ms. Trace:
I20260709 12:21:39.269809 11078 rpcz_store.cc:276] 0709 12:21:37.702253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.777466 (+1075213us) service_pool.cc:224] Handling call
0709 12:21:38.777885 (+   419us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:38.779236 (+  1351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:38.779274 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:38.792998 (+ 13724us) log.cc:844] Serialized 52 byte log entry
0709 12:21:38.865574 (+ 72576us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:38.865624 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.865715 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:39.244705 (+378990us) raft_consensus.cc:1685] finished
0709 12:21:39.244727 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.244910 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2663,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":12649,"thread_start_us":25777,"threads_started":1,"wal-append.queue_time_us":207174}
I20260709 12:21:39.253638 14826 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:39.228003 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:39.227272 10901 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:21:39.284283 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 343605us
W20260709 12:21:39.284824 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 321207us
I20260709 12:21:39.223345 15073 consensus_queue.cc:1059] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:21:39.261502 15146 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:39.317935 10899 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:39.311687 11622 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:39.278416 15034 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.100s	user 0.015s	sys 0.007s
I20260709 12:21:39.309206 11050 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:39.341320 11050 leader_election.cc:400] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15.
I20260709 12:21:39.341696 11050 leader_election.cc:403] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 12:21:39.315168 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 87975.4us
I20260709 12:21:39.314203 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2644) took 1201 ms. Trace:
I20260709 12:21:39.550280 11085 rpcz_store.cc:276] 0709 12:21:38.112832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.313435 (+1200603us) service_pool.cc:224] Handling call
0709 12:21:39.313739 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.313913 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:39.313937 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:39.313974 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:39.314005 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.314057 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.314152 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.270324 14941 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:39.326781 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 72233.1us
W20260709 12:21:39.549575 11084 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60046 (request call id 2635) took 1844 ms (client timeout 2215 ms). Trace:
W20260709 12:21:39.555365 11084 rpcz_store.cc:269] 0709 12:21:37.705213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.415142 (+709929us) service_pool.cc:224] Handling call
0709 12:21:39.549398 (+1134256us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b540044d4d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:39.549514 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1409843072}
W20260709 12:21:39.558879 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:39.309473 11077 rpcz_store.cc:276] 0709 12:21:37.705742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.916207 (+1210465us) service_pool.cc:224] Handling call
0709 12:21:38.944910 (+ 28703us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:38.945241 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:38.945268 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:38.945711 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 12:21:39.232973 (+287262us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:39.233017 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.233093 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:39.271222 (+ 38129us) raft_consensus.cc:1685] finished
0709 12:21:39.271240 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.271372 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4054,"raft.queue_time_us":1636,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":25708,"thread_start_us":262372,"threads_started":1,"wal-append.queue_time_us":282898}
I20260709 12:21:39.201323 15078 consensus_queue.cc:260] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:39.415489 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:39.564292 11078 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 5.
I20260709 12:21:39.439424 15111 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.440063 15011 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15.
I20260709 12:21:39.440368 15024 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:21:39.439478 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 98293.8us
I20260709 12:21:39.570034 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:39.571492 11077 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
W20260709 12:21:39.340310 15034 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.162s	user 0.015s	sys 0.008s
I20260709 12:21:39.325816 14603 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:39.572793 11082 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:21:39.158077 11655 rpcz_store.cc:276] 0709 12:21:37.175597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.175870 (+   273us) service_pool.cc:224] Handling call
0709 12:21:37.176221 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:37.176607 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:37.176639 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:37.177186 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 12:21:37.294144 (+116958us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:37.295997 (+  1853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.300814 (+  4817us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:39.057073 (+1756259us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:39.093088 (+ 36015us) raft_consensus.cc:1685] finished
0709 12:21:39.093116 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.108078 (+ 14962us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1313,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":11992448,"thread_start_us":116376,"threads_started":1,"wal-append.queue_time_us":156807}
I20260709 12:21:39.342489 15055 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:39.553185 15045 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:39.339639 14949 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:39.574484 15045 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:39.574620 14949 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:39.447335 15158 log.cc:927] Time spent T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:21:39.576778 15045 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:39.461885 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2636) took 1756 ms. Trace:
I20260709 12:21:39.460943 14946 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:39.493268 15100 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:39.578476 11079 rpcz_store.cc:276] 0709 12:21:37.705511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.905731 (+1200220us) service_pool.cc:224] Handling call
0709 12:21:38.906071 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:38.923591 (+ 17520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:38.923626 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:38.947288 (+ 23662us) log.cc:844] Serialized 26 byte log entry
0709 12:21:39.275204 (+327916us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:39.275251 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.275333 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:39.461654 (+186321us) raft_consensus.cc:1685] finished
0709 12:21:39.461675 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.461823 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22383,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":3896,"thread_start_us":289058,"threads_started":1,"wal-append.queue_time_us":498044}
I20260709 12:21:39.485999 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:39.578289 14949 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:39.494340 15060 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:39.418340 15040 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:39.580010 11652 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:39.493929 14973 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.581027 14973 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:39.583287 14973 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:39.525851 11007 raft_consensus.cc:2410] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:21:39.520692 15143 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:39.532707 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 270435us
I20260709 12:21:39.547076 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:39.206386 14617 consensus_queue.cc:237] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:39.547942 14885 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:39.511732 14974 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:39.585983 14974 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:39.588426 14974 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:39.553838 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:39.589397 11651 raft_consensus.cc:2410] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:21:39.314145 15131 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:39.590245 15131 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:39.590726 15108 consensus_queue.cc:1175] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" responder_term: 11 status { last_received { term: 11 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 11 index: 9 } }
I20260709 12:21:39.591614 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:39.592752 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:39.590623 15131 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:39.593737 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:39.577922 15006 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:39.620349 15006 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:39.595794 11079 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:39.585086 10974 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:39.551653 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:39.481011 15146 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:21:39.634202 15162 log.cc:927] Time spent T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:21:39.623426 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:39.623685 10974 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:39.625007 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:39.628507 15006 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:39.629714 15060 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:39.568034 14984 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.569418 15129 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:39.636364 11084 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:39.637322 15146 raft_consensus.cc:697] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:39.646677 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 417) took 1493 ms. Trace:
I20260709 12:21:39.647364 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:39.597060 15111 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:39.638176 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 209602us
I20260709 12:21:39.638974 10974 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:39.552609 14766 consensus_queue.cc:260] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:39.639747 11085 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 5.
I20260709 12:21:39.624068 15024 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:39.643092 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:39.647644 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:39.647101 11078 rpcz_store.cc:276] 0709 12:21:38.152975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.638831 (+1485856us) service_pool.cc:224] Handling call
0709 12:21:39.646167 (+  7336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.646364 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:39.646390 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:39.646433 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:39.646465 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.646516 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.646619 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.565910 14826 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:39.651711 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 75155.6us
I20260709 12:21:39.653657 10974 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:39.641758 15060 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:39.642872 14998 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:39.657553 11077 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:21:39.659693 10974 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:39.655934 15143 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:39.697078 15143 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:39.697505 15143 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:39.698438 15111 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:39.649472 15040 raft_consensus.cc:697] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:21:39.714496 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 169714us
I20260709 12:21:39.716233 10899 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:39.648341 14984 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:39.722314 11084 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:39.662932 15006 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:39.662649 14998 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.663306 15060 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:39.696113 14766 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:39.649688 15129 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:39.699520 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:39.733050 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2642) took 1783 ms. Trace:
I20260709 12:21:39.813827 11076 rpcz_store.cc:276] 0709 12:21:37.950113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.077431 (+1127318us) service_pool.cc:224] Handling call
0709 12:21:39.077743 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:39.078136 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:39.078164 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:39.150689 (+ 72525us) log.cc:844] Serialized 26 byte log entry
0709 12:21:39.288774 (+138085us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:39.288832 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.290551 (+  1719us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:39.487157 (+196606us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b4800210cd8. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb5e89aa1 00007f9bb5e80b37 00007f9bb5e809ca 00007f9bb5f7826f 00007f9bb5f77f37 00007f9bb5f8c55c 00007f9bb5f8c508 00007f9bb5f8c488 00007f9bb5f8c443 00007f9bb5f8b6ec 00007f9bb4eb5a96
0709 12:21:39.717032 (+229875us) raft_consensus.cc:1685] finished
0709 12:21:39.717055 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.732971 (+ 15916us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":134,"raft.run_cpu_time_us":1252,"raft.run_wall_time_us":401269,"spinlock_wait_cycles":5304576,"thread_start_us":137676,"threads_started":1,"wal-append.queue_time_us":376796}
I20260709 12:21:39.816058 11076 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:21:39.816701 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2772) took 1115 ms. Trace:
I20260709 12:21:39.733310 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 418) took 1283 ms. Trace:
I20260709 12:21:39.723392 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:39.817296 10977 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:39.693719 14994 raft_consensus.cc:697] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:21:39.771927 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 112298us
I20260709 12:21:39.663762 14826 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:39.819567 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 103723us
I20260709 12:21:39.831755 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 419) took 1344 ms. Trace:
W20260709 12:21:39.819427 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 169330us
I20260709 12:21:39.817019 11076 rpcz_store.cc:276] 0709 12:21:38.701166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.815384 (+1114218us) service_pool.cc:224] Handling call
0709 12:21:39.815690 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.816450 (+   760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.816637 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.819063 10974 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:39.836126 10901 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:39.837420 11076 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:39.821341 11078 rpcz_store.cc:276] 0709 12:21:38.449917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.657087 (+1207170us) service_pool.cc:224] Handling call
0709 12:21:39.695577 (+ 38490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.732933 (+ 37356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:39.732962 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:39.733002 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:39.733032 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.733094 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.733237 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36999,"raft.queue_time_us":39075,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":50304}
I20260709 12:21:39.732393 14998 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:39.819252 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 47423.6us
I20260709 12:21:39.834779 11077 rpcz_store.cc:276] 0709 12:21:38.487238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.732626 (+1245388us) service_pool.cc:224] Handling call
0709 12:21:39.830912 (+ 98286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.831251 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:39.831279 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:39.831404 (+   125us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:39.831455 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.831527 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.831671 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1056}
I20260709 12:21:39.873683 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2773) took 1172 ms. Trace:
W20260709 12:21:39.874120 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 55132.4us
I20260709 12:21:39.875801 10974 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:39.877369 10974 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:39.879087 10974 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:39.882684 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 43726.4us
I20260709 12:21:39.885002 10899 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:39.886564 10901 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:39.818383 15152 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.841640 15006 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:39.875329 15144 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:39.874188 11076 rpcz_store.cc:276] 0709 12:21:38.701504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.836911 (+1135407us) service_pool.cc:224] Handling call
0709 12:21:39.837233 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.873222 (+ 35989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.873614 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.878589 14335 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:39.880007 15036 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:21:39.887601 15167 log.cc:927] Time spent T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
W20260709 12:21:39.924978 15165 log.cc:927] Time spent T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.356s	user 0.001s	sys 0.000s
I20260709 12:21:39.985925 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:39.836897 15170 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:39.919361 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:39.922092 11006 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:21:39.918977 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:39.915967 10929 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:39.920579 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:39.928763 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:39.929442 10935 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.006s	sys 0.013s
W20260709 12:21:40.043612 10935 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.006s	sys 0.013s
I20260709 12:21:39.963347 15036 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.917405 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:39.820959 15056 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:39.889796 14990 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:39.647116 15146 consensus_queue.cc:237] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:40.017601 15071 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.018s	sys 0.054s
I20260709 12:21:39.917299 15172 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:39.887893 15040 consensus_queue.cc:237] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:39.910791 15152 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:40.028649 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 487418us
I20260709 12:21:39.916653 15173 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:40.035225 11004 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 6.
I20260709 12:21:39.964790 11077 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:40.121142 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2654) took 1181 ms. Trace:
I20260709 12:21:40.121505 11077 rpcz_store.cc:276] 0709 12:21:38.940214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.889884 (+949670us) service_pool.cc:224] Handling call
0709 12:21:39.930706 (+ 40822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:40.120903 (+190197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.121089 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:39.926640 15006 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.914302 14635 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:21:40.062067 11002 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 2783) took 2335 ms (client timeout 1754 ms). Trace:
I20260709 12:21:39.978865 10927 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:21:40.104928 10976 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.026s	sys 0.101s
I20260709 12:21:39.914960 15095 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:40.125049 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:40.059157 15036 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:40.119201 14683 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.009s	sys 0.035s
W20260709 12:21:40.075137 15071 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.018s	sys 0.055s
I20260709 12:21:40.132634 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:40.104399 15167 log.cc:927] Time spent T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
W20260709 12:21:40.136227 11002 rpcz_store.cc:269] 0709 12:21:37.701170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.701377 (+   207us) service_pool.cc:224] Handling call
0709 12:21:40.036729 (+2335352us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b540029c2d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:40.036877 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2227030912}
W20260709 12:21:40.136631 10976 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.026s	sys 0.101s
I20260709 12:21:40.147585 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:40.166807 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:40.130152 11080 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.947s	user 0.004s	sys 0.033s
I20260709 12:21:39.975572 14994 consensus_queue.cc:237] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:40.169013 11080 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.005s	sys 0.034s
I20260709 12:21:40.119220 15024 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:40.172022 11077 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:40.127094 15173 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:21:40.159087 15093 consensus_meta.cc:287] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.892s	user 0.000s	sys 0.010s
I20260709 12:21:40.178360 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2780) took 1043 ms. Trace:
I20260709 12:21:40.179148 11077 rpcz_store.cc:276] 0709 12:21:39.134910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.122403 (+987493us) service_pool.cc:224] Handling call
0709 12:21:40.167423 (+ 45020us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:40.174466 (+  7043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.178279 (+  3813us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:40.163767 14683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.010s	sys 0.035s
I20260709 12:21:40.054932 15170 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:40.136467 15006 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:40.077800 15056 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:40.182952 15166 log.cc:927] Time spent T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 12:21:40.183772 15182 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:40.184245 15093 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11.
I20260709 12:21:40.185245 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 2808) took 1052 ms. Trace:
I20260709 12:21:40.224220 11007 rpcz_store.cc:276] 0709 12:21:39.132959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.171493 (+ 38534us) service_pool.cc:224] Handling call
0709 12:21:40.185023 (+1013530us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b54002d9454. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:40.185180 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":792855808}
I20260709 12:21:40.180425 15173 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:40.165908 15164 log.cc:927] Time spent T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:21:40.141762 15095 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:40.143918 14990 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:21:40.173269 15181 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:40.206723 14826 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:40.133253 15175 consensus_queue.cc:1059] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
W20260709 12:21:40.211625 15163 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.373s	user 0.001s	sys 0.000s
W20260709 12:21:40.204425 15110 consensus_meta.cc:287] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 1.001s	user 0.010s	sys 0.001s
I20260709 12:21:40.239985 15170 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:40.212001 15129 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:40.264531 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 385483us
I20260709 12:21:40.271144 10974 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:40.237545 15095 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:40.254236 15175 consensus_queue.cc:1243] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 1abf4b385a2b493ab83f593a1f8c9cd1 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:21:40.264017 11077 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 12:21:40.304352 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 396963us
I20260709 12:21:40.306278 11011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2809) took 1173 ms. Trace:
I20260709 12:21:40.226357 15172 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:40.252818 10901 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.754s (SENT) [suppressed 19 similar messages]
I20260709 12:21:40.241019 15181 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:40.278723 10974 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:40.310770 11077 raft_consensus.cc:1240] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
W20260709 12:21:40.313019 15176 log.cc:927] Time spent T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
W20260709 12:21:40.313046 11036 heartbeater.cc:646] Failed to heartbeat to 127.9.131.126:46265 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.9.131.126:46265 timed out after 15.000s (SENT)
I20260709 12:21:40.326972 10933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2540) took 1114 ms. Trace:
I20260709 12:21:40.327400 10933 rpcz_store.cc:276] 0709 12:21:39.212574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.215921 (+  3347us) service_pool.cc:224] Handling call
0709 12:21:39.261051 (+ 45130us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:39.266055 (+  5004us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:39.266091 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:39.269305 (+  3214us) log.cc:844] Serialized 52 byte log entry
0709 12:21:39.701559 (+432254us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:39.701813 (+   254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.701881 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:40.326731 (+624850us) raft_consensus.cc:1685] finished
0709 12:21:40.326753 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:40.326906 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":139,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":4071,"thread_start_us":283379,"threads_started":1,"wal-append.queue_time_us":563237}
W20260709 12:21:40.264205 11085 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.020s	sys 0.018s
I20260709 12:21:40.328406 11077 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
W20260709 12:21:40.468855 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 156430us
W20260709 12:21:40.479681 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 169561us
W20260709 12:21:40.481953 10900 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.009s	sys 0.036s
I20260709 12:21:40.261356 15110 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:40.308441 15112 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:40.265308 15170 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:40.229079 15182 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:40.310540 15181 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:40.484994 15164 log.cc:927] Time spent T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 12:21:40.307757 10899 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:40.495826 10900 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.010s	sys 0.037s
I20260709 12:21:40.495699 11077 pending_rounds.cc:85] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 8
I20260709 12:21:40.525205 11077 pending_rounds.cc:107] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:21:40.525592 11077 raft_consensus.cc:2889] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:40.526365 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2658) took 1203 ms. Trace:
I20260709 12:21:40.526679 11077 rpcz_store.cc:276] 0709 12:21:39.322988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.311733 (+988745us) service_pool.cc:224] Handling call
0709 12:21:40.328046 (+ 16313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:40.526069 (+198023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.526303 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:40.528543 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:40.495746 11085 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.022s	sys 0.020s
I20260709 12:21:40.504315 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:40.505915 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:40.532794 11002 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
W20260709 12:21:40.537590 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 229971us
W20260709 12:21:40.543057 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.542274 11010 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 7: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:40.554774 10900 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:40.514004 14990 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:40.558619 15053 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:40.559623 14994 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:40.560374 14962 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:40.561120 14994 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:40.561734 14994 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:40.561420 15053 raft_consensus.cc:697] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:40.471709 15172 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:40.567845 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:40.570449 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:40.572467 10927 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:40.572381 10931 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:21:40.541121 15056 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:40.581398 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:40.556740 15060 consensus_meta.cc:287] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.738s	user 0.010s	sys 0.001s
I20260709 12:21:40.578457 10930 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16. Ops: [14.8-15.9]
I20260709 12:21:40.582065 10935 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:40.584288 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:40.541901 15177 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:21:40.570272 15180 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
I20260709 12:21:40.595059 14826 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:40.596091 14826 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:40.589932 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.563846 14994 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:40.541185 15170 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:40.563665 15053 consensus_queue.cc:237] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:40.606199 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:40.764765 10935 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 7.
W20260709 12:21:40.771986 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 519171us
I20260709 12:21:40.582947 14990 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:40.651593 15179 log.cc:927] Time spent T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.414s	user 0.001s	sys 0.001s
W20260709 12:21:40.771456 15185 log.cc:927] Time spent T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.495s	user 0.000s	sys 0.001s
W20260709 12:21:40.772573 14998 consensus_meta.cc:287] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.892s	user 0.019s	sys 0.000s
W20260709 12:21:40.688273 15073 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.259s	user 0.021s	sys 0.028s
I20260709 12:21:40.588882 15060 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:40.755509 15097 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:40.771692 15144 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:40.616889 15143 consensus_meta.cc:287] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.919s	user 0.008s	sys 0.005s
I20260709 12:21:40.775092 14868 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.728631 14962 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:40.723062 15188 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:40.774394 14684 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:40.650606 15172 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:40.783950 15152 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:40.613121 15095 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:40.795380 15073 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.376s	user 0.021s	sys 0.037s
I20260709 12:21:40.613684 14994 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:40.614202 15177 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:40.805754 14941 consensus_meta.cc:287] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 1.237s	user 0.016s	sys 0.003s
W20260709 12:21:40.821753 15183 log.cc:927] Time spent T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
W20260709 12:21:40.828236 15131 consensus_meta.cc:287] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 1.234s	user 0.010s	sys 0.002s
I20260709 12:21:40.788349 14990 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:40.796896 14998 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:40.832162 15191 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 12:21:40.831457 14826 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:40.820307 15143 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:40.803776 15097 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:40.821517 14868 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:40.851888 14868 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:40.832921 14962 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:40.856562 14962 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:40.857304 14998 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:40.845165 15187 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 12:21:40.846139 15110 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:40.846704 15195 log.cc:927] Time spent T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 12:21:40.863785 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:40.864426 14868 consensus_queue.cc:1059] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:40.837775 14994 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:40.867264 15186 log.cc:927] Time spent T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 12:21:40.867534 15006 consensus_meta.cc:287] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.649s	user 0.010s	sys 0.000s
I20260709 12:21:40.868016 15112 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:40.808893 15144 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:40.869266 14990 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:40.847494 15182 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:40.835839 14684 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:40.840608 14941 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:40.886475 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41098 (request call id 297) took 1002 ms. Trace:
I20260709 12:21:40.886919 11009 rpcz_store.cc:276] 0709 12:21:39.884174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.884294 (+   120us) service_pool.cc:224] Handling call
0709 12:21:39.908962 (+ 24668us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:39.909224 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:39.909249 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:39.915375 (+  6126us) log.cc:844] Serialized 26 byte log entry
0709 12:21:40.171987 (+256612us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:40.172022 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.172093 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:40.886215 (+714122us) raft_consensus.cc:1685] finished
0709 12:21:40.886239 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:40.886405 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":253557,"threads_started":1,"wal-append.queue_time_us":414815}
W20260709 12:21:40.883459 15036 consensus_meta.cc:287] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.713s	user 0.005s	sys 0.005s
I20260709 12:21:40.892688 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:40.896136 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:40.897076 15097 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:40.897979 15170 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:40.899117 15095 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:40.843818 15131 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:40.907640 11003 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:40.909807 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2751) took 3785 ms. Trace:
I20260709 12:21:40.910640 11082 rpcz_store.cc:276] 0709 12:21:37.124083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.304956 (+180873us) service_pool.cc:224] Handling call
0709 12:21:37.314608 (+  9652us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:39.573160 (+2258552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.909540 (+1336380us) spinlock_profiling.cc:243] Waited 2.26 s on lock 0x7b54000e1354. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:40.909746 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5192756096}
I20260709 12:21:40.911955 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:21:40.912993 11655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59414 (request call id 278) took 1253 ms (client timeout 1601 ms). Trace:
W20260709 12:21:40.913460 11655 rpcz_store.cc:269] 0709 12:21:39.659447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.660733 (+  1286us) service_pool.cc:224] Handling call
0709 12:21:40.892481 (+1231748us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b5800003998. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f260a0 00007f9bb5f25984 00007f9baf4a06d4 00007f9baf4a0662
0709 12:21:40.912923 (+ 20442us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11694464}
W20260709 12:21:40.914040 15178 log.cc:927] Time spent T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.427s	user 0.001s	sys 0.001s
I20260709 12:21:40.914987 14941 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:40.916929 10934 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:21:40.912343 11082 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:21:40.897486 14766 consensus_meta.cc:287] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 1.078s	user 0.009s	sys 0.003s
I20260709 12:21:40.832816 15188 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:40.917546 10934 raft_consensus.cc:606] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:40.947360 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:40.956225 10934 raft_consensus.cc:614] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:40.917789 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2659) took 1594 ms. Trace:
I20260709 12:21:40.950084 15109 consensus_queue.cc:260] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:40.840487 15177 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:40.956694 11082 rpcz_store.cc:276] 0709 12:21:39.323219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.911681 (+1588462us) service_pool.cc:224] Handling call
0709 12:21:40.912012 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:40.917528 (+  5516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.917727 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:40.911243 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:40.954201 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:40.958475 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2663) took 1619 ms. Trace:
I20260709 12:21:40.961772 11009 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:40.961726 11082 rpcz_store.cc:276] 0709 12:21:39.339653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.957632 (+1617979us) service_pool.cc:224] Handling call
0709 12:21:40.957966 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:40.958144 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:40.958180 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:40.958221 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:40.958258 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.958310 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:40.958421 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:40.947666 14994 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:40.963124 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.963122 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2640) took 3256 ms. Trace:
I20260709 12:21:40.963708 11003 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:40.884882 15006 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:40.902138 14684 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:40.966567 15109 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:40.916810 15060 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:40.964655 11080 rpcz_store.cc:276] 0709 12:21:37.706703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.033786 (+1327083us) service_pool.cc:224] Handling call
0709 12:21:39.034150 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:39.070514 (+ 36364us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:39.070549 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:39.094752 (+ 24203us) log.cc:844] Serialized 26 byte log entry
0709 12:21:40.171162 (+1076410us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:40.171295 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.171457 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:40.913436 (+741979us) spinlock_profiling.cc:243] Waited 6.29 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:40.957045 (+ 43609us) raft_consensus.cc:1685] finished
0709 12:21:40.957069 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:40.963057 (+  5988us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35877,"raft.queue_time_us":40695,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":5343,"spinlock_wait_cycles":14459776,"thread_start_us":987236,"threads_started":1,"wal-append.queue_time_us":1104843}
I20260709 12:21:40.970388 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2666) took 1426 ms. Trace:
I20260709 12:21:40.970574 11082 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: [7.5-10.6]
I20260709 12:21:40.970765 11080 rpcz_store.cc:276] 0709 12:21:39.544481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.969619 (+1425138us) service_pool.cc:224] Handling call
0709 12:21:40.969928 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:40.970101 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:40.970125 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:40.970165 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:40.970195 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.970243 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:40.970337 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:40.971292 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2664) took 1631 ms. Trace:
I20260709 12:21:40.971629 11082 rpcz_store.cc:276] 0709 12:21:39.339980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.962811 (+1622831us) service_pool.cc:224] Handling call
0709 12:21:40.970327 (+  7516us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:40.971010 (+   683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.971240 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:40.958371 15144 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:40.909904 15036 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:40.974162 15177 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:40.976815 15036 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:40.973742 15181 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:40.979418 15211 log.cc:927] Time spent T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:21:40.966495 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:40.980414 11004 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 7: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:40.981241 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:40.981802 11009 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:40.985709 15188 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:40.989645 15173 consensus_meta.cc:287] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.744s	user 0.005s	sys 0.004s
I20260709 12:21:40.990229 15173 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:40.991842 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:40.993806 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2798) took 2565 ms. Trace:
I20260709 12:21:40.994213 11008 rpcz_store.cc:276] 0709 12:21:38.427908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.428051 (+   143us) service_pool.cc:224] Handling call
0709 12:21:38.433922 (+  5871us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:39.193530 (+759608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.992918 (+1799388us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b5400400bd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:40.993104 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1745005440}
I20260709 12:21:41.040966 15004 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.041641 15004 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:41.044504 15004 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:41.047610 14868 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.048321 14868 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:41.049741 11009 raft_consensus.cc:2410] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 12:21:41.102070 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:41.266108 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.408962 14994 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:41.409593 14994 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:41.489720 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:41.490654 11008 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
W20260709 12:21:41.496155 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 373105us
I20260709 12:21:41.495553 15006 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:41.499615 14994 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:41.554311 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:41.555624 11008 raft_consensus.cc:2368] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6.
I20260709 12:21:41.556042 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 2814) took 1007 ms. Trace:
I20260709 12:21:41.556598 11008 rpcz_store.cc:276] 0709 12:21:40.548431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.549534 (+1001103us) service_pool.cc:224] Handling call
0709 12:21:41.555977 (+  6443us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:41.559449 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:21:41.568035 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.569415 15181 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:41.571627 11008 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:41.572441 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 2817) took 1020 ms. Trace:
I20260709 12:21:41.572829 11008 rpcz_store.cc:276] 0709 12:21:40.552101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.559237 (+1007136us) service_pool.cc:224] Handling call
0709 12:21:41.572372 (+ 13135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:41.581887 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:41.582676 11008 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:41.583479 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 2819) took 1016 ms. Trace:
I20260709 12:21:41.583984 11008 rpcz_store.cc:276] 0709 12:21:40.567156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.573646 (+1006490us) service_pool.cc:224] Handling call
0709 12:21:41.583281 (+  9635us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:41.592204 15078 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:41.600131 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:41.601068 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2275) took 1081 ms. Trace:
I20260709 12:21:41.601373 11008 rpcz_store.cc:276] 0709 12:21:40.519935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.598067 (+1078132us) service_pool.cc:224] Handling call
0709 12:21:41.600995 (+  2928us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:41.601800 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.602679 15067 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:41.602653 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:41.603754 11008 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:41.603567 15067 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:41.604979 15099 consensus_queue.cc:1059] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:41.606338 15067 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:41.606047 15099 raft_consensus.cc:3055] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:41.607484 10901 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:41.607312 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2272) took 1088 ms. Trace:
I20260709 12:21:41.611359 11008 rpcz_store.cc:276] 0709 12:21:40.519016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.602335 (+1083319us) service_pool.cc:224] Handling call
0709 12:21:41.607256 (+  4921us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:41.612063 10901 leader_election.cc:400] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 5 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6.
I20260709 12:21:41.613040 10901 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:41.614629 10901 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:40.306866 11011 rpcz_store.cc:276] 0709 12:21:39.133228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.183697 (+ 50469us) service_pool.cc:224] Handling call
0709 12:21:39.184023 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.184252 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:39.200734 (+ 16482us) log.cc:844] Serialized 14 byte log entry
0709 12:21:40.052931 (+852197us) log.cc:844] Serialized 14 byte log entry
0709 12:21:40.266438 (+213507us) log.cc:844] Serialized 14 byte log entry
0709 12:21:40.305658 (+ 39220us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:40.305756 (+    98us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:40.305836 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.306044 (+   208us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:40.306219 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7353,"prepare.queue_time_us":23964,"prepare.run_cpu_time_us":123,"prepare.run_wall_time_us":2450,"raft.queue_time_us":364712,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":8756,"thread_start_us":906808,"threads_started":3,"wal-append.queue_time_us":350658}
I20260709 12:21:41.619597 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:41.623262 11011 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:41.630028 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:41.631920 11008 raft_consensus.cc:2410] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:21:41.633265 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2265) took 1124 ms. Trace:
I20260709 12:21:41.634003 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:41.634302 11008 rpcz_store.cc:276] 0709 12:21:40.508658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.612037 (+1103379us) service_pool.cc:224] Handling call
0709 12:21:41.633209 (+ 21172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:41.612143 15099 raft_consensus.cc:740] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:41.615584 15067 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:41.649580 14984 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:41.652045 14517 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:41.652588 14517 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:41.652978 14517 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:41.656742 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:41.657794 11007 raft_consensus.cc:2410] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 14 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
W20260709 12:21:41.658874 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 44319.6us
I20260709 12:21:41.659901 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2274) took 1140 ms. Trace:
I20260709 12:21:41.660279 11007 rpcz_store.cc:276] 0709 12:21:40.519669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.656418 (+1136749us) service_pool.cc:224] Handling call
0709 12:21:41.659820 (+  3402us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:41.662185 15057 raft_consensus.cc:3055] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:41.662671 15057 raft_consensus.cc:740] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:41.662935 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:41.663439 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:41.663461 15057 consensus_queue.cc:260] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:41.664173 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:41.664932 15057 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:41.665107 10934 raft_consensus.cc:2410] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:21:41.666589 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:41.667303 10934 raft_consensus.cc:2393] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 12: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:41.667829 15173 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:41.664089 11008 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
W20260709 12:21:41.669924 11010 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 2811) took 2536 ms (client timeout 1869 ms). Trace:
I20260709 12:21:41.670065 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2270) took 1151 ms. Trace:
I20260709 12:21:41.670382 11008 rpcz_store.cc:276] 0709 12:21:40.518335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.635709 (+1117374us) service_pool.cc:224] Handling call
0709 12:21:41.670009 (+ 34300us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:41.670347 11010 rpcz_store.cc:269] 0709 12:21:39.133750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.161076 (+ 27326us) service_pool.cc:224] Handling call
0709 12:21:41.669712 (+2508636us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400473e54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:41.669856 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3173845376}
I20260709 12:21:41.671537 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:41.672310 11005 raft_consensus.cc:1240] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:41.674649 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:41.675421 11002 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:21:41.675962 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2267) took 1158 ms. Trace:
I20260709 12:21:41.676277 11002 rpcz_store.cc:276] 0709 12:21:40.517338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.674345 (+1157007us) service_pool.cc:224] Handling call
0709 12:21:41.675894 (+  1549us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:41.677289 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:41.678249 11002 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 7: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:41.674753 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:41.679543 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:41.680354 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 2818) took 1113 ms. Trace:
I20260709 12:21:41.680655 11002 rpcz_store.cc:276] 0709 12:21:40.566898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.679253 (+1112355us) service_pool.cc:224] Handling call
0709 12:21:41.680296 (+  1043us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:41.671588 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:41.681583 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:41.681891 11010 raft_consensus.cc:2376] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12. Re-sending same reply.
I20260709 12:21:41.682351 11002 raft_consensus.cc:2410] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:21:41.682585 11011 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:41.640303 15067 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:41.683730 10901 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:41.645634 15222 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:41.664995 15042 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:41.698628 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:41.702885 11657 raft_consensus.cc:1240] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:41.704222 15227 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:41.694298 15067 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:41.706712 10933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53346 (request call id 362) took 1102 ms. Trace:
W20260709 12:21:41.715503 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.713636 14683 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:41.708070 14990 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.712360 11008 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:41.711546 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:41.702754 15146 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:41.709504 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:41.715571 10933 rpcz_store.cc:276] 0709 12:21:40.603935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.604425 (+   490us) service_pool.cc:224] Handling call
0709 12:21:40.775656 (+171231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:40.967174 (+191518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:40.967205 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:40.967245 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:40.967275 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.706459 (+739184us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b540024b654. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:41.706504 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:41.706654 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440023936}
I20260709 12:21:41.717034 11010 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
W20260709 12:21:41.717816 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 78405us
I20260709 12:21:41.726883 14885 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:41.730249 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 46628.5us
I20260709 12:21:41.732582 11625 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:41.691463 15099 consensus_queue.cc:260] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:41.804591 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2647) took 3374 ms. Trace:
I20260709 12:21:41.785120 10977 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:41.799486 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2646) took 3379 ms. Trace:
I20260709 12:21:41.797438 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2258) took 1290 ms. Trace:
I20260709 12:21:41.821586 11009 rpcz_store.cc:276] 0709 12:21:40.507008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.984445 (+477437us) service_pool.cc:224] Handling call
0709 12:21:41.797206 (+812761us) spinlock_profiling.cc:243] Waited 56.9 ms on lock 0x7b54004001d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:41.797370 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130930432}
I20260709 12:21:41.804333 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2655) took 2863 ms. Trace:
I20260709 12:21:41.821282 11085 rpcz_store.cc:276] 0709 12:21:38.430457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.652788 (+1222331us) service_pool.cc:224] Handling call
0709 12:21:39.653090 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.653307 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:39.653604 (+   297us) log.cc:844] Serialized 14 byte log entry
0709 12:21:41.803618 (+2150014us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:41.803692 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:41.803740 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.803811 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:41.804539 (+   728us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1271067,"prepare.queue_time_us":1229,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"thread_start_us":878543,"threads_started":1,"wal-append.queue_time_us":947153}
W20260709 12:21:41.733594 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 98119.7us
I20260709 12:21:41.822810 11076 rpcz_store.cc:276] 0709 12:21:38.941259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.022147 (+1080888us) service_pool.cc:224] Handling call
0709 12:21:40.056211 (+ 34064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:40.056527 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:40.115126 (+ 58599us) log.cc:844] Serialized 14 byte log entry
0709 12:21:41.804016 (+1688890us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:41.804065 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:41.804105 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.804163 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:41.804272 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1234328,"prepare.queue_time_us":58784,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"thread_start_us":458280,"threads_started":1,"wal-append.queue_time_us":673672}
I20260709 12:21:41.768602 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:41.827206 11011 raft_consensus.cc:2410] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:21:41.827708 11011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2269) took 1309 ms. Trace:
I20260709 12:21:41.828128 11011 rpcz_store.cc:276] 0709 12:21:40.518037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.750621 (+1232584us) service_pool.cc:224] Handling call
0709 12:21:41.827639 (+ 77018us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:41.768234 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:41.829663 11003 raft_consensus.cc:2393] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 7: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:41.750998 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:41.832221 10977 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:41.833395 11010 raft_consensus.cc:2393] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 12: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:21:41.832122 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 99637.2us
I20260709 12:21:41.751672 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:41.821158 11079 rpcz_store.cc:276] 0709 12:21:38.419636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.640377 (+1220741us) service_pool.cc:224] Handling call
0709 12:21:39.640653 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.640862 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:39.641153 (+   291us) log.cc:844] Serialized 14 byte log entry
0709 12:21:40.020641 (+379488us) log.cc:844] Serialized 14 byte log entry
0709 12:21:41.798991 (+1778350us) spinlock_profiling.cc:243] Waited 5.89 ms on lock 0x7b18000d0de0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9baddedc0a 00007f9bb752d219 00007f9bade75a40 00007f9bade704e4 00007f9bade70455 00007f9bb0f58060 00007f9bb0f6a716 00007f9bb0f7b287 00007f9bb0f7b208
0709 12:21:41.799142 (+   151us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:41.799196 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:41.799241 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.799309 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:41.799430 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1760040,"prepare.queue_time_us":3046,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":70,"raft.queue_time_us":1779049,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":5713,"spinlock_wait_cycles":13537152,"thread_start_us":378845,"threads_started":1,"wal-append.queue_time_us":540403,"wal-append.run_cpu_time_us":1540,"wal-append.run_wall_time_us":1001653}
I20260709 12:21:41.838054 11010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2264) took 1329 ms. Trace:
I20260709 12:21:41.838567 11010 rpcz_store.cc:276] 0709 12:21:40.508441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.750703 (+1242262us) service_pool.cc:224] Handling call
0709 12:21:41.837988 (+ 87285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:41.718394 15078 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.848021 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:41.848723 11009 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:41.850271 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2263) took 1342 ms. Trace:
I20260709 12:21:41.850620 11009 rpcz_store.cc:276] 0709 12:21:40.508221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.849374 (+1341153us) service_pool.cc:224] Handling call
0709 12:21:41.849646 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.849922 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:41.849950 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:41.850014 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:41.850051 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.850107 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:41.850219 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:41.852169 11009 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:21:41.852530 11009 pending_rounds.cc:85] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 8
I20260709 12:21:41.852837 11009 pending_rounds.cc:107] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:21:41.853149 11009 raft_consensus.cc:2889] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:41.853884 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2266) took 1337 ms. Trace:
I20260709 12:21:41.854255 11009 rpcz_store.cc:276] 0709 12:21:40.516754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.851577 (+1334823us) service_pool.cc:224] Handling call
0709 12:21:41.851839 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.853660 (+  1821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.853834 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:41.840462 11007 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:21:41.859737 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2276) took 1339 ms. Trace:
I20260709 12:21:41.860275 11007 rpcz_store.cc:276] 0709 12:21:40.520165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.751436 (+1231271us) service_pool.cc:224] Handling call
0709 12:21:41.859676 (+108240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:41.863999 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:41.865048 11007 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:41.801489 14998 raft_consensus.cc:3055] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:41.803273 15111 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.865698 11656 raft_consensus.cc:1240] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:41.865698 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2815) took 1317 ms. Trace:
I20260709 12:21:41.868611 11003 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 4. Current term is 6. Ops: []
I20260709 12:21:41.734084 15057 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:41.874059 11007 rpcz_store.cc:276] 0709 12:21:40.548736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.861136 (+1312400us) service_pool.cc:224] Handling call
0709 12:21:41.861438 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.865430 (+  3992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.865629 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:41.836771 15222 raft_consensus.cc:697] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:41.874424 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2259) took 1367 ms. Trace:
I20260709 12:21:41.830631 15129 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:41.869189 11011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 2820) took 1301 ms. Trace:
I20260709 12:21:41.848084 15181 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:41.836146 14952 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:41.859323 15234 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:41.864755 15056 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:41.839694 15032 consensus_queue.cc:1059] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:21:41.859542 15024 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.879580 11003 rpcz_store.cc:276] 0709 12:21:40.507269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.841889 (+1334620us) service_pool.cc:224] Handling call
0709 12:21:41.868444 (+ 26555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.874182 (+  5738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.874369 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:41.866060 15099 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:41.801288 14517 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:41.750526 14990 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:41.935276 15056 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:41.942502 11005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41098 (request call id 298) took 2054 ms. Trace:
I20260709 12:21:41.942901 11005 rpcz_store.cc:276] 0709 12:21:39.888634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.888781 (+   147us) service_pool.cc:224] Handling call
0709 12:21:41.672112 (+1783331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.672704 (+   592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.942294 (+269590us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b5400473e50. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:41.942439 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4100577152}
I20260709 12:21:41.943544 14517 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:41.890161 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:41.868710 14998 raft_consensus.cc:740] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:41.880515 11011 rpcz_store.cc:276] 0709 12:21:40.567389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.828851 (+1261462us) service_pool.cc:224] Handling call
0709 12:21:41.869140 (+ 40289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:41.839803 14984 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:21:41.836410 15146 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:41.943784 15056 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:41.840807 15159 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:41.938923 15129 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:41.989130 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:41.944525 14990 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:41.941220 15024 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:41.945163 14635 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:41.936357 15223 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:21:41.945993 10935 raft_consensus.cc:2393] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 12: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:41.936813 15053 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:21:41.878239 15111 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:41.953796 15067 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:41.887116 15045 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.887471 15152 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:41.848037 15189 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.149s
I20260709 12:21:41.885286 15181 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.956432 15032 consensus_queue.cc:1243] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:21:41.890130 14952 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:41.874365 15057 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:41.962359 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:41.866230 15078 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:41.886572 15233 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:41.985602 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:41.987186 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:41.997794 15241 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:41.989722 11007 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: [10.4-10.4]
I20260709 12:21:41.989813 11080 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:21:41.955742 14885 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:41.991575 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:42.070726 11076 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:41.996567 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:41.997260 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:42.004514 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:41.734472 15227 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:41.960073 15229 consensus_queue.cc:1059] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:21:41.889894 15113 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:41.757295 15228 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.242s
I20260709 12:21:41.718616 15042 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:41.995749 15056 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:41.934599 15237 consensus_queue.cc:1059] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.111s
I20260709 12:21:41.937111 15234 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:41.998979 14635 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:42.060161 11085 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:41.987841 11011 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:21:42.134625 11011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2822) took 1532 ms. Trace:
I20260709 12:21:42.135005 11011 rpcz_store.cc:276] 0709 12:21:40.601862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.977130 (+1375268us) service_pool.cc:224] Handling call
0709 12:21:41.987572 (+ 10442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:42.134323 (+146751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.134554 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:42.060899 11005 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:42.069576 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:42.137107 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:42.067499 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:42.071501 11077 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:21:42.072369 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2823) took 1368 ms. Trace:
I20260709 12:21:42.138491 11007 rpcz_store.cc:276] 0709 12:21:40.704148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.980224 (+1276076us) service_pool.cc:224] Handling call
0709 12:21:41.989474 (+  9250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:42.071642 (+ 82168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.072295 (+   653us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:41.992986 15129 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:42.057420 15181 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:42.084362 11659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59384 (request call id 506) took 2422 ms (client timeout 1828 ms). Trace:
I20260709 12:21:42.126345 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:42.156663 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2650) took 3220 ms. Trace:
W20260709 12:21:42.074628 15223 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:21:42.056792 15226 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:42.065843 15233 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.052201 15045 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:42.161125 11002 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:21:42.161891 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2827) took 1328 ms. Trace:
I20260709 12:21:42.162230 11002 rpcz_store.cc:276] 0709 12:21:40.834705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.160464 (+1325759us) service_pool.cc:224] Handling call
0709 12:21:42.160779 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.161576 (+   797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.161818 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:42.140420 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:42.165725 11085 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:42.137885 11079 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:42.167172 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:42.055202 15152 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:42.153788 15247 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:42.155966 11659 rpcz_store.cc:269] 0709 12:21:39.656259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.656672 (+   413us) service_pool.cc:224] Handling call
0709 12:21:42.004341 (+2347669us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b5800003998. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f260a0 00007f9bb5f25984 00007f9baf4a06d4 00007f9baf4a0662
0709 12:21:42.078104 (+ 73763us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9412352}
I20260709 12:21:42.157089 11078 rpcz_store.cc:276] 0709 12:21:38.936268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.838160 (+901892us) service_pool.cc:224] Handling call
0709 12:21:39.886109 (+ 47949us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.886455 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:39.914203 (+ 27748us) log.cc:844] Serialized 14 byte log entry
0709 12:21:41.993520 (+2079317us) log.cc:844] Serialized 14 byte log entry
0709 12:21:41.996738 (+  3218us) log.cc:844] Serialized 14 byte log entry
0709 12:21:42.156337 (+159599us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:42.156387 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:42.156432 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.156494 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.156604 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1668306,"prepare.queue_time_us":89530,"prepare.run_cpu_time_us":137,"prepare.run_wall_time_us":1357,"raft.queue_time_us":1691875,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":6310,"spinlock_wait_cycles":26428800,"thread_start_us":574640,"threads_started":3,"wal-append.queue_time_us":640642,"wal-append.run_wall_time_us":1305187}
I20260709 12:21:42.168429 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:42.174242 11080 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:42.169596 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2828) took 1320 ms. Trace:
I20260709 12:21:42.128971 15242 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:42.174702 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:42.175149 11002 rpcz_store.cc:276] 0709 12:21:40.848910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.163195 (+1314285us) service_pool.cc:224] Handling call
0709 12:21:42.163529 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.163722 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:42.163749 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:42.163797 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:42.163831 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.169438 (+  5607us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.169545 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:42.189625 11076 raft_consensus.cc:2410] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:21:42.194536 11077 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:21:42.159801 14952 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:41.992455 15159 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:42.170542 15233 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:42.128525 15113 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:42.170315 15240 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:42.139617 15056 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:42.077412 15241 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:42.211130 14952 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.218225 14952 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:42.220294 14952 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:42.221086 14952 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:41.993691 15222 consensus_queue.cc:237] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:42.225896 11081 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2631) took 4523 ms. Trace:
I20260709 12:21:42.173367 15226 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:42.226338 11081 rpcz_store.cc:276] 0709 12:21:37.702024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.768938 (+1066914us) service_pool.cc:224] Handling call
0709 12:21:38.784361 (+ 15423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:38.784763 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:38.853262 (+ 68499us) log.cc:844] Serialized 14 byte log entry
0709 12:21:39.003593 (+150331us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b4800210cd8. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb5e89aa1 00007f9bb5e80b37 00007f9bb5e809ca 00007f9bb5f7826f 00007f9bb5f77f37 00007f9bb5f8c55c 00007f9bb5f8c508 00007f9bb5f8c488 00007f9bb5f8c443 00007f9bb5f8b6ec 00007f9bb4eb5a96
0709 12:21:41.526212 (+2522619us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b1800349de0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b 00007f9bb0affd23 00007f9bb0b0023a 00007f9bb0f6aa2a
0709 12:21:41.846375 (+320163us) log.cc:844] Serialized 14 byte log entry
0709 12:21:41.846570 (+   195us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:41.847064 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:21:41.847185 (+   121us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:41.847216 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.847292 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:42.225647 (+378355us) raft_consensus.cc:1685] finished
0709 12:21:42.225671 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.225827 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":242579,"prepare.queue_time_us":111720,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":6561,"raft.queue_time_us":266430,"raft.run_cpu_time_us":2241,"raft.run_wall_time_us":239861,"spinlock_wait_cycles":47430144,"thread_start_us":105663,"threads_started":2,"wal-append.queue_time_us":2738084}
I20260709 12:21:42.232801 11079 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:42.182946 15011 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:42.223905 15056 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:42.183419 15242 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:42.182070 15247 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:42.228991 15078 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:42.264849 11079 raft_consensus.cc:2410] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 11 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:21:42.248479 15024 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:42.272069 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.275244 11050 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:42.259205 15056 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:42.257723 15067 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:42.217090 15240 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:42.233698 14952 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:42.262497 15011 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:42.263098 15111 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:42.272895 15057 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:42.299464 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2824) took 1536 ms. Trace:
I20260709 12:21:42.299041 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2826) took 1479 ms. Trace:
I20260709 12:21:42.272655 15250 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.305506 11078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:21:42.304975 11003 rpcz_store.cc:276] 0709 12:21:40.763290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.075740 (+1312450us) service_pool.cc:224] Handling call
0709 12:21:42.086300 (+ 10560us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:42.086687 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:42.086718 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:42.087368 (+   650us) log.cc:844] Serialized 52 byte log entry
0709 12:21:42.275541 (+188173us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:42.275581 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.275653 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:42.299256 (+ 23603us) raft_consensus.cc:1685] finished
0709 12:21:42.299283 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.299409 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":900,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":7174,"thread_start_us":141784,"threads_started":1,"wal-append.queue_time_us":162061}
I20260709 12:21:42.328104 15250 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:42.329272 15129 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:42.332100 14635 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:42.334172 11050 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:42.335071 15249 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:42.336077 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.335592 15249 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:42.336318 15255 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:42.336880 15255 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:42.291988 15056 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:42.337993 15249 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:42.338745 15249 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.338946 15255 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:42.339411 15056 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:42.339794 15251 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.305332 11007 rpcz_store.cc:276] 0709 12:21:40.819496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.139302 (+1319806us) service_pool.cc:224] Handling call
0709 12:21:42.155587 (+ 16285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.155801 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:42.293944 (+138143us) log.cc:844] Serialized 14 byte log entry
0709 12:21:42.296766 (+  2822us) log.cc:844] Serialized 14 byte log entry
0709 12:21:42.296944 (+   178us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:42.296999 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:42.297058 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.298845 (+  1787us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.298980 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":140945,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":1650,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":127,"spinlock_wait_cycles":39168,"thread_start_us":122228,"threads_started":2,"wal-append.queue_time_us":3556}
I20260709 12:21:42.342995 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:42.344122 11078 raft_consensus.cc:606] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:42.345005 11078 raft_consensus.cc:614] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:42.348245 15242 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:42.328917 15246 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:21:42.349454 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2829) took 1472 ms. Trace:
I20260709 12:21:42.350126 11006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2832) took 1377 ms. Trace:
I20260709 12:21:42.351353 11007 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:42.352880 11657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59384 (request call id 501) took 2781 ms. Trace:
I20260709 12:21:42.353391 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2831) took 1384 ms. Trace:
I20260709 12:21:42.353252 11657 rpcz_store.cc:276] 0709 12:21:39.569118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.628346 (+ 59228us) service_pool.cc:224] Handling call
0709 12:21:39.628717 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.717609 (+2088892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.348840 (+631231us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b54006aaed4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:42.350562 (+  1722us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4769388288}
I20260709 12:21:42.336110 15024 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:42.354198 11007 rpcz_store.cc:276] 0709 12:21:40.969320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.343607 (+1374287us) service_pool.cc:224] Handling call
0709 12:21:42.351165 (+  7558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.353099 (+  1934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.353315 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:42.335533 15159 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:42.352667 11006 rpcz_store.cc:276] 0709 12:21:40.972759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.348222 (+1375463us) service_pool.cc:224] Handling call
0709 12:21:42.349675 (+  1453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.349847 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:42.349870 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:42.349906 (+    36us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:42.349935 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.349983 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.350073 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:42.355940 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2830) took 1465 ms. Trace:
I20260709 12:21:42.357539 11003 rpcz_store.cc:276] 0709 12:21:40.890348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.348800 (+1458452us) service_pool.cc:224] Handling call
0709 12:21:42.355381 (+  6581us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.355569 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:42.355594 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:42.355636 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:42.355672 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.355726 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.355842 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:42.358120 11006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2835) took 1381 ms. Trace:
I20260709 12:21:42.358595 11006 rpcz_store.cc:276] 0709 12:21:40.976688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.357374 (+1380686us) service_pool.cc:224] Handling call
0709 12:21:42.357677 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.357842 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:42.357865 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:42.357904 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:42.357932 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.357979 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.358070 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:42.359460 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2840) took 1381 ms. Trace:
I20260709 12:21:42.359915 11003 rpcz_store.cc:276] 0709 12:21:40.977938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.358702 (+1380764us) service_pool.cc:224] Handling call
0709 12:21:42.359004 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.359161 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:42.359187 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:42.359226 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:42.359255 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.359306 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.359407 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:42.341459 15248 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:42.368966 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2833) took 1393 ms. Trace:
I20260709 12:21:42.360459 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:42.352550 11002 rpcz_store.cc:276] 0709 12:21:40.877536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.179211 (+1301675us) service_pool.cc:224] Handling call
0709 12:21:42.179554 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.179779 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:42.286236 (+106457us) log.cc:844] Serialized 14 byte log entry
0709 12:21:42.346436 (+ 60200us) log.cc:844] Serialized 14 byte log entry
0709 12:21:42.349102 (+  2666us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:42.349157 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:42.349208 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.349275 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.349390 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4424,"prepare.queue_time_us":117836,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":5727,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":2293,"thread_start_us":96261,"threads_started":2}
I20260709 12:21:42.352981 15152 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:42.361944 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2843) took 1383 ms. Trace:
I20260709 12:21:42.368731 11006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2841) took 1381 ms. Trace:
I20260709 12:21:42.349349 15045 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:42.369453 11007 rpcz_store.cc:276] 0709 12:21:40.975784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.357114 (+1381330us) service_pool.cc:224] Handling call
0709 12:21:42.368465 (+ 11351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.368649 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:42.368673 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:42.368718 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:42.368755 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.368818 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.368914 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:42.348186 15226 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:42.370290 11003 rpcz_store.cc:276] 0709 12:21:40.978707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.361220 (+1382513us) service_pool.cc:224] Handling call
0709 12:21:42.361472 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.361636 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:42.361660 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:42.361704 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:42.361739 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.361805 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.361897 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:42.349545 14990 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:42.370934 11006 rpcz_store.cc:276] 0709 12:21:40.978190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.359248 (+1381058us) service_pool.cc:224] Handling call
0709 12:21:42.359441 (+   193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.359554 (+   113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:42.359568 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:42.359594 (+    26us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:42.359611 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.359650 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.359711 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:42.375453 11002 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:42.365706 11050 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:42.356225 15245 log.cc:927] Time spent T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:21:42.384531 15235 raft_consensus.cc:3055] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:42.384976 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2277) took 1864 ms. Trace:
I20260709 12:21:42.340339 15251 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:42.385923 15131 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:42.387847 15251 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:42.385376 11009 rpcz_store.cc:276] 0709 12:21:40.520398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.855052 (+1334654us) service_pool.cc:224] Handling call
0709 12:21:41.855345 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:41.855545 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:41.855569 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:41.856040 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 12:21:42.054215 (+198175us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:42.256085 (+201870us) log.cc:844] Serialized 14 byte log entry
0709 12:21:42.256326 (+   241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.256400 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:42.384766 (+128366us) raft_consensus.cc:1685] finished
0709 12:21:42.384788 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.384918 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":241885,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":64,"raft.queue_time_us":93,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":3473,"thread_start_us":336040,"threads_started":2,"wal-append.queue_time_us":246632}
W20260709 12:21:42.389315 10899 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.005s	sys 0.015s
W20260709 12:21:42.389647 10899 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.005s	sys 0.015s
I20260709 12:21:42.380335 11002 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:42.352102 15042 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:42.376011 15229 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:42.390463 15229 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:42.340338 15249 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:42.400807 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:42.393131 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 544201us
I20260709 12:21:42.455039 15241 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:42.455693 15241 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:21:42.457482 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 77380.2us
I20260709 12:21:42.458603 11051 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:42.371016 15259 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:42.393005 15045 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 12:21:42.462445 14952 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:42.383360 15240 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:42.452096 15266 log.cc:927] Time spent T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:21:42.463660 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:42.469301 15024 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:42.470618 15268 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:42.373390 15248 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:42.472447 15011 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:42.400228 15229 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:42.501021 11004 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2260) took 1993 ms (client timeout 1675 ms). Trace:
I20260709 12:21:42.502394 15024 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:42.503087 15024 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:42.392786 14990 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:42.504001 15248 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:42.478439 11005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2816) took 1929 ms. Trace:
W20260709 12:21:42.502696 11004 rpcz_store.cc:269] 0709 12:21:40.507498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.916795 (+409297us) service_pool.cc:224] Handling call
0709 12:21:42.500739 (+1583944us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b540037aad4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:42.500932 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54879616}
I20260709 12:21:42.480878 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2629) took 4779 ms. Trace:
I20260709 12:21:42.505889 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:42.506968 11078 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:42.457803 15053 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:42.384987 15235 raft_consensus.cc:740] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:42.507930 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:42.508531 11078 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:21:42.508699 15235 consensus_queue.cc:260] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:42.509790 15235 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:42.513824 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 61982.1us
I20260709 12:21:42.519013 15249 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:42.476061 15113 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:42.520180 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:42.524044 15053 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:42.526434 15053 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:42.378688 15181 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:42.527837 11010 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:42.523043 15233 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:42.505074 11005 rpcz_store.cc:276] 0709 12:21:40.548975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.943829 (+1394854us) service_pool.cc:224] Handling call
0709 12:21:41.944153 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.136024 (+191871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.478162 (+342138us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b540029c2d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:42.478367 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267761920}
W20260709 12:21:42.534296 11008 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2278) took 2013 ms (client timeout 2188 ms). Trace:
W20260709 12:21:42.534663 11008 rpcz_store.cc:269] 0709 12:21:40.520631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.671256 (+1150625us) service_pool.cc:224] Handling call
0709 12:21:42.534141 (+862885us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b540029c7d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:42.534248 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92022528}
W20260709 12:21:42.537837 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 172204us
I20260709 12:21:42.530619 11083 rpcz_store.cc:276] 0709 12:21:37.701510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.764864 (+1063354us) service_pool.cc:224] Handling call
0709 12:21:38.765162 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:38.828331 (+ 63169us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:39.207606 (+379275us) log.cc:844] Serialized 14 byte log entry
0709 12:21:39.502778 (+295172us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:39.502834 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:39.502879 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.898646 (+1395767us) spinlock_profiling.cc:243] Waited 8.3 ms on lock 0x7b180010abc0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade412a6 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419
0709 12:21:42.480617 (+1581971us) spinlock_profiling.cc:243] Waited 62.9 ms on lock 0x7b54001680d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:42.480668 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.480811 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16198,"prepare.queue_time_us":118077,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":1092,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":1186,"spinlock_wait_cycles":163805952,"thread_start_us":621668,"threads_started":2,"wal-append.queue_time_us":634526,"wal-append.run_cpu_time_us":2111,"wal-append.run_wall_time_us":1352239}
I20260709 12:21:42.540514 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:42.541344 11083 raft_consensus.cc:2376] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11. Re-sending same reply.
I20260709 12:21:42.542418 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:42.543088 11083 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:42.482892 15234 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:42.550588 11011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2825) took 1761 ms. Trace:
I20260709 12:21:42.551077 11011 rpcz_store.cc:276] 0709 12:21:40.789602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.135761 (+1346159us) service_pool.cc:224] Handling call
0709 12:21:42.169083 (+ 33322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.169279 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:42.351031 (+181752us) log.cc:844] Serialized 14 byte log entry
0709 12:21:42.550164 (+199133us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:42.550215 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:42.550258 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.550324 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.550517 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4262,"prepare.queue_time_us":127377,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":79,"thread_start_us":375929,"threads_started":2}
I20260709 12:21:42.554836 10974 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:42.556650 10974 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:42.557909 10974 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:42.556913 15131 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:42.567566 15131 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:42.568023 15131 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:42.564971 15093 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:42.571553 15093 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:42.586680 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.588382 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:42.566792 10974 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:42.588963 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:42.584985 11083 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:42.589573 10974 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:42.531306 15106 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:21:42.590960 11078 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:42.591917 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:42.592867 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:42.595734 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:42.595376 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:42.596529 10931 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:21:42.587774 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 44122.1us
I20260709 12:21:42.592514 10974 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:42.587622 15093 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:42.597733 10974 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:42.591980 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:42.597522 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:42.600205 11083 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:21:42.601259 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:42.601941 11083 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:42.602917 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:42.598654 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:42.604360 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:42.605162 11083 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:21:42.605749 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:42.572161 15234 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.606525 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:42.607255 11083 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:42.572386 15053 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:42.589563 15129 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:42.590191 15181 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:42.614951 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:42.616006 11078 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:42.594332 15112 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:42.598165 15057 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:42.620078 10974 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:42.604221 15032 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:42.608153 15078 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:42.623333 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:42.621851 15057 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.627959 15057 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:42.623405 15181 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:42.631883 15181 raft_consensus.cc:697] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:42.616899 15234 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:42.632922 15181 consensus_queue.cc:237] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:42.634639 15234 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:42.619210 15112 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:42.635275 15112 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:42.636821 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:42.637291 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:42.624125 10974 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:42.638979 10974 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:42.639825 10974 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:42.641412 10930 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:42.626863 15078 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.652357 15078 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:42.654286 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:42.654958 11011 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:42.656253 15177 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:42.656483 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:42.614113 15129 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:42.678368 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:42.660063 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:42.655105 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:42.675907 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:42.626971 15271 log.cc:927] Time spent T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:21:42.663771 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:42.682456 10936 raft_consensus.cc:2410] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:21:42.678860 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:42.683053 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:42.691023 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:42.691291 11005 raft_consensus.cc:2393] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 13: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:42.691444 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:42.686960 11078 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:42.688747 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:42.688963 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:42.691606 10929 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:42.692880 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:42.692904 10927 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:21:42.693917 11008 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:42.693825 11083 raft_consensus.cc:2410] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:21:42.686793 11076 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
W20260709 12:21:42.695827 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 163551us
W20260709 12:21:42.696869 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 117743us
I20260709 12:21:42.696906 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:42.697217 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:42.698439 11004 raft_consensus.cc:2393] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 6: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:42.699031 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:42.699998 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:42.701009 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:42.701802 11076 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:21:42.702214 11050 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:42.703054 10934 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 7: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:42.705120 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:42.705277 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:42.700479 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:42.616390 15053 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:42.889528 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.768249 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:42.779394 10936 raft_consensus.cc:3055] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:43.036047 10935 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:43.036368 10936 raft_consensus.cc:740] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:42.946149 10929 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
I20260709 12:21:42.706501 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:42.930756 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:43.038185 11078 raft_consensus.cc:2410] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:21:43.039520 11078 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:43.041071 11076 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:42.656647 15032 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:43.043716 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2789) took 1052 ms. Trace:
I20260709 12:21:42.665660 15233 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:42.719067 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:42.677872 14990 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:43.034664 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:42.656701 15177 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:43.063833 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:42.708101 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:43.066330 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:42.656491 15175 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:42.706687 11083 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:21:43.092612 11005 raft_consensus.cc:2368] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13.
I20260709 12:21:43.093291 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:43.093580 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:43.094476 11078 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:21:43.093971 11083 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:43.095538 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:43.096042 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:43.096520 11004 raft_consensus.cc:2410] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:21:43.097390 11083 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:43.073648 10934 raft_consensus.cc:1240] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:42.689795 15129 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:43.079337 10901 leader_election.cc:336] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.754s (SENT)
W20260709 12:21:42.956557 15271 log.cc:927] Time spent T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
W20260709 12:21:43.047513 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 345388us
I20260709 12:21:43.110021 11050 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:43.055001 15032 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:43.107553 10900 connection.cc:256] RPC call timeout handler was delayed by -1.9151384280000912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
I20260709 12:21:43.087849 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:43.044448 11084 rpcz_store.cc:276] 0709 12:21:41.990934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.201190 (+210256us) service_pool.cc:224] Handling call
0709 12:21:42.204489 (+  3299us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:42.211266 (+  6777us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:42.236413 (+ 25147us) log.cc:844] Serialized 14 byte log entry
0709 12:21:42.528854 (+292441us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:42.529684 (+   830us) log.cc:844] Serialized 52 byte log entry
0709 12:21:42.529876 (+   192us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:42.529912 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.529977 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:42.763785 (+233808us) raft_consensus.cc:1685] finished
0709 12:21:42.763809 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:43.042891 (+279082us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28078,"prepare.queue_time_us":24855,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":151214,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":20346,"spinlock_wait_cycles":15074048,"thread_start_us":201820,"threads_started":2,"wal-append.queue_time_us":43184}
I20260709 12:21:42.697268 15251 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:43.099083 11076 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 6.
I20260709 12:21:43.050065 10936 consensus_queue.cc:260] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:43.092274 11002 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:21:43.119549 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:43.120244 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:43.120615 11004 raft_consensus.cc:2393] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:43.120820 11002 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:43.093075 10932 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 7.
I20260709 12:21:43.126368 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:43.131839 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:43.135687 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:43.136059 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:43.110795 15032 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:43.131547 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:43.141413 11651 raft_consensus.cc:2393] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 10: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:43.103955 15175 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.112507 15143 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:42.778575 15270 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:43.107599 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:43.104471 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:42.761713 15173 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.947s	user 0.006s	sys 0.008s
I20260709 12:21:43.113073 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:43.117581 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:43.144862 11084 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:43.099388 15177 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:43.159499 15173 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.356s	user 0.008s	sys 0.013s
I20260709 12:21:43.128361 15251 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:43.146998 15175 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:43.165755 11009 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 8: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:42.782757 15131 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:42.956342 15275 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.178295 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2790) took 1187 ms. Trace:
I20260709 12:21:43.178915 11077 rpcz_store.cc:276] 0709 12:21:41.991177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.138338 (+147161us) service_pool.cc:224] Handling call
0709 12:21:43.178088 (+1039750us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b54001a68d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:43.178217 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43446656}
I20260709 12:21:43.182562 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:43.183328 10930 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:21:43.181960 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:43.154212 14868 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:43.189991 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:43.190657 10934 raft_consensus.cc:1813] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Handling vote request from an unknown peer 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:43.191151 10934 raft_consensus.cc:2393] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 10: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:21:43.177918 15024 consensus_meta.cc:287] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.674s	user 0.007s	sys 0.003s
I20260709 12:21:43.197063 11084 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:21:43.198292 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:43.201251 15057 consensus_meta.cc:287] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.573s	user 0.007s	sys 0.001s
I20260709 12:21:43.175726 15270 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.197834 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:43.216306 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:43.228786 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:43.214053 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:43.228184 11077 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8.
I20260709 12:21:43.216120 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:43.229666 11659 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:43.227990 10934 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:43.231949 10900 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:43.231956 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:43.236732 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:43.238080 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:43.214716 15129 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:43.242276 15129 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:43.233281 15270 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:43.244504 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:43.245152 10931 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:21:43.245818 15270 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:43.246028 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:43.211766 15175 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:43.247195 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:43.247875 10935 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:43.249994 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:43.254343 15032 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:43.254882 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:43.255692 15146 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:43.256179 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:43.256826 15032 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:43.257418 15112 consensus_meta.cc:287] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.622s	user 0.007s	sys 0.003s
I20260709 12:21:43.251189 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:43.257841 15112 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:43.258271 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:43.260098 15112 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:43.261704 11009 raft_consensus.cc:1240] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:43.262461 15281 log.cc:927] Time spent T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:21:43.264006 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:43.264642 11009 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:43.268288 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:43.269037 10935 raft_consensus.cc:2368] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13.
I20260709 12:21:43.271353 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:43.271596 10977 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:43.275027 10977 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:43.224517 15268 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:43.280145 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:43.281018 15084 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:43.281456 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:43.281741 11009 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8.
I20260709 12:21:43.285172 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:43.285863 11084 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:43.212735 15053 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:43.187376 15275 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:43.237883 15222 raft_consensus.cc:2804] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:21:43.289091 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 203292us
I20260709 12:21:43.293599 10974 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:43.290617 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:43.288159 11051 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:43.228904 15057 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:43.291589 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:43.289316 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:43.302887 10974 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:43.293761 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:43.288796 15144 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:43.309319 10974 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:43.310899 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:43.311573 11084 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:43.279901 15143 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.297533 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:43.294035 10901 leader_election.cc:336] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.955s (SENT)
I20260709 12:21:43.227133 15024 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:43.302386 11051 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:43.305977 14868 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:43.315172 11051 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:43.306751 15284 consensus_queue.cc:1059] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:43.291985 15268 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:43.307505 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:43.304382 10977 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:43.319638 11005 raft_consensus.cc:2368] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12.
I20260709 12:21:43.313371 10901 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:43.302852 15257 raft_consensus.cc:2764] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:21:43.294728 15222 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:43.319620 10977 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:43.316464 10974 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
W20260709 12:21:43.322908 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 212966us
I20260709 12:21:43.324744 15222 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:43.326236 15250 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:43.326781 14868 raft_consensus.cc:697] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:43.327816 14868 consensus_queue.cc:237] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:43.328781 11010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2262) took 2820 ms. Trace:
I20260709 12:21:43.329156 11010 rpcz_store.cc:276] 0709 12:21:40.507985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.841949 (+1333964us) service_pool.cc:224] Handling call
0709 12:21:41.842265 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.528342 (+686077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:43.328528 (+800186us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b540012cad4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:43.328721 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1576088960}
I20260709 12:21:43.330734 15247 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:43.331481 15181 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:43.332032 10932 raft_consensus.cc:1240] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:43.332082 15276 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:43.333343 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:43.333588 15024 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:43.333904 10977 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:43.334213 11076 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:43.321502 15109 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:43.335444 15109 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.316972 15287 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:43.339123 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:43.356055 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:43.304690 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:43.365334 10974 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:43.370642 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 74076.6us
I20260709 12:21:43.366739 11051 leader_election.cc:400] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13.
I20260709 12:21:43.374785 11051 leader_election.cc:403] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:43.317667 14990 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:43.382501 11622 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:43.383790 15236 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:43.384498 15236 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:43.384961 15236 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:43.380842 11050 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:43.392169 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:43.392899 11084 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:43.364537 15106 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:43.397177 10901 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:43.365379 15109 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:43.407555 10901 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:43.376274 15032 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:43.369649 14984 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:43.362871 15287 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.362679 15276 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:43.303216 14998 consensus_queue.cc:260] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:43.410192 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2671) took 1044 ms. Trace:
I20260709 12:21:43.428714 11078 rpcz_store.cc:276] 0709 12:21:42.365705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.068990 (+703285us) service_pool.cc:224] Handling call
0709 12:21:43.094167 (+ 25177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:43.094861 (+   694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:43.409932 (+315071us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b54000e0950. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:43.410090 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57099008}
I20260709 12:21:43.403123 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:43.429937 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:43.431239 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:43.319988 15143 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:43.332157 15268 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:43.414774 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:43.379441 15286 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:43.406219 11050 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:43.409842 14990 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:43.431789 11078 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:43.404321 15024 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:43.400559 15159 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:21:43.407456 15247 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13.
I20260709 12:21:43.440757 11084 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:43.392058 15275 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:43.412562 15067 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.444415 11049 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:43.413055 11652 raft_consensus.cc:2368] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8.
I20260709 12:21:43.429144 15287 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:43.447532 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.427289 15288 consensus_queue.cc:1059] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:21:43.426163 14984 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:21:43.428352 15093 consensus_meta.cc:287] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.813s	user 0.004s	sys 0.005s
I20260709 12:21:43.426877 15032 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:43.446249 15251 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:43.452279 15250 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:43.441247 15131 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:43.446777 14998 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:43.443099 15286 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:21:43.458199 15280 log.cc:927] Time spent T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 12:21:43.450496 15024 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:43.438421 14963 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:21:43.484476 15032 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:43.471484 15159 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:43.487798 15250 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:43.493997 15286 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:43.505007 15285 log.cc:927] Time spent T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:21:43.508436 15268 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:43.509753 15236 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:43.502681 15250 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:43.512225 15236 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:43.515944 15287 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:43.544073 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 228538us
W20260709 12:21:43.546139 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 135443us
I20260709 12:21:43.546641 10899 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:43.549499 10975 leader_election.cc:400] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8.
I20260709 12:21:43.549965 10975 leader_election.cc:403] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:21:43.551939 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.554466 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:43.464728 11049 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:43.446830 11050 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:43.470918 11078 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
W20260709 12:21:43.558857 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 94058.9us
I20260709 12:21:43.559471 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:43.561309 10974 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:21:43.563184 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 116322us
I20260709 12:21:43.481233 14984 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:43.577857 15222 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:43.578987 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:43.457815 14990 raft_consensus.cc:697] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:43.581560 14990 consensus_queue.cc:237] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:43.583205 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:43.584239 15131 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8.
I20260709 12:21:43.474174 15067 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:43.585507 15143 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:43.496672 15152 consensus_queue.cc:1059] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 12:21:43.588445 15257 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:43.589192 15257 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:43.589768 15257 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:43.496285 15057 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:43.589548 15301 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:43.592694 15301 raft_consensus.cc:697] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:43.594528 15301 consensus_queue.cc:237] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:43.596051 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 47126.3us
I20260709 12:21:43.569169 11659 raft_consensus.cc:2393] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:43.484784 15093 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:43.497238 15024 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:43.599351 10899 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:43.574311 15187 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:21:43.575001 15268 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:43.588318 15231 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:43.561352 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:43.604259 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:43.603389 15295 consensus_queue.cc:1059] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:21:43.603900 15292 consensus_queue.cc:1059] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:21:43.602615 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:43.616848 11010 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:43.564774 11050 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:43.599579 15093 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:43.615731 11078 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:43.619098 15300 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:43.596433 15296 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:43.629961 15296 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.630492 15296 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:43.604036 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:43.638821 15268 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:43.639801 15234 raft_consensus.cc:3055] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:43.640334 15234 raft_consensus.cc:740] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:43.642028 15234 consensus_queue.cc:260] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:43.645792 15287 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:43.700639 11009 raft_consensus.cc:2393] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 13: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:43.643647 15234 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:43.710803 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 146366us
I20260709 12:21:43.711943 15093 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:43.712430 15287 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:21:43.713675 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 114546us
I20260709 12:21:43.712757 15093 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:43.722203 11006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41098 (request call id 310) took 1836 ms. Trace:
I20260709 12:21:43.723358 15093 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:43.723567 15067 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:43.725980 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:43.726924 11009 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:43.728473 15287 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:43.722738 11006 rpcz_store.cc:276] 0709 12:21:41.885289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.382905 (+497616us) service_pool.cc:224] Handling call
0709 12:21:42.383137 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.538242 (+155105us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:21:42.548211 (+  9969us) log.cc:844] Serialized 14 byte log entry
0709 12:21:42.619479 (+ 71268us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:42.619528 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:42.619570 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:43.721586 (+1102016us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400473954. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:43.721659 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:43.721940 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10177,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":16890,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":3957,"spinlock_wait_cycles":356203264,"thread_start_us":70866,"threads_started":2,"wal-append.queue_time_us":153871}
I20260709 12:21:43.739403 10899 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:43.740885 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:43.742532 15078 consensus_meta.cc:287] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 1.090s	user 0.013s	sys 0.011s
I20260709 12:21:43.735293 15287 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:43.742528 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:43.745600 11005 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:43.743036 15078 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:43.748016 11008 raft_consensus.cc:1240] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:21:43.751199 11050 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:43.752596 15067 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:43.753337 15067 raft_consensus.cc:697] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:43.754729 15067 consensus_queue.cc:237] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:43.754855 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:43.758193 15109 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:43.764366 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:43.765231 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:43.764592 15106 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:43.766100 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:43.766736 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:43.766129 11082 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
W20260709 12:21:43.768271 11082 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2795) took 1774 ms (client timeout 2109 ms). Trace:
I20260709 12:21:43.768499 15106 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:43.769286 15309 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:43.769809 11655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59414 (request call id 282) took 1932 ms. Trace:
W20260709 12:21:43.771428 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 166585us
W20260709 12:21:43.770128 11082 rpcz_store.cc:269] 0709 12:21:41.993817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.157034 (+163217us) service_pool.cc:224] Handling call
0709 12:21:43.764925 (+1607891us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b5800017d98. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f260a0 00007f9bb5f25984 00007f9baf4a06d4 00007f9baf4a0662
0709 12:21:43.768190 (+  3265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3540224}
I20260709 12:21:43.774821 15309 raft_consensus.cc:697] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:43.775524 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:43.775909 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:43.776973 11651 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 8: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:43.777842 11006 raft_consensus.cc:2376] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13. Re-sending same reply.
I20260709 12:21:43.778419 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:43.778179 15309 consensus_queue.cc:237] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:43.781953 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:43.783437 11082 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
W20260709 12:21:43.784490 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.784701 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:43.776748 10899 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:43.772967 11655 rpcz_store.cc:276] 0709 12:21:41.837320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.841370 (+  4050us) service_pool.cc:224] Handling call
0709 12:21:41.877761 (+ 36391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.998173 (+120412us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:42.030467 (+ 32294us) log.cc:844] Serialized 14 byte log entry
0709 12:21:42.272695 (+242228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:42.272760 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:42.272818 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:43.769297 (+1496479us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54008a9dd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:43.769376 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:43.769587 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32113,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":7122,"raft.queue_time_us":91,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":13067,"spinlock_wait_cycles":260065152,"thread_start_us":241806,"threads_started":1,"wal-append.queue_time_us":337825,"wal-append.run_cpu_time_us":1422,"wal-append.run_wall_time_us":1100988}
I20260709 12:21:43.787503 15003 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:43.788297 11002 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:43.788679 15003 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:43.789017 15227 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:43.792171 15109 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:43.772725 15106 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:43.798079 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:43.799198 10935 raft_consensus.cc:2393] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:43.795308 15247 raft_consensus.cc:3055] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:43.800714 15247 raft_consensus.cc:740] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:43.801978 15247 consensus_queue.cc:260] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:43.803937 15247 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:43.806674 15177 consensus_meta.cc:287] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.620s	user 0.007s	sys 0.007s
I20260709 12:21:43.745615 15286 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:43.810305 15286 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:43.816674 15222 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:43.817101 10899 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:43.817549 14766 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:21:43.820859 15235 consensus_meta.cc:287] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 1.311s	user 0.009s	sys 0.015s
I20260709 12:21:43.820340 15295 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:43.822149 15227 consensus_queue.cc:1059] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:43.759348 15078 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:43.836668 15236 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.836897 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:43.837112 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:43.846124 15236 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:43.846704 15159 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:43.850301 11004 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:43.857388 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 106441us
I20260709 12:21:43.858560 15024 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:43.861155 15024 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:43.862375 15084 consensus_meta.cc:287] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.573s	user 0.007s	sys 0.025s
I20260709 12:21:43.884272 15084 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:43.845193 15250 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:43.888103 15257 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:43.889300 11082 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:43.890583 15250 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:43.864485 15312 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:43.891939 15312 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.892437 15312 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:43.875682 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.857945 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:21:45.058621 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 1.20081e+06us
I20260709 12:21:43.857628 11084 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8.
I20260709 12:21:43.865779 11050 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:43.867733 14984 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:43.825394 15177 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:43.874471 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:45.089344 11655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59414 (request call id 289) took 1226 ms. Trace:
I20260709 12:21:45.089679 11655 rpcz_store.cc:276] 0709 12:21:43.862656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.874195 (+ 11539us) service_pool.cc:224] Handling call
0709 12:21:45.089287 (+1215092us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:43.873224 11651 raft_consensus.cc:3055] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:45.094345 11651 raft_consensus.cc:740] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:43.877434 15032 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:43.985062 15312 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:44.603559 15106 consensus_meta.cc:287] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.807s	user 0.010s	sys 0.003s
I20260709 12:21:45.098523 15106 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:44.706305 11082 consensus_meta.cc:287] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.816s	user 0.013s	sys 0.002s
I20260709 12:21:44.759176 14963 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.770794 15236 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:44.844429 10977 connection.cc:256] RPC call timeout handler was delayed by -1.2389943170001061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
I20260709 12:21:44.846542 15257 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:44.848556 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:44.852128 14998 consensus_meta.cc:287] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 1.357s	user 0.014s	sys 0.015s
W20260709 12:21:44.951515 15234 consensus_meta.cc:287] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 1.241s	user 0.015s	sys 0.000s
I20260709 12:21:44.957535 10974 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:44.958308 15060 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:44.966893 15235 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:44.969901 10865 debug-util.cc:398] Leaking SignalData structure 0x7b0800229060 after lost signal to thread 9741
I20260709 12:21:44.969872 15319 consensus_queue.cc:1059] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:21:44.978672 15067 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.097s	user 0.013s	sys 0.003s
I20260709 12:21:44.984076 10901 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:44.984138 15222 consensus_queue.cc:1059] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:44.985146 15310 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:44.986141 15109 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:44.986577 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:44.988281 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2858) took 1384 ms. Trace:
W20260709 12:21:44.989827 11078 consensus_meta.cc:287] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 1.370s	user 0.016s	sys 0.023s
I20260709 12:21:44.993571 14766 raft_consensus.cc:3055] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:45.000144 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:45.002077 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:21:45.004144 11659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59414 (request call id 287) took 1624 ms (client timeout 1925 ms). Trace:
I20260709 12:21:45.009712 10936 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:45.021237 11011 consensus_meta.cc:287] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 1.136s	user 0.010s	sys 0.007s
I20260709 12:21:45.032667 15175 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:45.047674 14635 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:21:45.051323 15296 consensus_meta.cc:287] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 1.420s	user 0.017s	sys 0.009s
W20260709 12:21:45.062666 11084 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40200 (request call id 433) took 1865 ms (client timeout 2151 ms). Trace:
I20260709 12:21:45.059823 10899 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:45.074048 15231 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:45.078372 10831 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35614 (request call id 245) took 21161 ms (client timeout 15000 ms). Trace:
I20260709 12:21:45.079155 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:45.082882 15292 raft_consensus.cc:3055] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:45.083351 15112 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:45.083314 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41098 (request call id 303) took 3246 ms. Trace:
W20260709 12:21:45.084535 11079 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2797) took 3089 ms (client timeout 2201 ms). Trace:
I20260709 12:21:45.085669 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:45.086133 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 1.22044e+06us
I20260709 12:21:45.086606 11083 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:45.088271 15024 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:45.091238 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:45.092993 15177 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:45.199103 15112 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:45.199290 15078 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:45.200385 15067 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.318s	user 0.021s	sys 0.012s
I20260709 12:21:45.200078 15078 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.099660 15312 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:45.201685 11655 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:21:45.202068 15053 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:45.202939 15112 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:45.118503 11080 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.277s	user 0.003s	sys 0.002s
I20260709 12:21:45.203780 15129 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:45.204102 11011 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:45.203450 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:45.204414 15129 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:45.205729 11011 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 2854) took 1651 ms (client timeout 2185 ms). Trace:
I20260709 12:21:45.205852 11082 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:21:45.206808 15129 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:45.207280 14963 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:45.208655 14984 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:45.209458 14766 raft_consensus.cc:740] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:45.210548 14766 consensus_queue.cc:260] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.211537 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:45.212479 11658 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:45.212597 15229 raft_consensus.cc:3055] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:45.213153 15229 raft_consensus.cc:740] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
W20260709 12:21:45.213652 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 153960us
I20260709 12:21:45.213840 15067 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:45.214157 15229 consensus_queue.cc:260] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:45.214711 15292 raft_consensus.cc:740] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:45.215286 15229 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:45.215732 15292 consensus_queue.cc:260] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.217093 11007 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:21:45.217470 10900 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:45.217751 11077 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:45.218497 15067 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:45.219729 15067 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.123332 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2675) took 2756 ms. Trace:
I20260709 12:21:45.219468 15129 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.217504 11007 pending_rounds.cc:85] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 6
I20260709 12:21:45.220584 15129 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.221060 11007 pending_rounds.cc:107] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:21:45.221436 11007 raft_consensus.cc:2889] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:45.222121 15301 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.222575 15301 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.223505 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2849) took 3561 ms. Trace:
I20260709 12:21:45.249235 11007 rpcz_store.cc:276] 0709 12:21:41.661920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.373434 (+711514us) service_pool.cc:224] Handling call
0709 12:21:42.379325 (+  5891us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.221965 (+2842640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.223260 (+  1295us) spinlock_profiling.cc:243] Waited 2.84 s on lock 0x7b540012cfd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:45.223447 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6525015936}
I20260709 12:21:45.223693 15129 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:45.224119 15067 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:45.250834 15129 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:45.251369 15129 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.253849 15129 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:45.254379 15129 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:45.224287 11081 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:21:45.225020 11078 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
W20260709 12:21:45.225816 11654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59384 (request call id 515) took 2107 ms (client timeout 1771 ms). Trace:
I20260709 12:21:45.226071 15301 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:45.206130 11011 rpcz_store.cc:269] 0709 12:21:43.554473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.578511 (+ 24038us) service_pool.cc:224] Handling call
0709 12:21:45.205546 (+1627035us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b54000dd9d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:45.205648 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":703006976}
I20260709 12:21:45.226449 15175 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:45.261272 11049 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.68:41955 timed out after 1.925s (SENT) [suppressed 30 similar messages]
I20260709 12:21:45.262106 15175 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:45.260283 11654 rpcz_store.cc:269] 0709 12:21:43.118160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.135267 (+ 17107us) service_pool.cc:224] Handling call
0709 12:21:44.999889 (+1864622us) spinlock_profiling.cc:243] Waited 7.43 ms on lock 0x7b5800003998. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3beee 000000000036eb39 00007f9bb5eaf1e0 00007f9bb5f780c4 00007f9bb5f78131 00007f9bb5f260a0 00007f9bb5f25984 00007f9baf4a06d4 00007f9baf4a0662
0709 12:21:45.225713 (+225824us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17098112}
W20260709 12:21:45.226795 11079 rpcz_store.cc:269] 0709 12:21:41.995408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.166945 (+171537us) service_pool.cc:224] Handling call
0709 12:21:45.084118 (+2917173us) spinlock_profiling.cc:243] Waited 65 ms on lock 0x7b54000e0e54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:45.084327 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149516032}
I20260709 12:21:45.266534 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:45.267248 11079 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:45.228418 15053 raft_consensus.cc:3055] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:21:45.229429 11625 leader_election.cc:336] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.571s (SENT)
I20260709 12:21:45.268440 11625 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:45.269517 15319 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:45.269867 11625 leader_election.cc:336] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.607s (SENT)
I20260709 12:21:45.270341 11625 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:45.268097 15067 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:45.100788 15106 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:45.217864 10865 debug-util.cc:398] Leaking SignalData structure 0x7b0800241c20 after lost signal to thread 9744
W20260709 12:21:45.282051 10865 debug-util.cc:398] Leaking SignalData structure 0x7b080020ff80 after lost signal to thread 10868
I20260709 12:21:45.282724 15222 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:45.217772 14998 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:45.233515 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2673) took 2867 ms. Trace:
I20260709 12:21:45.233667 15310 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.234258 11085 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
W20260709 12:21:45.203370 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 219439us
I20260709 12:21:45.268045 15053 raft_consensus.cc:740] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:45.218575 15060 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:45.206907 11082 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2821) took 1805 ms (client timeout 2096 ms). Trace:
I20260709 12:21:45.240363 15177 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:45.240878 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:21:45.241118 10929 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 2178) took 2055 ms (client timeout 2071 ms). Trace:
W20260709 12:21:45.296044 11082 rpcz_store.cc:269] 0709 12:21:43.401853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.784307 (+382454us) service_pool.cc:224] Handling call
0709 12:21:45.206766 (+1422459us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b540011c6d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:45.206856 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239103360}
W20260709 12:21:45.241758 11659 rpcz_store.cc:269] 0709 12:21:43.379570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.379758 (+   188us) service_pool.cc:224] Handling call
0709 12:21:45.003852 (+1624094us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54001987d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:45.004062 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317976448}
I20260709 12:21:45.202220 15078 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:45.242630 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:45.214552 10899 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:45.244374 11080 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.406s	user 0.003s	sys 0.006s
I20260709 12:21:45.234632 11002 rpcz_store.cc:276] 0709 12:21:43.603609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.615054 (+ 11445us) service_pool.cc:224] Handling call
0709 12:21:43.615598 (+   544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:43.788729 (+173131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.988058 (+1199329us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54003796d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:44.988218 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396340480}
I20260709 12:21:45.099660 15032 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:45.217495 14635 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:45.232000 11084 rpcz_store.cc:269] 0709 12:21:43.197747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.393541 (+195794us) service_pool.cc:224] Handling call
0709 12:21:45.062565 (+1669024us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.242484 15296 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.220371 11076 rpcz_store.cc:276] 0709 12:21:42.366623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.118909 (+752286us) service_pool.cc:224] Handling call
0709 12:21:43.119220 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:43.334616 (+215396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.122814 (+1788198us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400217d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:45.123106 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493996416}
I20260709 12:21:45.206645 15024 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.095376 11651 consensus_queue.cc:260] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:45.248261 14963 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:45.294767 15310 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:45.260581 11078 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2818) took 1859 ms (client timeout 1887 ms). Trace:
I20260709 12:21:45.273461 11081 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
W20260709 12:21:45.317011 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 55772.1us
I20260709 12:21:45.231179 11050 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:45.219789 15109 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:45.284098 10865 debug-util.cc:398] Leaking SignalData structure 0x7b0800241720 after lost signal to thread 10960
W20260709 12:21:45.231840 10831 rpcz_store.cc:269] 0709 12:21:23.913156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.946981 (+ 33825us) service_pool.cc:224] Handling call
0709 12:21:45.071049 (+21124068us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:34.432038 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:34.432563 (+   525us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:34.432610 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:21:34.432627 (+    17us) tablet.cc:662] Decoding operations
0709 12:21:34.433140 (+   513us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:34.433196 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:34.433221 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:21:34.433559 (+   338us) tablet.cc:701] Row locks acquired
0709 12:21:34.433576 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:21:34.433712 (+   136us) write_op.cc:270] Start()
0709 12:21:34.433817 (+   105us) write_op.cc:276] Timestamp: P: 1783599694433666 usec, L: 0
0709 12:21:34.433831 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 12:21:34.434476 (+   645us) log.cc:844] Serialized 1308 byte log entry
0709 12:21:34.730935 (+296459us) op_driver.cc:464] REPLICATION: finished
0709 12:21:34.938829 (+207894us) write_op.cc:301] APPLY: starting
0709 12:21:34.938937 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:34.945686 (+  6749us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:34.945833 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:34.946401 (+   568us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:34.946628 (+   227us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:21:34.946673 (+    45us) write_op.cc:312] APPLY: finished
0709 12:21:34.946884 (+   211us) log.cc:844] Serialized 35 byte log entry
0709 12:21:34.947045 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:34.947136 (+    91us) write_op.cc:454] Released schema lock
0709 12:21:34.947176 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:34.947607 (+   431us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:34.947640 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":780659,"reported_tablets":26,"spinlock_wait_cycles":8448,"child_traces":[["op",{"apply.queue_time_us":181622,"apply.run_cpu_time_us":2242,"apply.run_wall_time_us":8797,"num_ops":3,"prepare.queue_time_us":181,"prepare.run_cpu_time_us":2718,"prepare.run_wall_time_us":2718,"replication_time_us":235222,"thread_start_us":132888,"threads_started":1}]]}
W20260709 12:21:45.286761 11085 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2793) took 3293 ms (client timeout 2173 ms). Trace:
I20260709 12:21:45.285578 11083 rpcz_store.cc:276] 0709 12:21:42.366167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.098171 (+732004us) service_pool.cc:224] Handling call
0709 12:21:45.086244 (+1988073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.232418 (+146174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.233277 (+   859us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b54000e0e50. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:45.233438 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4571359616}
I20260709 12:21:45.217110 15292 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:45.296473 10929 rpcz_store.cc:269] 0709 12:21:43.185195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.078745 (+1893550us) service_pool.cc:224] Handling call
0709 12:21:45.241031 (+162286us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:45.310853 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 96426us
I20260709 12:21:45.285670 15229 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:45.203538 11003 rpcz_store.cc:276] 0709 12:21:41.837025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.380193 (+543168us) service_pool.cc:224] Handling call
0709 12:21:42.380480 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.380674 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:21:42.454103 (+ 73429us) log.cc:844] Serialized 14 byte log entry
0709 12:21:45.046586 (+2592483us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b1800423e80. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b 00007f9bb0affd23 00007f9bb0b0023a 00007f9bb0f6aa2a
0709 12:21:45.082729 (+ 36143us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:45.082815 (+    86us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:21:45.082881 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.082968 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.083100 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33499,"prepare.queue_time_us":73285,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":4455,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":13608832,"thread_start_us":35814,"threads_started":1,"wal-append.queue_time_us":2629595}
I20260709 12:21:45.315465 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:45.324296 11082 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:21:45.318631 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:45.325235 11084 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
W20260709 12:21:45.325699 11084 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2830) took 1765 ms (client timeout 2173 ms). Trace:
W20260709 12:21:45.326015 11084 rpcz_store.cc:269] 0709 12:21:43.559848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.310709 (+1750861us) service_pool.cc:224] Handling call
0709 12:21:45.325647 (+ 14938us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.304817 15177 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:45.318033 11007 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:45.319121 10865 debug-util.cc:398] Leaking SignalData structure 0x7b0800241740 after lost signal to thread 10961
W20260709 12:21:45.319453 11085 rpcz_store.cc:269] 0709 12:21:41.992848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.166453 (+173605us) service_pool.cc:224] Handling call
0709 12:21:45.085368 (+2918915us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b5800017d98. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f260a0 00007f9bb5f25984 00007f9baf4a06d4 00007f9baf4a0662
0709 12:21:45.286685 (+201317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2588416}
W20260709 12:21:45.322293 11081 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2828) took 1758 ms (client timeout 1917 ms). Trace:
W20260709 12:21:45.316895 11078 rpcz_store.cc:269] 0709 12:21:43.401202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.560933 (+159731us) service_pool.cc:224] Handling call
0709 12:21:45.260522 (+1699589us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.211896 14766 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:45.330152 10865 debug-util.cc:398] Leaking SignalData structure 0x7b0800309d40 after lost signal to thread 11035
W20260709 12:21:45.331339 10865 debug-util.cc:398] Leaking SignalData structure 0x7b080003cf60 after lost signal to thread 11109
W20260709 12:21:45.327656 11081 rpcz_store.cc:269] 0709 12:21:43.559000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.001739 (+1442739us) service_pool.cc:224] Handling call
0709 12:21:45.317489 (+315750us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.219487 15235 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:45.333601 11082 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2829) took 1765 ms (client timeout 2109 ms). Trace:
W20260709 12:21:45.334053 11082 rpcz_store.cc:269] 0709 12:21:43.559406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.307092 (+1747686us) service_pool.cc:224] Handling call
0709 12:21:45.324778 (+ 17686us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:45.334761 10865 debug-util.cc:398] Leaking SignalData structure 0x7b080023d240 after lost signal to thread 11110
W20260709 12:21:45.335503 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 113873us
W20260709 12:21:45.336097 10865 debug-util.cc:398] Leaking SignalData structure 0x7b0800314ba0 after lost signal to thread 11683
I20260709 12:21:45.336915 11002 raft_consensus.cc:1240] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 8. Current term is 9. Ops: []
W20260709 12:21:45.337391 10865 debug-util.cc:398] Leaking SignalData structure 0x7b08000d1020 after lost signal to thread 11684
I20260709 12:21:45.338927 15053 consensus_queue.cc:260] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.340106 15053 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:45.342223 15032 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:45.342790 15032 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.344926 15032 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:45.345814 14963 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:45.346602 10930 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:45.347932 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:45.348369 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:45.348635 10927 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:21:45.349915 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:45.350898 10933 raft_consensus.cc:2410] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:21:45.353613 10901 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:45.354206 10865 debug-util.cc:398] Leaking SignalData structure 0x7b0800368680 after lost signal to thread 15284
I20260709 12:21:45.356325 15109 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:45.356547 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:45.357846 15042 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:45.358024 15060 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:45.358421 15042 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:45.359638 14517 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:21:45.360333 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:21:45.365422 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 407959us
I20260709 12:21:45.365257 11077 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
W20260709 12:21:45.366029 11077 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2834) took 1531 ms (client timeout 1791 ms). Trace:
W20260709 12:21:45.366557 11077 rpcz_store.cc:269] 0709 12:21:43.834619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.090848 (+1256229us) service_pool.cc:224] Handling call
0709 12:21:45.365971 (+275123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.329051 15175 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:45.330317 15177 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:45.351850 15106 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:45.337996 11651 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:45.369405 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53346 (request call id 364) took 2659 ms. Trace:
I20260709 12:21:45.351686 15257 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:45.314134 15222 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.313360 14998 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.369158 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:45.367647 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:45.420262 11083 raft_consensus.cc:2410] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 11 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:21:45.369028 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:45.344961 15296 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:45.379038 14635 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:45.384599 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:45.385737 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:45.390893 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:45.427582 11077 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:21:45.428145 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2824) took 2020 ms. Trace:
I20260709 12:21:45.428486 11077 rpcz_store.cc:276] 0709 12:21:43.407962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.372812 (+1964850us) service_pool.cc:224] Handling call
0709 12:21:45.428059 (+ 55247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.429425 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:45.393504 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.433640 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:45.434417 11084 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:45.395470 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:45.435823 11655 raft_consensus.cc:2393] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
W20260709 12:21:45.436632 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.437014 10901 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:45.437892 15296 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:45.438280 15296 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.438616 15296 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:45.438887 10901 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:45.439252 15235 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:45.440953 14998 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:45.375972 15106 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:45.442057 15106 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:45.442314 11085 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:45.442906 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2835) took 1603 ms. Trace:
I20260709 12:21:45.443202 11085 rpcz_store.cc:276] 0709 12:21:43.839057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.354522 (+1515465us) service_pool.cc:224] Handling call
0709 12:21:45.442842 (+ 88320us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.444286 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:45.444989 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:45.446204 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:45.447227 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:45.448769 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:45.448947 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:45.450827 11011 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:45.433691 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:45.452080 15236 consensus_queue.cc:1059] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:45.452821 10933 raft_consensus.cc:1240] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:45.453200 15236 raft_consensus.cc:3055] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:45.452112 10927 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:45.453613 15236 raft_consensus.cc:740] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:45.455175 15042 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:45.454900 15236 consensus_queue.cc:260] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:45.456202 15236 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:45.395696 15310 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:45.399701 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:45.459822 11076 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
W20260709 12:21:45.460359 11076 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60046 (request call id 2698) took 2226 ms (client timeout 2718 ms). Trace:
W20260709 12:21:45.460687 11076 rpcz_store.cc:269] 0709 12:21:43.234229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.399368 (+2165139us) service_pool.cc:224] Handling call
0709 12:21:45.460302 (+ 60934us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.398072 15234 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:45.361131 15024 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.469113 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:45.469331 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:45.444933 11085 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:45.409067 15067 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:45.409961 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 178945us
I20260709 12:21:45.470945 11050 leader_election.cc:400] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13.
I20260709 12:21:45.471726 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:45.472050 11050 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:45.412181 15257 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:45.472887 15257 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.375936 10936 rpcz_store.cc:276] 0709 12:21:42.677088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.698499 (+ 21411us) service_pool.cc:224] Handling call
0709 12:21:42.779271 (+ 80772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.008649 (+2229378us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b58008c5ad0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0ebc0aa 00007f9bb0f3e447 00007f9bb0f56fe7 00007f9bb0f587de 00007f9bb0f62b49 00007f9bb0f63416 00007f9bb0f5fd8f 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4
0709 12:21:45.329171 (+320522us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:45.329199 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:45.329240 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:45.329284 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.336636 (+  7352us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.336754 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":5048,"spinlock_wait_cycles":1524464000}
I20260709 12:21:45.372509 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:45.475572 10930 raft_consensus.cc:2393] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 13: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:21:45.424885 11083 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2831) took 1864 ms (client timeout 2201 ms). Trace:
I20260709 12:21:45.475961 15234 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:45.432166 10935 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:45.476536 15234 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:45.469781 11082 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:45.476305 11083 rpcz_store.cc:269] 0709 12:21:43.560320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.333313 (+1772993us) service_pool.cc:224] Handling call
0709 12:21:45.424824 (+ 91511us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.479607 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:45.480268 11083 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:45.482689 14635 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:45.482939 15310 consensus_queue.cc:1059] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:45.483603 15310 consensus_queue.cc:1243] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:45.484156 15310 raft_consensus.cc:3055] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:45.484467 15310 raft_consensus.cc:740] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:45.485364 15310 consensus_queue.cc:260] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.486321 15310 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:45.486935 11082 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:21:45.487084 15177 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.489087 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:45.482570 15067 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:45.494710 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.432901 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:45.430076 11077 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:21:45.496241 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2833) took 1665 ms. Trace:
I20260709 12:21:45.393879 15175 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.435041 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:45.433683 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:21:45.462260 11084 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60046 (request call id 2700) took 2187 ms (client timeout 2595 ms). Trace:
I20260709 12:21:45.453203 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:45.496310 11078 raft_consensus.cc:2393] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 11: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:45.496649 11077 rpcz_store.cc:276] 0709 12:21:43.831033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.429136 (+1598103us) service_pool.cc:224] Handling call
0709 12:21:45.496181 (+ 67045us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:45.501034 11084 rpcz_store.cc:269] 0709 12:21:43.275265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.397838 (+2122573us) service_pool.cc:224] Handling call
0709 12:21:45.462206 (+ 64368us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.497339 11079 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
I20260709 12:21:45.502316 11085 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:45.502249 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2836) took 1633 ms. Trace:
I20260709 12:21:45.502938 11078 rpcz_store.cc:276] 0709 12:21:43.868780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.420807 (+1552027us) service_pool.cc:224] Handling call
0709 12:21:45.502187 (+ 81380us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.500417 10927 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:21:45.499379 10935 raft_consensus.cc:2410] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 12:21:45.500728 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.495635 10974 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:45.501329 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2837) took 1632 ms. Trace:
I20260709 12:21:45.451987 15222 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:45.506564 11081 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:45.507324 11082 rpcz_store.cc:276] 0709 12:21:43.869216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.433329 (+1564113us) service_pool.cc:224] Handling call
0709 12:21:45.501260 (+ 67931us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:45.506705 11079 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40200 (request call id 435) took 1930 ms (client timeout 2069 ms). Trace:
W20260709 12:21:45.508558 11079 rpcz_store.cc:269] 0709 12:21:43.572368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.266266 (+1693898us) service_pool.cc:224] Handling call
0709 12:21:45.502589 (+236323us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.508677 10901 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:45.511791 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:45.512348 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:45.513037 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:45.512992 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:45.513264 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:45.477244 15106 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.516983 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:45.519956 11078 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:45.520867 11081 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:21:45.523903 11077 raft_consensus.cc:2410] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:21:45.524797 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:45.521839 10974 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:45.507768 14963 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:21:45.527377 10934 raft_consensus.cc:1240] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:45.527779 15275 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:45.527788 15321 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:45.522612 15222 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:45.536762 15222 raft_consensus.cc:697] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:45.537853 15222 consensus_queue.cc:237] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:45.540073 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.541499 11079 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
W20260709 12:21:45.542629 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 70696.1us
I20260709 12:21:45.544133 11081 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:21:45.545843 10974 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:45.547072 10974 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:45.547575 15275 raft_consensus.cc:697] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:45.548708 15275 consensus_queue.cc:237] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.549633 15109 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:45.550047 15109 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:45.550487 15109 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:45.552644 15177 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:45.553699 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:45.554281 11084 raft_consensus.cc:2376] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8. Re-sending same reply.
I20260709 12:21:45.555262 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:45.552599 15032 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:45.556526 15032 raft_consensus.cc:697] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 8 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:21:45.557024 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 51879.9us
I20260709 12:21:45.557458 15032 consensus_queue.cc:237] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.541260 10833 catalog_manager.cc:5697] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:45.579435 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:45.561930 11084 raft_consensus.cc:2393] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 13: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:45.548619 11622 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:45.586099 11076 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:45.543581 11050 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:45.589354 11083 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:45.589939 11085 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:21:45.593497 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:45.550136 14998 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:45.593149 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:45.599848 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:45.597549 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:45.515923 15175 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.601361 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:45.606334 11011 raft_consensus.cc:2393] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 9: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:45.601624 11081 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 8: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:45.604084 11082 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:45.538570 15257 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:45.609447 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:45.611796 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:21:45.612069 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 63687.2us
W20260709 12:21:45.612715 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.576617 15024 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:45.616710 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:45.620613 11007 raft_consensus.cc:2393] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 7: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:45.622785 11076 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:45.623566 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2806) took 3108 ms. Trace:
I20260709 12:21:45.623914 11076 rpcz_store.cc:276] 0709 12:21:42.514996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.613581 (+3098585us) service_pool.cc:224] Handling call
0709 12:21:45.622572 (+  8991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.623281 (+   709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.623483 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.626894 15236 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:45.627508 15236 raft_consensus.cc:697] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:45.628479 15236 consensus_queue.cc:237] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:45.629427 15257 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:45.617682 10833 catalog_manager.cc:5697] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 7 to 9, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 9 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:45.631973 11004 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 8: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:45.632349 11651 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:21:45.633167 15290 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:21:45.634099 15175 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:45.613236 11622 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:45.637684 11077 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:21:45.541110 15112 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:45.638703 11651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59398 (request call id 378) took 1770 ms. Trace:
I20260709 12:21:45.639819 15106 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:45.586934 14963 consensus_queue.cc:1059] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:21:45.652140 15175 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.656937 15175 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:45.660109 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 113109us
I20260709 12:21:45.660941 10974 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:45.661895 10974 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:45.662184 15175 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:45.662721 15060 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:45.662850 10974 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:45.663076 15175 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:45.653750 15109 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.661959 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:45.664378 14963 raft_consensus.cc:3055] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:45.655443 11651 rpcz_store.cc:276] 0709 12:21:43.868558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.868738 (+   180us) service_pool.cc:224] Handling call
0709 12:21:43.872992 (+  4254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.632849 (+1759857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.638643 (+  5794us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.664994 11658 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:45.663362 15060 raft_consensus.cc:697] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:45.663446 15042 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.666134 15060 consensus_queue.cc:237] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.666523 15042 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.667212 15175 raft_consensus.cc:697] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:45.664921 14963 raft_consensus.cc:740] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:45.668569 15042 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:45.668834 14963 consensus_queue.cc:260] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.669512 15109 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:45.600908 14998 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:45.670020 14963 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:45.670395 14998 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:45.670859 15290 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:45.670562 15175 consensus_queue.cc:237] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:45.665125 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 51963.8us
W20260709 12:21:45.672224 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.673616 15109 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:45.631963 10833 catalog_manager.cc:5697] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 7 to 11, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 11 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:45.682930 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:45.684147 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:45.677901 10974 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:45.690364 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:45.690956 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:45.691586 10935 raft_consensus.cc:1240] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:45.693572 11077 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:21:45.694247 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 426) took 2502 ms. Trace:
I20260709 12:21:45.694541 11077 rpcz_store.cc:276] 0709 12:21:43.192117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.692993 (+2500876us) service_pool.cc:224] Handling call
0709 12:21:45.693373 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:45.693983 (+   610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.694164 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.691704 10932 raft_consensus.cc:2393] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 8: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:45.700261 11084 raft_consensus.cc:1240] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:45.695683 11077 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:45.702244 10974 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:45.691172 11076 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:45.703293 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2809) took 3187 ms. Trace:
I20260709 12:21:45.703605 11076 rpcz_store.cc:276] 0709 12:21:42.515912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.690705 (+3174793us) service_pool.cc:224] Handling call
0709 12:21:45.691006 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.703063 (+ 12057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.703243 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.671391 15290 raft_consensus.cc:697] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:45.705930 11079 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
W20260709 12:21:45.719075 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.718650 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 427) took 2509 ms. Trace:
I20260709 12:21:45.718277 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2683) took 3326 ms. Trace:
I20260709 12:21:45.719758 10936 raft_consensus.cc:2376] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10. Re-sending same reply.
I20260709 12:21:45.719923 11084 rpcz_store.cc:276] 0709 12:21:42.374145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.635100 (+3260955us) service_pool.cc:224] Handling call
0709 12:21:45.700041 (+ 64941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.700711 (+   670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.700888 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.719449 11077 rpcz_store.cc:276] 0709 12:21:43.192393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.695201 (+2502808us) service_pool.cc:224] Handling call
0709 12:21:45.695535 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.701934 (+  6399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.702103 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.725246 11078 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
W20260709 12:21:45.731104 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:45.733800 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.741878 10927 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:45.717998 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:45.744776 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:45.740739 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2788) took 3750 ms. Trace:
I20260709 12:21:45.698729 15084 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:45.750499 10934 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
I20260709 12:21:45.748245 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:45.752929 11079 raft_consensus.cc:1240] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:21:45.753582 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2689) took 2529 ms. Trace:
I20260709 12:21:45.753890 11079 rpcz_store.cc:276] 0709 12:21:43.224134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.741516 (+2517382us) service_pool.cc:224] Handling call
0709 12:21:45.752717 (+ 11201us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:45.753328 (+   611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.753532 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.717741 15268 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:45.756729 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 213219us
I20260709 12:21:45.750370 11006 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:45.760340 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:45.760506 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:45.761229 10932 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 8: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:21:45.753594 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 301883us
I20260709 12:21:45.759253 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:45.772982 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:45.773701 10934 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
I20260709 12:21:45.779429 11082 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:45.781272 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:45.783290 11084 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:45.784503 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2687) took 2550 ms. Trace:
I20260709 12:21:45.785387 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 429) took 2591 ms. Trace:
I20260709 12:21:45.784901 11078 rpcz_store.cc:276] 0709 12:21:43.223178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.726031 (+2502853us) service_pool.cc:224] Handling call
0709 12:21:45.751848 (+ 25817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.773646 (+ 21798us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:45.773674 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:45.773719 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:45.773747 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.773801 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.773910 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.785992 11084 rpcz_store.cc:276] 0709 12:21:43.192861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.720928 (+2528067us) service_pool.cc:224] Handling call
0709 12:21:45.764584 (+ 43656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.783609 (+ 19025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.783756 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54528}
I20260709 12:21:45.786661 11076 raft_consensus.cc:1240] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:21:45.788039 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:45.790017 14517 consensus_queue.cc:1059] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:45.790192 10899 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:45.791038 15067 raft_consensus.cc:3055] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:45.791088 14517 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:45.791703 15067 raft_consensus.cc:740] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:45.791884 14517 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:45.792346 14517 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:45.792760 15067 consensus_queue.cc:260] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.794174 15067 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:45.797140 10899 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:45.798048 14635 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:45.798466 14635 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:45.798837 14635 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:45.798193 10899 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:45.811740 11655 raft_consensus.cc:1240] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:45.761905 10833 catalog_manager.cc:5697] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:45.752553 15084 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:45.824834 11085 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:21:45.813764 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:45.815651 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 428) took 2623 ms. Trace:
W20260709 12:21:45.822309 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 136613us
I20260709 12:21:45.829376 11076 rpcz_store.cc:276] 0709 12:21:43.192620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.720462 (+2527842us) service_pool.cc:224] Handling call
0709 12:21:45.786431 (+ 65969us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:45.815310 (+ 28879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.815582 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.764842 15078 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:45.831409 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2688) took 2608 ms. Trace:
I20260709 12:21:45.827483 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:45.836611 11007 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:21:45.829821 10974 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:45.838245 10974 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:45.826771 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:45.839990 11004 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:45.836119 11083 rpcz_store.cc:276] 0709 12:21:43.223494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.744800 (+2521306us) service_pool.cc:224] Handling call
0709 12:21:45.765111 (+ 20311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.811328 (+ 46217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:45.811354 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:45.831090 (+ 19736us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:45.831145 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.831211 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.831348 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1232768}
I20260709 12:21:45.835141 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2807) took 3310 ms. Trace:
I20260709 12:21:45.841285 11085 rpcz_store.cc:276] 0709 12:21:42.515332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.730452 (+3215120us) service_pool.cc:224] Handling call
0709 12:21:45.785076 (+ 54624us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:45.825347 (+ 40271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.825578 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.761545 15109 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:45.843950 15067 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:45.747833 11080 rpcz_store.cc:276] 0709 12:21:41.990626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.175690 (+185064us) service_pool.cc:224] Handling call
0709 12:21:43.752271 (+1576581us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b5800017d98. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f39fc0 00007f9bb5f24929 00007f9bb5f243d2 00007f9baf49bbd4
0709 12:21:43.752623 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:43.753277 (+   654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:43.753319 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:43.753871 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 12:21:43.823484 (+ 69613us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:45.305643 (+1482159us) log.cc:844] Serialized 14 byte log entry
0709 12:21:45.714445 (+408802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.714539 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:45.714590 (+    51us) raft_consensus.cc:1685] finished
0709 12:21:45.729851 (+ 15261us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.740661 (+ 10810us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3247,"prepare.queue_time_us":154364,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":34073,"raft.run_cpu_time_us":413,"raft.run_wall_time_us":80930,"spinlock_wait_cycles":4937088,"thread_start_us":1936781,"threads_started":4,"wal-append.queue_time_us":320924,"wal-append.run_cpu_time_us":1945,"wal-append.run_wall_time_us":1002505}
I20260709 12:21:45.852214 10974 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:21:45.862319 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.862556 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:45.863674 11050 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:45.863591 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.866266 11076 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:21:45.866977 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2702) took 2589 ms. Trace:
I20260709 12:21:45.867301 11076 rpcz_store.cc:276] 0709 12:21:43.277810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.830296 (+2552486us) service_pool.cc:224] Handling call
0709 12:21:45.856815 (+ 26519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.866684 (+  9869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.866916 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.833120 15084 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:45.869412 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.875276 10974 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:45.852442 15275 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:21:45.886404 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 60172.9us
I20260709 12:21:45.893224 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:45.871143 10833 catalog_manager.cc:5697] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 5 to 7, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 7 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:45.890741 10974 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:45.865715 15177 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:45.896358 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2703) took 2618 ms. Trace:
I20260709 12:21:45.898558 11009 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:45.899821 11083 rpcz_store.cc:276] 0709 12:21:43.278097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.841149 (+2563052us) service_pool.cc:224] Handling call
0709 12:21:45.879326 (+ 38177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.879515 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:45.879542 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:45.889047 (+  9505us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:45.896090 (+  7043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.896169 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.896303 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.907070 15106 consensus_queue.cc:1059] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:45.907919 15106 consensus_queue.cc:1243] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 0b171b6aaedc4f809f2753dcfadb14ce log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:21:45.908411 15106 raft_consensus.cc:3055] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:45.908732 15106 raft_consensus.cc:740] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:45.908648 14635 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:45.909713 15106 consensus_queue.cc:260] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:45.910254 15078 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:45.910797 14635 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:45.910923 15106 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:45.912058 11080 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:45.912689 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2832) took 2088 ms. Trace:
I20260709 12:21:45.912983 11080 rpcz_store.cc:276] 0709 12:21:43.824540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.911488 (+2086948us) service_pool.cc:224] Handling call
0709 12:21:45.911883 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.912457 (+   574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.912635 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.914672 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 437) took 2060 ms. Trace:
I20260709 12:21:45.916224 15112 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:45.901535 15234 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:45.918540 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:45.920501 10935 raft_consensus.cc:1240] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:45.892805 15321 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:45.897358 15032 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:21:45.932845 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.887233 15275 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:45.915007 11080 rpcz_store.cc:276] 0709 12:21:43.854720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.913734 (+2059014us) service_pool.cc:224] Handling call
0709 12:21:45.914034 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.914337 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:45.914366 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:45.914405 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:45.914442 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.914494 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.914600 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.929536 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2823) took 2524 ms. Trace:
I20260709 12:21:45.942878 11076 rpcz_store.cc:276] 0709 12:21:43.405622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.868142 (+2462520us) service_pool.cc:224] Handling call
0709 12:21:45.899949 (+ 31807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.921108 (+ 21159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:45.921139 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:45.921182 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:45.929250 (+  8068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.929327 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.929471 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.928773 10927 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8.
I20260709 12:21:45.910739 15078 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:45.935768 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 46255.3us
W20260709 12:21:45.966799 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 46012.9us
I20260709 12:21:45.965982 10833 catalog_manager.cc:5697] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 6 to 11, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 11 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:45.977468 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:45.977769 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:45.920984 15322 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:45.975656 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:45.974983 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:45.976743 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 436) took 2358 ms. Trace:
I20260709 12:21:45.919523 15234 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:45.980273 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:45.931918 15060 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:21:45.981220 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 146043us
W20260709 12:21:45.981910 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 91264.6us
I20260709 12:21:45.982674 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:45.983714 11083 rpcz_store.cc:276] 0709 12:21:43.618447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.904598 (+2286151us) service_pool.cc:224] Handling call
0709 12:21:45.930983 (+ 26385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.976344 (+ 45361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:45.976380 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:45.976433 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:45.976466 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.976531 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.976682 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.985016 10928 raft_consensus.cc:2410] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:21:45.985419 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:45.983933 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:45.992360 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:45.973629 15333 log.cc:927] Time spent T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:21:45.989121 10931 raft_consensus.cc:1240] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:45.988577 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:45.897054 15235 consensus_queue.cc:1059] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 12:21:45.996479 11076 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:21:45.934906 15032 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:45.987982 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:45.950496 15275 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:45.990593 11625 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:46.003517 10936 raft_consensus.cc:2393] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 10: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:46.034704 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2838) took 1041 ms. Trace:
I20260709 12:21:46.048141 11076 rpcz_store.cc:276] 0709 12:21:44.956031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.988309 (+1032278us) service_pool.cc:224] Handling call
0709 12:21:45.991764 (+  3455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.997111 (+  5347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.997316 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.878567 15290 consensus_queue.cc:237] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:45.982510 15322 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.039712 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:46.041894 10929 raft_consensus.cc:3055] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:46.053354 10929 raft_consensus.cc:740] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:46.041038 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:46.042814 11006 raft_consensus.cc:2393] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 11: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:46.034484 15060 raft_consensus.cc:697] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:46.044617 10833 catalog_manager.cc:5697] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 8 to 11, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 11 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:46.045094 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:46.043628 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 438) took 2180 ms. Trace:
I20260709 12:21:45.998423 10974 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:45.977523 15177 consensus_queue.cc:1059] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:21:46.034952 15032 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:46.049108 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:46.050485 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:46.067248 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:46.070024 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.066293 10932 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:46.064428 10929 consensus_queue.cc:260] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:46.059443 11080 rpcz_store.cc:276] 0709 12:21:43.862940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.942512 (+2079572us) service_pool.cc:224] Handling call
0709 12:21:45.986622 (+ 44110us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.018362 (+ 31740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:46.038135 (+ 19773us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:46.043132 (+  4997us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:46.043210 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.043297 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:46.043482 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.059590 11050 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:46.062748 11083 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
W20260709 12:21:46.061335 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 63015.8us
W20260709 12:21:46.063369 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.063640 11076 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:46.072790 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2690) took 2839 ms. Trace:
W20260709 12:21:46.045060 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 46768us
I20260709 12:21:46.074632 10974 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:46.074273 11079 rpcz_store.cc:276] 0709 12:21:43.224442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.762686 (+2538244us) service_pool.cc:224] Handling call
0709 12:21:45.785588 (+ 22902us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.864116 (+ 78528us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:21:45.973162 (+109046us) log.cc:844] Serialized 14 byte log entry
0709 12:21:46.063077 (+ 89915us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:46.063132 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:46.063189 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.063250 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:46.063694 (+   444us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":182929,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"thread_start_us":108961,"threads_started":2}
I20260709 12:21:46.079332 11079 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: [10.6-12.8]
I20260709 12:21:46.052875 15322 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:46.081615 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:46.072353 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:46.052722 15234 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:46.084421 10929 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:46.089883 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 122985us
I20260709 12:21:46.062948 15319 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:46.091768 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:46.082932 10833 catalog_manager.cc:5697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 7 to 9, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 9 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:46.093465 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.102689 10899 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:21:46.103698 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 106905us
W20260709 12:21:46.106153 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.109809 11080 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:46.112394 11010 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:46.145361 10977 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:46.081166 15346 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:46.155778 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:46.111104 10833 catalog_manager.cc:5697] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: config changed from index 8 to 10, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New cstate: current_term: 9 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:46.095428 15319 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:46.104295 15321 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:46.095114 15109 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:46.168182 15229 raft_consensus.cc:3055] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:46.168676 15229 raft_consensus.cc:740] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:46.170866 15319 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:46.172654 15296 consensus_meta.cc:287] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.734s	user 0.010s	sys 0.000s
W20260709 12:21:46.173888 14963 consensus_meta.cc:287] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.000s
I20260709 12:21:46.175107 14517 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:46.177372 14517 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:46.173128 10833 catalog_manager.cc:5697] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 7 to 10, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 10 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
W20260709 12:21:46.181984 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.142294 14766 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:46.186174 11083 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:46.186445 10934 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:46.090903 15234 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:46.169623 15229 consensus_queue.cc:260] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:46.199350 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:46.157647 15346 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:46.207700 11083 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:21:46.211894 11083 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:21:46.213748 11083 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:21:46.218096 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.200964 10833 catalog_manager.cc:5697] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 8 to 11, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 11 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:46.202617 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:21:46.203161 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 160512us
I20260709 12:21:46.144124 15235 consensus_queue.cc:1059] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:21:46.177866 15222 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 12:21:46.229619 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 77742.1us
I20260709 12:21:46.173100 15296 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:46.239391 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:46.240311 10934 raft_consensus.cc:2368] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13.
I20260709 12:21:46.241642 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:46.242203 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:46.242959 10934 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
W20260709 12:21:46.245024 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 100425us
I20260709 12:21:46.216226 15346 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:46.246093 11050 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:46.246798 10934 pending_rounds.cc:85] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 8
I20260709 12:21:46.236510 15357 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:46.250007 10934 pending_rounds.cc:107] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:21:46.250317 10934 raft_consensus.cc:2889] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:46.242308 10933 raft_consensus.cc:2376] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7. Re-sending same reply.
W20260709 12:21:46.232878 15310 consensus_meta.cc:287] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.746s	user 0.009s	sys 0.004s
I20260709 12:21:46.252509 10833 catalog_manager.cc:5697] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 9 to 11, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 11 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:46.256454 10935 raft_consensus.cc:2368] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13.
I20260709 12:21:46.258550 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:46.179834 15060 consensus_queue.cc:237] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:46.262427 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.263132 10930 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
W20260709 12:21:46.262455 15339 log.cc:927] Time spent T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.117s	user 0.001s	sys 0.001s
I20260709 12:21:46.261790 15229 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:46.266332 10977 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:46.266541 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 84108.2us
I20260709 12:21:46.263505 10930 pending_rounds.cc:85] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 4
I20260709 12:21:46.268275 10930 pending_rounds.cc:107] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:21:46.268546 10930 raft_consensus.cc:2889] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:46.261942 10833 catalog_manager.cc:5697] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: config changed from index 4 to 6, term changed from 5 to 6, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to <none>, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 6 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:46.253830 15357 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:46.241248 15236 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:21:46.279799 15357 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:46.282456 15296 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:46.296726 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:46.308089 11083 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:46.308991 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:46.309994 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:46.310372 11083 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:46.250733 15109 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:46.307134 11004 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:21:46.297205 10833 catalog_manager.cc:5697] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 7 to 9, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 9 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:46.320766 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 58135.2us
I20260709 12:21:46.328893 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:46.329675 10936 raft_consensus.cc:2368] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12.
I20260709 12:21:46.333901 15368 consensus_queue.cc:1059] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:46.340302 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:46.342547 15337 log.cc:927] Time spent T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
W20260709 12:21:46.335780 15342 log.cc:927] Time spent T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 12:21:46.353271 11083 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:46.330747 15109 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:46.359906 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:21:46.365690 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.367096 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:46.322978 15078 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:46.369378 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 107226us
I20260709 12:21:46.357362 10833 catalog_manager.cc:5697] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:46.342919 15067 raft_consensus.cc:697] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:46.377348 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:46.361483 14766 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.380674 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:46.387248 10899 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:46.388494 10899 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:46.395987 10899 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:21:46.379174 15348 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 12:21:46.384596 15234 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:46.407917 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:46.370893 15053 consensus_queue.cc:1059] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 12:21:46.416848 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 50278.9us
I20260709 12:21:46.373612 14517 consensus_queue.cc:1059] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:21:46.419746 10929 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:21:46.401840 14635 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:46.402068 15042 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:46.398241 15344 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:46.407284 15177 consensus_queue.cc:1243] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:46.428925 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:46.419521 15341 log.cc:927] Time spent T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
W20260709 12:21:46.425627 15349 log.cc:927] Time spent T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:21:46.432571 15292 raft_consensus.cc:3055] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:21:46.436029 15343 log.cc:927] Time spent T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
W20260709 12:21:46.436920 15359 log.cc:927] Time spent T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:21:46.436612 10833 catalog_manager.cc:5697] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 11 to 12, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 12 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:46.385692 14766 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:46.492074 10833 catalog_manager.cc:5697] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 5 to 6, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 6 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:46.493058 14766 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:46.440433 15360 raft_consensus.cc:3055] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:46.496124 15360 raft_consensus.cc:740] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:46.497102 15360 consensus_queue.cc:260] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:46.498499 15360 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:46.443274 15342 log.cc:927] Time spent T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:21:46.443099 10977 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:46.447479 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:21:46.436769 15355 log.cc:927] Time spent T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:21:46.500821 11083 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:46.502019 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2697) took 3268 ms. Trace:
I20260709 12:21:46.502514 11082 rpcz_store.cc:276] 0709 12:21:43.233880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.825678 (+2591798us) service_pool.cc:224] Handling call
0709 12:21:45.886355 (+ 60677us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:45.904227 (+ 17872us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:45.904276 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:45.935378 (+ 31102us) log.cc:844] Serialized 26 byte log entry
0709 12:21:46.186780 (+251402us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:46.186818 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.186890 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:46.501720 (+314830us) raft_consensus.cc:1685] finished
0709 12:21:46.501744 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:46.501919 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5697,"raft.queue_time_us":41645,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":33781,"thread_start_us":152091,"threads_started":1,"wal-append.queue_time_us":244044}
W20260709 12:21:46.534435 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.533529 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:46.539109 11083 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:46.540401 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:46.430357 15344 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:46.548269 11084 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.050s	sys 0.114s
W20260709 12:21:46.548743 11084 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.050s	sys 0.114s
W20260709 12:21:46.551132 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 476524us
W20260709 12:21:46.533207 15340 log.cc:927] Time spent T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:21:46.557101 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:46.553107 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:46.480626 15042 raft_consensus.cc:697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:46.557790 11082 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:46.505038 15292 raft_consensus.cc:740] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:21:46.564220 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 121200us
I20260709 12:21:46.570833 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 430) took 3374 ms. Trace:
I20260709 12:21:46.561373 10974 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:46.534200 15368 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.572865 10974 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:46.558413 11083 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:46.575706 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:46.543503 14766 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.531358 15319 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:46.576716 11083 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:46.571257 11077 rpcz_store.cc:276] 0709 12:21:43.196166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.721706 (+2525540us) service_pool.cc:224] Handling call
0709 12:21:45.775995 (+ 54289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:45.823190 (+ 47195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:45.823225 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:45.833547 (+ 10322us) log.cc:844] Serialized 26 byte log entry
0709 12:21:46.079896 (+246349us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:21:46.099196 (+ 19300us) log.cc:844] Serialized 14 byte log entry
0709 12:21:46.149756 (+ 50560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.149831 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:46.445112 (+295281us) spinlock_profiling.cc:243] Waited 6.29 ms on lock 0x7b180042fd60. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9baddedc0a 00007f9bb752d219 00007f9bb4e3458f 00007f9bade73571 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd
0709 12:21:46.557155 (+112043us) raft_consensus.cc:1685] finished
0709 12:21:46.570626 (+ 13471us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:46.570768 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18891,"prepare.queue_time_us":106870,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":134214,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":39127,"spinlock_wait_cycles":14464768,"thread_start_us":230976,"threads_started":2,"wal-append.queue_time_us":224424}
I20260709 12:21:46.583065 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:46.583637 10930 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:46.550190 15344 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:46.596829 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:46.570360 15363 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:46.602360 10899 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:46.543540 15362 consensus_queue.cc:1059] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:21:46.610545 11080 raft_consensus.cc:1240] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:46.619078 11004 raft_consensus.cc:1240] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: []
W20260709 12:21:46.602134 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 363443us
I20260709 12:21:46.634939 11083 raft_consensus.cc:3055] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:46.632942 10899 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:46.635376 11083 raft_consensus.cc:740] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:46.636219 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:46.636837 11010 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:46.555202 15067 consensus_queue.cc:237] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:46.639775 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:46.636308 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:46.639603 10899 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:46.643636 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:46.644534 11010 raft_consensus.cc:1240] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:46.644984 10899 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:46.590977 14766 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:46.651705 14766 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:46.648170 11003 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: []
W20260709 12:21:46.634971 14998 consensus_meta.cc:287] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.938s	user 0.012s	sys 0.001s
W20260709 12:21:46.658753 15369 log.cc:927] Time spent T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 12:21:46.660404 15374 log.cc:927] Time spent T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 12:21:46.661413 15335 log.cc:927] Time spent T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.499s	user 0.001s	sys 0.002s
I20260709 12:21:46.663039 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:21:46.665962 15106 consensus_meta.cc:287] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.755s	user 0.008s	sys 0.006s
I20260709 12:21:46.642930 15292 consensus_queue.cc:260] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:46.668783 15292 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:46.654341 14963 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:46.670164 14963 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.670531 14963 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:46.671972 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.637760 11652 raft_consensus.cc:1240] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:46.673347 15379 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:46.673835 15379 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:46.674206 15379 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:46.636544 15234 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:46.676245 15234 raft_consensus.cc:697] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:46.677166 15234 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:46.678777 11050 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:46.580794 15368 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:46.601980 15380 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:46.680748 10899 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:46.637903 15112 consensus_queue.cc:1059] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:21:46.655310 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:46.612527 15367 raft_consensus.cc:2764] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:21:46.682026 10932 raft_consensus.cc:2410] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:21:46.682552 11081 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2804) took 4176 ms. Trace:
I20260709 12:21:46.663673 11007 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:46.647230 11083 consensus_queue.cc:260] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:46.657331 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:46.704960 11081 rpcz_store.cc:276] 0709 12:21:42.506448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.611780 (+3105332us) service_pool.cc:224] Handling call
0709 12:21:45.645925 (+ 34145us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:45.701125 (+ 55200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:45.701169 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:45.746913 (+ 45744us) log.cc:844] Serialized 52 byte log entry
0709 12:21:45.932277 (+185364us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:45.932319 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.932390 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:46.682329 (+749939us) raft_consensus.cc:1685] finished
0709 12:21:46.682349 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:46.682498 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17874,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":27933,"thread_start_us":119268,"threads_started":1,"wal-append.queue_time_us":295426}
I20260709 12:21:46.708647 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2827) took 3150 ms. Trace:
W20260709 12:21:46.661429 15032 consensus_meta.cc:287] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.569s	user 0.006s	sys 0.002s
I20260709 12:21:46.709065 11085 rpcz_store.cc:276] 0709 12:21:43.558603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.869047 (+2310444us) service_pool.cc:224] Handling call
0709 12:21:45.891453 (+ 22406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.897156 (+  5703us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:21:46.083827 (+186671us) log.cc:844] Serialized 14 byte log entry
0709 12:21:46.600133 (+516306us) log.cc:844] Serialized 14 byte log entry
0709 12:21:46.708178 (+108045us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b180043b460. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9baddedc0a 00007f9bb752d219 00007f9bade75a40 00007f9bade704e4 00007f9bade70455 00007f9bb0f58060 00007f9bb0f6a716 00007f9bb0f7b287 00007f9bb0f7b208
0709 12:21:46.708321 (+   143us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:46.708369 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:46.708414 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.708480 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:46.708591 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":266091,"prepare.queue_time_us":218573,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":83,"raft.queue_time_us":267665,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5758,"spinlock_wait_cycles":6022912,"thread_start_us":366461,"threads_started":3,"wal-append.queue_time_us":292450}
I20260709 12:21:46.642395 15078 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:46.716668 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:46.643226 15053 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:21:46.711665 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 56434.2us
I20260709 12:21:46.716497 10901 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:46.720515 10977 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:46.680882 14635 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:46.728559 10974 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:46.698191 15222 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:21:46.719066 15373 log.cc:927] Time spent T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:21:46.710161 14517 raft_consensus.cc:3055] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:21:46.722162 15377 log.cc:927] Time spent T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.055s	user 0.002s	sys 0.000s
W20260709 12:21:46.737172 15084 consensus_meta.cc:287] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.843s	user 0.005s	sys 0.006s
I20260709 12:21:46.737605 15368 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:46.737905 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 94702us
I20260709 12:21:46.716662 15060 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:46.739061 15024 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:21:46.720692 15376 log.cc:927] Time spent T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:21:46.719872 15032 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:46.723598 15322 consensus_meta.cc:287] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.632s	user 0.007s	sys 0.001s
I20260709 12:21:46.766508 15322 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:46.742614 15222 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.716545 15380 raft_consensus.cc:697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:21:46.751600 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 112634us
I20260709 12:21:46.770105 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2712) took 1355 ms. Trace:
I20260709 12:21:46.770524 11079 rpcz_store.cc:276] 0709 12:21:45.415147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.095159 (+680012us) service_pool.cc:224] Handling call
0709 12:21:46.150647 (+ 55488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:46.557888 (+407241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:46.557945 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:46.591433 (+ 33488us) log.cc:844] Serialized 26 byte log entry
0709 12:21:46.728625 (+137192us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:46.728738 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.728832 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:46.769854 (+ 41022us) raft_consensus.cc:1685] finished
0709 12:21:46.769875 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:46.770045 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66577,"raft.queue_time_us":376083,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":35000,"thread_start_us":429797,"threads_started":2,"wal-append.queue_time_us":148035}
I20260709 12:21:46.755982 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2699) took 3481 ms. Trace:
I20260709 12:21:46.758038 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:46.760528 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:46.774047 11004 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:21:46.732304 14635 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:46.732739 15175 raft_consensus.cc:3055] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:46.750869 14766 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:46.757711 15078 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:46.743637 10936 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:46.738094 15319 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:46.768896 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 62103.9us
I20260709 12:21:46.769287 11006 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:21:46.754115 14517 raft_consensus.cc:740] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:46.754495 15112 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.687727 14998 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:46.777462 11008 raft_consensus.cc:1240] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:46.772306 11078 rpcz_store.cc:276] 0709 12:21:43.274815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.786302 (+2511487us) service_pool.cc:224] Handling call
0709 12:21:45.862933 (+ 76631us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.878751 (+ 15818us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:46.080376 (+201625us) log.cc:844] Serialized 14 byte log entry
0709 12:21:46.227178 (+146802us) log.cc:844] Serialized 14 byte log entry
0709 12:21:46.445692 (+218514us) log.cc:844] Serialized 14 byte log entry
0709 12:21:46.725847 (+280155us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b180029b420. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade73522 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:21:46.742032 (+ 16185us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:46.742085 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:46.742127 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.742193 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:46.755924 (+ 13731us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":486306,"prepare.queue_time_us":206939,"prepare.run_cpu_time_us":171,"prepare.run_wall_time_us":26398,"raft.queue_time_us":841789,"raft.run_cpu_time_us":610,"raft.run_wall_time_us":44035,"spinlock_wait_cycles":29535488,"thread_start_us":528946,"threads_started":3,"wal-append.queue_time_us":136681}
I20260709 12:21:46.687470 15042 consensus_queue.cc:237] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:46.790611 11005 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:46.760308 15024 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:46.778260 10977 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:46.778275 15222 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:46.814628 15393 consensus_queue.cc:1059] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:46.816359 15393 raft_consensus.cc:3055] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:46.817260 10930 raft_consensus.cc:1240] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 9. Current term is 10. Ops: []
W20260709 12:21:46.817485 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.818310 15393 raft_consensus.cc:740] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:46.820099 10930 raft_consensus.cc:1240] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:46.819155 15393 consensus_queue.cc:260] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:46.821892 11083 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:46.824477 11009 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:46.757378 15084 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:46.776284 15175 raft_consensus.cc:740] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:46.822858 10901 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:46.776206 14635 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:46.827499 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.780864 15078 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:46.795405 15060 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:21:46.828287 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 99814.9us
I20260709 12:21:46.831482 11050 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:46.823174 10977 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:46.838999 11002 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:46.822382 15024 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:46.821200 15236 consensus_queue.cc:1059] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:21:46.778709 15371 consensus_queue.cc:1059] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:21:46.841884 15234 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:46.846071 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2701) took 3570 ms. Trace:
I20260709 12:21:46.849277 11084 rpcz_store.cc:276] 0709 12:21:43.275808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.822827 (+2547019us) service_pool.cc:224] Handling call
0709 12:21:45.874009 (+ 51182us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:45.901914 (+ 27905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:45.901945 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:45.928067 (+ 26122us) log.cc:844] Serialized 26 byte log entry
0709 12:21:46.549148 (+621081us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:46.549186 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.549255 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:46.721510 (+172255us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:46.838355 (+116845us) raft_consensus.cc:1685] finished
0709 12:21:46.838377 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:46.846009 (+  7632us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50233,"raft.queue_time_us":13820,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":2279,"spinlock_wait_cycles":90520320,"thread_start_us":560541,"threads_started":1,"wal-append.queue_time_us":646458}
I20260709 12:21:46.844992 11011 raft_consensus.cc:1240] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:46.845453 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2711) took 1430 ms. Trace:
I20260709 12:21:46.852466 15393 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:46.851357 11083 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:46.851275 11076 rpcz_store.cc:276] 0709 12:21:45.414893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.086208 (+671315us) service_pool.cc:224] Handling call
0709 12:21:46.105467 (+ 19259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:46.256729 (+151262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:46.256759 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:46.265123 (+  8364us) log.cc:844] Serialized 26 byte log entry
0709 12:21:46.379322 (+114199us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:46.379363 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.379441 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:46.845139 (+465698us) raft_consensus.cc:1685] finished
0709 12:21:46.845163 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:46.845378 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91575,"raft.queue_time_us":338010,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":41748,"thread_start_us":141866,"threads_started":2,"wal-append.queue_time_us":262039}
I20260709 12:21:46.840065 10901 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:46.838428 15078 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:46.864400 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 93635.2us
W20260709 12:21:46.846802 15357 consensus_meta.cc:287] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260709 12:21:46.822527 15112 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:46.827045 15319 consensus_queue.cc:1059] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
W20260709 12:21:46.867676 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:46.872725 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 76232.5us
I20260709 12:21:46.864943 15060 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:21:46.888947 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 48972.4us
I20260709 12:21:46.889305 11003 raft_consensus.cc:1275] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:21:46.866115 15275 consensus_meta.cc:287] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.805s	user 0.005s	sys 0.006s
I20260709 12:21:46.890012 10901 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:46.891974 11050 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:46.828933 14517 consensus_queue.cc:260] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:46.885201 15346 consensus_meta.cc:287] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.623s	user 0.003s	sys 0.007s
W20260709 12:21:46.893936 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 52982.2us
I20260709 12:21:46.892733 15381 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:46.897265 10974 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:46.885638 15234 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:46.890645 15060 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.889079 14963 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:46.896975 15222 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:46.906273 15372 raft_consensus.cc:3055] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:46.906705 15372 raft_consensus.cc:740] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:46.906996 15222 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:46.907714 15372 consensus_queue.cc:260] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:46.909346 15372 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:46.911357 11007 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:46.908066 15401 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:21:46.913072 15365 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:46.897864 15388 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:46.883735 15380 consensus_queue.cc:237] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:46.912070 15396 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:21:46.905077 15060 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:46.921801 10901 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:46.907045 14963 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:46.922842 15067 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:46.935134 10901 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:21:46.931419 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.898258 15310 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:46.881296 15357 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:46.899428 15175 consensus_queue.cc:260] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:46.929471 15344 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:46.970264 15175 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:46.970712 15112 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:46.971843 15344 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:46.973918 14998 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:46.937157 15032 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:46.917435 15322 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:46.898792 15346 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:46.974200 15396 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:46.977128 15396 raft_consensus.cc:697] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:46.964943 11050 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:46.978034 15396 consensus_queue.cc:237] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:46.979139 15388 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:46.968508 15379 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:46.979687 11050 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:46.980973 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:46.978361 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:46.982196 11077 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:46.982115 15365 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:46.967406 15357 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:46.978300 15346 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:46.984018 15084 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:46.984269 15379 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:46.984494 11011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2879) took 1271 ms. Trace:
I20260709 12:21:46.981750 11050 leader_election.cc:400] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12.
I20260709 12:21:46.964804 14517 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:46.984862 11011 rpcz_store.cc:276] 0709 12:21:45.712891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.713042 (+   151us) service_pool.cc:224] Handling call
0709 12:21:45.745743 (+ 32701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.851006 (+1105263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.984271 (+133265us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540012acd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:46.984433 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2527557760}
I20260709 12:21:46.983140 14766 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:46.985165 11050 leader_election.cc:403] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:46.894327 15275 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:46.999761 11051 leader_election.cc:400] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13.
I20260709 12:21:47.000142 11051 leader_election.cc:403] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:21:46.939584 15053 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:46.997184 10901 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:47.016604 11051 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:46.962499 15222 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:47.024194 11077 raft_consensus.cc:1240] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:47.027180 11051 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:46.995124 15319 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.027000 15268 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:47.031291 14635 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:47.033459 15368 raft_consensus.cc:3055] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:47.033733 15381 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:47.005404 15024 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:47.045646 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:47.006182 15365 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13.
I20260709 12:21:47.027830 15310 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:47.049901 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:47.050581 10933 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:47.041419 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:47.051483 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:46.982473 15388 consensus_queue.cc:1059] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:21:46.993671 15067 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:47.036573 15383 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.052996 10936 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:47.049320 11051 leader_election.cc:400] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12.
I20260709 12:21:47.040076 15268 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:47.079780 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.092252 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:47.029505 15321 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12.
I20260709 12:21:47.045441 15368 raft_consensus.cc:740] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:47.096727 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:21:47.110879 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 213655us
I20260709 12:21:47.117573 10974 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:47.120810 10933 raft_consensus.cc:2393] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 7: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:47.053961 15257 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:47.093050 11051 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:47.038818 15290 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:21:47.040649 15319 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:47.095450 15268 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:47.162565 15381 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:21:47.166967 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 74005.7us
W20260709 12:21:47.163818 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.094895 15310 raft_consensus.cc:697] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:47.181264 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:47.162744 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 45256.8us
I20260709 12:21:47.198539 10933 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:47.121019 15365 consensus_queue.cc:1059] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:21:47.200876 11051 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:47.204008 11007 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:47.166692 14766 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.119115 15383 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:47.205803 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:47.162063 15060 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:47.208978 15024 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:47.210033 15060 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:47.184203 15257 raft_consensus.cc:697] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:47.212448 15257 consensus_queue.cc:237] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:47.216066 15078 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:47.217170 14635 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:47.218258 15078 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:47.219413 15383 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:47.219980 15275 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:47.220505 15404 log.cc:927] Time spent T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:21:47.221462 11006 raft_consensus.cc:1240] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:47.224228 15388 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:47.224494 15365 raft_consensus.cc:3055] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:47.224980 15365 raft_consensus.cc:740] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:47.225865 15177 raft_consensus.cc:3055] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:47.226368 15310 consensus_queue.cc:237] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:47.221613 15323 raft_consensus.cc:3055] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:47.230526 15323 raft_consensus.cc:740] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:47.226358 15177 raft_consensus.cc:740] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:47.232298 10936 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:47.179644 15236 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.179414 15386 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:47.200341 15381 raft_consensus.cc:697] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:47.232507 15177 consensus_queue.cc:260] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:47.240065 15381 consensus_queue.cc:237] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:47.240561 15296 raft_consensus.cc:3055] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:47.241026 15296 raft_consensus.cc:740] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:47.241916 15296 consensus_queue.cc:260] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:47.248382 11006 raft_consensus.cc:1240] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 9. Current term is 10. Ops: []
W20260709 12:21:47.259972 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:47.270098 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 69307.7us
I20260709 12:21:47.270426 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2885) took 1519 ms. Trace:
I20260709 12:21:47.270884 11002 rpcz_store.cc:276] 0709 12:21:45.751435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.815969 (+ 64534us) service_pool.cc:224] Handling call
0709 12:21:45.848757 (+ 32788us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.839466 (+990709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.270143 (+430677us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b54000de3d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:47.270356 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2273593728}
I20260709 12:21:47.277136 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:21:47.278820 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 57660.7us
I20260709 12:21:47.314817 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:47.202052 15321 consensus_queue.cc:1059] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 12:21:47.328094 15362 consensus_queue.cc:1059] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:21:47.327876 15323 consensus_queue.cc:260] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:47.284201 15296 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:47.351472 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:47.349056 11076 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:47.352078 11081 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:47.238864 14766 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:47.348214 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:47.353755 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:47.450021 11078 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:47.451767 15386 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.452632 15396 raft_consensus.cc:3055] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:47.453091 15396 raft_consensus.cc:740] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:47.453992 15396 consensus_queue.cc:260] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:47.454586 15024 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:47.455155 15396 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:47.455119 15024 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:47.455659 15367 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.456283 15367 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:47.272639 15236 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:47.340826 11006 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 11.
I20260709 12:21:47.458709 15367 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:47.445367 15403 log.cc:927] Time spent T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 12:21:47.355392 11003 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:47.465961 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:47.431250 11079 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:47.340621 15412 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.447974 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:47.467502 11002 raft_consensus.cc:2410] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:21:47.468114 11085 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:47.449175 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 100778us
I20260709 12:21:47.225816 15365 consensus_queue.cc:260] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:47.238292 15368 consensus_queue.cc:260] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:47.450449 15321 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:47.482241 11078 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:47.452330 15386 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:47.444512 15411 log.cc:927] Time spent T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 12:21:47.464356 11051 leader_election.cc:336] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.925s (SENT)
I20260709 12:21:47.485615 11051 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:47.473023 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:47.492259 11077 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 11.
I20260709 12:21:47.500367 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:47.446621 15257 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:47.459014 15236 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:47.519191 10977 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:47.307559 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 270032us
I20260709 12:21:47.524441 11085 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:47.398758 11083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:60724
I20260709 12:21:47.527005 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:47.534430 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.536938 11083 raft_consensus.cc:606] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:47.537664 10901 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:47.538710 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:47.483705 15381 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:21:47.517025 15383 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:47.527738 11080 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
I20260709 12:21:47.543959 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:47.511119 15067 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:47.543702 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.525550 15275 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:47.544756 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:21:47.556137 15410 log.cc:927] Time spent T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 12:21:47.553372 15414 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:21:47.553364 15382 log.cc:927] Time spent T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.754s	user 0.000s	sys 0.006s
I20260709 12:21:47.554891 15396 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:47.558459 15175 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:47.555359 15375 log.cc:927] Time spent T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.833s	user 0.004s	sys 0.005s
I20260709 12:21:47.553548 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:47.555922 15310 consensus_queue.cc:1059] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:47.562206 15310 raft_consensus.cc:3055] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:47.548938 11083 raft_consensus.cc:614] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:47.562561 15310 raft_consensus.cc:740] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:47.560333 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:47.483898 15380 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:21:47.484895 15413 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:21:47.563532 15310 consensus_queue.cc:260] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:47.566771 15310 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:47.575831 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:47.573208 10901 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:21:47.578547 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 113764us
I20260709 12:21:47.584172 15319 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:47.544870 15236 consensus_queue.cc:1059] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:21:47.551836 15275 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.619256 14517 consensus_queue.cc:1059] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:47.526676 15257 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:47.611156 11081 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:21:47.611645 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:47.559006 15175 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:47.612891 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53346 (request call id 385) took 1361 ms. Trace:
I20260709 12:21:47.577921 15296 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.614367 14766 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:47.614879 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:47.616039 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 115003us
I20260709 12:21:47.558732 15396 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:47.580377 11622 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:47.625653 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:47.623593 10934 rpcz_store.cc:276] 0709 12:21:46.246053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.246230 (+   177us) service_pool.cc:224] Handling call
0709 12:21:46.246608 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:46.255692 (+  9084us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:46.255741 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:46.256234 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 12:21:46.331264 (+ 75030us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:46.331301 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.331367 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:47.284454 (+953087us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:47.587194 (+302740us) raft_consensus.cc:1685] finished
0709 12:21:47.587216 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:47.607679 (+ 20463us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36774784,"thread_start_us":38656,"threads_started":1,"wal-append.queue_time_us":396001}
I20260709 12:21:47.625653 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:47.633786 11006 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 12: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:47.628046 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:47.614228 15416 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:47.629258 14517 raft_consensus.cc:3055] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:47.633157 11081 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:47.637645 14517 raft_consensus.cc:740] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:47.635921 11003 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 13: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:47.589366 15290 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
W20260709 12:21:47.634656 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 54386.5us
I20260709 12:21:47.621695 15275 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:47.647444 11081 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:21:47.626885 15366 raft_consensus.cc:3055] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:47.497087 15321 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:47.618080 15106 consensus_queue.cc:1059] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:21:47.651849 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:47.500824 15412 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:47.659238 14517 consensus_queue.cc:260] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:47.639472 15416 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:47.656656 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:47.650367 14766 consensus_queue.cc:1059] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:21:47.674551 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:47.675319 11078 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:47.691123 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:47.692641 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:47.693238 11078 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:47.631649 15296 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:47.657675 15423 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.653185 15366 raft_consensus.cc:740] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:47.635692 15384 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.181s
I20260709 12:21:47.744192 14517 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:47.749106 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:47.749887 11081 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:47.766228 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:47.651736 15344 consensus_queue.cc:1059] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:21:47.787451 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:47.666358 15416 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:47.790795 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:47.791632 11080 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:47.664135 15042 consensus_queue.cc:1059] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 12:21:47.793706 11078 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:21:47.800998 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:47.786073 15106 raft_consensus.cc:3055] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:21:47.805398 15419 log.cc:927] Time spent T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 12:21:47.808441 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:47.814953 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:47.838501 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:47.810655 11081 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:21:47.839171 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:21:47.816291 15424 log.cc:927] Time spent T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:21:47.770534 15414 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
W20260709 12:21:47.846738 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 197387us
I20260709 12:21:47.848488 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:47.796722 15372 consensus_queue.cc:1059] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:21:47.852432 11078 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:47.853560 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:47.854189 11011 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:47.855084 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:47.855897 11079 raft_consensus.cc:2393] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 8: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:47.857329 11010 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:47.820526 15053 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:47.833142 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 182345us
I20260709 12:21:47.818106 15386 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:47.833791 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 183845us
W20260709 12:21:47.816838 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.845230 11006 raft_consensus.cc:2410] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:21:47.768239 15423 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:47.814706 14635 raft_consensus.cc:3055] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:47.867762 14635 raft_consensus.cc:740] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:47.867595 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:47.858901 11076 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:47.861845 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:47.860065 11010 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:47.871081 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:47.869755 11003 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:47.769583 15425 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:47.872447 11004 raft_consensus.cc:1240] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:21:47.873445 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:21:47.886694 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.847692 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:47.832449 15106 raft_consensus.cc:740] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:47.871665 11008 raft_consensus.cc:1240] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:47.886384 11009 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:47.864447 15268 consensus_meta.cc:287] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.679s	user 0.006s	sys 0.003s
I20260709 12:21:47.875476 15366 consensus_queue.cc:260] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:47.897298 14635 consensus_queue.cc:260] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:47.900490 11011 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:21:47.864105 15384 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:47.902660 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:47.905032 11006 raft_consensus.cc:2393] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:47.921229 14635 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:47.921705 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:47.922843 11006 raft_consensus.cc:2368] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10.
I20260709 12:21:47.924201 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:47.925292 11006 raft_consensus.cc:2393] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 13: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:47.874421 15053 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:47.930096 15053 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:47.928746 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:47.885468 15425 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.931345 15425 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:47.932426 15296 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:47.933089 15430 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:47.936264 15412 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:47.937434 10929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:21:47.936686 11006 raft_consensus.cc:2410] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:21:47.944613 15423 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:47.874562 15234 consensus_queue.cc:1059] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:21:47.942848 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:47.948357 11006 raft_consensus.cc:2393] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 12: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:47.949519 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:47.950372 11011 raft_consensus.cc:2393] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 14: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:47.952018 15384 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:47.945676 15321 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:47.954882 11080 raft_consensus.cc:2410] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:21:47.930892 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:47.957023 11009 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:47.957719 11005 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:21:47.960781 11003 raft_consensus.cc:2393] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 7: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:47.884330 15433 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.952425 11011 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:21:47.985668 11006 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:47.897303 15396 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:47.960194 15371 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.017s	sys 0.042s
I20260709 12:21:47.995625 11622 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:47.963228 15366 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:48.037635 11006 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:47.936926 15067 consensus_queue.cc:1048] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
W20260709 12:21:47.998250 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 114933us
I20260709 12:21:47.966583 15296 raft_consensus.cc:3055] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:47.999768 10929 raft_consensus.cc:606] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:47.985662 14766 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:47.904938 15268 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:48.043556 10929 raft_consensus.cc:614] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:47.997793 15386 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:48.056252 11078 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:21:48.057003 11006 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 12:21:48.056955 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 241428us
I20260709 12:21:48.057721 10899 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:48.047823 14766 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:47.988251 15275 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:48.065475 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.066826 11081 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:47.987496 15433 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:47.995497 15372 raft_consensus.cc:3055] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:48.076370 11080 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:48.077273 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:47.999127 15435 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.074s
W20260709 12:21:48.136572 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 63455.7us
I20260709 12:21:48.137365 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:48.042380 15296 raft_consensus.cc:740] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:21:48.075457 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 203073us
I20260709 12:21:48.140429 11006 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:48.170392 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.175674 11081 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:48.196205 11002 raft_consensus.cc:2368] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 9.
I20260709 12:21:48.035465 15106 consensus_queue.cc:260] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:48.211895 11624 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:48.226133 14766 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:48.059414 15386 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:48.280699 11006 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
I20260709 12:21:48.282088 15257 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:48.251917 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.138033 15372 raft_consensus.cc:740] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
W20260709 12:21:48.295724 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 238484us
W20260709 12:21:48.296038 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.299922 15436 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.300606 15436 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:48.302201 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:48.304306 15434 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:48.304841 15434 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.305199 15434 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:48.308869 10899 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:48.309759 10899 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:48.310513 10899 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:48.312001 15445 consensus_queue.cc:1059] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:48.144765 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:48.141458 15412 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.329596 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:48.315562 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:48.282383 15386 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:48.332293 15444 consensus_queue.cc:1059] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:21:48.333206 15444 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:48.333619 15067 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:48.334234 15067 raft_consensus.cc:697] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:48.334729 15443 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.282133 15236 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:48.322813 15257 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.308753 15268 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:48.332728 14766 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:48.337041 15412 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:48.228237 15438 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.293290 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:48.343640 15236 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.361370 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:48.363655 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:48.364311 10931 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:48.336244 11658 raft_consensus.cc:2393] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 10: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
W20260709 12:21:48.336841 15427 log.cc:927] Time spent T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.485s	user 0.000s	sys 0.001s
I20260709 12:21:48.351366 15257 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:48.349876 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:48.359305 10933 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:48.335270 15443 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:48.360014 15442 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:48.387490 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:48.387694 15442 raft_consensus.cc:697] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:48.381750 15425 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:48.388626 15442 consensus_queue.cc:237] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:48.390306 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:48.380518 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:48.390905 11655 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:48.391769 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:48.384244 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:48.392411 11085 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:48.379992 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:48.337981 11652 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:48.364638 15372 consensus_queue.cc:260] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:48.360783 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:48.359750 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:48.372097 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:48.393267 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:48.393621 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:48.391969 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:48.396088 11003 raft_consensus.cc:2368] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13.
I20260709 12:21:48.397728 10900 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:48.363804 15236 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:48.418797 11011 raft_consensus.cc:2368] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10.
I20260709 12:21:48.412611 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:48.357419 15433 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:48.357658 15436 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:48.335175 15067 consensus_queue.cc:237] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:48.512364 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.396324 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:48.468081 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.361649 15177 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:48.532473 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:48.433012 11078 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 12:21:48.476698 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 166242us
I20260709 12:21:48.535568 10899 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:48.474466 11085 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 12.
I20260709 12:21:48.470057 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:48.415282 11006 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:48.536986 11010 raft_consensus.cc:2393] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 16: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:48.519815 10927 raft_consensus.cc:2393] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 10: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:48.384948 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:48.436108 11050 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:48.537269 11622 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:48.420161 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:48.364229 15438 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:48.438273 15222 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:48.468891 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:48.556164 11003 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:48.539103 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:48.549933 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2623) took 1191 ms. Trace:
I20260709 12:21:48.557626 11085 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:21:48.441817 15319 raft_consensus.cc:3055] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:48.538357 15433 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:48.398010 15425 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:48.538369 15235 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:48.437742 15450 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:48.538570 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 102566us
I20260709 12:21:48.557878 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:48.419555 10935 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:48.558408 10936 rpcz_store.cc:276] 0709 12:21:47.358233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.444578 (+ 86345us) service_pool.cc:224] Handling call
0709 12:21:47.445004 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:47.819416 (+374412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:47.819446 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:47.819487 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:47.819517 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.549644 (+730127us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b54000609d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:48.549700 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:48.549864 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":860595584}
I20260709 12:21:48.561975 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:48.436812 15437 log.cc:927] Time spent T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:21:48.564656 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:48.577613 10932 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
I20260709 12:21:48.578624 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:48.559720 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:48.490774 15268 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:48.567704 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 355915us
I20260709 12:21:48.568645 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 447) took 1066 ms. Trace:
I20260709 12:21:48.557968 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:48.395567 15416 consensus_meta.cc:287] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.591s	user 0.009s	sys 0.000s
I20260709 12:21:48.569415 14517 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.580247 11624 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:48.580681 14517 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:48.582074 11050 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:48.373168 15384 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:48.377260 15412 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:48.378669 15275 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:48.537438 11005 raft_consensus.cc:2393] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:48.570860 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:48.476747 15372 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:48.418555 10930 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 6.
I20260709 12:21:48.538143 11009 raft_consensus.cc:2393] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:48.530525 15310 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.427254 15451 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:48.575989 11006 raft_consensus.cc:2393] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 8: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:48.576340 10933 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
I20260709 12:21:48.530161 15386 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:48.598052 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:48.580052 11077 rpcz_store.cc:276] 0709 12:21:47.502105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.522081 (+ 19976us) service_pool.cc:224] Handling call
0709 12:21:47.812859 (+290778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:47.813076 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:47.995486 (+182410us) log.cc:844] Serialized 14 byte log entry
0709 12:21:48.568298 (+572812us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:48.568356 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:48.568405 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.568472 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:48.568586 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40094,"prepare.queue_time_us":553542,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":43087,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":15013,"thread_start_us":693987,"threads_started":3,"wal-append.queue_time_us":418498}
I20260709 12:21:48.608359 11085 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:21:48.614403 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:48.615235 10928 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
W20260709 12:21:48.615680 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.617367 11003 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:21:48.559084 15222 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.582728 14517 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:48.603032 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:48.619035 11625 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:48.607246 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:48.570232 15414 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:48.566071 15319 raft_consensus.cc:740] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:48.564100 15436 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:21:48.606590 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:48.621836 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:21:48.622186 15447 log.cc:927] Time spent T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:21:48.622795 15417 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 1.078s	user 0.003s	sys 0.011s
I20260709 12:21:48.624348 15389 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:48.625140 15412 consensus_queue.cc:1059] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:48.626561 14963 raft_consensus.cc:3055] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:48.642854 14963 raft_consensus.cc:740] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:48.640102 15389 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.644304 15389 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:48.648306 15454 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:48.651288 15412 raft_consensus.cc:3055] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:48.651743 15412 raft_consensus.cc:740] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:48.587365 14766 raft_consensus.cc:697] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:48.657244 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:48.626405 15319 consensus_queue.cc:260] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:48.627269 15344 raft_consensus.cc:3055] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:48.627562 15414 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.607652 15268 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:48.627966 15310 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:48.628890 10936 raft_consensus.cc:2393] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 8: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:48.628697 15451 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:48.629696 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:48.630991 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:48.637738 11003 raft_consensus.cc:1275] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:48.640103 11005 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:21:48.608100 15425 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:48.671720 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:48.661772 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.603112 15416 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:48.673498 15323 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:48.673801 10934 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:48.674913 14766 consensus_queue.cc:237] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:48.678495 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:48.639092 15257 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:48.679162 11005 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
I20260709 12:21:48.681295 11010 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:48.683048 11010 raft_consensus.cc:1240] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:48.576777 15434 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:48.632028 15222 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:48.636271 15429 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.638787 15385 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.676779 15078 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.688541 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:48.631237 15386 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:48.644670 14963 consensus_queue.cc:260] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:48.663990 15344 raft_consensus.cc:740] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:48.582392 15450 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:48.703235 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:48.693010 11005 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
I20260709 12:21:48.692883 10931 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:48.693724 15429 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:48.685422 15275 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:48.693212 15401 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.716462 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:48.718601 11005 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:48.719019 10974 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:48.723088 14963 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:48.718231 15275 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:48.737562 15268 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:48.738425 15275 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:48.740895 10977 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:48.714960 15366 consensus_meta.cc:287] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.670s	user 0.008s	sys 0.002s
I20260709 12:21:48.745375 11005 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 12.
W20260709 12:21:48.709872 15421 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.020s	sys 0.027s
I20260709 12:21:48.670732 15414 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:48.739638 15275 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:48.697973 15078 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:48.749408 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:48.753446 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:48.754545 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:48.755149 11080 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
W20260709 12:21:48.756312 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.750123 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:48.748415 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:48.758051 10929 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:48.765359 11080 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:48.694612 15385 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:48.747617 15421 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.020s	sys 0.028s
I20260709 12:21:48.729652 15443 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:48.775024 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:48.775713 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 56797.9us
I20260709 12:21:48.779052 10974 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:48.780311 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 204610us
I20260709 12:21:48.782500 10974 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:48.759939 15436 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.783200 10929 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:48.768203 15310 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:48.807734 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:48.784600 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.723552 15401 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:48.807911 11078 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:21:48.793169 11080 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:21:48.812233 11050 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:48.794107 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.804894  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:21:48.776949 15235 raft_consensus.cc:697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
W20260709 12:21:48.817135 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 63498.5us
I20260709 12:21:48.772431 15462 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:48.781530 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:48.805744 15434 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:48.808728 15436 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:48.824523 15456 log.cc:927] Time spent T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:21:48.824888 15078 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:48.806666 15451 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:48.777661 15275 consensus_queue.cc:1059] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:21:48.829128 15310 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.831073 15385 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:48.759361 15344 consensus_queue.cc:260] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:48.834018  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:48.835592 15389 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:48.834717 15112 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:48.835673 15235 consensus_queue.cc:237] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:48.926721 15389 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:48.836299 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 55283.6us
I20260709 12:21:48.929041 15078 raft_consensus.cc:3055] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:48.929447 15078 raft_consensus.cc:740] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:48.927803 15344 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:48.930323 15470 log.cc:927] Time spent T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:21:48.908358 15401 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:48.928212 15454 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:48.837013 15462 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:48.837669 15466 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:48.920012 15310 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:48.850344 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:48.933248 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:48.934080 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 113780us
I20260709 12:21:48.939651 11050 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:48.864807 15469 log.cc:927] Time spent T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:21:48.851883 11656 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:21:48.847016 11652 raft_consensus.cc:1813] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Handling vote request from an unknown peer 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:48.848274 11010 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8.
I20260709 12:21:48.854887 11003 raft_consensus.cc:1240] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:21:48.857641 11081 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2869) took 1272 ms. Trace:
I20260709 12:21:48.949223 11081 rpcz_store.cc:276] 0709 12:21:47.585146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.848245 (+263099us) service_pool.cc:224] Handling call
0709 12:21:48.857435 (+1009190us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b540031db54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:48.857543 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":500609920}
I20260709 12:21:48.851058 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
W20260709 12:21:48.881656 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.851476 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:48.883881 10899 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:48.951160 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 67392.7us
I20260709 12:21:48.952201 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:48.852892 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:48.856190 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:48.885241 11051 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:48.953727 11659 raft_consensus.cc:2410] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:21:48.852504 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:21:48.839807 15444 consensus_meta.cc:287] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.506s	user 0.003s	sys 0.003s
I20260709 12:21:48.815057 15438 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:48.908907 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:48.961262 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:48.961880 11079 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:48.919814 15433 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:48.971626 11624 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:48.921229 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:48.922319 15222 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:48.843922 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.866799 15414 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:48.844728 15450 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:48.851212 15177 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:48.946593 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:21:48.849395 11002 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2302) took 1274 ms (client timeout 1675 ms). Trace:
I20260709 12:21:48.842017 15175 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:48.856771 15368 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:48.852592 15467 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:48.853220 15436 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:48.959033 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:48.978021 14963 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:49.079658 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 193812us
I20260709 12:21:48.969573 10899 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:49.083323 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 113820us
I20260709 12:21:48.996094 15432 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.970714 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:48.845445 15429 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:48.974918 10933 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
W20260709 12:21:48.989151 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 207028us
W20260709 12:21:48.996712 11002 rpcz_store.cc:269] 0709 12:21:47.575274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.575420 (+   146us) service_pool.cc:224] Handling call
0709 12:21:48.849187 (+1273767us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b540037aad4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:48.849342 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1308248448}
I20260709 12:21:49.073042 11652 raft_consensus.cc:2410] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 12:21:48.968029 15422 log.cc:927] Time spent T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 1.351s	user 0.009s	sys 0.012s
I20260709 12:21:49.090128 14517 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:48.960798 15454 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:48.972733 15444 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:49.072438 10935 raft_consensus.cc:2393] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:48.973093 15466 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:48.960126 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 74944.6us
I20260709 12:21:49.098665 14517 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:48.972966 15053 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:49.101104 15053 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:49.101660 15053 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:49.079404 15467 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:49.090762 15432 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:49.081590 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:48.852455 15386 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:49.078745 11005 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:49.108768 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.955505 15236 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:48.997812 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:49.109472 11081 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:49.088938 10974 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:49.111105 10974 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:49.090895 15434 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:49.111771 15434 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.112154 15434 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:49.112285 10974 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:49.113119 15175 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:49.108141 15429 consensus_queue.cc:1059] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:21:49.114049 10974 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:48.972631 15385 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:49.114682 15385 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.114892 11657 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:49.099786 15458 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:21:49.116585 15310 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:49.118597 15236 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:49.115031 15462 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:49.101023 15455 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.120172 11651 raft_consensus.cc:2393] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 11: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:49.121057 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 446) took 1778 ms. Trace:
I20260709 12:21:49.121269 11080 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:49.100064 15290 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:49.115484 15401 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:48.996498 15371 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.120020 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:49.091800 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:49.124449 11082 rpcz_store.cc:276] 0709 12:21:47.343002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.346025 (+  3023us) service_pool.cc:224] Handling call
0709 12:21:47.448900 (+102875us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:47.639483 (+190583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:47.639515 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:47.639560 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:47.639602 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:49.120843 (+1481241us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b5400277ed4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:49.120890 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:49.120999 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":437853568}
I20260709 12:21:49.126084 10933 raft_consensus.cc:2410] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:21:49.090806 11079 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:49.126855 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:49.099911 11051 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:49.106594 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:49.080772 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 141191us
I20260709 12:21:49.129382 11083 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
I20260709 12:21:49.129596 11050 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:49.128819 11051 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:49.114152 15429 consensus_queue.cc:1243] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:21:49.087432 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 78330.7us
I20260709 12:21:48.976643 15389 consensus_queue.cc:1059] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.111s
I20260709 12:21:49.135061 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:49.133512 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:49.135972 10929 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:49.136531 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:49.136701 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:49.137168 11082 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:49.130652 11051 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:49.131549 11083 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:49.139485 11005 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
I20260709 12:21:49.140218 10974 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:49.132419 15388 raft_consensus.cc:2764] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:21:49.009542 15078 consensus_queue.cc:260] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.141445 11624 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:49.142114 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:49.142601 11085 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:49.127740 15385 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:49.143570 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:49.153023 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:49.153661 10933 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:49.122329 15467 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:49.141000 15175 raft_consensus.cc:697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:49.148281 15429 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:49.148763 15444 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:49.163012 15429 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:49.148993 11082 raft_consensus.cc:3055] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:49.163515 15429 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:49.149720 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:49.164273 10929 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:49.163715 11082 raft_consensus.cc:740] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:49.165848 11082 consensus_queue.cc:260] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.129973 15455 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:49.156613 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:49.169481 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:49.169714 15455 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:49.170370 10930 raft_consensus.cc:2410] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:21:49.159560 15323 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:49.132078 15371 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.160907 10974 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:49.161974 15053 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.162087 15175 consensus_queue.cc:237] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:49.143429 15401 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:49.163245 15444 raft_consensus.cc:697] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:49.145231 10899 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:49.151610 15078 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:49.134758 15438 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:49.172165 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:49.235400 11006 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
W20260709 12:21:49.234721 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 89553.8us
I20260709 12:21:49.236960 10929 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
I20260709 12:21:49.238787 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:49.192895 15292 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.248206 15292 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.250397 15292 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:49.254449 11658 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:49.107967 15466 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.256119 15053 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:49.256476 15466 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:49.141394 15367 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:49.156236 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:49.257560 10933 raft_consensus.cc:2393] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 13: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:49.258520 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:49.183895 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:49.184937 11085 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:49.261863 11085 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:49.262528 15416 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:49.185868 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.186126 14517 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:49.155531 11622 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:49.264828 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:49.183817 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 54282.9us
I20260709 12:21:49.196812 15412 consensus_queue.cc:260] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.200100 15275 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:49.201711 11651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59384 (request call id 531) took 1105 ms. Trace:
I20260709 12:21:49.203981 15290 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.205725 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:49.284348 10936 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:49.208815 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:49.285863 10928 raft_consensus.cc:2410] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:21:49.213070 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:49.222131 15385 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:49.226353 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.226547 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:49.169831 15432 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:49.229599 10974 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:49.233294 15406 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:21:49.193420 11082 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:49.268878 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 113431us
I20260709 12:21:49.235096 15438 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:49.273712 11050 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:49.296692 15367 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.271445 15368 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:49.297303 15367 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:49.300693 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.301972 10928 raft_consensus.cc:1240] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:49.266460 10899 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:49.275365 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:49.276518 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:49.275282 15479 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.280400 15434 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:49.281222 11077 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:21:49.314700 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:49.315573 11077 raft_consensus.cc:2410] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:21:49.272010 15401 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:49.281852 15275 raft_consensus.cc:697] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:49.318445 10901 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:49.282835 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:49.263459 15430 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.263893 15042 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:21:49.291119 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 61608.2us
I20260709 12:21:49.292888 11622 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:49.291960 15474 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:49.268651 15032 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:49.304368 10930 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:21:49.332816 10930 pending_rounds.cc:85] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 8
I20260709 12:21:49.306860 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:49.307431 14517 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:49.334280 14517 raft_consensus.cc:697] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:49.335059 14517 consensus_queue.cc:237] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.333073 10930 pending_rounds.cc:107] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:21:49.336190 10930 raft_consensus.cc:2889] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:49.301429 11051 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:49.309803 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:49.287757 15290 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:49.344413 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:49.313488 10899 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:49.344784 11011 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:21:49.288044 15412 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:49.234150 15429 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.344378 10929 raft_consensus.cc:2393] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:49.320706 15367 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:49.312844 14963 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:49.351809 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 43811.9us
W20260709 12:21:49.326426 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.353350 10899 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:49.354138 11005 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
W20260709 12:21:49.326800 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.327781 10974 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:49.328893 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:49.271533 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.329663 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:49.301275 15438 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:49.339015 10936 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:49.323776 15436 consensus_queue.cc:1059] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:21:49.341055 15385 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:49.376988 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:49.324321 15401 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.342093 15275 consensus_queue.cc:237] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.286614 15222 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:49.304991 15466 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.293936 11652 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:49.349375 11082 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:21:49.350708 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 49367.1us
I20260709 12:21:49.360100 15321 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:49.358414 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:49.357810 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 90678.8us
I20260709 12:21:49.361163 10974 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:49.301105 15416 consensus_queue.cc:1059] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:21:49.277323 11651 rpcz_store.cc:276] 0709 12:21:48.096930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.140239 (+ 43309us) service_pool.cc:224] Handling call
0709 12:21:49.201455 (+1061216us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b54001374d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:49.201637 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1739919616}
I20260709 12:21:49.291429 15431 consensus_queue.cc:1059] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:21:49.327338 15042 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.357586 11077 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:49.383263 15458 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:49.374816 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:49.333035 15389 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:49.399173 15389 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.399232 10936 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:49.399699 15389 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:49.327338 15310 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:49.382730 15053 consensus_queue.cc:1059] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:21:49.404220 15310 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.328699 15463 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:49.406904 10977 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:49.397962 14635 raft_consensus.cc:3055] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:49.408293 14635 raft_consensus.cc:740] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:49.409263 14635 consensus_queue.cc:260] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.409843 10928 raft_consensus.cc:1240] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:49.410285 14635 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:49.317523 15292 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:21:49.312731 14766 consensus_queue.cc:1059] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:21:49.318102 15479 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.408058 15406 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:49.413862 15406 raft_consensus.cc:697] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:49.415014 15479 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:49.414779 15406 consensus_queue.cc:237] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.418365 10927 raft_consensus.cc:1240] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 12:21:49.385882 11051 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:49.419808 15319 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:49.420352 15042 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:49.421723 10931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 2233) took 1054 ms. Trace:
I20260709 12:21:49.422096 10931 rpcz_store.cc:276] 0709 12:21:48.366954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.367062 (+   108us) service_pool.cc:224] Handling call
0709 12:21:49.421530 (+1054468us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b540043b2d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:49.421641 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":354649856}
I20260709 12:21:49.358068 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:49.423638 11004 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:49.358108 15414 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:49.386046 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:21:49.390887 15386 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:21:49.428591 11082 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:49.388655 11050 leader_election.cc:400] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10.
I20260709 12:21:49.373935 15078 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:49.389674 10974 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:49.375577 15323 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:49.330708 15430 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:49.391996 10930 raft_consensus.cc:2393] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 10: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:21:49.392818 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.381206 15445 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:49.382261 15401 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:49.330847 15444 consensus_queue.cc:237] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:49.407752 15474 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:49.429296 15385 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:49.426846 10936 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:21:49.427623 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:49.387559 15321 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:49.458415 15321 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:49.385051 15432 consensus_queue.cc:1059] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:21:49.393668 15175 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:21:49.435149 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 46638.8us
W20260709 12:21:49.439194 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 49582.2us
I20260709 12:21:49.440461 11051 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:49.428397 15414 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.387244 15466 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.447748 15479 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:49.453954 11082 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 11.
I20260709 12:21:49.431155 15367 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.464340 11050 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:49.438922 15067 raft_consensus.cc:3055] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:49.450311 11004 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:49.447034 15323 raft_consensus.cc:697] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:49.472083 10974 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:49.473274 15429 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:49.474434 15468 log.cc:927] Time spent T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.703s	user 0.003s	sys 0.005s
I20260709 12:21:49.469875 15454 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:49.475090 15466 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:49.445901 15446 consensus_queue.cc:1059] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:21:49.476094 15474 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:49.461241 15436 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.434693 15439 consensus_queue.cc:1059] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:21:49.486233 15435 raft_consensus.cc:3055] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:49.378930 11083 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:49.480772 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:49.482447 15024 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:49.489136 15032 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:21:49.470990 15414 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:49.482823 15067 raft_consensus.cc:740] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:49.484440 15366 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:49.492791 15067 consensus_queue.cc:260] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.496272 15436 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.498618 15436 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:49.478726 15367 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.500869 15367 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:49.484318 15454 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.501907 15454 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:49.483892 15175 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:49.438661 15078 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.476004 15177 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:49.508244 15177 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.510385 15177 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:49.510541 15235 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.511085 15235 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:49.481598 10974 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:49.486697 15435 raft_consensus.cc:740] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:49.515365 15435 consensus_queue.cc:260] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:49.448772 15442 consensus_queue.cc:1059] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:21:49.456319 15431 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:21:49.509518 15389 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:49.468935 11051 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:49.481317 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:21:49.548321 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.548163 11002 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:21:49.534480 11011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2336) took 1151 ms. Trace:
I20260709 12:21:49.525228 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:49.528442 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2224) took 1176 ms. Trace:
I20260709 12:21:49.528275 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:49.516983 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:49.546731 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:49.545337 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:49.617311 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 153040us
I20260709 12:21:49.622720 10929 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:49.622834 11007 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:49.477334 15371 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:49.547562 11079 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:21:49.518613 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:49.617429 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:49.529901 15323 consensus_queue.cc:237] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.532092 15434 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:49.617579 15067 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:49.530907 15486 log.cc:927] Time spent T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:21:49.527151 15222 raft_consensus.cc:3055] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:49.623973 15175 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:49.641696 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:49.642321 11010 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:21:49.624792 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 159593us
I20260709 12:21:49.646317 10933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2629) took 1061 ms. Trace:
I20260709 12:21:49.628271 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:49.646804 11051 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:49.624580 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:49.647753 10935 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:49.626114 11082 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:49.640661 11658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59384 (request call id 534) took 1253 ms. Trace:
I20260709 12:21:49.621443 11011 rpcz_store.cc:276] 0709 12:21:48.383074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.555649 (+172575us) service_pool.cc:224] Handling call
0709 12:21:49.171940 (+616291us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b5800223598. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f260a0 00007f9bb5f25984 00007f9baf4a06d4 00007f9baf4a0662
0709 12:21:49.534283 (+362343us) spinlock_profiling.cc:243] Waited 84.5 ms on lock 0x7b540044ff54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:49.534415 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198962688}
I20260709 12:21:49.621785 10934 rpcz_store.cc:276] 0709 12:21:48.352203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.352327 (+   124us) service_pool.cc:224] Handling call
0709 12:21:48.352610 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:48.674271 (+321661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:49.528145 (+853874us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b5400370ad4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:49.528376 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":738254080}
I20260709 12:21:49.649420 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:49.630944 11079 raft_consensus.cc:1240] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:21:49.648837 11658 rpcz_store.cc:276] 0709 12:21:48.387125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.387246 (+   121us) service_pool.cc:224] Handling call
0709 12:21:49.640464 (+1253218us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b54004ce5d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:49.640603 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1992229632}
I20260709 12:21:49.651191 11011 raft_consensus.cc:2393] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 9: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:49.652969 11050 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:49.680348 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 198808us
I20260709 12:21:49.659497 10936 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:49.655473 10935 raft_consensus.cc:1275] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:49.708937 10974 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:49.713560 11654 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:21:49.650923 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:49.655539 10900 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:49.716596 14517 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:49.717173 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.717085 14517 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.714521 10974 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:21:49.718364 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 62909us
I20260709 12:21:49.718237 10901 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:21:49.718420 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 150169us
W20260709 12:21:49.640265 15491 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:21:49.647405 10933 rpcz_store.cc:276] 0709 12:21:48.585274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.259474 (+674200us) service_pool.cc:224] Handling call
0709 12:21:49.259822 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:49.272637 (+ 12815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:49.272667 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:49.273102 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 12:21:49.382478 (+109376us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:49.382515 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:49.382630 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:49.646098 (+263468us) raft_consensus.cc:1685] finished
0709 12:21:49.646120 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:49.646263 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12148,"raft.queue_time_us":14978,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"thread_start_us":88721,"threads_started":1,"wal-append.queue_time_us":192051}
I20260709 12:21:49.650130 15435 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:49.551595 15177 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:49.629477 15106 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:49.634443 15367 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:21:49.749781 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.751327 11082 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:21:49.631824 14963 raft_consensus.cc:3055] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:49.541538 15430 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:49.732084 15024 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:49.634058 15078 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:49.776822 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:49.738874 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 92149.2us
I20260709 12:21:49.733037 15467 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.726899 15406 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:49.792284 11622 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:49.793414 11622 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:49.727957 15175 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:21:49.740111 11077 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:49.694214 15365 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:49.743101 10933 raft_consensus.cc:1240] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:49.798959 11051 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:49.749688 15367 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.746822 14517 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:49.729960 10929 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:21:49.732151 15032 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:49.755263 11079 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:49.634611 15432 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 12:21:49.638387 15321 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.733284 15434 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:49.810982 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:49.637323 15222 raft_consensus.cc:740] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:21:49.785887 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 161845us
I20260709 12:21:49.742615 15388 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:49.797253 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 372260us
I20260709 12:21:49.799845 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:49.620201 15235 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:49.714643 11002 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:49.857146 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:49.804841 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:49.858210 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.858384 10933 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:49.745265 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:49.655599 15296 consensus_queue.cc:260] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.748598 15495 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:49.752563 14963 raft_consensus.cc:740] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:49.852044 10935 raft_consensus.cc:1240] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:49.853782 10899 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:21:49.860452 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 118360us
I20260709 12:21:49.864503 11050 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:49.865705 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:49.870517 11080 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
I20260709 12:21:49.857857 11002 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:49.875265 11077 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:49.875542 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:49.750108 15474 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
W20260709 12:21:49.869055 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.800836 15463 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:49.802752 15466 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.873998 10899 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:49.856096 15434 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.881050 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:49.790714 15406 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:49.814481 15319 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:49.883486 11083 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:49.852661 15432 consensus_queue.cc:1243] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:21:49.804327 15467 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.807029 15430 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:49.846978 15367 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:49.855969 15024 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:49.886893 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:49.892192 15434 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:49.895040 10899 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:49.899262 15290 consensus_meta.cc:287] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.003s
I20260709 12:21:49.918507 10899 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:49.897394 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:49.919443 10929 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
W20260709 12:21:49.897702 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 44145.6us
I20260709 12:21:49.757581 15177 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:49.920482 11050 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:49.921334 15497 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:49.921780 15497 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:49.922127 15497 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:49.922474 15177 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:49.923091 15292 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:49.923467 15292 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.923810 15292 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:49.924628 15493 log.cc:927] Time spent T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:21:49.926231 15453 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:49.926678 15453 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.926999 15453 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:49.929399 15463 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:49.930018 15321 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:49.932711 11002 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:49.933547 11079 raft_consensus.cc:2393] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 13: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:49.900046 11622 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:49.855572 15446 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 12:21:49.888533 15438 consensus_meta.cc:287] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.502s	user 0.004s	sys 0.004s
I20260709 12:21:49.885457 11077 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:21:49.860056 15366 consensus_queue.cc:1059] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:21:49.879930 15385 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:49.907552 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:49.892349 15235 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:21:49.911388 11010 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:21:49.888216 15296 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:49.914947 11005 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:49.867126 15495 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.889752 15032 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.915733 14517 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:49.894074 15406 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:49.931607 15479 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.911216 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:49.972503 11007 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
W20260709 12:21:49.935947 15412 consensus_meta.cc:287] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.000s
I20260709 12:21:49.901971 15414 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.951548 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:49.917237 15024 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:49.935089 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 48728.1us
I20260709 12:21:49.955899 10974 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:49.920619 15501 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.890611 15466 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.973577 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:49.904158 15042 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.914819 15401 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:49.981011 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:49.943681 15177 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.979035 11658 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:50.018743 11050 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:49.952455 15321 raft_consensus.cc:3055] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:21:49.948073 15310 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:49.953260 15430 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:49.970670 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:50.016762 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:49.917122 15445 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:21:49.938730 15438 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.956856 15495 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:50.023579 10930 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:49.971495 15389 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:50.025240 11010 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:49.951485 14766 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:21:49.932081 14963 consensus_queue.cc:260] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:49.935567 15290 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:50.041620 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:50.034986 11050 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:50.035441 11005 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:50.036011 10927 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:50.036011 11079 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:21:50.043609 11005 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:50.044000 11050 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:49.980491 15024 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:50.049101 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 450) took 1994 ms. Trace:
I20260709 12:21:49.972854 15032 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.052778 11010 raft_consensus.cc:1240] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:21:50.049486 11076 rpcz_store.cc:276] 0709 12:21:48.054650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.054763 (+   113us) service_pool.cc:224] Handling call
0709 12:21:48.057982 (+  3219us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:49.123677 (+1065695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:49.123707 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:49.124354 (+   647us) log.cc:844] Serialized 52 byte log entry
0709 12:21:49.222033 (+ 97679us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b4800210cd8. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb5e89aa1 00007f9bb5e80b37 00007f9bb5e809ca 00007f9bb5f7826f 00007f9bb5f77f37 00007f9bb5f8c55c 00007f9bb5f8c508 00007f9bb5f8c488 00007f9bb5f8c443 00007f9bb5f8b6ec 00007f9bb4eb5a96
0709 12:21:49.269262 (+ 47229us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:49.289814 (+ 20552us) log.cc:844] Serialized 14 byte log entry
0709 12:21:49.290036 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.048779 (+758743us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000df054. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:50.048836 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:50.048879 (+    43us) raft_consensus.cc:1685] finished
0709 12:21:50.048892 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:50.049042 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21204,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":5960,"raft.queue_time_us":4267,"raft.run_cpu_time_us":2545,"raft.run_wall_time_us":94598,"spinlock_wait_cycles":2463261824,"thread_start_us":125884,"threads_started":1,"wal-append.queue_time_us":163709}
I20260709 12:21:50.024773 15430 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.021543 15321 raft_consensus.cc:740] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:49.977576 15479 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.073930 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:50.050510 15454 consensus_meta.cc:287] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.548s	user 0.004s	sys 0.007s
I20260709 12:21:50.064038 11005 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:50.066090 11006 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 9: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:21:50.071010 14635 consensus_meta.cc:287] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.660s	user 0.008s	sys 0.000s
I20260709 12:21:50.071950 15508 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.096419 15508 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.096946 15414 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:50.032228 15385 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:50.061154 11655 raft_consensus.cc:2393] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 11: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:50.074725 11076 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:50.080871 11003 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:21:50.100075 11003 pending_rounds.cc:85] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 6
I20260709 12:21:50.100383 11003 pending_rounds.cc:107] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:21:50.100616 11003 raft_consensus.cc:2889] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:50.101123 15434 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:50.082646 11010 raft_consensus.cc:1240] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:50.103008 11010 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:50.102888 15292 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.104470 11010 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 12:21:50.049011 15366 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:50.091930 15454 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.106065 15366 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:50.107211 11076 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:50.107270 15454 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:50.108959 15434 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:50.112808 15042 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:50.113758 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:50.125203 15438 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:50.127224 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:50.127986 11080 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:50.133514 11083 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:21:50.135064 11083 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:21:50.136302 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2776) took 1262 ms. Trace:
I20260709 12:21:50.137399 11051 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:50.136722 11078 rpcz_store.cc:276] 0709 12:21:48.873913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.517662 (+643749us) service_pool.cc:224] Handling call
0709 12:21:49.617465 (+ 99803us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:49.624361 (+  6896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:49.624390 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:49.709410 (+ 85020us) log.cc:844] Serialized 26 byte log entry
0709 12:21:49.875020 (+165610us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:49.875054 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:49.875115 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:50.136044 (+260929us) raft_consensus.cc:1685] finished
0709 12:21:50.136065 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:50.136232 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16394,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":55296,"thread_start_us":121784,"threads_started":1,"wal-append.queue_time_us":212916}
I20260709 12:21:50.138574 11051 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:50.139461 11051 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:50.141588 15433 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:50.142210 15433 raft_consensus.cc:697] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:21:50.138724 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.143290 11007 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:21:50.045516 15504 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:50.138679 11078 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:21:50.025195 15462 consensus_queue.cc:1059] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:21:50.016261 15501 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.024984 15177 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.056596 14963 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:50.151371 11080 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 11.
I20260709 12:21:50.151577 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:50.111507 15388 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:50.156868 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:50.157536 11003 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:21:50.078099 15430 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:50.163690 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 119811us
I20260709 12:21:50.057130 15319 raft_consensus.cc:697] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:50.163991 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:50.165271 11050 leader_election.cc:400] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13.
W20260709 12:21:50.152477 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 196683us
I20260709 12:21:50.165661 11050 leader_election.cc:403] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:21:50.166371 15438 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13.
I20260709 12:21:50.166318 15175 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:50.166667 10974 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:50.167986 15175 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:50.168349 15175 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.168491 11050 leader_election.cc:400] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10.
I20260709 12:21:50.168782 15175 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:50.169723 11050 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:50.170559 15438 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:50.171047 11050 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:50.172297 11050 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:50.174022 11050 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:50.178457 15438 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:50.178478 15175 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.179672 15438 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:21:50.184151 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.183606 11082 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
I20260709 12:21:50.152451 15454 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:50.148449 15455 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:50.196486 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.207561 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:50.159745 15366 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:50.342373 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
W20260709 12:21:50.384311 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 210342us
I20260709 12:21:50.218308 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:50.366375 11624 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:50.348451 11077 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:50.344866 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.180236 15438 raft_consensus.cc:697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:50.233528 10930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2641) took 1572 ms. Trace:
W20260709 12:21:50.310317 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.427155 11077 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11. Ops: [9.10-10.11]
I20260709 12:21:50.323540 11005 raft_consensus.cc:1240] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:50.405443 11658 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:50.183357 15510 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:50.218714 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 265561us
W20260709 12:21:50.187162 15499 log.cc:927] Time spent T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 12:21:50.364446 15503 log.cc:927] Time spent T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
W20260709 12:21:50.341591 15496 log.cc:927] Time spent T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.429s	user 0.000s	sys 0.003s
W20260709 12:21:50.430516 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 64243.7us
I20260709 12:21:50.352524 15467 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:50.426546 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:50.415405 11050 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:50.450124 11081 raft_consensus.cc:2410] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:21:50.433920 15235 raft_consensus.cc:2804] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:50.434262 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:50.426403 10930 rpcz_store.cc:276] 0709 12:21:48.661298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.435822 (+774524us) service_pool.cc:224] Handling call
0709 12:21:49.436130 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:50.030241 (+594111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.233187 (+202946us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b540024b154. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:50.233444 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1344439680}
I20260709 12:21:50.341724 15401 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:50.187387 15388 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:50.428457 11622 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
W20260709 12:21:50.430886 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.428113 15319 consensus_queue.cc:237] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:50.438120 15366 raft_consensus.cc:697] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:50.436491 15510 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:50.439718 15438 consensus_queue.cc:237] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.441329 15175 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:50.441063 15024 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.207428 15454 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.486289 15454 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:50.311601 15466 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:50.357501 15508 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:50.218358 15385 raft_consensus.cc:697] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:50.489106 15385 consensus_queue.cc:237] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.228742 15290 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:50.222608 15455 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.442579 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:50.180827 15433 consensus_queue.cc:237] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.492161 15106 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.492776 15106 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:50.485280 15367 consensus_meta.cc:287] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.002s
I20260709 12:21:50.495036 15106 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:50.443512 11658 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:50.444178 10899 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:50.230304 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:50.424470 15463 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:50.376652 15514 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:50.450749 11081 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60046 (request call id 2780) took 1575 ms (client timeout 1770 ms). Trace:
W20260709 12:21:50.502403 11081 rpcz_store.cc:269] 0709 12:21:48.874921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.110111 (+235190us) service_pool.cc:224] Handling call
0709 12:21:50.449627 (+1339516us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b5400215da8. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d3d5f4 00007f9bb5f26227 00007f9bb5f25ab8 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:50.450679 (+  1052us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5313792}
I20260709 12:21:50.342447 15292 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:50.451241 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 243557us
I20260709 12:21:50.476536 15504 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:50.475711 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 60406.3us
I20260709 12:21:50.513612 11050 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:50.514882 11050 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:50.483637 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.457808 11652 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:50.487680 15024 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:50.489751 15365 consensus_meta.cc:287] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.679s	user 0.009s	sys 0.000s
I20260709 12:21:50.496238 11079 raft_consensus.cc:2393] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 12: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:50.496445 10931 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:21:50.454361 15235 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:50.497601 10975 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:21:50.496423 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 52451us
I20260709 12:21:50.498414 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:50.498732 10933 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:50.495105 15367 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.500388 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2928) took 1343 ms. Trace:
W20260709 12:21:50.476720 15296 consensus_meta.cc:287] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.517s	user 0.007s	sys 0.002s
I20260709 12:21:50.405782 15453 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:50.477897 15389 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:50.557122 15389 raft_consensus.cc:697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:50.558075 15389 consensus_queue.cc:237] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:50.187671 15497 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.510913 15430 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:50.512344 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.481765 15467 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:50.518141 11050 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:21:50.503326 15435 consensus_meta.cc:287] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.764s	user 0.011s	sys 0.000s
I20260709 12:21:50.521454 15466 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:50.502966 15511 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:50.543372 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2649) took 1456 ms. Trace:
I20260709 12:21:50.583468 10936 rpcz_store.cc:276] 0709 12:21:49.086797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.706822 (+620025us) service_pool.cc:224] Handling call
0709 12:21:49.710339 (+  3517us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:49.721965 (+ 11626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:49.722001 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:49.751050 (+ 29049us) log.cc:844] Serialized 52 byte log entry
0709 12:21:49.915531 (+164481us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:49.915570 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:49.915650 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:50.543064 (+627414us) raft_consensus.cc:1685] finished
0709 12:21:50.543088 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:50.543286 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11143,"raft.queue_time_us":15844,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":9788,"thread_start_us":104738,"threads_started":1,"wal-append.queue_time_us":183319}
W20260709 12:21:50.544275 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 46756.8us
I20260709 12:21:50.545123 10899 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:50.546054 15235 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:50.546397 15523 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:50.519497 15495 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.522594 15388 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:50.522859 15504 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.545367 10930 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:50.556474 15453 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:50.545127 11009 rpcz_store.cc:276] 0709 12:21:49.157223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.157614 (+   391us) service_pool.cc:224] Handling call
0709 12:21:49.947987 (+790373us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b5800223598. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f39fc0 00007f9bb5f24929 00007f9bb5f243d2 00007f9baf49bbd4
0709 12:21:49.948191 (+   204us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:49.948410 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:49.948434 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:49.956202 (+  7768us) log.cc:844] Serialized 26 byte log entry
0709 12:21:50.450970 (+494768us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:50.451010 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.451090 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:50.497129 (+ 46039us) raft_consensus.cc:1685] finished
0709 12:21:50.497186 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:50.500312 (+  3126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32365440,"thread_start_us":426773,"threads_started":1,"wal-append.queue_time_us":499728}
I20260709 12:21:50.568864 11051 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:50.571923 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 53877.9us
I20260709 12:21:50.575256 15430 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:50.606036 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.578195 11084 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
W20260709 12:21:50.523221 15406 consensus_meta.cc:287] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.545s	user 0.006s	sys 0.003s
I20260709 12:21:50.581719 11083 raft_consensus.cc:1240] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:21:50.582151 11081 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:50.551642 15067 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.588282 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:50.613821 11658 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:50.521951 14766 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:50.595499 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.568500 15024 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.583109 15365 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:50.610729 11078 raft_consensus.cc:1240] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:21:50.617089 10928 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:21:50.596325 15106 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:21:50.624558 10901 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.770s (SENT) [suppressed 22 similar messages]
I20260709 12:21:50.622082 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:50.625841 11009 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:50.628027 11658 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:50.629846 11050 leader_election.cc:400] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 9.
I20260709 12:21:50.630191 11050 leader_election.cc:403] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:50.598333 15466 raft_consensus.cc:697] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:50.601365 15511 raft_consensus.cc:697] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:50.610714 15524 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.642915 11659 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:21:50.643985 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:50.646230 11009 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:21:50.609023 15523 raft_consensus.cc:697] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:50.634999 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:50.625052 15514 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:50.611332 15368 consensus_queue.cc:1059] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:21:50.581169 15366 consensus_queue.cc:237] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.629261 15106 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.664788 11654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59398 (request call id 400) took 1268 ms. Trace:
I20260709 12:21:50.665254 11654 rpcz_store.cc:276] 0709 12:21:49.396667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.397383 (+   716us) service_pool.cc:224] Handling call
0709 12:21:49.433063 (+ 35680us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:49.718959 (+285896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.664450 (+945491us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54000eb854. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:50.664706 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644479744}
I20260709 12:21:50.668027 15032 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:50.624934 15463 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:21:50.672482 11009 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:50.617985 15454 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.641007 15510 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:50.674098 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:50.668857 10823 maintenance_manager.cc:419] P b5a9c6dd870a436699566823a8e6e1ca: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033586
I20260709 12:21:50.677665 11076 raft_consensus.cc:2393] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 13: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:50.657723 14963 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.623762 14766 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.620721 15067 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.627362 15024 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.621246 15406 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:50.680013 15517 log.cc:927] Time spent T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 12:21:50.674667 15234 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.682811 15526 consensus_queue.cc:1059] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:50.683809 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:50.713068 11076 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:50.670269 15106 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:50.683630 15523 consensus_queue.cc:237] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:50.684639 15512 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:50.685745 15462 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:21:50.661164 15514 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.694991 11081 raft_consensus.cc:2393] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 12: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:50.674916 15518 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:50.707602 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:50.708045 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:50.709230 11009 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:50.742348 10933 raft_consensus.cc:2393] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:21:50.709297 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 95309us
I20260709 12:21:50.712086 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:50.743544 11050 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:50.745210 11051 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:50.748103 15386 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:50.748769 15386 raft_consensus.cc:697] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:50.749750 15386 consensus_queue.cc:237] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.753032 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:50.753677 10931 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:50.754309 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:50.755426 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:50.757478 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:50.757663 10929 raft_consensus.cc:2393] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:50.758872 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:50.759958 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:50.765982 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 141441us
I20260709 12:21:50.766397 10933 raft_consensus.cc:2393] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 17: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:21:50.768775 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.767189 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:50.658857 15524 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:50.784220 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 98899.4us
I20260709 12:21:50.693812 14963 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.801446 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:50.803905 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:50.804527 11009 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:50.798306 10977 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:50.729324 15526 consensus_queue.cc:1243] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:50.743597 15522 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.806650 10977 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:50.808650 11010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2956) took 1370 ms. Trace:
I20260709 12:21:50.757367 15514 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:50.844151 11010 rpcz_store.cc:276] 0709 12:21:49.438049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.105236 (+667187us) service_pool.cc:224] Handling call
0709 12:21:50.108823 (+  3587us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:50.109750 (+   927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:50.109785 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:50.110327 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 12:21:50.337209 (+226882us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:50.337257 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.337335 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:50.808440 (+471105us) raft_consensus.cc:1685] finished
0709 12:21:50.808460 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:50.808588 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":393,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":89,"thread_start_us":226443,"threads_started":1,"wal-append.queue_time_us":316778}
I20260709 12:21:50.790165 15433 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:50.713101 15234 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:50.811846 15508 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:21:50.802390 15464 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.767316 15175 consensus_queue.cc:1059] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:21:50.797999 15463 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.850070 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:50.742758 15511 consensus_queue.cc:237] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.857084 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:50.879729 11010 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:50.881870 15454 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:50.755578 15466 consensus_queue.cc:237] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.809048 15516 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:50.859104 15495 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:50.861130 15234 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:50.862130 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:50.852147 15433 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:50.864815 15024 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:50.954434 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 147848us
W20260709 12:21:50.866358 15531 log.cc:927] Time spent T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:21:50.866815 15504 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:50.868327 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.869061 15524 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:50.870100 14766 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:50.874670 10932 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:21:50.846793 15522 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.946820 15175 consensus_queue.cc:1243] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:21:50.812670 15367 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:50.907109 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:50.910614 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:50.919116 15406 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:50.981144 15528 log.cc:927] Time spent T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 12:21:50.905074 15368 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:50.981735 15512 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:50.905316 15463 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:50.905181 15464 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:50.987454 10930 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:50.813331 15497 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:50.949117 15433 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:51.006505 10936 raft_consensus.cc:2368] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10.
I20260709 12:21:51.038563 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:21:50.962585 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.040042 10930 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:51.040592 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.891824 11010 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:51.010317 10933 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:21:51.009322 14766 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:51.016054 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40200 (request call id 460) took 1217 ms. Trace:
I20260709 12:21:50.999609 15504 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.002259 15508 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.042122 11082 rpcz_store.cc:276] 0709 12:21:49.798282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.799513 (+  1231us) service_pool.cc:224] Handling call
0709 12:21:51.015883 (+1216370us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b540031ea54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:51.015993 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":758179712}
I20260709 12:21:51.045990 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:51.052536 10936 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:51.053834 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:51.046348 10977 leader_election.cc:400] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10.
I20260709 12:21:51.054859 10977 leader_election.cc:403] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:51.005360 15523 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.056027 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:51.059607 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.060201 11076 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:21:51.059033 15523 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.062045 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:51.062582 11082 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:51.063688 15523 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:51.065577 15522 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:51.068892 11084 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40200 (request call id 444) took 3726 ms (client timeout 2068 ms). Trace:
W20260709 12:21:51.069347 11084 rpcz_store.cc:269] 0709 12:21:47.342499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.347982 (+  5483us) service_pool.cc:224] Handling call
0709 12:21:51.068693 (+3720711us) spinlock_profiling.cc:243] Waited 3.09 s on lock 0x7b54002788d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:51.068807 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7116821376}
I20260709 12:21:51.070386 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:51.071470 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:51.072597 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2890) took 1187 ms. Trace:
I20260709 12:21:51.078140 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2945) took 1832 ms. Trace:
I20260709 12:21:51.078588 11003 rpcz_store.cc:276] 0709 12:21:49.245601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.101524 (+855923us) service_pool.cc:224] Handling call
0709 12:21:50.101824 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:50.160286 (+ 58462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.077885 (+917599us) spinlock_profiling.cc:243] Waited 52.2 ms on lock 0x7b5400400bd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:51.078071 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120144768}
I20260709 12:21:51.080361 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2650) took 1973 ms. Trace:
I20260709 12:21:51.080766 10935 rpcz_store.cc:276] 0709 12:21:49.107398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.708162 (+600764us) service_pool.cc:224] Handling call
0709 12:21:49.810481 (+102319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:49.872053 (+ 61572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.080151 (+1208098us) spinlock_profiling.cc:243] Waited 78.2 ms on lock 0x7b5400202bd0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:51.080297 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179768704}
I20260709 12:21:51.082274 10935 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:51.084578 11002 raft_consensus.cc:3055] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:51.085759 10936 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:21:51.087334 11622 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:50.926209 15516 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:51.072980 11083 rpcz_store.cc:276] 0709 12:21:49.885474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.148172 (+262698us) service_pool.cc:224] Handling call
0709 12:21:50.164706 (+ 16534us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:50.619063 (+454357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.072351 (+453288us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54001a5ed4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:51.072539 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":929849728}
I20260709 12:21:51.079734 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.097532 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.097751 10977 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:51.039129 15236 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.084980 11002 raft_consensus.cc:740] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:21:51.100251 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.096109 11082 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:21:51.105495 10899 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:51.109926 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:51.112435 10930 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:51.114339 15406 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:51.114814 15406 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.115139 15406 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:51.117224 10934 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:51.120103 15497 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:21:51.120524 15544 log.cc:927] Time spent T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:21:51.120700 15497 raft_consensus.cc:697] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:51.125661 10931 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:51.127439 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:51.102572 11002 consensus_queue.cc:260] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.131664 11002 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:51.134234 10930 raft_consensus.cc:3055] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:51.134873 10930 raft_consensus.cc:740] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:51.136029 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:51.137444 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:51.021813 15368 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:51.192099 11003 raft_consensus.cc:2393] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 12: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:51.089036 15512 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10.
I20260709 12:21:51.143702 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:51.197431 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:51.139350 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:51.200021 11082 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:51.202189 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:51.192456 10930 consensus_queue.cc:260] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.203605 10930 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:51.206411 15067 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:51.208515 15177 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:51.052688 14766 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.058452 15508 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.105166 15518 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 9.
I20260709 12:21:51.104791 15522 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.200848 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:51.218216 11003 raft_consensus.cc:2393] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:51.210973 11076 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:51.055845 15504 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:51.225817 11082 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:21:51.131631 15175 consensus_queue.cc:1059] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 12:21:51.192513 15523 consensus_queue.cc:1059] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:21:51.229504 11010 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 13: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:51.230201 11624 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:51.138854 15524 consensus_queue.cc:1059] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 12:21:51.121587 15497 consensus_queue.cc:237] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.211164 10930 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:21:51.229362 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:51.238482 10930 raft_consensus.cc:1240] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:51.132247 15236 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:51.241341 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.248355 11003 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:51.249495 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.250731 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.251446 11003 raft_consensus.cc:2393] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 12: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:51.239419 15510 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:51.252691 15524 consensus_queue.cc:1243] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:21:51.245944 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:51.257457 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:21:51.238329 11652 consensus_meta.cc:287] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.691s	user 0.010s	sys 0.001s
I20260709 12:21:51.260219 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:51.261062 11076 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:21:51.262915 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:51.263639 11076 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:51.255565 15524 raft_consensus.cc:3055] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:51.265084 15524 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:51.265961 15524 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.267165 15524 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:51.268260 15523 raft_consensus.cc:3055] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:51.268678 15523 raft_consensus.cc:740] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:51.269580 15523 consensus_queue.cc:260] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.270809 15523 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:51.274266 11652 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:51.275224 15389 raft_consensus.cc:2764] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:21:51.256989 15512 raft_consensus.cc:3055] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:51.276201 15512 raft_consensus.cc:740] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:51.276998 15512 consensus_queue.cc:260] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.234016 14963 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:51.291786 11002 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:21:51.292290 11002 pending_rounds.cc:85] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 5
I20260709 12:21:51.293727 15368 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:51.294755 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:51.310590 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:51.295782 15516 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:51.268508 15463 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:51.227070 15522 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.312695 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.313483 11003 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 11.
I20260709 12:21:51.314213 15522 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:51.315129 10936 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:51.289350 15512 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:51.316198 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:51.317451 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:51.318354 15416 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 12:21:51.319099 11002 pending_rounds.cc:107] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:21:51.319386 11002 raft_consensus.cc:2889] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:51.292200 15479 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:51.319847 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2639) took 2659 ms. Trace:
I20260709 12:21:51.320308 10927 rpcz_store.cc:276] 0709 12:21:48.660704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.419296 (+758592us) service_pool.cc:224] Handling call
0709 12:21:49.425762 (+  6466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:50.042880 (+617118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.319150 (+1276270us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b540043b2d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:51.319646 (+   496us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b540043b2d0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:51.319787 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1417145472}
W20260709 12:21:51.321655 10932 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 2627) took 2750 ms (client timeout 2073 ms). Trace:
W20260709 12:21:51.322085 10932 rpcz_store.cc:269] 0709 12:21:48.571287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.578330 (+  7043us) service_pool.cc:224] Handling call
0709 12:21:51.321431 (+2743101us) spinlock_profiling.cc:243] Waited 2.14 s on lock 0x7b54001e5ad4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:51.321528 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4910516096}
I20260709 12:21:51.322168 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:51.323272 11003 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:51.324070 15433 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.324885 15504 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:51.325306 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:51.325969 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.326248 15433 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:51.297379 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2932) took 2139 ms. Trace:
W20260709 12:21:51.297340 15541 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 12:21:51.320034 15474 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:21:51.320633 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2959) took 1776 ms. Trace:
I20260709 12:21:51.358517 11002 rpcz_store.cc:276] 0709 12:21:49.544382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.126459 (+582077us) service_pool.cc:224] Handling call
0709 12:21:50.126792 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:51.084485 (+957693us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b54001935a0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0ed7dc0 00007f9bb0f621c0 00007f9bb0f63231 00007f9bb0f5fd8f 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c
0709 12:21:51.319817 (+235332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.320577 (+   760us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86743296}
I20260709 12:21:51.359716 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:51.327500 11007 rpcz_store.cc:276] 0709 12:21:49.158356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.029873 (+871517us) service_pool.cc:224] Handling call
0709 12:21:50.030118 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:50.143709 (+113591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.297120 (+1153411us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540029bdd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:51.297314 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":259511040}
W20260709 12:21:51.297750 15235 consensus_meta.cc:287] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.690s	user 0.010s	sys 0.000s
I20260709 12:21:51.337554 11003 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 12.
I20260709 12:21:51.353617 11076 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:21:51.361102 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.362099 15504 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.362890 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:51.370805 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:51.374050 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.374991 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:51.375694 11076 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 14.
I20260709 12:21:51.376574 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:51.377184 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.377310 11076 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:51.377815 11002 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
W20260709 12:21:51.378998 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.373267 11011 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:51.376502 11624 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:51.386461 11076 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:51.387349 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.387709 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:51.388864 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.389050 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:51.314499 15106 consensus_meta.cc:287] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.557s	user 0.008s	sys 0.000s
I20260709 12:21:51.326596 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:51.408855 11076 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:51.410846 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:51.411587 11076 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:51.417488 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:51.392576 14963 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.392424 15368 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:51.419989 11076 raft_consensus.cc:2393] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 11: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:51.357775 15406 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.457613 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:51.460718 11076 raft_consensus.cc:2410] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 13 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:21:51.457911 11011 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
W20260709 12:21:51.458349 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.465279 11011 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:51.465122 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:51.465864 11076 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:51.390697 15235 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:51.410215 15106 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.468109 11011 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:21:51.392319 15504 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.474248 11011 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:51.475626 11076 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:51.475677 11011 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:51.462800 15368 raft_consensus.cc:697] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:51.480830 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:51.457131 15508 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:51.482256 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:51.486274 11658 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:51.468430 14963 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.423027 15222 consensus_queue.cc:260] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.485625 14766 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:51.497913 15106 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:51.496769 15235 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:51.495509 15388 consensus_meta.cc:287] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.897s	user 0.010s	sys 0.000s
I20260709 12:21:51.506532 15388 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:51.508914 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.488849 11076 raft_consensus.cc:2410] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 12:21:51.484690 15467 consensus_meta.cc:287] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.886s	user 0.007s	sys 0.004s
W20260709 12:21:51.484458 15514 consensus_meta.cc:287] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.001s
W20260709 12:21:51.511116 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.503381 11011 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:21:51.494056 15505 log.cc:927] Time spent T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 1.456s	user 0.003s	sys 0.000s
I20260709 12:21:51.532521 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:51.533104 11076 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:51.533811 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:51.534428 11076 raft_consensus.cc:2410] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:21:51.499908 14963 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:51.538843 15548 log.cc:927] Time spent T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:21:51.523512 15467 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:51.539924 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:51.543053 15368 consensus_queue.cc:237] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:51.549264 10934 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:21:51.550506 10934 raft_consensus.cc:1240] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:51.529798 15508 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:51.553117 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.553717 11657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59384 (request call id 542) took 1658 ms. Trace:
I20260709 12:21:51.554140 11657 rpcz_store.cc:276] 0709 12:21:49.895439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.895675 (+   236us) service_pool.cc:224] Handling call
0709 12:21:51.553505 (+1657830us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b54001374d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:51.553638 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2241605888}
I20260709 12:21:51.555028 15236 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:51.556571 15406 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:51.558351 15504 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:51.559810 15549 log.cc:927] Time spent T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:21:51.547667 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2886) took 1665 ms. Trace:
I20260709 12:21:51.562553 11079 rpcz_store.cc:276] 0709 12:21:49.882209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.079720 (+197511us) service_pool.cc:224] Handling call
0709 12:21:51.547425 (+1467705us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b5400278dd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:51.547591 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":877562112}
I20260709 12:21:51.564162 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:21:51.564785 11655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59384 (request call id 540) took 2255 ms (client timeout 2415 ms). Trace:
I20260709 12:21:51.565634 11079 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: [10.6-13.8]
I20260709 12:21:51.572763 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2899) took 1403 ms. Trace:
I20260709 12:21:51.523546 15514 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.573225 11079 rpcz_store.cc:276] 0709 12:21:50.169617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.565044 (+1395427us) service_pool.cc:224] Handling call
0709 12:21:51.565383 (+   339us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:21:51.572440 (+  7057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.572704 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:51.574635 11084 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:51.577039 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2897) took 1409 ms. Trace:
I20260709 12:21:51.580237 15053 raft_consensus.cc:3055] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:51.580680 15053 raft_consensus.cc:740] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:51.572144 15508 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:51.581712 15518 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:51.582329 15518 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.584152 15078 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.584723 15078 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.586539 15516 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.586961 15078 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:51.587114 15516 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.589430 15516 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:51.589748 11083 raft_consensus.cc:2393] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 14: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:51.590675 15463 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:51.591284 15463 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:51.565521 11655 rpcz_store.cc:269] 0709 12:21:49.309421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.309567 (+   146us) service_pool.cc:224] Handling call
0709 12:21:51.564554 (+2254987us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b54007ddf54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:51.564689 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1663419648}
I20260709 12:21:51.593361 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:51.594010 11082 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
I20260709 12:21:51.594571 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:51.594691 15438 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.595218 11657 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:21:51.595315 15438 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:51.596794 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:51.581426 15053 consensus_queue.cc:260] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.597659 15438 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:51.591748 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.598286 15454 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.598206 15053 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:51.599493 15463 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:51.577497 15385 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:51.601505 11049 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:51.602584 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2893) took 1647 ms. Trace:
I20260709 12:21:51.602978 11078 rpcz_store.cc:276] 0709 12:21:49.955275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.150879 (+195604us) service_pool.cc:224] Handling call
0709 12:21:50.151217 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:50.626867 (+475650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.602336 (+975469us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b540011b7d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:51.602525 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1056143744}
I20260709 12:21:51.601408 15385 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:51.605150 15462 raft_consensus.cc:3055] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:51.605576 15462 raft_consensus.cc:740] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:51.605683 15385 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:51.607081 15366 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:51.607550 15366 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.608824 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:51.577433 11077 rpcz_store.cc:276] 0709 12:21:50.168023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.499201 (+331178us) service_pool.cc:224] Handling call
0709 12:21:50.499505 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:50.499721 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:50.660314 (+160593us) log.cc:844] Serialized 14 byte log entry
0709 12:21:51.576541 (+916227us) spinlock_profiling.cc:243] Waited 7.56 ms on lock 0x7b180043b880. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9baddedc0a 00007f9bb752d219 00007f9bade75a40 00007f9bade704e4 00007f9bade70455 00007f9bb0f58060 00007f9bb0f6a716 00007f9bb0f7b287 00007f9bb0f7b208
0709 12:21:51.576695 (+   154us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:51.576744 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:51.576805 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.576870 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:51.576986 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7183,"prepare.queue_time_us":289198,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":785940,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"spinlock_wait_cycles":17381632,"thread_start_us":290353,"threads_started":2,"wal-append.queue_time_us":328066}
I20260709 12:21:51.598873 15454 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.611927 15462 consensus_queue.cc:260] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.613245 15462 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:51.613850 15454 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:51.589460 15514 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:51.616288 15518 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:51.607949 15366 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:51.620147 15455 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:51.572826 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.631516 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.632197 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.632650 11622 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:51.632812 11009 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:51.631523 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.633962 11007 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
I20260709 12:21:51.634931 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.631819 11010 raft_consensus.cc:3055] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:51.640086 11010 raft_consensus.cc:740] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:51.591542 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:51.642439 11077 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:51.594887 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:51.648672 11082 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:21:51.649791 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.650347 11007 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:51.651096 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.651571 11007 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:51.653992 10901 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:51.655679 10901 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:51.657159 11084 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 12.
I20260709 12:21:51.655704 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.658593 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.659073 11007 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:21:51.659713 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.660187 11007 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:51.660754 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.661171 11007 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:51.661741 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.662631 11051 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:51.665166 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.665809 11004 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:51.666675 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.667232 11004 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:51.642373 11083 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 7.
W20260709 12:21:51.671123 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.673902 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.674721 11004 raft_consensus.cc:2368] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 9. Current term is 10.
I20260709 12:21:51.676354 10899 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:51.678578 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:51.678136 10901 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:51.688890 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:51.689880 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:51.691030 10931 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:21:51.691416 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 58861.4us
I20260709 12:21:51.641004 11010 consensus_queue.cc:260] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:51.693634 11010 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:51.663364 11051 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:51.696491 11051 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:51.677421 10899 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:51.697692 10899 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:51.698592 10899 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:51.700373 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:51.690536 11078 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:21:51.702385 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:51.703110 11004 raft_consensus.cc:2376] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17. Re-sending same reply.
I20260709 12:21:51.704264 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:51.704802 11004 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:51.709749 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:51.709935 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:51.562445 15464 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:51.714849 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2796) took 1111 ms. Trace:
I20260709 12:21:51.710481 10936 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
I20260709 12:21:51.715422 11077 rpcz_store.cc:276] 0709 12:21:50.603580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.641972 (+1038392us) service_pool.cc:224] Handling call
0709 12:21:51.642274 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:51.714267 (+ 71993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.714460 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:51.717610 15516 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:51.717898 15432 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:51.719956 10899 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:51.722576 11011 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 8.
I20260709 12:21:51.717382 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:51.612533 15501 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:51.663918 15455 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.688987 15431 raft_consensus.cc:2804] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:51.692987 15463 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:51.690847 14766 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.725229 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:51.742018 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.701653 15504 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.701522 14963 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:51.701153 15106 raft_consensus.cc:2764] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:21:51.820201 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:51.828801 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.813584 14766 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:51.755510 10974 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:51.744671 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:51.707178 15412 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:51.740473 14517 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:51.731304 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 465) took 1203 ms. Trace:
I20260709 12:21:51.847065 11080 rpcz_store.cc:276] 0709 12:21:50.527697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.597083 (+1069386us) service_pool.cc:224] Handling call
0709 12:21:51.597351 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:51.606632 (+  9281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:51.606669 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:51.606714 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:51.606763 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.731010 (+124247us) spinlock_profiling.cc:243] Waited 9.04 ms on lock 0x7b540044cad4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:51.731076 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:51.731234 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20798848}
I20260709 12:21:51.729341 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:51.727823 11077 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
W20260709 12:21:51.811096 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 108180us
I20260709 12:21:51.810698 10929 raft_consensus.cc:2393] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 8: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:51.711299 15385 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:51.707058 15510 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:51.707372 15497 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:51.785722 10900 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:51.726794 15432 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.814685 11007 raft_consensus.cc:1240] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:21:51.835819 11004 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:51.836396 11085 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:51.837330 11009 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:21:51.719105 15516 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.702535 15439 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:21:51.692683 15321 consensus_queue.cc:260] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.868716 15321 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:51.869211 15508 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:51.834813 14963 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.870004 14963 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:51.812120 15455 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.821552 15501 consensus_queue.cc:1059] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:21:51.844864 15078 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:21:51.867667 15516 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:51.701195 15406 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.111s
I20260709 12:21:51.702245 15451 consensus_queue.cc:1059] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.110s
I20260709 12:21:51.853574 14517 raft_consensus.cc:697] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:51.854595 11077 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:21:51.856029 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 177974us
I20260709 12:21:51.745294 15527 raft_consensus.cc:3055] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:51.863904 15432 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:51.877424 11083 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 12:21:51.892853 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2803) took 1283 ms. Trace:
I20260709 12:21:51.893185 11083 rpcz_store.cc:276] 0709 12:21:50.609460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.863913 (+1254453us) service_pool.cc:224] Handling call
0709 12:21:51.877055 (+ 13142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:51.892552 (+ 15497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.892788 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:51.845669 11010 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 12:21:51.894243 11010 pending_rounds.cc:85] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 10
I20260709 12:21:51.894495 11010 pending_rounds.cc:107] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 12:21:51.894723 11010 raft_consensus.cc:2889] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:51.880254 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:21:51.881126 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 95474.4us
I20260709 12:21:51.867895 15518 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.852851 15431 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.845090 15463 raft_consensus.cc:697] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:51.888114 11005 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:51.888350 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2802) took 1279 ms. Trace:
I20260709 12:21:51.888163 11080 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:21:51.780249 11011 pending_rounds.cc:85] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 7
I20260709 12:21:51.835282 15504 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.862653 15510 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:21:51.891906 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.862385 15412 raft_consensus.cc:697] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:51.857529 15416 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:51.898473 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:51.889640 14517 consensus_queue.cc:237] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:51.905686 11011 pending_rounds.cc:107] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:21:51.906095 11077 rpcz_store.cc:276] 0709 12:21:50.609226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.850907 (+1241681us) service_pool.cc:224] Handling call
0709 12:21:51.851253 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:51.887733 (+ 36480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.888291 (+   558us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:52.001895 11011 raft_consensus.cc:2889] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:52.003154 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2807) took 1328 ms. Trace:
I20260709 12:21:51.907815 11078 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: [7.5-12.7]
I20260709 12:21:51.886801 15366 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:51.909054 15463 consensus_queue.cc:237] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.904598 15431 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:51.911052 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40200 (request call id 467) took 1200 ms. Trace:
I20260709 12:21:52.009917 11084 rpcz_store.cc:276] 0709 12:21:50.710935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.071261 (+360326us) service_pool.cc:224] Handling call
0709 12:21:51.910861 (+839600us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b5400277ed4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:51.910990 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1075495168}
I20260709 12:21:52.011217 11084 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:52.011842 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2809) took 1314 ms. Trace:
I20260709 12:21:52.012153 11084 rpcz_store.cc:276] 0709 12:21:50.697499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.010739 (+1313240us) service_pool.cc:224] Handling call
0709 12:21:52.011033 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:52.011591 (+   558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.011788 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:51.882617 15385 raft_consensus.cc:697] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:51.885439 15497 raft_consensus.cc:697] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:51.917169 15515 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:21:51.921469 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 201585us
I20260709 12:21:51.865626 15177 consensus_queue.cc:1059] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:21:51.890614 15106 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:51.923916 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 464) took 1496 ms. Trace:
I20260709 12:21:51.890367 15527 raft_consensus.cc:740] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:51.925632 11050 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:52.016686 11079 rpcz_store.cc:276] 0709 12:21:50.427701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.574202 (+1146501us) service_pool.cc:224] Handling call
0709 12:21:51.574500 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:51.574716 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:51.890107 (+315391us) log.cc:844] Serialized 14 byte log entry
0709 12:21:51.923311 (+ 33204us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:51.923422 (+   111us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:51.923499 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.923608 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:51.923816 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47951,"prepare.queue_time_us":360057,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":59,"raft.queue_time_us":27070,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":26430,"thread_start_us":336097,"threads_started":2}
W20260709 12:21:52.017419 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 91848.6us
I20260709 12:21:51.940783 11654 raft_consensus.cc:2393] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 11: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
W20260709 12:21:52.016160 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 123019us
W20260709 12:21:51.945765 11006 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 2947) took 2699 ms (client timeout 1555 ms). Trace:
W20260709 12:21:51.949566 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:52.020001 11006 rpcz_store.cc:269] 0709 12:21:49.246096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.325808 (+ 79712us) service_pool.cc:224] Handling call
0709 12:21:51.945453 (+2619645us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b5400473e54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:51.945648 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1657564416}
I20260709 12:21:51.955070 15558 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:52.023540 15106 raft_consensus.cc:697] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:51.959892 15504 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:52.025180 15497 consensus_queue.cc:237] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:52.028163 15557 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:52.028849 15557 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:52.030328 15366 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:52.030867 15557 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:51.961477 15455 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:52.031504 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:51.966395 14766 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:51.973898 14963 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.975494 15412 consensus_queue.cc:237] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:52.032226 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2669) took 1021 ms. Trace:
W20260709 12:21:51.978950 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.032634 10927 rpcz_store.cc:276] 0709 12:21:51.010343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.321355 (+311012us) service_pool.cc:224] Handling call
0709 12:21:51.556529 (+235174us) spinlock_profiling.cc:243] Waited 973 us on lock 0x7b5800002d98. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f39fc0 00007f9bb5f24929 00007f9bb5f243d2 00007f9baf49bbd4
0709 12:21:51.556728 (+   199us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:51.557087 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:51.557114 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:51.557591 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 12:21:51.889920 (+332329us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:51.889965 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.890058 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:52.031930 (+141872us) raft_consensus.cc:1685] finished
0709 12:21:52.031950 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.032169 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3934,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":2236800,"thread_start_us":331904,"threads_started":1,"wal-append.queue_time_us":464135}
I20260709 12:21:52.003703 11077 rpcz_store.cc:276] 0709 12:21:50.674632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.002150 (+1327518us) service_pool.cc:224] Handling call
0709 12:21:52.002531 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:52.002781 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:52.002808 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:52.002855 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:52.002896 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.002952 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.003087 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:51.922600 15510 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:52.007947 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2806) took 1346 ms. Trace:
I20260709 12:21:52.036444 11078 rpcz_store.cc:276] 0709 12:21:50.661685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.907188 (+1245503us) service_pool.cc:224] Handling call
0709 12:21:51.907554 (+   366us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:21:52.007531 (+ 99977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.007878 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:52.036877 10901 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:52.037698 11078 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:52.015349 10899 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:52.016299 15515 consensus_queue.cc:1243] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:51.914119 15518 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:52.018649 11050 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:51.951012 15432 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:52.019498 15454 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:51.963388 15523 consensus_meta.cc:287] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.692s	user 0.005s	sys 0.006s
I20260709 12:21:52.060294 11050 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:52.062419 11050 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:52.032122 11657 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:52.035151 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2813) took 1287 ms. Trace:
I20260709 12:21:52.064266 11077 rpcz_store.cc:276] 0709 12:21:50.747633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.034342 (+1286709us) service_pool.cc:224] Handling call
0709 12:21:52.034670 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:52.034843 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:52.034867 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:52.034908 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:52.034947 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.035001 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.035103 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:52.007957 15416 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.063651 11050 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:52.067793 15365 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:52.067378 10901 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:52.070327 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:52.058993 14766 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:52.040990 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:52.041903 15527 consensus_queue.cc:260] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:52.045548 11622 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:52.031345 15385 consensus_queue.cc:237] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:51.941576 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2798) took 1337 ms. Trace:
I20260709 12:21:49.641978  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:52.052371 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2814) took 1304 ms. Trace:
I20260709 12:21:52.055577 15522 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:52.057515 10899 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:52.072110 11002 raft_consensus.cc:2410] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:21:52.068666 15053 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:21:52.071022 11077 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:52.080358 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:52.075590 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2810) took 1374 ms. Trace:
I20260709 12:21:52.075683 11078 rpcz_store.cc:276] 0709 12:21:50.754484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.037243 (+1282759us) service_pool.cc:224] Handling call
0709 12:21:52.037524 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:52.052092 (+ 14568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.052307 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:52.081945 11050 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:52.047184 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.080914 11084 rpcz_store.cc:276] 0709 12:21:50.701163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.012875 (+1311712us) service_pool.cc:224] Handling call
0709 12:21:52.013140 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:52.013355 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:52.014478 (+  1123us) log.cc:844] Serialized 14 byte log entry
0709 12:21:52.075219 (+ 60741us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:52.075288 (+    69us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:52.075340 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.075407 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.075534 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5812,"prepare.queue_time_us":8612,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":5933,"thread_start_us":54535,"threads_started":1}
I20260709 12:21:52.081318 14517 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:21:52.077199 11079 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:21:52.083513 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:52.082324 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:52.084275 11084 raft_consensus.cc:2393] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 7: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:52.081316 10899 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:52.024576 15106 consensus_queue.cc:237] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:52.066576 15416 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:52.059422 15366 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:52.067028 15557 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.033644 15516 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:52.094918 15563 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:52.103005 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2249) took 1952 ms. Trace:
I20260709 12:21:52.111963 15563 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.112658 15563 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:52.113807 15366 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:52.077860 15467 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:52.069854 15514 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:52.086863 15511 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:52.071501 15455 consensus_queue.cc:1059] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 12:21:52.113916 15550 log.cc:927] Time spent T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.648s	user 0.003s	sys 0.000s
I20260709 12:21:52.107569 10899 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:52.079504 15388 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:52.112021 10928 rpcz_store.cc:276] 0709 12:21:50.150536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.150652 (+   116us) service_pool.cc:224] Handling call
0709 12:21:50.163657 (+ 13005us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:50.623801 (+460144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.102721 (+1478920us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b540024bb54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:52.102935 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1042243328}
I20260709 12:21:52.111027 15522 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:52.084767 14517 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:21:52.076742 11082 rpcz_store.cc:276] 0709 12:21:50.604118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.649308 (+1045190us) service_pool.cc:224] Handling call
0709 12:21:51.710896 (+ 61588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:51.711220 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:21:51.890800 (+179580us) log.cc:844] Serialized 14 byte log entry
0709 12:21:51.941156 (+ 50356us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:51.941229 (+    73us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:51.941296 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.941368 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:51.941506 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20864,"prepare.queue_time_us":300225,"raft.queue_time_us":20841,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":25155,"spinlock_wait_cycles":22738048,"thread_start_us":191166,"threads_started":2,"wal-append.queue_time_us":119891}
I20260709 12:21:52.090003 15368 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:52.090608 11084 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:21:52.147300 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2904) took 1300 ms. Trace:
I20260709 12:21:52.147738 11084 rpcz_store.cc:276] 0709 12:21:50.846553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.088564 (+1242011us) service_pool.cc:224] Handling call
0709 12:21:52.088862 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:52.147038 (+ 58176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.147244 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:52.137696 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 55857.3us
I20260709 12:21:52.103276 11657 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:52.152283 11049 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:52.135977 15527 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:52.158793 10899 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:52.169787 11005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2962) took 2029 ms. Trace:
I20260709 12:21:52.177858 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2902) took 1570 ms. Trace:
I20260709 12:21:52.178320 11080 rpcz_store.cc:276] 0709 12:21:50.607331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.848287 (+1240956us) service_pool.cc:224] Handling call
0709 12:21:51.887941 (+ 39654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:51.905161 (+ 17220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.177679 (+272518us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b54000e1d50. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:52.177802 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48108928}
I20260709 12:21:52.170266 11005 rpcz_store.cc:276] 0709 12:21:50.140327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.491438 (+351111us) service_pool.cc:224] Handling call
0709 12:21:50.491820 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:51.913738 (+1421918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.169513 (+255775us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b540012c5d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:52.169718 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3210782976}
I20260709 12:21:52.148751 15522 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.144306 15558 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:52.120018 15557 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:52.156401 15366 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:52.174320 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2815) took 1393 ms. Trace:
I20260709 12:21:52.109951 15431 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:52.149288 15454 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:52.146641 15368 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:52.166903 15389 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.231415 15454 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.197645 11080 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:21:52.191758 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 121027us
I20260709 12:21:52.354285 10901 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:52.190973 11078 rpcz_store.cc:276] 0709 12:21:50.780788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.084564 (+1303776us) service_pool.cc:224] Handling call
0709 12:21:52.084949 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:52.085172 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:52.104902 (+ 19730us) log.cc:844] Serialized 14 byte log entry
0709 12:21:52.173937 (+ 69035us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:52.173992 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:52.174059 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.174126 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.174259 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22940,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"thread_start_us":68655,"threads_started":1}
I20260709 12:21:52.146772 15515 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:21:52.159559 15566 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:21:52.180958 15455 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:52.356105 11078 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:21:52.357586 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.188035 15522 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:52.164835 15053 consensus_queue.cc:1059] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
W20260709 12:21:52.368350 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 179672us
I20260709 12:21:52.189081 15558 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.378981 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:52.380446 10936 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:52.385093 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:52.385736 11078 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:52.387185 11080 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:52.272109 15368 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:52.362648 15454 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:52.412763 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:52.415891 10927 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:21:52.418087 15222 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:52.414739 14963 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:52.424705 14963 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:52.425175 14963 raft_consensus.cc:697] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:52.426009 14963 consensus_queue.cc:237] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:52.378459 15518 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:52.427284 15518 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:52.405659 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 253446us
I20260709 12:21:52.411266 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:52.272399 15366 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:52.412457 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:52.361776 15508 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:52.352864 15451 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:52.348029 15463 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.192111 15575 consensus_queue.cc:1059] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.221s
W20260709 12:21:52.430976 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 49618us
I20260709 12:21:52.433765 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:52.436507 11078 raft_consensus.cc:1240] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:52.379395 15455 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.382858 15558 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:52.424134 15438 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.364853 15389 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:52.452337 15366 raft_consensus.cc:697] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:21:52.453603 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:52.453781 15577 log.cc:927] Time spent T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:21:52.455600 15557 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:52.440936 15463 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:52.427719 15518 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:52.456142 15516 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:52.457257 15571 log.cc:927] Time spent T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 12:21:52.441526 15053 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:52.496423 15568 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
W20260709 12:21:52.485488 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 131286us
I20260709 12:21:52.440522 15455 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:52.443081 15323 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.494843 15463 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:52.516635 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.466320 15501 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:52.547020 10901 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:52.552544 10901 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:52.442761 15451 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:52.496688 15053 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:52.563382 11081 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 466) took 2002 ms. Trace:
I20260709 12:21:52.567469 11081 rpcz_store.cc:276] 0709 12:21:50.560612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.600588 (+1039976us) service_pool.cc:224] Handling call
0709 12:21:51.600902 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:51.601121 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:21:51.904853 (+303732us) log.cc:844] Serialized 14 byte log entry
0709 12:21:52.145519 (+240666us) log.cc:844] Serialized 14 byte log entry
0709 12:21:52.460559 (+315040us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b1800384460. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade73522 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:21:52.563018 (+102459us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:52.563075 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:52.563125 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.563199 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.563320 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11948,"prepare.queue_time_us":406226,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":3261,"raft.queue_time_us":48599,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":44189,"spinlock_wait_cycles":14690048,"thread_start_us":944222,"threads_started":3,"wal-append.queue_time_us":244658}
W20260709 12:21:52.571142 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 708871us
I20260709 12:21:52.546912 15582 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.469686 15438 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:52.560912 15567 raft_consensus.cc:2764] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:21:52.576587 10901 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:52.584627 10901 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:52.586376 10901 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:21:52.589197 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.569834 15523 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.558784 15575 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:21:52.549908 15323 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:52.558493 15501 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:52.589907 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 152886us
I20260709 12:21:52.582015 15515 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:52.601833 11625 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:52.601006 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 845516us
I20260709 12:21:52.590600 15566 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:52.593041 15412 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.620613 11081 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:21:52.622316 15389 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:52.623113 15389 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:52.608242 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:52.610713 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.614449 15053 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:52.615501 15575 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.616072 15515 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:52.648994 15515 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.649471 15515 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:52.620291 15566 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.599311 15516 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.653600 15516 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:52.591058 15584 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:52.583060 15366 consensus_queue.cc:237] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:52.588408 15275 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
W20260709 12:21:52.656562 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.548022 15581 consensus_queue.cc:1059] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 12:21:52.650699 15566 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:52.641665 15578 log.cc:927] Time spent T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:21:52.629881 15412 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:52.644081 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.661194 11078 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:21:52.641137 15576 log.cc:927] Time spent T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:21:52.658800 15592 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.640728 15589 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:52.669853 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.598330 15523 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:52.687701 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:52.688092 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:52.689239 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:52.700187 11009 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:52.690274 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:52.700830 11004 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:21:52.701704 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:52.702581 11004 raft_consensus.cc:2393] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 16: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:52.703372 11006 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:21:52.691326 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:52.697211 11005 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:52.583424 15582 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:52.716776 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:52.705940 11010 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
W20260709 12:21:52.721298 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 135010us
I20260709 12:21:52.738232 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:52.739233 10901 leader_election.cc:400] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 9. Current term is 10.
I20260709 12:21:52.739634 10901 leader_election.cc:403] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:52.740748 10901 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:52.738955 11008 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:52.743651 10901 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:52.713797 11009 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:52.745702 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:52.747946 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:52.747828 10901 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:52.748698 11003 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:52.749267 11009 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:52.749966 11003 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:21:52.750298 11003 pending_rounds.cc:85] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 7
I20260709 12:21:52.750500 11003 pending_rounds.cc:107] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:21:52.643698 15454 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:52.745649 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:52.750801 11003 raft_consensus.cc:2889] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:52.750567 10901 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:52.743561 11007 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:21:52.754837 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:52.753597 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 161222us
W20260709 12:21:52.744122 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 142383us
I20260709 12:21:52.753048 11009 raft_consensus.cc:1275] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:52.757789 11010 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
W20260709 12:21:52.754184 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 54662us
I20260709 12:21:52.754925 11011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2982) took 1145 ms. Trace:
I20260709 12:21:52.762007 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:52.763226 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:52.764092 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:52.759506 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2820) took 1708 ms. Trace:
I20260709 12:21:52.761519 11011 rpcz_store.cc:276] 0709 12:21:51.609310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.727341 (+118031us) service_pool.cc:224] Handling call
0709 12:21:51.780017 (+ 52676us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:52.426763 (+646746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:52.426793 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:52.427359 (+   566us) log.cc:844] Serialized 52 byte log entry
0709 12:21:52.568994 (+141635us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:52.744026 (+175032us) log.cc:844] Serialized 14 byte log entry
0709 12:21:52.754539 (+ 10513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.754626 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:52.754680 (+    54us) raft_consensus.cc:1685] finished
0709 12:21:52.754695 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.754857 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":430367,"raft.queue_time_us":444677,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":6050,"thread_start_us":299829,"threads_started":2,"wal-append.queue_time_us":214682}
I20260709 12:21:52.764578 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:52.764700 10936 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:21:52.762858 11008 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:21:52.765146 11077 rpcz_store.cc:276] 0709 12:21:51.051484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.091907 (+1040423us) service_pool.cc:224] Handling call
0709 12:21:52.092306 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:52.092761 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:52.092792 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:52.109335 (+ 16543us) log.cc:844] Serialized 26 byte log entry
0709 12:21:52.347710 (+238375us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:52.347753 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.347820 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:52.759274 (+411454us) raft_consensus.cc:1685] finished
0709 12:21:52.759298 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.759444 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11594,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":209194,"threads_started":1,"wal-append.queue_time_us":312692}
I20260709 12:21:52.768476 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:52.769196 10933 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:52.744541 15584 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:21:52.764693 15567 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:52.772280 10931 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:21:52.772198 15567 raft_consensus.cc:697] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:52.751093 15497 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:52.773728 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:52.759253 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:52.774585 11007 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
I20260709 12:21:52.774652 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:52.751062 15581 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:21:52.761955 15576 log.cc:927] Time spent T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:21:52.667642 15575 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:52.771225 11624 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:52.682423 15516 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:52.753995 15590 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:52.784837 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:52.756345 15597 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:52.786795 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:52.685295 15583 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.074s
W20260709 12:21:52.777582 15416 consensus_meta.cc:287] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.648s	user 0.010s	sys 0.000s
I20260709 12:21:52.767659 15518 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:52.788568 11659 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:21:52.789187 10974 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:52.789726 10933 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:52.794162 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:52.781373 15508 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.780898 15474 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.795346 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:52.761860 15275 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:21:52.714814 15589 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:52.815444 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:52.699262 15592 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:52.884861 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:52.786715 15581 raft_consensus.cc:697] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:52.910310 15581 consensus_queue.cc:237] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:52.912271 15438 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:52.913192 10935 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:21:52.913502 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:52.803800 15558 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:52.914057 11659 raft_consensus.cc:1813] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Handling vote request from an unknown peer 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:52.803566 15603 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 12:21:52.914798 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:52.915578 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:52.915908 10929 raft_consensus.cc:2368] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11.
W20260709 12:21:52.893918 15527 consensus_meta.cc:287] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.720s	user 0.009s	sys 0.000s
I20260709 12:21:52.915603 15558 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:52.916173 10931 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:52.793035 15416 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:52.904981 15454 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:52.907110 15412 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:52.793372 15451 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:52.791944 15597 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.790398 15406 consensus_queue.cc:1059] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.118s
W20260709 12:21:52.909363 15522 consensus_meta.cc:287] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.520s	user 0.006s	sys 0.001s
I20260709 12:21:52.792790 15177 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
I20260709 12:21:52.914122 15032 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:52.900053 15567 consensus_queue.cc:237] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:52.919835 15067 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:52.930009 15565 log.cc:927] Time spent T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.883s	user 0.006s	sys 0.004s
W20260709 12:21:52.934720 15572 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.877s	user 0.009s	sys 0.000s
I20260709 12:21:52.935014 15275 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:52.935771 15323 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:52.936532 15501 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:52.938316 15589 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:52.939456 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2804) took 2325 ms. Trace:
I20260709 12:21:52.940372 11004 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:52.942379 10931 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:53.012497 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:53.013306 10931 raft_consensus.cc:2393] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 8: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:52.946956 11659 raft_consensus.cc:2393] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
W20260709 12:21:52.947659 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 150014us
I20260709 12:21:53.014410 10977 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:52.788317 15594 consensus_queue.cc:1059] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.130s
W20260709 12:21:52.949744 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 160706us
I20260709 12:21:52.956070 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:52.915745 15603 raft_consensus.cc:2804] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:52.966697 10932 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 13: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:21:52.975313 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 204151us
I20260709 12:21:52.948113 15222 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:52.990353 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.886293 15508 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:52.891244 15474 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.003180 15515 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:52.963277 15597 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:52.985914 15510 consensus_meta.cc:287] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.926s	user 0.011s	sys 0.000s
I20260709 12:21:53.009855 11083 rpcz_store.cc:276] 0709 12:21:50.614310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.893987 (+1279677us) service_pool.cc:224] Handling call
0709 12:21:51.923050 (+ 29063us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:51.939680 (+ 16630us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:52.062666 (+122986us) log.cc:844] Serialized 14 byte log entry
0709 12:21:52.190384 (+127718us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:52.232809 (+ 42425us) log.cc:844] Serialized 26 byte log entry
0709 12:21:52.232986 (+   177us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:52.233022 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.233099 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:52.423460 (+190361us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b4800210cd8. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb5e89aa1 00007f9bb5e80b37 00007f9bb5e809ca 00007f9bb5f7826f 00007f9bb5f77f37 00007f9bb5f8c55c 00007f9bb5f8c508 00007f9bb5f8c488 00007f9bb5f8c443 00007f9bb5f8b6ec 00007f9bb4eb5a96
0709 12:21:52.939174 (+515714us) raft_consensus.cc:1685] finished
0709 12:21:52.939263 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.939389 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16192,"prepare.queue_time_us":82028,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":250110,"raft.run_cpu_time_us":6147,"raft.run_wall_time_us":483442,"spinlock_wait_cycles":41755392,"thread_start_us":137878,"threads_started":2,"wal-append.queue_time_us":340765}
I20260709 12:21:53.031001 10974 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:53.068735 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:52.977792 15522 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:53.095459 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 64549.8us
I20260709 12:21:53.096541 10974 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:53.082994 11007 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:53.000131 15067 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.111271 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:53.114343 10931 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:53.033066 15523 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:53.037647 15603 raft_consensus.cc:697] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:53.135555 10936 raft_consensus.cc:2368] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17.
I20260709 12:21:53.031890 15451 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 12:21:53.068877 15582 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:53.036180 15222 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.113173 15501 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:53.144961 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:53.037505 15586 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.105s
I20260709 12:21:53.109542 10974 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:21:53.158020 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 48559us
W20260709 12:21:53.148741 11652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59398 (request call id 405) took 1822 ms (client timeout 1604 ms). Trace:
I20260709 12:21:53.132854 15365 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:53.078676 15510 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:53.138414 15523 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:53.153745 15501 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.132228 15512 consensus_queue.cc:1059] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:21:53.162017 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:53.158875 10974 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:53.159979 15455 consensus_meta.cc:287] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.609s	user 0.007s	sys 0.003s
W20260709 12:21:53.161796 10902 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.046s	sys 0.050s
W20260709 12:21:53.173420 15563 consensus_meta.cc:287] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 1.060s	user 0.012s	sys 0.000s
I20260709 12:21:53.183779 10974 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:53.180536 10902 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.046s	sys 0.050s
I20260709 12:21:53.178545 15032 raft_consensus.cc:697] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:53.162971 15275 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:53.182147 11657 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:53.171507 15365 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:53.187003 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:53.185052 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.182888 15455 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.191041 15365 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:53.160475 11652 rpcz_store.cc:269] 0709 12:21:51.326133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.326304 (+   171us) service_pool.cc:224] Handling call
0709 12:21:53.148497 (+1822193us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b54004b3a54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:53.148662 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1087968640}
I20260709 12:21:53.196617 15522 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:53.196642 15515 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:53.187521 15563 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:53.199231 10934 raft_consensus.cc:2368] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11.
I20260709 12:21:53.181367 15594 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:21:53.201048 15368 consensus_meta.cc:287] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.765s	user 0.010s	sys 0.000s
I20260709 12:21:53.202581 15497 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:53.185870 15275 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.181717 15610 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:53.200443 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:53.177816 15501 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:53.205307 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 175215us
I20260709 12:21:53.219513 10974 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:53.206646 14963 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:53.217414 15275 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:53.210548 15368 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:53.262724 10977 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:53.278680 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 59228us
I20260709 12:21:53.301858 10974 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:53.298317 15611 log.cc:927] Time spent T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.093s	user 0.000s	sys 0.002s
I20260709 12:21:53.260967 15614 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.306540 10974 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:53.203343 15603 consensus_queue.cc:237] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:53.261653 15610 raft_consensus.cc:697] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:21:53.306923 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 44263.2us
I20260709 12:21:53.268311 15582 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:53.306267 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:53.386332 11003 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:53.300709 15512 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:53.365417 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:53.315697 15474 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:53.394076 15474 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:53.400873 15222 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:53.290761 14963 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.259771 15032 consensus_queue.cc:237] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.308838 15613 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:53.489094 11003 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:53.494746 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:53.529215 15621 log.cc:927] Time spent T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 12:21:53.528352 10830 catalog_manager.cc:5697] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 6 to 4, leader changed from <none> to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from VOTER to NON_VOTER, now has a pending config: VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65), VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66), VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67), VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 6 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:21:53.530503 15615 log.cc:927] Time spent T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
I20260709 12:21:53.535132 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:53.535962 11009 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:53.536782 14766 raft_consensus.cc:3055] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:53.537199 14766 raft_consensus.cc:740] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:53.540954 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:53.541700 10933 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:53.542588 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:53.548616 11009 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:53.549548 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:53.548759 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 150801us
I20260709 12:21:53.550472 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:53.551054 10931 raft_consensus.cc:2393] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 10: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:53.319802 15614 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.488765 15617 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:53.551410 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:53.552011 11009 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:53.490221 15613 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.556900 15613 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:53.538995 15177 raft_consensus.cc:3055] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:21:53.554325 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 247864us
I20260709 12:21:53.524380 15365 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:53.572806 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.558470 10974 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:53.592100 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:53.593557 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:53.593803 10974 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:53.594735 10974 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:53.552687 15619 log.cc:927] Time spent T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 12:21:53.597079 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:53.598095 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:53.601388 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2812) took 2854 ms. Trace:
I20260709 12:21:53.601840 11079 rpcz_store.cc:276] 0709 12:21:50.747269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.018273 (+1271004us) service_pool.cc:224] Handling call
0709 12:21:52.045640 (+ 27367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:52.083593 (+ 37953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.559849 (+1476256us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b54000dff54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:53.601308 (+ 41459us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59116800}
W20260709 12:21:53.603828 11002 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2342) took 2839 ms (client timeout 2891 ms). Trace:
W20260709 12:21:53.604749 11002 rpcz_store.cc:269] 0709 12:21:50.764209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.388640 (+624431us) service_pool.cc:224] Handling call
0709 12:21:53.559536 (+2170896us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b54003796d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:53.603632 (+ 44096us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1569297152}
I20260709 12:21:53.608672 11011 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:21:53.609089 11011 pending_rounds.cc:85] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 8
I20260709 12:21:53.609325 11011 pending_rounds.cc:107] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:21:53.609560 11011 raft_consensus.cc:2889] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:53.551398 15527 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.557713 15575 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:53.555362 15592 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:53.555274 15454 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:53.594542 15566 consensus_meta.cc:287] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.910s	user 0.007s	sys 0.004s
I20260709 12:21:53.614732 11003 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 7.
I20260709 12:21:53.588443 15177 raft_consensus.cc:740] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:53.596529 15365 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:53.604467 15474 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:53.604018 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:53.621411 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:53.625308 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:53.626530 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:53.622838 15569 log.cc:927] Time spent T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 1.567s	user 0.009s	sys 0.016s
I20260709 12:21:53.627363 10931 raft_consensus.cc:2410] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 12:21:53.632459 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 267119us
I20260709 12:21:53.627830 15592 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:53.635690 15592 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.636076 15592 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:53.622640 15474 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:53.595383 15275 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:53.622677 15627 log.cc:927] Time spent T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:21:53.623221 15618 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:53.616496 15527 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:53.605580 15610 consensus_queue.cc:237] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.627403 15566 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.628788 15454 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.661685 11655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59398 (request call id 408) took 1778 ms. Trace:
I20260709 12:21:53.670698 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:53.678053 11008 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:21:53.679666 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 84996.4us
I20260709 12:21:53.661487 15628 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.680636 10974 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:53.659677 15467 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:53.685851 10933 raft_consensus.cc:2393] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 9: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:53.673314 11655 rpcz_store.cc:276] 0709 12:21:51.883489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.883611 (+   122us) service_pool.cc:224] Handling call
0709 12:21:51.902246 (+ 18635us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:51.902625 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:51.902655 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:51.903128 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 12:21:52.057641 (+154513us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:52.057680 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.057741 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:53.618391 (+1560650us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:53.656288 (+ 37897us) raft_consensus.cc:1685] finished
0709 12:21:53.656310 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:53.661597 (+  5287us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":10786,"spinlock_wait_cycles":9573760,"thread_start_us":154084,"threads_started":1,"wal-append.queue_time_us":152698}
I20260709 12:21:53.689443 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:53.690120 10931 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:53.657007 15177 consensus_queue.cc:260] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.684420 14963 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:53.705430 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:53.710944 15631 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.711535 15631 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.701961 15617 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:53.715953 15629 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.685568 15628 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.738833 15629 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.716885 15454 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:53.717068 15275 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:53.717938 15432 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:53.685245 15467 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.714545 15177 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:53.720594 15589 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.721146 15613 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.721086 15631 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:53.731380 15510 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:53.733512 15508 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:53.741247 15604 log.cc:927] Time spent T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.820s	user 0.009s	sys 0.002s
I20260709 12:21:53.725303 15617 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.751071 15614 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:53.762106 15431 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:53.753499 15589 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.763476 15451 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.763841 15566 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:53.768591 11076 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60046 (request call id 2794) took 3165 ms (client timeout 4199 ms). Trace:
W20260709 12:21:53.777490 11076 rpcz_store.cc:269] 0709 12:21:50.603096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.540240 (+937144us) service_pool.cc:224] Handling call
0709 12:21:53.768342 (+2228102us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b5400278dd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:53.768511 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1130596224}
W20260709 12:21:53.768998 15501 consensus_meta.cc:287] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.000s
I20260709 12:21:53.770316 15365 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:53.719763 15592 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.760828 15527 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:53.741225 15629 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:53.714720 15474 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
W20260709 12:21:53.757354 15622 log.cc:927] Time spent T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:21:53.778471 15451 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:53.779076 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:53.774405 15617 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:53.787705 11655 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:21:53.789465 15613 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:53.789808 15589 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:53.779596 15501 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.791340 15563 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:53.791944 15501 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:53.793291 15592 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:53.795732 15628 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:53.797309 15590 consensus_meta.cc:287] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.915s	user 0.005s	sys 0.003s
I20260709 12:21:53.796921 14766 consensus_queue.cc:260] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.798105 14766 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:53.798417 15584 consensus_meta.cc:287] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 1.014s	user 0.009s	sys 0.000s
I20260709 12:21:53.798743 15584 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 9. Current term is 10.
I20260709 12:21:53.796029 15524 raft_consensus.cc:3055] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:53.799414 15524 raft_consensus.cc:740] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:53.799700 15504 raft_consensus.cc:3055] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:53.800091 15504 raft_consensus.cc:740] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:53.800189 15524 consensus_queue.cc:260] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.800917 15504 consensus_queue.cc:260] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.801394 15524 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:53.802083 15504 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:53.803601 15467 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:53.804172 15590 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:53.805406 15451 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:53.808144 15511 raft_consensus.cc:3055] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:53.808684 15511 raft_consensus.cc:740] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:21:53.809329 15597 consensus_meta.cc:287] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.697s	user 0.006s	sys 0.002s
I20260709 12:21:53.809474 15511 consensus_queue.cc:260] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.809847 15597 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:53.810727 15511 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:53.812865 15597 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:53.859392 10928 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:53.861447 10930 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:53.865392 11010 raft_consensus.cc:2393] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 10: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:21:53.867223 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 158726us
W20260709 12:21:53.868240 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 92546.1us
I20260709 12:21:53.865244 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:53.883800 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:53.884111 15078 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.884681 15032 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:21:53.885627 11005 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 12:21:53.886114 15078 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:53.888592 15365 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:53.889741 15365 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.891641 15078 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:53.891851 11050 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:53.893214 15067 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:53.899358 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53346 (request call id 410) took 1115 ms. Trace:
I20260709 12:21:53.902376 10929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 2260) took 1139 ms. Trace:
I20260709 12:21:53.904031 10932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 2264) took 1139 ms. Trace:
I20260709 12:21:53.905346 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 2270) took 1116 ms. Trace:
I20260709 12:21:53.905660 10932 rpcz_store.cc:276] 0709 12:21:52.764245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.764355 (+   110us) service_pool.cc:224] Handling call
0709 12:21:53.903508 (+1139153us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54001e7654. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:53.903827 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":459841408}
I20260709 12:21:53.906697 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 2272) took 1021 ms. Trace:
I20260709 12:21:53.904548 10927 rpcz_store.cc:276] 0709 12:21:52.783422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.783896 (+   474us) service_pool.cc:224] Handling call
0709 12:21:52.793707 (+  9811us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:52.944708 (+151001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:52.944740 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:52.947775 (+  3035us) log.cc:844] Serialized 26 byte log entry
0709 12:21:53.260615 (+312840us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:53.260658 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.898538 (+637880us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b540024b654. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:53.898622 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:53.898729 (+   107us) raft_consensus.cc:1685] finished
0709 12:21:53.898746 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:53.899133 (+   387us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":170435,"raft.queue_time_us":143441,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":17132,"spinlock_wait_cycles":24490240,"thread_start_us":263767,"threads_started":1,"wal-append.queue_time_us":419719}
I20260709 12:21:53.910099 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:53.889590 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:53.910940 10927 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:53.907123 10936 rpcz_store.cc:276] 0709 12:21:52.885479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.914554 (+ 29075us) service_pool.cc:224] Handling call
0709 12:21:53.906266 (+991712us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54001e5ad4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:53.906498 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502042368}
I20260709 12:21:53.913475 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:21:53.914012 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.914355 10936 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:53.916174 14766 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:53.911942 10934 rpcz_store.cc:276] 0709 12:21:52.789185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.789311 (+   126us) service_pool.cc:224] Handling call
0709 12:21:53.904943 (+1115632us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b540024c554. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:53.905175 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":723474304}
I20260709 12:21:53.917454 10929 rpcz_store.cc:276] 0709 12:21:52.762594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.762993 (+   399us) service_pool.cc:224] Handling call
0709 12:21:53.901884 (+1138891us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b5400060ed4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:53.902139 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":349390080}
I20260709 12:21:53.919445 10929 raft_consensus.cc:1240] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:53.912504 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:53.922216 10901 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:53.922792 10931 raft_consensus.cc:2393] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 17: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:53.907413 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:21:53.917021 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:53.929157 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.929363 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2920) took 1319 ms. Trace:
I20260709 12:21:53.932469 10931 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:53.929726 11078 rpcz_store.cc:276] 0709 12:21:52.610269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.610518 (+   249us) service_pool.cc:224] Handling call
0709 12:21:52.610780 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:52.669239 (+ 58459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.928854 (+1259615us) spinlock_profiling.cc:243] Waited 50 ms on lock 0x7b54000c26d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:53.929161 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115088768}
I20260709 12:21:53.917114 14766 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:53.934628 10931 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:21:53.936599 10933 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:53.941589 11657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59398 (request call id 409) took 1484 ms. Trace:
I20260709 12:21:53.942140 11657 rpcz_store.cc:276] 0709 12:21:52.457041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.457211 (+   170us) service_pool.cc:224] Handling call
0709 12:21:52.457542 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:53.186097 (+728555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.940942 (+754845us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b54004df8d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:53.941295 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1666042624}
I20260709 12:21:53.947911 10932 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 13: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:53.949142 15365 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:53.949911 15365 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:53.949595 10830 catalog_manager.cc:5697] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:53.957944 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.959443 10901 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:53.961258 10901 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:53.961969 15323 raft_consensus.cc:3055] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:53.962498 15323 raft_consensus.cc:740] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:53.974243 15617 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.979635 15617 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:53.986446 15412 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:53.988236 15467 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.988643 15497 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:53.989493 11078 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:21:53.989881 15514 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.991082 15497 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:53.990738 15514 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:53.992379 15597 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.992537 15515 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:53.993095 15597 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:53.994333 15454 consensus_queue.cc:1059] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:53.996280 15557 raft_consensus.cc:3055] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:53.996788 15557 raft_consensus.cc:740] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:53.996958 10929 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:21:53.998045 15557 consensus_queue.cc:260] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:53.996304 15566 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:21:53.964890 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:53.964685 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:53.995711 15454 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:21:54.009887 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 118338us
I20260709 12:21:54.013352 15631 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:54.013072 10830 catalog_manager.cc:5697] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 8 to 10, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 10 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:54.015177 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.014268 15631 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:54.016603 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:53.989334 15586 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:21:54.018342 15631 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:54.021281 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:54.022264 11003 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 11.
I20260709 12:21:53.950773 15365 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:54.026109 15365 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:54.029608 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:54.040046 15628 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.041049 15628 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:54.044459 15628 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:53.991757 15497 raft_consensus.cc:697] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:53.993108 15515 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:54.013419 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:54.003309 15412 raft_consensus.cc:697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:54.010177 15454 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:54.011997 15617 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.012085 14766 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:54.056331 15389 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:21:54.060181 15504 consensus_queue.cc:1059] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 12:21:54.060961 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:54.064249 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:54.064252 10932 raft_consensus.cc:2393] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 9: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:54.064767 11624 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:54.064457 15467 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:54.065548 15642 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.242s	user 0.002s	sys 0.006s
I20260709 12:21:54.064317 15323 consensus_queue.cc:260] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:54.067574 15455 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:54.068102 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:54.069170 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:54.053625 15515 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:54.071879 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:54.072556 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:54.073599 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 60898.6us
I20260709 12:21:54.015295 10830 catalog_manager.cc:5697] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 5 to 6, term changed from 5 to 8, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:54.070775 11085 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:54.085872 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:54.086318 11076 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:21:54.086968 11084 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:21:54.087440 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:54.087703 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:54.088279 11081 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:54.088686 15323 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:54.088428 11076 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:21:54.053131 15597 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:54.088073 11624 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:54.072496 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:54.058439 15454 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:54.093358 11079 raft_consensus.cc:2410] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:21:54.078804 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:54.085891 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:54.099086 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:54.107257 10927 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:54.125605 11085 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:21:54.088168 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:54.097339 15557 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:54.128438 11078 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:54.132730 10936 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:21:54.136428 15368 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:54.140021 15527 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:54.140585 15527 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:54.140995 15527 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:54.133388 11082 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:21:54.142427 11080 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:54.064471 15451 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:21:54.145632 10929 raft_consensus.cc:2393] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 9: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:21:54.144870 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 49846.2us
I20260709 12:21:54.147703 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:54.152551 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:54.140008 15597 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:54.090406 15412 consensus_queue.cc:237] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:54.167078 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:54.162497 11005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3002) took 1194 ms. Trace:
I20260709 12:21:54.171206 11005 rpcz_store.cc:276] 0709 12:21:52.963571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.963955 (+   384us) service_pool.cc:224] Handling call
0709 12:21:52.983639 (+ 19684us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:53.886312 (+902673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:54.152283 (+265971us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b540012b6d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:54.157562 (+  5279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2072191232}
I20260709 12:21:54.178884 15365 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:54.184551 11006 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:21:54.186033 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:54.186415 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:54.187296 11658 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:54.187546 10901 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:54.189044 14766 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:54.189533 14766 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:54.189898 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:54.189900 14766 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:54.191543 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:54.165657 15597 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:54.194772 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:54.197461 15567 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:54.200747 15646 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:21:54.202087 15365 consensus_queue.cc:1059] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:54.203250 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2688) took 1187 ms. Trace:
I20260709 12:21:54.204101 15497 consensus_queue.cc:237] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:54.208513 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:21:54.216305 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 48353.3us
I20260709 12:21:54.147586 15617 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:54.216938 11081 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:21:54.217096 10934 rpcz_store.cc:276] 0709 12:21:53.015896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:53.917772 (+901876us) service_pool.cc:224] Handling call
0709 12:21:53.918392 (+   620us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:53.919071 (+   679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:53.919108 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:53.923979 (+  4871us) log.cc:844] Serialized 26 byte log entry
0709 12:21:54.029736 (+105757us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:54.029776 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:54.029845 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:54.203020 (+173175us) raft_consensus.cc:1685] finished
0709 12:21:54.203038 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:54.203169 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":64481,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":262,"thread_start_us":105284,"threads_started":1,"wal-append.queue_time_us":207514}
I20260709 12:21:54.220912 11005 raft_consensus.cc:2376] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12. Re-sending same reply.
I20260709 12:21:54.222071 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:54.223060 11005 raft_consensus.cc:2393] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 16: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:54.224193 15567 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:54.225437 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:54.228219 15644 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:54.230413 15644 consensus_queue.cc:1048] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:21:54.231333 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 57267.1us
I20260709 12:21:54.232757 15467 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:54.216807 15597 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:54.233587 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:54.225113 11050 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:54.239679 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:54.227502 15567 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:54.237869 10975 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:54.245697 11004 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:54.245301 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:54.220639 15416 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:54.263510 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.265811 11655 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:54.266965 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:54.260959 11081 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:21:54.256317 15631 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:54.279055 11002 raft_consensus.cc:2368] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11.
I20260709 12:21:54.279665 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:21:54.282689 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 44906.9us
I20260709 12:21:54.289932 10933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2701) took 1067 ms. Trace:
I20260709 12:21:54.296638 15594 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:54.298638 15617 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:54.275933 15365 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.284443 11050 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:54.300410 15365 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:54.301812 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:54.275764 15368 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.279832 15631 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:54.320405 11005 raft_consensus.cc:2410] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:21:54.324689 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 68021.8us
I20260709 12:21:54.290575 10933 rpcz_store.cc:276] 0709 12:21:53.222902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:53.937650 (+714748us) service_pool.cc:224] Handling call
0709 12:21:53.938197 (+   547us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:53.958815 (+ 20618us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:53.958852 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:54.016005 (+ 57153us) log.cc:844] Serialized 52 byte log entry
0709 12:21:54.091574 (+ 75569us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:54.278304 (+186730us) log.cc:844] Serialized 14 byte log entry
0709 12:21:54.289559 (+ 11255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:54.289643 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:54.289685 (+    42us) raft_consensus.cc:1685] finished
0709 12:21:54.289698 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:54.289862 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10905,"prepare.queue_time_us":87605,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":49210,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":177,"thread_start_us":212383,"threads_started":2,"wal-append.queue_time_us":121224}
I20260709 12:21:54.332230 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:54.323571 15631 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:54.335491 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:54.337476 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:54.355338 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 76497.1us
I20260709 12:21:54.357632 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:54.333209 15644 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.360558 11050 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:21:54.361173 10935 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 2674) took 3166 ms (client timeout 1847 ms). Trace:
I20260709 12:21:54.361922 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41098 (request call id 354) took 1034 ms. Trace:
W20260709 12:21:54.364418 10935 rpcz_store.cc:269] 0709 12:21:51.135331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.196596 (+ 61265us) service_pool.cc:224] Handling call
0709 12:21:54.256809 (+3060213us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b540023afd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:54.301702 (+ 44893us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3933430528}
I20260709 12:21:54.431651 11004 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
W20260709 12:21:54.460017 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.460099 10977 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:54.478507 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 180835us
I20260709 12:21:54.366446 11008 rpcz_store.cc:276] 0709 12:21:53.221203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:53.679698 (+458495us) service_pool.cc:224] Handling call
0709 12:21:53.688046 (+  8348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:53.710393 (+ 22347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:53.710428 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:53.715493 (+  5065us) log.cc:844] Serialized 26 byte log entry
0709 12:21:54.128844 (+413351us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:54.150310 (+ 21466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:54.156628 (+  6318us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:54.243837 (+ 87209us) raft_consensus.cc:1685] finished
0709 12:21:54.243890 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:54.255222 (+ 11332us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19175,"raft.queue_time_us":20141,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":10288,"thread_start_us":164688,"threads_started":1,"wal-append.queue_time_us":232970}
W20260709 12:21:54.479647 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:54.480852 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.462949 11010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 3006) took 1468 ms. Trace:
I20260709 12:21:54.461160 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:54.522153 15661 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:21:54.523970 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:54.524992 11650 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 10: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:54.405819 15644 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:54.498947 11010 rpcz_store.cc:276] 0709 12:21:52.964792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:53.252467 (+287675us) service_pool.cc:224] Handling call
0709 12:21:54.390637 (+1138170us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b540037a5d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:54.432717 (+ 42080us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":613803264}
W20260709 12:21:54.478506 15660 log.cc:927] Time spent T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 12:21:54.533775 15511 consensus_meta.cc:287] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.722s	user 0.016s	sys 0.001s
I20260709 12:21:54.535254 15454 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:54.536357 15406 consensus_queue.cc:1059] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:54.406581 15512 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:54.544248 11084 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 13: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:54.354878 15368 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:54.540803 11658 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:54.546627 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:54.546792 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:54.546833 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:54.510986 11007 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 8.
W20260709 12:21:54.547381 15646 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:21:54.540205 15365 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:54.539639 15557 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:54.616637 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 231081us
I20260709 12:21:54.480728 15514 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:54.634617 15569 log.cc:927] Time spent T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.456s	user 0.008s	sys 0.007s
I20260709 12:21:54.635881 10900 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:54.637444 15659 log.cc:927] Time spent T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:21:54.639134 15609 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:54.545522 15644 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:54.617009 15557 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:54.801126 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 395522us
W20260709 12:21:55.133409 14766 consensus_meta.cc:287] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.909s	user 0.000s	sys 0.007s
W20260709 12:21:54.724278 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 106909us
W20260709 12:21:54.908684 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 121099us
W20260709 12:21:55.008689 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 527122us
I20260709 12:21:54.607113 15566 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.015125 11002 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:21:54.740634 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:55.181557 11007 raft_consensus.cc:1813] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Handling vote request from an unknown peer 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:54.738516 11003 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:21:55.181002 14766 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.184047 11003 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:55.184731 11007 raft_consensus.cc:2393] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:21:54.761273 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 425912us
W20260709 12:21:54.700747 15660 log.cc:927] Time spent T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 12:21:54.877763 15527 consensus_meta.cc:287] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.736s	user 0.013s	sys 0.000s
I20260709 12:21:55.192158 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2384) took 1113 ms. Trace:
W20260709 12:21:55.101889 15515 consensus_meta.cc:287] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.998s	user 0.009s	sys 0.003s
W20260709 12:21:55.030531 15597 consensus_meta.cc:287] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.797s	user 0.003s	sys 0.009s
I20260709 12:21:55.193333 10930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2262) took 2428 ms. Trace:
I20260709 12:21:54.846493 15455 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:54.825829 15664 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.764622 15454 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:55.081831 15666 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:55.195255 11051 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:55.193109 14766 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:55.195889 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:55.196194 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:55.187599 15514 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.196935 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:55.203580 10930 rpcz_store.cc:276] 0709 12:21:52.763132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.763251 (+   119us) service_pool.cc:224] Handling call
0709 12:21:52.763543 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:53.861997 (+1098454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:55.108936 (+1246939us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000609d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:55.191080 (+ 82144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2523720960}
I20260709 12:21:55.210876 11078 raft_consensus.cc:2410] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:21:55.207721 15666 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.197365 15628 raft_consensus.cc:3055] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:21:54.826031 15657 log.cc:927] Time spent T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.123s	user 0.000s	sys 0.003s
I20260709 12:21:54.765021 15644 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:55.201372 11007 rpcz_store.cc:276] 0709 12:21:54.084677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.641344 (+556667us) service_pool.cc:224] Handling call
0709 12:21:55.192079 (+550735us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:55.037937 15222 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.723390 15365 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:55.202148 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2376) took 1148 ms. Trace:
I20260709 12:21:54.811666 15613 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:54.639849 15609 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.230055 15609 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:55.212333 11081 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:21:55.200064 15632 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.233340 15632 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.211560 15666 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:55.217293 15566 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.237825 15566 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:55.216959 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.241231 15504 consensus_queue.cc:1059] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:55.235688 15632 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:55.213860 15628 raft_consensus.cc:740] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:55.242192 15594 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:55.243000 15524 consensus_queue.cc:1059] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:55.243175 15628 consensus_queue.cc:260] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:55.243956 15524 raft_consensus.cc:3055] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:55.244239 15628 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:55.244302 15524 raft_consensus.cc:740] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:55.245424 15524 consensus_queue.cc:260] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:55.213128 15412 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.029s	sys 0.041s
I20260709 12:21:55.206202 15455 raft_consensus.cc:697] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:21:55.248083 15412 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.029s	sys 0.041s
I20260709 12:21:55.248848 15455 consensus_queue.cc:237] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:55.216203 15368 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:55.212028 15557 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:55.224426 15454 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:55.225416 15514 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:55.209980 15664 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.226707 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2268) took 2444 ms. Trace:
I20260709 12:21:55.227751 11658 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:55.196678 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:55.226752 11051 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:55.221599 15365 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:55.260967 15365 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:55.223527 15613 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.223686 15672 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:55.205483 15527 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:55.224529 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3004) took 2260 ms. Trace:
I20260709 12:21:55.241745 10974 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:55.211671 15406 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:55.221856 11003 rpcz_store.cc:276] 0709 12:21:54.044872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.183349 (+1138477us) service_pool.cc:224] Handling call
0709 12:21:55.183730 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:55.192943 (+  9213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:55.193155 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:55.259639 15566 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.260447 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:55.258337 10928 rpcz_store.cc:276] 0709 12:21:52.782342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.782491 (+   149us) service_pool.cc:224] Handling call
0709 12:21:52.792757 (+ 10266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:53.860477 (+1067720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:55.226429 (+1365952us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400169754. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:55.226640 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2451678080}
I20260709 12:21:55.207528 15597 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:55.204083 15515 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:55.231808 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:55.279979 11080 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:55.277832 11654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59384 (request call id 551) took 1274 ms. Trace:
I20260709 12:21:55.287776 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:55.284466 11654 rpcz_store.cc:276] 0709 12:21:53.997815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.032250 (+ 34435us) service_pool.cc:224] Handling call
0709 12:21:55.107196 (+1074946us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b5800003998. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f260a0 00007f9bb5f25984 00007f9baf4a06d4 00007f9baf4a0662
0709 12:21:55.272429 (+165233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41792384}
I20260709 12:21:55.288596 11003 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:55.289471 10935 raft_consensus.cc:1240] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:55.289813 10930 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 14: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:55.267416 15613 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:55.312187 11652 raft_consensus.cc:2393] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 12: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:55.223163 15222 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.267733 15412 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:55.316697 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:21:55.319257 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 77577.1us
I20260709 12:21:55.273346 11009 rpcz_store.cc:276] 0709 12:21:52.964374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:53.559425 (+595051us) service_pool.cc:224] Handling call
0709 12:21:53.591486 (+ 32061us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:54.126944 (+535458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:54.129882 (+  2938us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:54.170436 (+ 40554us) log.cc:844] Serialized 26 byte log entry
0709 12:21:54.239680 (+ 69244us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:54.270725 (+ 31045us) log.cc:844] Serialized 14 byte log entry
0709 12:21:54.531095 (+260370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:55.196064 (+664969us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b540029bdd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:55.196109 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:55.222812 (+ 26703us) raft_consensus.cc:1685] finished
0709 12:21:55.224058 (+  1246us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:55.224308 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":282443,"prepare.queue_time_us":29249,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":56,"raft.queue_time_us":272658,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":25691,"spinlock_wait_cycles":1107771648,"thread_start_us":38959,"threads_started":1,"wal-append.queue_time_us":122038}
I20260709 12:21:55.311583 15609 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:55.281713 15644 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.347030 11007 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:55.348881 10974 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:55.349962 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:55.350670 11009 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:21:55.285950 15673 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 12:21:55.300601 15406 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.357205 10974 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:55.358142 15504 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:55.345319 15609 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:55.324420 15566 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:55.364668 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 149098us
I20260709 12:21:55.365533 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:55.361296 15504 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.370730 15504 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:55.371487 15597 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:55.373111 15666 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:55.378180 15665 log.cc:927] Time spent T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.311s	user 0.000s	sys 0.004s
I20260709 12:21:55.379060 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:55.380478 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:55.381456 15566 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:55.381778 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:55.380649 15515 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:55.381920 15222 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:55.382455 10934 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:55.384239 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:55.386699 10927 raft_consensus.cc:1240] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:55.388003 10932 raft_consensus.cc:1240] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:55.388842 15664 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:55.389109 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:55.362849 15610 consensus_queue.cc:1059] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 12:21:55.389864 10931 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 11.
I20260709 12:21:55.390441 15610 raft_consensus.cc:3055] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:55.392215 11080 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:55.362829 15670 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:55.343606 15412 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.397068 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:55.397634 11658 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:55.363300 15609 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:55.398818 11009 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 13: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:21:55.381788 15674 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:21:55.390815 15610 raft_consensus.cc:740] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:55.402659 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:55.404333 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:55.405324 11654 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 10: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:55.387912 15557 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.403343 11050 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:55.407949 15515 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:55.409109 15663 log.cc:927] Time spent T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.858s	user 0.002s	sys 0.000s
I20260709 12:21:55.414532 15670 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:55.415000 15670 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.415319 15670 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:55.417749 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:55.420514 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2938) took 1168 ms. Trace:
W20260709 12:21:55.413395 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 43962.7us
I20260709 12:21:55.423751 11650 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:55.423383 10830 catalog_manager.cc:5697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:55.427951 15323 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:55.428427 15323 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.428790 15323 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:55.421051 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:55.431993 15557 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:55.439056 15557 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:55.441334 11003 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:21:55.442169 11007 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:55.445361 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:55.438848 15412 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:55.420936 11076 rpcz_store.cc:276] 0709 12:21:54.254298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.256365 (+  2067us) service_pool.cc:224] Handling call
0709 12:21:54.264413 (+  8048us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:54.265195 (+   782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:54.265224 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:54.265847 (+   623us) log.cc:844] Serialized 26 byte log entry
0709 12:21:54.326479 (+ 60632us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:54.326519 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:54.326585 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:55.408174 (+1081589us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:55.410874 (+  2700us) raft_consensus.cc:1685] finished
0709 12:21:55.410894 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:55.420441 (+  9547us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1518,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":116,"spinlock_wait_cycles":1020313856,"thread_start_us":60149,"threads_started":1,"wal-append.queue_time_us":284197}
I20260709 12:21:55.446099 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:55.446578 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 89452.4us
I20260709 12:21:55.448251 11003 raft_consensus.cc:2393] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 9: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:55.448985 15566 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:55.448519 10974 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:55.452086 11009 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:55.455171 10934 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
W20260709 12:21:55.456038 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 49084.5us
I20260709 12:21:55.436183 15666 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:55.460450 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 55248.6us
I20260709 12:21:55.420737 15515 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:21:55.445070 15514 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:55.467545 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.468217 10977 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:55.464744 15504 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.471282 15504 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:55.472182 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:55.472771 11007 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:55.465890 15628 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:55.485868 15527 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:55.486850 11051 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:55.449563 15566 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.500094 15610 consensus_queue.cc:260] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.501539 15610 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:55.502104 15566 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:55.503810 15406 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:55.508035 10977 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:55.508409 15406 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.508934 15406 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.510439 11654 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:55.512270 15594 consensus_queue.cc:1059] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:21:55.513165 15631 consensus_meta.cc:287] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 1.145s	user 0.009s	sys 0.002s
I20260709 12:21:55.513691 15631 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.516390 15613 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.489400 15514 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:55.521772 15514 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.522164 15514 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:55.490896 15628 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:55.524441 15628 raft_consensus.cc:697] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:55.525483 15628 consensus_queue.cc:237] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.491775 15644 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:55.530388 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:55.531693 10931 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:55.532403 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 2936) took 1387 ms. Trace:
I20260709 12:21:55.533212 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:55.534312 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:55.535071 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:55.535511 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:55.536166 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:55.536294 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 47796.8us
I20260709 12:21:55.536491 10928 raft_consensus.cc:1240] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:55.537129 10977 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:55.537338 10933 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:55.497539 11009 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:21:55.538796 10930 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:55.490164 11003 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:55.532768 11084 rpcz_store.cc:276] 0709 12:21:54.157866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.161915 (+  4049us) service_pool.cc:224] Handling call
0709 12:21:55.532209 (+1370294us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b54000c21d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:55.532326 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":765816064}
I20260709 12:21:55.518658 11051 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:55.494289 15670 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.520917 15365 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.530781 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:55.547494 15512 raft_consensus.cc:3055] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:55.547962 15512 raft_consensus.cc:740] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:55.534400 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:55.548705 10927 raft_consensus.cc:2393] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:21:55.507741 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.548985 15512 consensus_queue.cc:260] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:55.541496 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:55.541960 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:55.542160 15644 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:55.542927 11011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 2996) took 2588 ms. Trace:
I20260709 12:21:55.542176 15594 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:55.553906 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:55.552248 11011 rpcz_store.cc:276] 0709 12:21:52.954154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.954301 (+   147us) service_pool.cc:224] Handling call
0709 12:21:53.601127 (+646826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:53.610015 (+  8888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:54.537023 (+927008us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b54003796d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:55.542524 (+1005501us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b54003796d0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:55.542725 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1454344704}
I20260709 12:21:55.544677 11051 leader_election.cc:400] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17.
I20260709 12:21:55.555508 11051 leader_election.cc:403] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:55.545166 15406 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:55.545562 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 97120.8us
I20260709 12:21:55.520810 15467 raft_consensus.cc:3055] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:55.557612 15467 raft_consensus.cc:740] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:55.557928 15609 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.532809 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:55.548178 10934 raft_consensus.cc:2410] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:21:55.554652 15644 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:55.557197 10974 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:55.546028 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2380) took 1483 ms. Trace:
I20260709 12:21:55.559438 10932 raft_consensus.cc:2410] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:21:55.560685 11003 rpcz_store.cc:276] 0709 12:21:54.056776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.459673 (+1402897us) service_pool.cc:224] Handling call
0709 12:21:55.473222 (+ 13549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:55.539473 (+ 66251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:55.539724 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:55.562183 11009 raft_consensus.cc:2393] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 13: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:55.564100 11011 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:55.564486 11009 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:55.564853 11011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2385) took 1469 ms. Trace:
I20260709 12:21:55.565172 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2399) took 1197 ms. Trace:
I20260709 12:21:55.565824 15666 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:21:55.566473 15365 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:55.567209 11049 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:55.568037 15365 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:55.568434 15365 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.562450 15644 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:55.569235 11051 leader_election.cc:400] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11.
I20260709 12:21:55.569550 11051 leader_election.cc:403] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:55.570757 11051 leader_election.cc:400] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11.
I20260709 12:21:55.571029 11051 leader_election.cc:403] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:21:55.571604 15673 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:21:55.572515 15557 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:55.573689 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:55.568774 15365 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:55.574638 11650 raft_consensus.cc:2393] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 15: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:55.572448 15670 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:55.577700 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:55.578473 11003 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:21:55.578742 11084 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:55.565605 11009 rpcz_store.cc:276] 0709 12:21:54.402751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.563676 (+1160925us) service_pool.cc:224] Handling call
0709 12:21:55.564066 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:55.564893 (+   827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:55.565086 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:55.565253 11011 rpcz_store.cc:276] 0709 12:21:54.098169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.563313 (+1465144us) service_pool.cc:224] Handling call
0709 12:21:55.563689 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:55.564579 (+   890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:55.564781 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:55.568619 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:55.575706 15512 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:55.585333 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3013) took 1389 ms. Trace:
I20260709 12:21:55.585970 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:55.585721 11003 rpcz_store.cc:276] 0709 12:21:54.190390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.561466 (+1371076us) service_pool.cc:224] Handling call
0709 12:21:55.578095 (+ 16629us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:55.579950 (+  1855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:55.580187 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:55.617048 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 168682us
I20260709 12:21:55.605477 11010 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:21:55.618549 11010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2391) took 1454 ms. Trace:
I20260709 12:21:55.618881 11010 rpcz_store.cc:276] 0709 12:21:54.164865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.528254 (+363389us) service_pool.cc:224] Handling call
0709 12:21:55.568455 (+1040201us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b5800223598. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f260a0 00007f9bb5f25984 00007f9baf4a06d4 00007f9baf4a0662
0709 12:21:55.618471 (+ 50016us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3245824}
I20260709 12:21:55.625722 11011 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:55.626626 11080 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: [12.5-12.5]
I20260709 12:21:55.625765 11009 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:55.628649 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:55.560169 15664 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:21:55.605926 15412 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.606498 15527 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:55.613683 15222 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:21:55.631233 10899 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.67:40209 timed out after 1.635s (SENT) [suppressed 20 similar messages]
I20260709 12:21:55.648595 11050 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:55.649235 11080 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:21:55.624615 15613 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:55.632043 15609 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:55.558648 15467 consensus_queue.cc:260] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:55.680995 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 142476us
I20260709 12:21:55.644460 15631 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:55.684204 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.686064 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:55.682976 15609 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.692584 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:55.692866 15467 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:55.674412 15323 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.696650 11050 leader_election.cc:400] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11.
I20260709 12:21:55.697654 11050 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:55.697830 15323 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:55.699347 11050 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:55.700227 11008 raft_consensus.cc:2393] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 17: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:55.700476 11078 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:55.701041 15631 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:55.701548 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:55.702152 11078 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:55.704366 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 53688.2us
I20260709 12:21:55.705462 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:55.705744 15510 consensus_queue.cc:1059] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:55.706063 15586 consensus_queue.cc:1059] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:55.706642 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:55.706864 15368 raft_consensus.cc:3055] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:55.683231 15412 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.706606 15510 raft_consensus.cc:3055] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:55.682114 15670 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:55.706248 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:55.709157 11077 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 13: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:55.710078 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:55.710675 11077 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:55.666728 15527 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:55.712551 11004 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41098 (request call id 361) took 1749 ms (client timeout 2023 ms). Trace:
I20260709 12:21:55.712728 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:55.692602 15609 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.715832 15609 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:55.706084 11625 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:55.716895 15514 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:55.719595 15586 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:55.720167 15586 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.720321 15677 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:55.720800 11652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59398 (request call id 412) took 1723 ms. Trace:
I20260709 12:21:55.721170 11652 rpcz_store.cc:276] 0709 12:21:53.996946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.048596 (+ 51650us) service_pool.cc:224] Handling call
0709 12:21:55.720598 (+1672002us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54007ddf54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:55.720746 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2716323584}
I20260709 12:21:55.722625 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:55.713505 15527 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:55.724004 15586 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:55.707412 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:55.726393 11079 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:21:55.726647 11003 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:21:55.727763 15412 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:55.728392 11651 raft_consensus.cc:1240] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:21:55.729550 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:55.666244 15222 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:55.713449 11076 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:55.731804 11081 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:21:55.712982 11004 rpcz_store.cc:269] 0709 12:21:53.963509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.016270 (+ 52761us) service_pool.cc:224] Handling call
0709 12:21:55.712397 (+1696127us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b540037aad4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:55.712500 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525275392}
W20260709 12:21:55.730576 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 173448us
I20260709 12:21:55.727766 11079 raft_consensus.cc:1275] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:21:55.711607 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:55.736575 11077 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 14: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:55.735659 11079 pending_rounds.cc:85] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 4
I20260709 12:21:55.735594 11007 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:55.723594 11006 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 14: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:55.737887 11006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2378) took 1692 ms. Trace:
I20260709 12:21:55.738224 11006 rpcz_store.cc:276] 0709 12:21:54.045519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.355269 (+309750us) service_pool.cc:224] Handling call
0709 12:21:55.722493 (+1367224us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b5800223598. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3beee 000000000036eb39 00007f9bb5eaf1e0 00007f9bb5f780c4 00007f9bb5f78131 00007f9bb5f260a0 00007f9bb5f25984 00007f9baf4a06d4 00007f9baf4a0662
0709 12:21:55.737833 (+ 15340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10462976}
W20260709 12:21:55.710788 15667 log.cc:927] Time spent T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 1.076s	user 0.014s	sys 0.000s
I20260709 12:21:55.680116 15594 raft_consensus.cc:697] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:55.769304 11084 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:55.737306 11079 pending_rounds.cc:107] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:21:55.772440 11079 raft_consensus.cc:2889] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:55.707334 15368 raft_consensus.cc:740] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:55.779675 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
W20260709 12:21:55.783208 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.731839 15222 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:55.730613 15666 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17.
I20260709 12:21:55.792415 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:55.740912 15504 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:55.799913 15524 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:55.800383 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:55.800621 11079 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:55.801164 11084 raft_consensus.cc:2393] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 13: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:55.801829 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:55.802464 11079 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:55.732472 15510 raft_consensus.cc:740] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:55.803848 15510 consensus_queue.cc:260] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:55.804934 15609 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.805066 15510 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:55.805517 15609 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.806435 11081 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18. Ops: []
I20260709 12:21:55.808154 11010 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17. Ops: []
W20260709 12:21:55.809460 15662 log.cc:927] Time spent T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 1.354s	user 0.007s	sys 0.007s
I20260709 12:21:55.809917 15610 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.810266 15222 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.805626 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2382) took 1727 ms. Trace:
I20260709 12:21:55.810863 11008 rpcz_store.cc:276] 0709 12:21:54.078595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.521767 (+443172us) service_pool.cc:224] Handling call
0709 12:21:55.417586 (+895819us) spinlock_profiling.cc:243] Waited 968 us on lock 0x7b5800223598. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f260a0 00007f9bb5f25984 00007f9baf4a06d4 00007f9baf4a0662
0709 12:21:55.805408 (+387822us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54004010d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:55.805565 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":649889920}
I20260709 12:21:55.812783 11077 raft_consensus.cc:2393] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 9: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:21:55.785862 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 51932.8us
I20260709 12:21:55.813858 10974 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:55.703635 15365 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:55.810809 15222 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.815999 15365 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:21:55.816622 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.793975 15557 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11.
I20260709 12:21:55.817950 15566 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.818477 15566 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.820029 15412 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.820679 15566 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:55.820606 15412 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.822804 15412 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:55.813978 15673 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11.
I20260709 12:21:55.810436 15610 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.825285 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:55.826661 11077 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:55.826987 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:55.827529 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:55.828174 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:55.719763 15514 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:55.802134 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:55.825850 11653 raft_consensus.cc:1240] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:55.825448 11654 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:21:55.826360 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:55.802522 15504 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.779239 15613 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:55.828644 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:55.826051 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:55.797037 10975 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:55.716144 15644 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.832263 11084 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:55.802992 11076 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:21:55.848500 11079 raft_consensus.cc:2393] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 13: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:55.830291 11657 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:55.855612 11658 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:55.856035 15368 consensus_queue.cc:260] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:55.857295 15368 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:55.858737 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 44952.3us
I20260709 12:21:55.859702 10974 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:55.865836 15632 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.866503 15632 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.866858 15586 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:55.868261 15594 consensus_queue.cc:237] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.868856 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:55.870002 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:55.870632 11084 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:55.871464 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:55.816527 15222 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:55.874035 11078 raft_consensus.cc:2410] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:21:55.876959 11080 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:55.879904 11082 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:55.826390 15610 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:55.885428 11050 leader_election.cc:336] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.618s (SENT)
I20260709 12:21:55.888737 11050 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:55.807740 15609 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:55.796226 15686 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:55.893116 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:55.836440 15613 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.895048 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:55.899221 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:55.901422 11079 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:55.902027 11077 raft_consensus.cc:2393] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 12: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:55.902844 11650 raft_consensus.cc:1240] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:21:55.903271 15613 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:55.886443 15566 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 12:21:55.904280 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 107353us
I20260709 12:21:55.905725 15512 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:55.906167 15512 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:55.906535 15512 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:55.908134 15689 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:55.903337 10901 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:55.910513 10901 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:55.911401 10901 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:55.912041 15412 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:55.912590 15412 raft_consensus.cc:697] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:55.913502 15412 consensus_queue.cc:237] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:55.916095 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.917007 15586 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:55.906736 15610 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:55.917804 15610 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:55.918187 15610 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:55.911304 15222 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:55.918653 15222 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.903741 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:55.919409 15222 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:55.920258 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:55.921406 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:55.922384 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:55.923416 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:55.918308 11652 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:55.895088 11651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59384 (request call id 555) took 1858 ms. Trace:
I20260709 12:21:55.903339 10974 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:55.926153 11078 raft_consensus.cc:3055] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:55.926585 11078 raft_consensus.cc:740] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:55.918648 15666 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:55.931043 15632 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:55.905994 15690 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.932425 15690 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.924430 11651 rpcz_store.cc:276] 0709 12:21:54.048857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.051441 (+  2584us) service_pool.cc:224] Handling call
0709 12:21:55.366985 (+1315544us) spinlock_profiling.cc:243] Waited 7.08 ms on lock 0x7b5800003998. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f39fc0 00007f9bb5f24929 00007f9bb5f243d2 00007f9baf49bbd4
0709 12:21:55.728016 (+361031us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:55.728830 (+   814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:55.849242 (+120412us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b54007ddf50. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:55.891961 (+ 42719us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":845940864}
W20260709 12:21:55.936550 15681 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:21:55.849489 15504 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:55.947064 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.946977 11076 raft_consensus.cc:1240] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:55.974222 15566 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:55.974896 15566 raft_consensus.cc:697] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:55.975785 15566 consensus_queue.cc:237] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.976707 11080 raft_consensus.cc:1240] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:21:55.978470 11622 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:55.979750 15527 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:55.983924 11077 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
W20260709 12:21:55.986152 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 82902us
I20260709 12:21:55.988061 10974 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:55.989427 10974 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:55.944185 15632 raft_consensus.cc:2764] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:21:55.993690 11655 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:55.996366 11079 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
I20260709 12:21:55.999338 11085 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:21:55.982550 15222 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.936929 15686 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:55.943478 15644 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:55.982582 15689 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:56.015851 15467 consensus_queue.cc:1059] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:21:56.018716 15467 raft_consensus.cc:3055] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:56.019071 15467 raft_consensus.cc:740] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:56.020016 15467 consensus_queue.cc:260] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:56.021304 15688 raft_consensus.cc:2764] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:21:55.998834 11078 consensus_queue.cc:260] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:56.022699 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41098 (request call id 359) took 2060 ms. Trace:
I20260709 12:21:56.021265 15467 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:56.034775 10974 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:56.035974 10974 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:56.024199 11002 rpcz_store.cc:276] 0709 12:21:53.962605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.187370 (+1224765us) service_pool.cc:224] Handling call
0709 12:21:55.205772 (+ 18402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:55.220759 (+ 14987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:55.220784 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:55.266650 (+ 45866us) log.cc:844] Serialized 26 byte log entry
0709 12:21:55.602660 (+336010us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:55.602698 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:55.602770 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:56.022430 (+419660us) raft_consensus.cc:1685] finished
0709 12:21:56.022456 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:56.022636 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":900,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":2357,"thread_start_us":335552,"threads_started":1,"wal-append.queue_time_us":413400}
I20260709 12:21:56.051115 11051 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:56.022210 15688 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:56.029100 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:56.013881 15692 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:21:56.056380 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 276958us
I20260709 12:21:56.083561 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:56.084422 11005 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:56.087468 11010 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:56.089568 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:56.090471 11007 raft_consensus.cc:2393] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 11: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:56.092696 11007 raft_consensus.cc:1275] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:56.094328 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:56.095260 11007 raft_consensus.cc:2410] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:21:56.109050 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:56.109583 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:56.109875 11008 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:56.110399 11007 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:56.117017 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 57146.4us
I20260709 12:21:56.053310 15632 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:56.120275 15692 raft_consensus.cc:697] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:56.119024 15690 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:56.117101 11651 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:56.116849 15557 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:56.129209 15613 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:56.033382 15514 consensus_queue.cc:1059] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 12:21:56.059689 15628 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:21:56.190243 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 168558us
I20260709 12:21:56.191033 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:56.191479 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:56.193117 10932 raft_consensus.cc:2368] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15.
I20260709 12:21:56.113045 15644 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.130s
W20260709 12:21:56.183363 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 132310us
W20260709 12:21:56.194769 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:56.137621 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 505762us
W20260709 12:21:56.199812 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.200309 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:56.122996 15683 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:21:56.194820 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:56.199097 11007 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:56.195017 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:56.130683 15222 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:56.206714 11051 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:56.211242 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:56.216715 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:56.217512 10936 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:21:56.192911 15712 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.192153 15628 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:56.220693 15613 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:56.221473 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:56.228609 11008 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:56.124571 15688 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:56.228507 11051 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:56.223850 10932 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 10: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:56.209028 15673 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.240914 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:56.241813 10936 raft_consensus.cc:2410] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:21:56.242563 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:56.236282 15557 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:56.248186 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:56.248874 11010 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:56.249038 15686 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:56.249557 15504 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:56.254287 15666 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:56.255086 15666 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:56.259752 15688 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:56.260417 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2939) took 1023 ms. Trace:
I20260709 12:21:56.260818 11083 rpcz_store.cc:276] 0709 12:21:55.184904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.186836 (+  1932us) service_pool.cc:224] Handling call
0709 12:21:55.197377 (+ 10541us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:55.288213 (+ 90836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:55.288242 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:55.292763 (+  4521us) log.cc:844] Serialized 26 byte log entry
0709 12:21:55.648207 (+355444us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:21:56.024868 (+376661us) log.cc:844] Serialized 14 byte log entry
0709 12:21:56.025137 (+   269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.193680 (+168543us) spinlock_profiling.cc:243] Waited 79.6 ms on lock 0x7b540044c5d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:56.193725 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:56.193773 (+    48us) raft_consensus.cc:1685] finished
0709 12:21:56.207632 (+ 13859us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:56.207816 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":758,"prepare.queue_time_us":384742,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":2768,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":34304,"spinlock_wait_cycles":183138560,"thread_start_us":539563,"threads_started":2,"wal-append.queue_time_us":380447}
I20260709 12:21:56.266278 15512 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:56.213583 15514 consensus_queue.cc:1243] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:21:56.223495 15694 log.cc:927] Time spent T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:21:56.243193 10932 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:56.277810 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:56.278681 10932 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 13: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:56.271008 15610 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:56.230753 15628 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:56.281240 15692 consensus_queue.cc:237] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:56.283180 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:56.284399 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:56.285115 11008 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:21:56.300886 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:56.300956 11006 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:56.302117 15610 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:56.230458 15712 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:56.306347 15557 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:56.308475 15706 log.cc:927] Time spent T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.192s	user 0.002s	sys 0.001s
I20260709 12:21:56.305490 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:56.319454 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.271822 15673 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:56.330359 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 101935us
I20260709 12:21:56.330866 10936 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:21:56.335320 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:56.336054 11008 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:21:56.344604 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:56.344537 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:56.345991 10932 raft_consensus.cc:2393] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:21:56.347110 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.325376 11651 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:56.350700 10932 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:21:56.354435 15673 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:56.352294 15467 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:21:56.334249 15644 consensus_queue.cc:1059] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:21:56.361248 11049 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:56.362990 11051 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:56.348546 15557 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:21:56.363276 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:56.364307 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.366433 15644 consensus_queue.cc:1243] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:56.352901 15512 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:56.368337 15644 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:56.372867 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:56.373370 10900 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:56.377100 15644 raft_consensus.cc:697] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:56.377311 15515 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:56.377801 15712 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:56.378170 15644 consensus_queue.cc:237] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:56.378568 15412 consensus_queue.cc:1059] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:56.379686 15412 raft_consensus.cc:3055] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:56.380085 15412 raft_consensus.cc:740] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:56.369585 15673 raft_consensus.cc:3055] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:56.388859 11051 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:56.391762 15708 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:56.374814 15566 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:21:56.394986 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:56.395705 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:56.400326 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:56.403450 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:56.381460 15467 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:56.419287 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.408298 15708 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:21:56.429999 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.406121 15557 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:56.436513 15412 consensus_queue.cc:260] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:56.437920 15412 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:56.439953 15708 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:56.415007 15712 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.444340 15712 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:56.446683 15712 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:56.404709 15673 raft_consensus.cc:740] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:56.461700 15673 consensus_queue.cc:260] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:56.463135 15673 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:56.447300 15712 consensus_queue.cc:1059] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
W20260709 12:21:56.465478 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 76686.2us
I20260709 12:21:56.466363 11051 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:56.405845 15222 consensus_queue.cc:1059] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:21:56.477146 15467 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:56.485180 15628 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:56.494947 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 80955.7us
I20260709 12:21:56.497726 11051 leader_election.cc:400] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15.
I20260709 12:21:56.498106 11051 leader_election.cc:403] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:56.499069 11051 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:56.500281 11051 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:56.503005 11051 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:56.497339 10900 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:56.487509 15628 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:56.505649 15666 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:56.506551 15467 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:21:56.513059 11654 raft_consensus.cc:1240] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:21:56.506122 15557 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:56.507834 15721 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:56.527132 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3032) took 1021 ms. Trace:
W20260709 12:21:56.524506 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 110898us
W20260709 12:21:56.528610 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 472089us
I20260709 12:21:56.531929 10974 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:56.527925 15721 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:56.533329 15721 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:56.533855 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:56.534426 11002 raft_consensus.cc:2376] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10. Re-sending same reply.
I20260709 12:21:56.535280 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:56.536924 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:56.538172 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:56.511430 15729 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:21:56.539943 15731 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:21:56.544461 11006 raft_consensus.cc:1240] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:56.545022 15731 consensus_queue.cc:1059] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:56.545761 15731 consensus_queue.cc:1243] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:21:56.523562 15644 consensus_queue.cc:1059] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:21:56.524834 15557 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:56.547062 15557 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:56.547850 15733 raft_consensus.cc:3055] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:56.548305 15733 raft_consensus.cc:740] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:56.549119 15733 consensus_queue.cc:260] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:56.552419 11004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3033) took 1046 ms. Trace:
I20260709 12:21:56.552740 11004 rpcz_store.cc:276] 0709 12:21:55.505757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.733094 (+227337us) service_pool.cc:224] Handling call
0709 12:21:55.733400 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:55.772156 (+ 38756us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:56.113468 (+341312us) log.cc:844] Serialized 14 byte log entry
0709 12:21:56.552106 (+438638us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:56.552170 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:56.552222 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.552276 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:56.552370 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":275059,"prepare.queue_time_us":77938,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"thread_start_us":375123,"threads_started":2,"wal-append.queue_time_us":228062}
I20260709 12:21:56.546855 15666 raft_consensus.cc:3055] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:21:56.555285 15707 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.481s	user 0.000s	sys 0.004s
I20260709 12:21:56.530720 15727 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:56.556267 15727 raft_consensus.cc:697] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:56.557219 15727 consensus_queue.cc:237] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:56.563503 11011 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 12.
I20260709 12:21:56.555508 15666 raft_consensus.cc:740] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:56.529165 11003 rpcz_store.cc:276] 0709 12:21:55.505442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.727409 (+221967us) service_pool.cc:224] Handling call
0709 12:21:55.727708 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:55.784782 (+ 57074us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:56.074968 (+290186us) log.cc:844] Serialized 14 byte log entry
0709 12:21:56.523256 (+448288us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b18002d8980. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9baddedc0a 00007f9bb752d219 00007f9bade75a40 00007f9bade704e4 00007f9bade70455 00007f9bb0f58060 00007f9bb0f6a716 00007f9bb0f7b287 00007f9bb0f7b208
0709 12:21:56.526796 (+  3540us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:56.526850 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:56.526901 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.526964 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:56.527077 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92422,"prepare.queue_time_us":72791,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":70,"raft.queue_time_us":445065,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":5244,"spinlock_wait_cycles":75664512,"thread_start_us":253292,"threads_started":2,"wal-append.queue_time_us":7221}
W20260709 12:21:56.569569 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.531555 15222 raft_consensus.cc:3055] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:56.570896 15222 raft_consensus.cc:740] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:56.566969 15666 consensus_queue.cc:260] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:56.527532 15732 raft_consensus.cc:3055] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:56.572213 11624 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:56.576342 11011 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:56.571796 15222 consensus_queue.cc:260] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:56.578073 15714 log.cc:927] Time spent T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.495s	user 0.002s	sys 0.000s
I20260709 12:21:56.580614 11624 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:56.581591 15368 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:56.582157 15368 raft_consensus.cc:697] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:56.583184 15368 consensus_queue.cc:237] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:56.574472 15412 consensus_queue.cc:1059] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:21:56.574978 15732 raft_consensus.cc:740] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:56.621989 15732 consensus_queue.cc:260] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:56.623780 11078 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:56.628165 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 256354us
I20260709 12:21:56.629938 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:56.630837 15729 consensus_queue.cc:1059] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:21:56.632730 15705 log.cc:927] Time spent T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.558s	user 0.001s	sys 0.001s
I20260709 12:21:56.637370 11654 raft_consensus.cc:1240] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 12:21:56.653657 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 121844us
I20260709 12:21:56.654510 10974 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:56.581861 15603 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:21:56.660442 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 79963.2us
I20260709 12:21:56.667292 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:56.668574 11006 raft_consensus.cc:1275] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:56.662171 11078 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:21:56.665340 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:21:56.665655 11050 leader_election.cc:336] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 2.891s (SENT)
I20260709 12:21:56.672916 11005 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:56.672933 11050 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:56.666296 11007 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:56.673929 11078 pending_rounds.cc:85] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 8
I20260709 12:21:56.674269 11078 pending_rounds.cc:107] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:21:56.674517 11078 raft_consensus.cc:2889] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:56.668608 11003 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:21:56.672916 11011 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:56.672020 15222 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:56.653370 15732 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:56.624023 15691 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:21:56.672199 15713 log.cc:927] Time spent T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.591s	user 0.006s	sys 0.000s
I20260709 12:21:56.673105 11004 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
W20260709 12:21:56.682487 15699 log.cc:927] Time spent T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.611s	user 0.000s	sys 0.006s
I20260709 12:21:56.688279 11624 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:56.684415 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 101900us
I20260709 12:21:56.590253 15708 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:56.694876 10899 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:56.696691 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:56.695227 15708 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:56.700433 15603 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:56.701037 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:56.701067 15603 raft_consensus.cc:697] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:56.702338 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:56.703510 11080 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:56.702407 15603 consensus_queue.cc:237] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:56.712003 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:56.714186 11078 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:21:56.709091 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 198323us
I20260709 12:21:56.684063 15512 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:56.704087 15691 raft_consensus.cc:697] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:56.664458 15729 consensus_queue.cc:1059] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:21:56.717396 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:56.721267 15597 consensus_queue.cc:1059] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:56.722232 15597 raft_consensus.cc:3055] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:56.722640 15597 raft_consensus.cc:740] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:56.726406 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:56.727097 11084 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:21:56.727921 15365 consensus_queue.cc:1059] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:56.729001 15365 raft_consensus.cc:3055] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:56.729375 15365 raft_consensus.cc:740] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:56.730161 15365 consensus_queue.cc:260] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:56.731320 15365 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:56.732087 15691 consensus_queue.cc:237] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:56.733589 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 72413.2us
W20260709 12:21:56.735132 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.735754 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:56.736626 11076 raft_consensus.cc:2410] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:21:56.731338 11078 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:21:56.740080 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:56.741398 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3030) took 1236 ms. Trace:
I20260709 12:21:56.741804 11009 rpcz_store.cc:276] 0709 12:21:55.504979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.632813 (+127834us) service_pool.cc:224] Handling call
0709 12:21:55.666825 (+ 34012us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:55.690029 (+ 23204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:55.690058 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:55.778312 (+ 88254us) log.cc:844] Serialized 26 byte log entry
0709 12:21:56.071043 (+292731us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:56.071091 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.071165 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:56.661299 (+590134us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:56.741119 (+ 79820us) raft_consensus.cc:1685] finished
0709 12:21:56.741139 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:56.741342 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3344,"raft.queue_time_us":121591,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":105426176,"thread_start_us":274197,"threads_started":1,"wal-append.queue_time_us":274628}
I20260709 12:21:56.707608 15412 raft_consensus.cc:3055] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:56.748594 11011 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:21:56.752624 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:56.756012 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:56.758322 11076 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:56.713582 15514 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:56.759070 10901 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:56.756253 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:56.760632 11078 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:21:56.761860 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:56.763062 15467 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15.
I20260709 12:21:56.762836 15557 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:56.763550 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:56.747781 15412 raft_consensus.cc:740] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:56.764364 11085 raft_consensus.cc:2410] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:21:56.764561 15412 consensus_queue.cc:260] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:56.765062 15557 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:56.765856 15412 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:56.763088 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:56.768225 15734 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:56.769198 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:56.769836 11081 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:21:56.769748 15734 raft_consensus.cc:2804] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:56.771739 15734 raft_consensus.cc:697] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:56.745239 15736 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:56.773173 15736 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:56.773602 15736 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:56.776301 11080 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:56.777221 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:56.777806 11081 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:56.780632 11002 raft_consensus.cc:1240] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:21:56.780875 15708 raft_consensus.cc:3055] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:56.782333 15708 raft_consensus.cc:740] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:56.782611 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:56.782799 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:56.783533 11009 raft_consensus.cc:2368] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15.
I20260709 12:21:56.723948 15597 consensus_queue.cc:260] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:56.796106 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:56.796265 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:56.796303 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:56.788383 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 283158us
I20260709 12:21:56.797165 11085 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:21:56.797484 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:56.798285 11003 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 10: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:56.796886 11007 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 7.
I20260709 12:21:56.803267 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:56.804028 11007 raft_consensus.cc:2393] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 12: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:56.800410 11622 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:56.805951 11002 raft_consensus.cc:1240] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:21:56.807765 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:56.808656 11006 raft_consensus.cc:2410] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 15 because replica has last-logged OpId of term: 14 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 12:21:56.810746 11004 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:21:56.809895 11002 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:21:56.811838 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:56.814237 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.815227 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:56.815487 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:56.816174 11082 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:21:56.817342 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:56.817860 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:56.819581 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:56.820914 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:56.821188 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:56.823006 11076 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:21:56.822607 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:56.823766 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 82140.5us
I20260709 12:21:56.823845 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:56.807374 15514 consensus_queue.cc:1059] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:21:56.825664 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:56.825706 11009 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 13: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:21:56.825034 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 130221us
I20260709 12:21:56.826437 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:56.827841 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:56.829154 11080 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:56.830855 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:56.832126 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:56.807902 15586 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:56.835728 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:56.836216 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:56.841403 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:56.841245 15514 raft_consensus.cc:3055] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:56.837728 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:56.844342 11003 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:56.840344 11081 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:21:56.845834 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:56.846735 11081 raft_consensus.cc:2410] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 12:21:56.848838 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 48519.2us
I20260709 12:21:56.849370 11077 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:56.849699 11622 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:56.851745 11078 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:21:56.840615 11076 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 10: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:56.841388 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:56.842907 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:56.852649 11079 raft_consensus.cc:2376] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10. Re-sending same reply.
I20260709 12:21:56.842300 11085 raft_consensus.cc:2410] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:21:56.837293 11084 raft_consensus.cc:2393] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 14: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:56.783349 15566 consensus_queue.cc:1059] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:21:56.843393 11082 raft_consensus.cc:2393] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 12: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:56.829113 15597 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:56.854843 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 87667.2us
I20260709 12:21:56.856870 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:56.858506 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:56.860805 11622 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:56.861513 11005 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 14: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:56.843673 15514 raft_consensus.cc:740] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:21:56.863911 15368 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:56.864225 15586 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:21:56.861235 15738 raft_consensus.cc:3055] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:56.865887 15738 raft_consensus.cc:740] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:56.866226 15727 raft_consensus.cc:3055] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:21:56.866642 15727 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:56.867558 15727 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:56.868134 15368 consensus_queue.cc:1059] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:56.868827 15727 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:56.869850 15733 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:56.870777 11622 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:56.872063 15695 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:56.872843 10899 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:56.875125 15222 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:56.875454 15557 consensus_queue.cc:1059] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:56.877750 15735 consensus_queue.cc:1059] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:56.878939 15712 raft_consensus.cc:3055] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:21:56.879303 15712 raft_consensus.cc:740] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:56.880366 11653 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:56.880091 15712 consensus_queue.cc:260] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:56.881728 10899 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:56.885258 11003 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:21:56.873478 15412 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:21:56.863936 10833 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35608 (request call id 262) took 22745 ms (client timeout 15000 ms). Trace:
I20260709 12:21:56.891081 15222 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:56.888542 10833 rpcz_store.cc:269] 0709 12:21:34.048885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.049112 (+   227us) service_pool.cc:224] Handling call
0709 12:21:56.781204 (+22732092us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:46.799203 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:46.799919 (+   716us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:46.799965 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:21:46.799982 (+    17us) tablet.cc:662] Decoding operations
0709 12:21:46.801482 (+  1500us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:46.801607 (+   125us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:46.801638 (+    31us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:21:46.803010 (+  1372us) tablet.cc:701] Row locks acquired
0709 12:21:46.803064 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:21:46.803257 (+   193us) write_op.cc:270] Start()
0709 12:21:46.803406 (+   149us) write_op.cc:276] Timestamp: P: 1783599706803178 usec, L: 0
0709 12:21:46.803444 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:21:46.819036 (+ 15592us) log.cc:844] Serialized 6708 byte log entry
0709 12:21:47.770392 (+951356us) op_driver.cc:464] REPLICATION: finished
0709 12:21:48.440444 (+670052us) spinlock_profiling.cc:243] Waited 6.53 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bade560ac 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb4996ef0
0709 12:21:48.738903 (+298459us) write_op.cc:301] APPLY: starting
0709 12:21:48.739003 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:48.739327 (+   324us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:48.739365 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:48.849585 (+110220us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:48.849942 (+   357us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 12:21:48.850001 (+    59us) write_op.cc:312] APPLY: finished
0709 12:21:48.850413 (+   412us) log.cc:844] Serialized 119 byte log entry
0709 12:21:48.986440 (+136027us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:49.078559 (+ 92119us) write_op.cc:454] Released schema lock
0709 12:21:49.097866 (+ 19307us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:49.162155 (+ 64289us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:49.162194 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":85062,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":948836,"apply.run_cpu_time_us":19670,"apply.run_wall_time_us":423209,"num_ops":17,"prepare.queue_time_us":74303,"prepare.run_cpu_time_us":17472,"prepare.run_wall_time_us":74150,"raft.queue_time_us":485012,"raft.run_cpu_time_us":50124,"raft.run_wall_time_us":1123179,"replication_time_us":869158,"spinlock_wait_cycles":15011712,"thread_start_us":1554228,"threads_started":5,"wal-append.queue_time_us":314758,"wal-append.run_cpu_time_us":68635,"wal-append.run_wall_time_us":2769235}]]}
I20260709 12:21:56.847609 15708 consensus_queue.cc:260] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:56.892709 15708 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:56.893343 15514 consensus_queue.cc:260] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:56.894722 15712 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:21:56.882117 15711 log.cc:927] Time spent T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca: Append to log took a long time: real 0.805s	user 0.005s	sys 0.000s
I20260709 12:21:56.772697 15734 consensus_queue.cc:237] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:56.869081 15527 raft_consensus.cc:3055] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:56.897023 15666 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:56.897373 15740 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:56.896950 15527 raft_consensus.cc:740] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:21:56.899537 15527 consensus_queue.cc:260] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:56.862435 15721 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:56.900768 15527 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:56.902060 15721 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:56.902882 11083 raft_consensus.cc:2393] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 8: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:56.855823 15731 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:21:56.885862 15745 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:56.886528 10899 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:56.866704 15738 consensus_queue.cc:260] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:56.910517 10974 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:21:56.913056 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.919462 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:56.915256 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:56.915477 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:56.916862 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.922487 15467 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.920938 10974 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:56.856333 10901 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:56.922806 15644 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:56.943161 11011 raft_consensus.cc:2393] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 17: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:21:56.945019 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 88772.9us
I20260709 12:21:56.944365 15691 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.947132 10974 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:56.946717 15732 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:56.951970 11080 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:21:56.965763 11050 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:56.967494 10901 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:56.957020 11084 raft_consensus.cc:1240] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:56.923517 15686 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:56.977563 15686 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:56.978101 15686 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:56.978621 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 54431.9us
I20260709 12:21:56.957469 15734 consensus_queue.cc:1059] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:21:56.960829 15692 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:56.980963 15692 raft_consensus.cc:697] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:56.981874 15692 consensus_queue.cc:237] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:56.984025 15731 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:56.957449 15732 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:56.989221 10899 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:21:56.969949 10822 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.246s	user 0.000s	sys 0.000s
I20260709 12:21:56.949306 15691 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:56.972803 11067 tablet_service.cc:1558] Processing DeleteTablet for tablet 6aa58b8bde194f658aced897744b4d35 with delete_type TABLET_DATA_TOMBSTONED (TS 1abf4b385a2b493ab83f593a1f8c9cd1 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:60028
I20260709 12:21:56.973448 15557 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:56.973834 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.922955 15467 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:56.919765 15721 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 12:21:56.917503 15514 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:56.976346 15738 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:56.950045 15689 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:56.923280 15712 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:56.968135 10974 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:21:56.975977 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.927544 15740 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:21:57.014808 10899 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:57.021795 10901 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:57.020284 15689 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:57.023989 15691 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:57.024474 15467 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:57.025712 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:56.994820 11050 leader_election.cc:400] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15.
W20260709 12:21:57.028777 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 60715.7us
I20260709 12:21:57.028136 15712 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:56.948273 15644 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:57.032960 15609 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:57.015424 15732 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:56.992653 15735 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:56.993083 15734 raft_consensus.cc:3055] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:57.038172 10899 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:57.052026 10901 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:57.016769 15733 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:56.920154 15736 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.045570 10974 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:21:57.046387 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 51732.9us
I20260709 12:21:57.047328 15712 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:57.058367 11050 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:21:57.060030 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.060046 15731 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:57.047169 15222 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:21:57.051302 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.051460 15735 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.048667 15609 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.039381 15689 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:57.061468 15735 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:57.061504 15609 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:57.064044 15708 consensus_queue.cc:1059] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:57.065831 15412 raft_consensus.cc:3055] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:57.066226 15412 raft_consensus.cc:740] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:57.054839 15738 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:57.067883 15738 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:57.068302 15738 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:57.068802 10974 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:57.069181 15691 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:57.069571 15691 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.069911 15691 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:57.069571 15323 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:57.070477 15323 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.070817 15323 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:57.048875 11650 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:21:57.067050 15412 consensus_queue.cc:260] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.072746 15412 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:57.073205 10975 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:57.073738 15644 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:57.074000 15512 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:57.074534 15512 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.074875 15512 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:57.075572 15736 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:57.072103 15610 consensus_queue.cc:1059] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:21:57.076697 15594 raft_consensus.cc:3055] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:57.076974 10974 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:57.052196 15734 raft_consensus.cc:740] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:57.077966 15688 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:57.075757 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:57.077064 15594 raft_consensus.cc:740] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:57.080082 11650 raft_consensus.cc:2393] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 8: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:57.083092 10899 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:57.084111 15222 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:57.085395 15594 consensus_queue.cc:260] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.086359 15566 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:57.086834 15566 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.087159 15566 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:57.091166 15738 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.093824 15735 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.086462 15594 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:57.097995 15222 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:21:57.097302 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 45362.6us
I20260709 12:21:57.098495 15222 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.099689 15222 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:57.101060 15721 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:57.103380 10901 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:57.104374 15708 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:57.104755 15708 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.105137 15708 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:57.106518 15731 consensus_queue.cc:1048] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:57.108665 15731 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:57.111012 15731 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:57.063377 15732 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:57.112435 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 54144.6us
I20260709 12:21:57.134385 11050 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:57.135739 11050 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:57.137146 15644 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:57.078078 10974 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:57.114490 15732 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:57.114854 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:57.138626 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 60622.5us
I20260709 12:21:57.116235 11011 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:57.139000 15692 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:57.140658 15527 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:57.114171 10899 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:57.142776 15731 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:57.120452 15735 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:57.120537 15689 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.121363 15721 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:57.144135 10899 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:57.121758 15733 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.116565 15734 consensus_queue.cc:260] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.122025 15609 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.128863 15738 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:57.112756 10901 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:57.146727 15738 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:57.132606 15752 tablet_replica.cc:333] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:21:57.130640 15222 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.133199 15323 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.113047 15727 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:57.136371 15740 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:57.145067 15735 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:57.121572 15512 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:57.145650 15731 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:57.170964 15594 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.091750 15712 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.139393 10974 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:57.148772 11050 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:57.149461 10899 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:57.123304 15686 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.145756 15733 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:57.146809 15734 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:57.125551 15566 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.130769 15691 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.169193 15732 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:57.184247 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:57.184720 11050 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:57.145269 15708 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.192925 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:57.189409 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 50109.4us
I20260709 12:21:57.195194 10929 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:57.194306 10932 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 10: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:57.194782 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:57.196148 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:57.195396 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:57.178951 15644 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.197248 10930 raft_consensus.cc:2410] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:21:57.196875 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:57.244092 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:57.242918 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:57.220793 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:57.200116 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 46359.8us
I20260709 12:21:57.225114 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:57.278597 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:57.286820 10933 raft_consensus.cc:2393] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:57.193683 15692 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:21:57.198462 11050 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:57.243654 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:57.292145 10929 raft_consensus.cc:2410] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:21:57.283087 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:57.191803 15688 raft_consensus.cc:697] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:57.192651 15740 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:57.254344 15609 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:57.299183 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:57.285491 10928 raft_consensus.cc:2393] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:57.191639 15515 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:57.287655 11051 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:57.302594 11051 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:57.300120 10931 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
W20260709 12:21:57.303529 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 105603us
I20260709 12:21:57.304418 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:57.305298 15752 raft_consensus.cc:2243] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.198983 10936 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:57.290786 10935 raft_consensus.cc:2393] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 8: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:57.315775 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:57.316290 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:57.317070 10935 raft_consensus.cc:2393] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 8: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:57.221225 15721 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:57.293453 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:57.290591 15644 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.234479 15695 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.323184 10929 raft_consensus.cc:1240] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:57.193931 15732 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.198567 15610 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:57.199162 10934 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:21:57.295892 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 97490.6us
W20260709 12:21:57.298529 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.330101 11050 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:57.221185 11003 raft_consensus.cc:2393] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 9: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:57.299347 15557 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:57.307487 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:57.308055 15755 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:21:57.309940 15512 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:57.346431 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:57.310163 15666 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:57.311640 15222 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:57.311262 15688 consensus_queue.cc:237] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.363024 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:57.367051 15691 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:57.367712 10930 raft_consensus.cc:2393] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:57.367937 11008 raft_consensus.cc:1240] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:21:57.325438 15323 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:57.368651 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:57.369036 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:57.369529 10930 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:21:57.370157 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:57.370760 11008 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:57.314430 15752 raft_consensus.cc:2272] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.314431 11076 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:57.315062 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:57.316927 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:57.377019 10928 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:21:57.377080 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:57.377830 11005 raft_consensus.cc:2376] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14. Re-sending same reply.
I20260709 12:21:57.189545 15594 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:57.379017 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:57.307430 15686 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:57.322563 15753 log.cc:927] Time spent T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:21:57.325225 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:57.324980 15695 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:57.331683 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.331718 10936 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:21:57.322463 15609 consensus_queue.cc:1059] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:21:57.332309 10934 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:21:57.333695 15644 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:57.334285 15721 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:57.335469 11050 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:57.338676 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 59359.6us
I20260709 12:21:57.344489 11007 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:21:57.387490 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:57.380537 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:57.388149 11007 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:57.344655 11006 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:21:57.345306 11002 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:21:57.345703 11004 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:57.323930 15515 raft_consensus.cc:697] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:57.329466 15732 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:57.363090 15557 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.363003 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:57.312407 10822 maintenance_manager.cc:643] P b5a9c6dd870a436699566823a8e6e1ca: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 6.596s	user 0.141s	sys 0.083s Metrics: {"bytes_written":29223,"cfile_init":1,"dirs.queue_time_us":66333,"dirs.run_cpu_time_us":503,"dirs.run_wall_time_us":12159,"drs_written":1,"lbm_read_time_us":409,"lbm_reads_lt_1ms":4,"lbm_write_time_us":223958,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":3,"lbm_writes_gt_100_ms":1,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":63,"thread_start_us":37909,"threads_started":1}
I20260709 12:21:57.337267 15689 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:57.379822 11005 raft_consensus.cc:2368] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14.
I20260709 12:21:57.385679 10901 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:57.320979 15467 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:57.404538 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:57.383297 10936 pending_rounds.cc:85] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 10
I20260709 12:21:57.384505 11051 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:57.405304 10936 pending_rounds.cc:107] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:21:57.405665 10936 raft_consensus.cc:2889] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:57.406018 11051 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:57.393640 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 58235.2us
I20260709 12:21:57.375705 15752 ts_tablet_manager.cc:1916] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:57.381475 15566 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:57.407218 11050 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:57.362974 15512 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:57.433773 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 48156.6us
W20260709 12:21:57.405937 15758 log.cc:927] Time spent T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.121s	user 0.002s	sys 0.002s
I20260709 12:21:57.410449 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:57.438624 11009 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:57.380232 15712 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:57.402921 15644 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:57.410857 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:57.447721 11004 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:57.433986 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:57.388777 15594 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:57.436451 10901 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:57.411275 15666 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:57.339169 15610 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:57.450675 11050 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:57.443842 11007 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:57.430688 15514 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:21:57.453926 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 149429us
I20260709 12:21:57.469615 11076 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:21:57.470053 11076 pending_rounds.cc:85] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 8
I20260709 12:21:57.470274 11076 pending_rounds.cc:107] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:21:57.470498 11076 raft_consensus.cc:2889] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:57.471475 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:57.472160 11080 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:57.473848 10934 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:21:57.393003 15603 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:21:57.435727 15222 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:57.459062 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:57.494158 11007 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
I20260709 12:21:57.408242 15557 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.470602 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:57.478292 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:57.499148 11078 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:57.480183 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:57.502575 11081 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 7.
I20260709 12:21:57.481237 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:57.503681 11085 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:57.438148 15512 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.495169 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:57.506604 11007 raft_consensus.cc:2410] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:21:57.506379 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:57.507267 11002 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 13: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:57.477502 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:57.508867 11076 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:57.509092 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:57.509805 11084 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:21:57.507215 11005 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:57.514974 11080 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:21:57.516397 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:57.516569 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:57.459977 15566 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:57.459661 15721 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:57.520633 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:57.521458 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.521890 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:57.523080 11082 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:57.523321 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 70044.7us
I20260709 12:21:57.458019 15695 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:57.473806 15514 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.517122 11079 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:57.534818 10934 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:21:57.493290 15686 raft_consensus.cc:3055] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:57.542402 11009 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:57.493702 15692 raft_consensus.cc:697] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:57.461709 15740 consensus_queue.cc:1059] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:21:57.564821 10931 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:21:57.518333 15666 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:21:57.487056 15712 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:21:57.496850 15644 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:21:57.538166 11077 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:57.597148 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:21:57.598506 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 147914us
W20260709 12:21:57.572517 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 106562us
I20260709 12:21:57.536382 11004 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
W20260709 12:21:57.571125 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.571976 10974 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:57.582801 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:57.601779 11654 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:57.584896 11085 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:57.520397 15708 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:57.543470 15686 raft_consensus.cc:740] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:57.549796 15594 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.530679 15222 raft_consensus.cc:697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:57.656255 10901 leader_election.cc:400] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14.
I20260709 12:21:57.656708 10901 leader_election.cc:403] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:21:57.606670 11078 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:21:57.610932 11076 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:21:57.659339 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:57.660122 10931 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:57.619452 15586 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.605186 15666 raft_consensus.cc:697] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:21:57.664865 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 64752.5us
I20260709 12:21:57.625367 11050 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:57.631556 10830 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 113) took 22267 ms (client timeout 15000 ms). Trace:
I20260709 12:21:57.541338 15514 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:57.640556 11011 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:21:57.639170 15721 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:57.661845 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:21:57.662142 15760 log.cc:927] Time spent T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:21:57.523567 15515 consensus_queue.cc:237] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.659507 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:57.643164 15692 consensus_queue.cc:237] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.624203 11624 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:57.588891 15727 consensus_queue.cc:1059] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:21:57.638581 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:57.666973 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:57.667950 11082 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:21:57.666210 10901 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:57.681071 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:57.681931 10930 raft_consensus.cc:2410] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:21:57.664126 10823 maintenance_manager.cc:419] P b5a9c6dd870a436699566823a8e6e1ca: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10481 bytes on disk
I20260709 12:21:57.688545 10901 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:57.668969 11008 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:57.689337 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:57.650638 15594 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.610879 11079 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
W20260709 12:21:57.671270 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 99569us
I20260709 12:21:57.675508 11011 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:21:57.677066 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 51840.2us
W20260709 12:21:57.677021 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 52917.4us
I20260709 12:21:57.668051 15586 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:57.684170 11650 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:57.668223 15755 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:57.691843 10974 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:57.704345 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:57.704854 11050 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:57.706432 15557 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:57.708968 10934 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 10: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:57.633780 15768 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 12:21:57.712257 10930 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:57.682086 15603 raft_consensus.cc:2804] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:57.670179 15708 consensus_queue.cc:1059] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:21:57.700520 15745 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:57.671125 15766 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:57.733731 10822 maintenance_manager.cc:643] P b5a9c6dd870a436699566823a8e6e1ca: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.025s	user 0.001s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":422,"lbm_reads_lt_1ms":4}
I20260709 12:21:57.703416 15738 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:57.737521 11050 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:57.755218 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:57.755722 11050 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:57.738145 10936 raft_consensus.cc:1240] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:57.747037 10932 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
W20260709 12:21:57.666265 10830 rpcz_store.cc:269] 0709 12:21:35.364242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.364400 (+   158us) service_pool.cc:224] Handling call
0709 12:21:57.631429 (+22267029us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:55.886360 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:55.933487 (+ 47127us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:55.933568 (+    81us) write_op.cc:435] Acquired schema lock
0709 12:21:55.933602 (+    34us) tablet.cc:662] Decoding operations
0709 12:21:55.934368 (+   766us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:55.934450 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:55.934481 (+    31us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:21:55.935168 (+   687us) tablet.cc:701] Row locks acquired
0709 12:21:55.935220 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:21:55.935460 (+   240us) write_op.cc:270] Start()
0709 12:21:55.935606 (+   146us) write_op.cc:276] Timestamp: P: 1783599715935357 usec, L: 0
0709 12:21:55.935634 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:21:56.017041 (+ 81407us) log.cc:844] Serialized 2421 byte log entry
0709 12:21:56.798530 (+781489us) spinlock_profiling.cc:243] Waited 44.8 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:56.987639 (+189109us) op_driver.cc:464] REPLICATION: finished
0709 12:21:57.220948 (+233309us) write_op.cc:301] APPLY: starting
0709 12:21:57.242798 (+ 21850us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:57.309552 (+ 66754us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:57.309596 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:57.335310 (+ 25714us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:57.335648 (+   338us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 12:21:57.335695 (+    47us) write_op.cc:312] APPLY: finished
0709 12:21:57.336015 (+   320us) log.cc:844] Serialized 57 byte log entry
0709 12:21:57.380579 (+ 44564us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:57.380720 (+   141us) write_op.cc:454] Released schema lock
0709 12:21:57.380807 (+    87us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:57.381444 (+   637us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:57.381476 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6289200,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":191737,"apply.run_cpu_time_us":13978,"apply.run_wall_time_us":183927,"cfile_cache_hit":18,"cfile_cache_hit_bytes":18783,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6214,"cfile_init":1,"lbm_read_time_us":13931,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":6,"num_ops":5,"prepare.queue_time_us":285453,"prepare.run_cpu_time_us":7651,"prepare.run_wall_time_us":246001,"raft.queue_time_us":90947,"raft.run_cpu_time_us":12477,"raft.run_wall_time_us":52308,"replication_time_us":1051819,"spinlock_wait_cycles":103146112,"thread_start_us":332478,"threads_started":4,"wal-append.queue_time_us":59636}]]}
I20260709 12:21:57.704546 15755 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.678444 15721 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.750097 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:57.681200 15776 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:21:57.759569 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.731981 15689 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:57.731669 15557 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:21:57.716147 15323 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:57.721208 15695 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:21:57.721529 15603 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.818033 15603 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:57.818135 11005 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
W20260709 12:21:57.766111 15775 log.cc:927] Time spent T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:21:57.807299 10933 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:21:57.811178 15323 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.812243 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:57.812388 15721 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:57.816193 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:57.805953 11082 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:57.805045 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:57.821491 10936 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:57.760572 15644 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:57.824412 10929 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
W20260709 12:21:57.825522 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 69899.5us
I20260709 12:21:57.826874 10933 pending_rounds.cc:85] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 10
I20260709 12:21:57.856276 10933 pending_rounds.cc:107] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:21:57.856575 10933 raft_consensus.cc:2889] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:57.832603 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:57.839496 10901 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:57.857649 11005 raft_consensus.cc:2393] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:57.766340 15755 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:57.849802 11654 raft_consensus.cc:2393] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 8: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:21:57.680181 15686 consensus_queue.cc:260] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.851424 11079 raft_consensus.cc:2376] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17. Re-sending same reply.
I20260709 12:21:57.765012 15745 raft_consensus.cc:697] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:57.783555 15610 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:57.782821 15738 raft_consensus.cc:697] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:57.825960 15512 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:57.855751 11050 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:57.833389 15689 raft_consensus.cc:697] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:57.713059 15222 consensus_queue.cc:237] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:57.867096 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 111035us
I20260709 12:21:57.827453 15609 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.859177 15736 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.877272 10928 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:57.760380 15740 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:21:57.891181 11010 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:21:57.892798 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:57.893904 11050 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:57.894490 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:57.895206 11050 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:57.892014 10931 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:21:57.896029 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:57.896340 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:57.896934 11076 raft_consensus.cc:2410] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:21:57.784439 15666 consensus_queue.cc:237] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.897764 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:57.898557 11079 raft_consensus.cc:2376] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11. Re-sending same reply.
I20260709 12:21:57.780797 15766 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.899281 10977 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:57.899698 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.906093 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:57.899415 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:57.902081 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:57.929246 11076 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:21:57.929667 11082 raft_consensus.cc:2410] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:21:57.929906 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:57.902407 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:57.930688 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:57.930968 11080 raft_consensus.cc:2376] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10. Re-sending same reply.
I20260709 12:21:57.931463 11076 raft_consensus.cc:2368] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14.
I20260709 12:21:57.899231 11050 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:57.879686 15721 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:57.927896 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 70004.5us
I20260709 12:21:57.902783 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:57.933535 11078 raft_consensus.cc:2410] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:21:57.936093 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:57.932328 10977 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:57.936736 11080 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:57.938736 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:57.939342 11078 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:57.900381 15566 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14.
I20260709 12:21:57.941408 11625 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:57.947752 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:57.944646 11080 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:21:57.949059 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:57.949589 11080 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:57.936369 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:57.955972 11078 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:21:57.958467 10901 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:57.927747 15644 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:57.931989 15610 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:57.959407 10901 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:57.891266 15609 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:57.893170 15736 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:57.964299 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:57.927610 15776 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:57.963631 11003 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 12:21:57.927201 15515 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:57.969395 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:57.933599 15740 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.947340 15557 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:57.970189 11078 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:21:57.971298 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:57.975564 11077 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 13: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:57.906579 15727 consensus_queue.cc:1059] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:21:57.977626 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:57.979779 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:57.957782 15695 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:58.001909 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:21:57.950476 10819 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9b6c427f0a234dbab806dced4d3ba0fb with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0b171b6aaedc4f809f2753dcfadb14ce is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:57.950716 15759 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:58.000468 10936 raft_consensus.cc:2393] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:57.997965 10934 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:21:57.995661 11080 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:21:57.973809 15712 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:58.018539 11079 raft_consensus.cc:2393] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 8: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:58.021247 11078 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 12:21:58.021472 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 138700us
I20260709 12:21:57.978366 15594 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:58.040851 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 77807.6us
W20260709 12:21:58.024067 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 85836.3us
I20260709 12:21:58.039901 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:58.042737 10977 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:58.044281 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:58.044988 11078 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:21:57.906456 15692 consensus_queue.cc:1059] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:21:57.974131 15597 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:21:58.052269 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:58.053475 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:58.023231 15786 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:58.072029 10977 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:57.976207 15738 consensus_queue.cc:237] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.038735 15527 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:21:58.100958 11008 raft_consensus.cc:1275] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:21:58.109647 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 108620us
I20260709 12:21:58.075532 15586 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:58.000280 15740 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.062358 15712 raft_consensus.cc:697] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:58.064260 15323 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:58.121693 10977 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:58.122315 15787 consensus_queue.cc:1059] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:58.123462 15776 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:58.087885 15768 raft_consensus.cc:3055] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:58.127995 10977 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:58.024942 15689 consensus_queue.cc:237] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.090356 15759 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:58.126338 15733 consensus_meta.cc:287] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.901s	user 0.010s	sys 0.002s
I20260709 12:21:57.964715 15745 consensus_queue.cc:237] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.109809 15761 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:58.109627 15515 raft_consensus.cc:697] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:21:58.214084 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 234520us
W20260709 12:21:58.333609 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 205678us
I20260709 12:21:58.133319 15586 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.137948 15692 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:58.118865 15594 consensus_queue.cc:1059] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.217s
I20260709 12:21:58.328543 15467 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.135551 15768 raft_consensus.cc:740] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:58.328611 15644 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:58.339056 15721 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.348877 15759 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:58.337615 15733 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.375279 11085 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:21:58.352823 15766 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:58.328235 15776 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:58.365471 15779 log.cc:927] Time spent T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.428s	user 0.001s	sys 0.001s
I20260709 12:21:58.351882 15692 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:58.373476 15770 raft_consensus.cc:3055] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:58.407225 15712 consensus_queue.cc:237] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.352064 15586 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:58.370654 15786 raft_consensus.cc:697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:58.425499 10927 raft_consensus.cc:2393] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 14: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:58.370920 15727 consensus_queue.cc:1059] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:21:58.364241 15761 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 12:21:58.412209 15783 log.cc:927] Time spent T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.388s	user 0.000s	sys 0.001s
I20260709 12:21:58.364692 15467 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.368268 15644 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:58.425292 15784 log.cc:927] Time spent T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.402s	user 0.000s	sys 0.001s
W20260709 12:21:58.464787 15603 consensus_meta.cc:287] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.646s	user 0.006s	sys 0.004s
I20260709 12:21:58.465641 15586 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:58.412618 15609 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:58.471468 11650 consensus_meta.cc:287] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.751s	user 0.006s	sys 0.004s
I20260709 12:21:58.451085 15789 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.476804 15799 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:58.451967 15785 log.cc:927] Time spent T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.429s	user 0.001s	sys 0.000s
I20260709 12:21:58.372996 15721 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.475741 15752 ts_tablet_manager.cc:1929] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.9
I20260709 12:21:58.480573 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3075) took 1132 ms. Trace:
I20260709 12:21:58.497725 11002 rpcz_store.cc:276] 0709 12:21:57.348253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.525418 (+177165us) service_pool.cc:224] Handling call
0709 12:21:57.525877 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:57.596174 (+ 70297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:57.596214 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:57.605491 (+  9277us) log.cc:844] Serialized 26 byte log entry
0709 12:21:58.142507 (+537016us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:58.142553 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:58.142642 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:58.480330 (+337688us) raft_consensus.cc:1685] finished
0709 12:21:58.480353 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:58.480504 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82869,"raft.queue_time_us":80300,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":10286,"thread_start_us":475736,"threads_started":1,"wal-append.queue_time_us":773445}
I20260709 12:21:58.424962 15692 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:58.503890 15740 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:58.504500 15467 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:58.505050 15467 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:58.505734 15557 consensus_meta.cc:287] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.504s	user 0.005s	sys 0.003s
I20260709 12:21:58.506275 15557 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:58.508394 15799 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:58.510933 15799 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:58.511245 15733 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:58.511626 15791 log.cc:927] Time spent T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:21:58.425168 15770 raft_consensus.cc:740] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:21:58.494379 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 383807us
I20260709 12:21:58.512635 15776 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:58.486907 15603 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:58.514550 15644 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:21:58.475508 15514 consensus_meta.cc:287] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.795s	user 0.007s	sys 0.000s
I20260709 12:21:58.516451 11082 raft_consensus.cc:2410] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 12:21:58.502750 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 165312us
W20260709 12:21:58.524017 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 519789us
I20260709 12:21:58.531492 11078 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: [7.5-13.7]
I20260709 12:21:58.492059 11650 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:21:58.505138 15740 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:21:58.525410 15732 consensus_meta.cc:287] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 1.093s	user 0.012s	sys 0.000s
I20260709 12:21:58.519438 15222 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.540015 10899 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:58.540396 11078 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:21:58.540522 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:58.527738 15787 consensus_queue.cc:1243] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:58.547624 11654 raft_consensus.cc:1240] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:58.505802 15467 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:58.540556 10902 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.000s	sys 0.015s
W20260709 12:21:58.550933 10902 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.000s	sys 0.015s
I20260709 12:21:58.542860 10974 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:58.526455 15752 log.cc:1199] T 6aa58b8bde194f658aced897744b4d35 P 1abf4b385a2b493ab83f593a1f8c9cd1: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-2-root/wals/6aa58b8bde194f658aced897744b4d35
I20260709 12:21:58.548879 11084 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:21:58.575572 11084 pending_rounds.cc:85] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 5
I20260709 12:21:58.540946 10977 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:58.495967 15789 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:58.552577 10974 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:58.541152 11650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59398 (request call id 424) took 1011 ms. Trace:
I20260709 12:21:58.533144 15514 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:58.592826 15798 log.cc:927] Time spent T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:21:58.597711 11084 pending_rounds.cc:107] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 9.6
W20260709 12:21:58.601661 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 49172.9us
I20260709 12:21:58.613287 11084 raft_consensus.cc:2889] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:58.601641 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 60766.8us
I20260709 12:21:58.484059 15515 consensus_queue.cc:237] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.548132 15786 consensus_queue.cc:237] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.539721 15766 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:21:58.538878 15609 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:21:58.484686 15768 consensus_queue.cc:260] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.551088 15776 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.545100 15594 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:21:58.614728 10899 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:58.613667 10974 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:58.614380 10977 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:21:58.609215 15755 consensus_meta.cc:287] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.737s	user 0.014s	sys 0.002s
I20260709 12:21:58.602559 15738 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:58.608247 15787 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:58.612314 15759 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:58.545804 15732 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.641234 11083 raft_consensus.cc:1240] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:58.628474 15610 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:58.548651 15222 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.608708 15777 raft_consensus.cc:3055] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:58.641410 10974 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:58.680828 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:58.681488 11655 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:58.658358 10899 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:58.543123 15740 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.620393 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:58.636035 15412 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.670176 15467 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:58.670043 15790 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:58.670825 15514 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:58.640913 15766 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.671206 15752 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60028 (request call id 68) took 1727 ms. Trace:
W20260709 12:21:58.672549 15801 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:21:58.673501 15789 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:58.674693 15721 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:58.641290 15776 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.676715 11010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3063) took 1334 ms. Trace:
I20260709 12:21:58.657196 15686 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:58.661271 15688 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:58.667387 15768 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:58.764245 15708 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:58.765219 15811 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:58.575177 15770 consensus_queue.cc:260] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.765743 15804 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.766266 15804 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.661723 15755 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:58.770900 11007 raft_consensus.cc:2368] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 8. Current term is 9.
I20260709 12:21:58.771389 15755 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:58.771710 15222 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:58.771952 15688 raft_consensus.cc:697] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:58.751948 15467 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.772542 15804 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:58.773124 15740 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:58.772938 15688 consensus_queue.cc:237] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.752123 10932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 2725) took 1565 ms. Trace:
W20260709 12:21:58.760340 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 102079us
I20260709 12:21:58.774319 10899 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:58.775084 15609 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:58.775450 10899 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:58.756927 11010 rpcz_store.cc:276] 0709 12:21:57.342776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.342906 (+   130us) service_pool.cc:224] Handling call
0709 12:21:57.363183 (+ 20277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:57.892384 (+529201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:58.676470 (+784086us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b54003796d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:58.676660 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1213548288}
I20260709 12:21:58.775622 15609 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:58.749866 15752 rpcz_store.cc:276] 0709 12:21:56.965049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.972489 (+  7440us) service_pool.cc:224] Handling call
0709 12:21:57.132162 (+159673us) ts_tablet_manager.cc:1151] Deleting tablet 6aa58b8bde194f658aced897744b4d35
0709 12:21:57.132272 (+   110us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:21:58.135490 (+1003218us) tablet_metadata.cc:665] Metadata flushed
0709 12:21:58.475424 (+339934us) tablet_metadata.cc:665] Metadata flushed
0709 12:21:58.671114 (+195690us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":143493,"tablet-delete.queue_time_us":115957,"thread_start_us":24320,"threads_started":1}
I20260709 12:21:58.608067 11650 rpcz_store.cc:276] 0709 12:21:57.529332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.537878 (+  8546us) service_pool.cc:224] Handling call
0709 12:21:58.538155 (+1000277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:58.692477 15800 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:58.659533 15803 consensus_queue.cc:1048] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 12:21:58.777016 10932 rpcz_store.cc:276] 0709 12:21:57.186393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.221341 (+ 34948us) service_pool.cc:224] Handling call
0709 12:21:58.723320 (+1501979us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b540017a7d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:58.752035 (+ 28715us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":921770240}
I20260709 12:21:58.800660 10899 leader_election.cc:400] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14.
I20260709 12:21:58.693485 10935 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:21:58.679811 15777 raft_consensus.cc:740] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:58.680365 15689 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
W20260709 12:21:58.773257 15809 log.cc:927] Time spent T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.127s	user 0.005s	sys 0.000s
I20260709 12:21:58.758131 15738 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.752669 11651 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:21:58.794448 15790 consensus_queue.cc:1059] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:21:58.804497 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:58.805011 15323 raft_consensus.cc:3055] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:21:58.806051 15773 log.cc:927] Time spent T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.983s	user 0.002s	sys 0.023s
I20260709 12:21:58.807545 15764 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:58.755851 15766 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.780712 15804 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:58.808588 15692 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.810187 15609 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:58.812538 15808 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:58.813788 15732 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:58.775554 15776 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:58.773078 15603 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:58.816010 10899 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:58.816800 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2971) took 1349 ms. Trace:
I20260709 12:21:58.777980 15610 raft_consensus.cc:697] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:58.823107 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:58.724874 15412 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:58.826462 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:58.907773 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 251576us
I20260709 12:21:58.832790 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:58.908876 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.842509 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:58.779798 15811 raft_consensus.cc:697] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:58.845417 10932 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 12:21:58.858755 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:58.867120 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:58.866024 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:21:58.860749 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 219394us
I20260709 12:21:58.772571 15467 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.880702 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:58.909693 10934 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
W20260709 12:21:58.862267 10927 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 2727) took 1675 ms (client timeout 1618 ms). Trace:
I20260709 12:21:58.863983 11658 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:58.889150 10818 catalog_manager.cc:5028] TS 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): tablet 6aa58b8bde194f658aced897744b4d35 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:21:58.890367 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:58.874605 15735 raft_consensus.cc:3055] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:58.890064 15764 raft_consensus.cc:697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:58.855336 15514 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:58.890393 15790 consensus_queue.cc:1243] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:21:58.868094 15323 raft_consensus.cc:740] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:58.896468 11006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3072) took 1549 ms. Trace:
I20260709 12:21:58.896672 15823 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:58.865881 15738 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.799625 15800 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:58.896349 15780 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.022s	sys 0.068s
I20260709 12:21:58.864447 15734 raft_consensus.cc:3055] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:58.929760 15734 raft_consensus.cc:740] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:58.930671 15734 consensus_queue.cc:260] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:58.901337 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 85409.2us
I20260709 12:21:58.931288 15800 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:58.931970 15738 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:58.929682 15780 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.023s	sys 0.068s
I20260709 12:21:58.933115 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:58.933880 15467 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:58.901117 11083 rpcz_store.cc:276] 0709 12:21:57.467415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.467539 (+   124us) service_pool.cc:224] Handling call
0709 12:21:57.496210 (+ 28671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:58.668067 (+1171857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:58.816552 (+148485us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54001a45d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:58.816738 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2632877824}
I20260709 12:21:58.889822 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:58.909794 10931 raft_consensus.cc:2393] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 14: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:21:58.909014 11076 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 11.
I20260709 12:21:58.910285 10928 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:58.910933 10930 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:58.909449 11078 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 12.
I20260709 12:21:58.911969 10932 pending_rounds.cc:85] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 9
I20260709 12:21:58.937773 10932 pending_rounds.cc:107] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 12:21:58.938081 10932 raft_consensus.cc:2889] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:58.936769 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:58.913723 15735 raft_consensus.cc:740] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:21:58.911765 10927 rpcz_store.cc:269] 0709 12:21:57.186837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.195712 (+  8875us) service_pool.cc:224] Handling call
0709 12:21:58.862060 (+1666348us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540043b2d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:58.862193 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2619395968}
I20260709 12:21:58.892375 15808 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:58.975510 15808 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:58.977619 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60046 (request call id 2910) took 1041 ms. Trace:
I20260709 12:21:58.978029 11082 rpcz_store.cc:276] 0709 12:21:57.936227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.948738 (+ 12511us) service_pool.cc:224] Handling call
0709 12:21:58.977421 (+1028683us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b5400216954. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:58.977555 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1236681088}
I20260709 12:21:58.981688 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:58.983081 15692 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:58.983876 11650 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:58.891849  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:58.914383 10933 raft_consensus.cc:2393] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 13: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:58.987612 15833 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:58.991600 15833 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:21:58.992270 15833 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.987557 15708 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
W20260709 12:21:58.975651 15765 log.cc:927] Time spent T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 1.210s	user 0.003s	sys 0.009s
I20260709 12:21:58.995038 15833 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:58.995674 10819 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9b6c427f0a234dbab806dced4d3ba0fb with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0b171b6aaedc4f809f2753dcfadb14ce is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:58.997041 10899 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:21:58.998011 15803 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:21:58.999459 15788 log.cc:927] Time spent T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.864s	user 0.002s	sys 0.001s
I20260709 12:21:59.001191 11005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2430) took 1282 ms. Trace:
I20260709 12:21:59.002403 11082 raft_consensus.cc:1275] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:59.001552 11005 rpcz_store.cc:276] 0709 12:21:57.718468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.903540 (+185072us) service_pool.cc:224] Handling call
0709 12:21:57.903925 (+   385us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:57.904283 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:57.904313 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:57.904885 (+   572us) log.cc:844] Serialized 52 byte log entry
0709 12:21:57.977488 (+ 72603us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:58.019371 (+ 41883us) log.cc:844] Serialized 14 byte log entry
0709 12:21:58.019589 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:58.019659 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:58.593892 (+574233us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b1800451420. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:21:58.998770 (+404878us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:59.000938 (+  2168us) raft_consensus.cc:1685] finished
0709 12:21:59.000965 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:59.001128 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14965,"prepare.queue_time_us":41733,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":2401,"raft.queue_time_us":1058,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":7018,"spinlock_wait_cycles":14975104,"thread_start_us":26450,"threads_started":1,"wal-append.queue_time_us":141325}
W20260709 12:21:59.004210 11007 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2431) took 1285 ms (client timeout 1614 ms). Trace:
I20260709 12:21:59.005004 11082 raft_consensus.cc:1275] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:21:59.004632 11007 rpcz_store.cc:269] 0709 12:21:57.718720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.754937 (+ 36217us) service_pool.cc:224] Handling call
0709 12:21:59.004034 (+1249097us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400150754. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:21:59.004155 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2333966208}
I20260709 12:21:59.010030 15808 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:59.014039 15736 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:59.015940 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:59.017175 11653 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 8.
I20260709 12:21:59.018282 10900 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:59.019120 15736 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:59.019495 15736 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.019881 15736 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:59.021628 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:59.025249 11654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59384 (request call id 571) took 1124 ms. Trace:
I20260709 12:21:59.025781 15515 raft_consensus.cc:3055] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:21:59.026162 15515 raft_consensus.cc:740] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:59.032018 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:59.032199 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:59.032547 15808 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:59.032737 11005 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:59.033733 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:59.034325 11005 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:21:59.035156 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:59.022293 11007 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 7.
I20260709 12:21:59.025667 11654 rpcz_store.cc:276] 0709 12:21:57.901340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.901506 (+   166us) service_pool.cc:224] Handling call
0709 12:21:57.931386 (+ 29880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:58.551099 (+619713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:59.024958 (+473859us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54004cf254. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:59.025185 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1398261120}
I20260709 12:21:59.037932 15770 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:59.045527 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.043498 11051 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:59.046460 15808 consensus_queue.cc:1059] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:59.047230 15808 consensus_queue.cc:1243] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 0b171b6aaedc4f809f2753dcfadb14ce log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:21:59.051599 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:59.051394 15797 raft_consensus.cc:3055] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:59.053783 15797 raft_consensus.cc:740] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:59.054657 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2313) took 1756 ms. Trace:
I20260709 12:21:59.054618 15797 consensus_queue.cc:260] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:59.055083 10935 rpcz_store.cc:276] 0709 12:21:57.297900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.317697 (+ 19797us) service_pool.cc:224] Handling call
0709 12:21:57.319424 (+  1727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:58.804159 (+1484735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:59.054371 (+250212us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540002c6d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:21:59.054587 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3150702336}
I20260709 12:21:59.055680 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:59.056612 15797 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:59.057926 11004 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:21:59.059204 11004 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:21:59.066864 10901 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:58.910550 10974 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:21:58.916139 10818 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 71603.6us
I20260709 12:21:58.912468 10936 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:21:58.856276 15787 raft_consensus.cc:697] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:58.918910 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:58.909715 15712 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:59.074694 15787 consensus_queue.cc:237] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.922369 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:59.075970 10934 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:21:59.078696 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 168211us
I20260709 12:21:58.918987 11006 rpcz_store.cc:276] 0709 12:21:57.346641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.394218 (+ 47577us) service_pool.cc:224] Handling call
0709 12:21:57.394537 (+   319us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:57.437460 (+ 42923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:57.437497 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:57.449357 (+ 11860us) log.cc:844] Serialized 52 byte log entry
0709 12:21:57.645701 (+196344us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:57.645754 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:57.645822 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:58.805335 (+1159513us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:21:58.890399 (+ 85064us) raft_consensus.cc:1685] finished
0709 12:21:58.890421 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:58.896389 (+  5968us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21074,"raft.queue_time_us":40813,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":9307,"spinlock_wait_cycles":13251840,"thread_start_us":137867,"threads_started":1,"wal-append.queue_time_us":248413}
I20260709 12:21:58.927364 11658 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:58.928264 15610 consensus_queue.cc:237] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.858997 15777 consensus_queue.cc:260] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.883950 15759 raft_consensus.cc:697] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:58.946692 11622 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:58.946811 11010 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 12.
I20260709 12:21:58.889417 15695 raft_consensus.cc:2955] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 LEADER]: Committing config change with OpId 5.6: config changed from index 4 to 6, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:58.955663 15691 raft_consensus.cc:3055] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:58.958003 15826 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:58.934971 15823 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:59.082849 15826 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.960333 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:58.960628 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:58.961570 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:58.962886 15766 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:58.964964 15412 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:58.920047 15514 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.966259 15764 consensus_queue.cc:237] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:58.945729 15811 consensus_queue.cc:237] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.969591 15323 consensus_queue.cc:260] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:58.970304 15804 consensus_queue.cc:1059] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:58.971277 15812 consensus_queue.cc:1059] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:58.972028 15745 consensus_queue.cc:1059] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:59.086328 15777 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:59.087837 10975 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:59.088883 15810 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:59.073314 15761 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:59.080343 10829 catalog_manager.cc:5697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:59.085139 15826 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:59.089632 15810 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.089670 15512 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:21:59.096891 15761 raft_consensus.cc:697] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:59.092710 15594 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:21:59.089773 15768 consensus_queue.cc:1175] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" responder_term: 14 status { last_received { term: 5 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: [7.5-13.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:21:59.098655 15594 raft_consensus.cc:697] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:59.091133 11002 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 7.
I20260709 12:21:59.089555 15323 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:59.099581 15594 consensus_queue.cc:237] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:21:59.100865 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 54745us
I20260709 12:21:59.101619 11049 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:59.102473 15776 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:59.088162 15759 consensus_queue.cc:237] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:21:59.103315 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 59812.6us
I20260709 12:21:59.103426 15467 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:59.104044 15467 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.102841 15776 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:59.105048 15776 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:59.105350 15823 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:59.106894 11004 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:59.107300 15514 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:59.104414 15467 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:59.088615 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 150046us
I20260709 12:21:59.113332 11622 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:21:59.114243 15793 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:59.115063 11051 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:59.115464 15793 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.115958 15793 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:59.115990 11051 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:21:59.116624 15514 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:59.116958 15817 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:59.117120 15514 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.117466 15817 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.117630 15514 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:59.118182 15817 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:59.082582 15691 raft_consensus.cc:740] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:21:59.124871 15691 consensus_queue.cc:260] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:59.126034 15691 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:59.096330 15810 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:59.131891 15820 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:21:59.132565 15820 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:59.097867 15761 consensus_queue.cc:237] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:59.132989 15776 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:59.101874 10829 catalog_manager.cc:5697] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:59.155349 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.154938 15793 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:59.158072 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:59.157994 15820 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:59.158628 11008 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:21:59.165810 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:59.161670 15817 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:59.152325 10829 catalog_manager.cc:5697] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:59.166442 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:21:59.176510 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 60591.6us
I20260709 12:21:59.176115 10934 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:21:59.162647 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:59.239773 11654 raft_consensus.cc:2368] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13.
W20260709 12:21:59.170815 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 104031us
I20260709 12:21:59.242009 10901 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:21:59.171231 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 90192.3us
I20260709 12:21:59.252960 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:59.253749 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:59.253851 11081 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:21:59.255908 11049 leader_election.cc:400] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13.
I20260709 12:21:59.277005 11078 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:21:59.280071 11049 leader_election.cc:403] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:21:59.281224 10977 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:59.283300 11624 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:59.285281 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:21:59.287742 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:59.288043 10977 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:59.288400 11076 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:21:59.289237 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:59.290783 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:59.292255 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:59.292867 11085 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:21:59.296345 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:59.297088 11080 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:21:59.298075 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:59.300335 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:59.300376 10977 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:21:59.300958 11076 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:21:59.302553 11076 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:21:59.304309 11076 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:59.256731 11002 raft_consensus.cc:2955] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:21:59.308368 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:59.309073 11079 raft_consensus.cc:2393] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 14: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:59.172569 15826 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.309319 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:59.310380 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:59.319924 11081 raft_consensus.cc:2393] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 13: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:59.315102 11085 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:21:59.172398 15794 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:59.166555 15787 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:59.236626 15820 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.328003 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:59.319587 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 77662.6us
I20260709 12:21:59.162038 15776 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:59.179551 15712 raft_consensus.cc:697] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:21:59.322314 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:21:59.342209 11084 raft_consensus.cc:2393] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 12: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:59.319205 11083 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:21:59.331054 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:59.344105 11085 raft_consensus.cc:2393] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 14: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:59.287286 15692 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:59.332899 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:59.332937 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:59.335544 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:59.345079 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:59.332234 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:59.309190 15686 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.321137 15794 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.299697 15603 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:59.362946 10974 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:59.165110 15467 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:59.369931 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:59.287093 15594 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:21:59.290143 15323 consensus_queue.cc:1059] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:21:59.366135 11003 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:21:59.366118 11010 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:59.310700 15689 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:59.257726 15740 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 12:21:59.278463 15721 consensus_queue.cc:1059] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 12:21:59.349788 10829 catalog_manager.cc:5697] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 8 to 9, leader changed from 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 9 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:59.348244 15512 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.376959 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:59.163807 15810 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:59.401084 10974 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:21:59.375155 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:59.402992 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:59.403227 11003 raft_consensus.cc:2393] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 13: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:21:59.348219 15733 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.399315 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:21:59.315996 15514 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:59.377720 11078 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:21:59.406697 11078 pending_rounds.cc:85] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 7
I20260709 12:21:59.406981 11078 pending_rounds.cc:107] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:21:59.403589 11004 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:59.376674 15794 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:59.407222 11078 raft_consensus.cc:2889] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:59.321420 15787 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:59.424458 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:59.329283 15826 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:59.375777 15603 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:59.439828 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 46323.3us
I20260709 12:21:59.379725 15689 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:59.443531 15805 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:59.378160 15686 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:59.451962 15515 consensus_queue.cc:260] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:59.453790 15712 consensus_queue.cc:237] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:59.454299 15467 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:59.455770 15817 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:59.444201 15835 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:59.455526 15736 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:59.456563 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:21:59.457804 11010 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 13.
I20260709 12:21:59.396798 15745 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.461834 15688 raft_consensus.cc:3055] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:59.462342 15810 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:59.462692 15734 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:59.463711 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:21:59.464673 15801 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.003s
I20260709 12:21:59.347226 15820 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:59.466406 10934 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07467552f78d410bb9e5774f3340f134"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:57884
W20260709 12:21:59.466446 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 65441.8us
I20260709 12:21:59.467739 15787 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:59.469020 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:21:59.424779 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:59.382131 15804 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.374774 15776 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:59.372474 15732 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:59.416546 10829 catalog_manager.cc:5697] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:21:59.490669 11082 raft_consensus.cc:2393] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 12: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:21:59.536212 15644 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:21:59.536800 10931 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:21:59.536291 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:59.539216 10930 raft_consensus.cc:1240] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:21:59.426843 15811 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:59.422844 15793 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:21:59.549153 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:59.549782 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 219874us
I20260709 12:21:59.489269 15603 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:59.554875 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:59.555289 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:59.563946 11011 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:21:59.555085 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:59.555401 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:21:59.551294 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 310215us
W20260709 12:21:59.565563 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 347002us
I20260709 12:21:59.532961 15689 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:59.541966 15721 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.553077 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:59.570312 11078 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:59.408118 15512 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:59.488385 15733 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:59.830504 11077 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:21:59.915817 11077 pending_rounds.cc:85] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 7
I20260709 12:21:59.916141 11077 pending_rounds.cc:107] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:21:59.916384 11077 raft_consensus.cc:2889] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:59.916283 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:21:59.917068 11654 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:59.918491 10935 raft_consensus.cc:2410] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:21:59.606402 10974 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:21:59.917632 10901 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:21:59.919601 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 313249us
I20260709 12:21:59.919907 10927 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:21:59.574509 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:59.922032 11079 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.006s	sys 0.061s
I20260709 12:21:59.922401 11080 raft_consensus.cc:2393] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 12: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:21:59.922381 11079 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.006s	sys 0.061s
W20260709 12:21:59.926285 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.931522 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:59.930205 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:21:59.561057 11650 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.007s	sys 0.003s
I20260709 12:21:59.932677 10931 raft_consensus.cc:2410] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:21:59.549342 15814 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.568743 15688 raft_consensus.cc:740] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:21:59.627976 15845 log.cc:927] Time spent T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:21:59.960515 11078 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 13.
I20260709 12:21:59.940425 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:59.923332 15811 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.934891 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:59.570264 15566 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:59.703352 15851 log.cc:927] Time spent T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.278s	user 0.006s	sys 0.000s
I20260709 12:21:59.799100 15761 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.686097 15817 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.616452 15835 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.347s
I20260709 12:21:59.627259 15860 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.957651 10974 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:22:00.011066 11002 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.006s	sys 0.017s
I20260709 12:21:59.957983 11080 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:21:59.956233 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:59.939321 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:21:59.915048 15732 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.940393 11077 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:00.012825 10935 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:21:59.570413 15745 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:59.964267 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:59.693992 15812 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:21:59.685108 15738 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:21:59.937696 11650 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.007s	sys 0.016s
I20260709 12:21:59.937551 15721 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:59.930281 15759 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:59.988106 10829 catalog_manager.cc:5697] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 6 to 8, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 8 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:59.986052 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:59.967307 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:21:59.925642 15789 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:00.015946 10934 raft_consensus.cc:606] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:00.084153 10934 raft_consensus.cc:614] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:00.080482 11003 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:21:59.930935 15777 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:59.996676 11004 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:21:59.997843 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:00.002467 10931 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:21:59.954264 11005 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:22:00.005401 11010 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:21:59.998049 15566 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:00.104584 15721 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:00.014122 15686 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:21:59.961360 15814 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:00.006582 11006 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:21:59.934530 15853 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.962819 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:21:59.938195 15222 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 12:21:59.932776 15644 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:00.030659 15692 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:59.987742 15733 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:21:59.934361 15803 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:21:59.795941 15735 consensus_queue.cc:260] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:21:59.615028 15805 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.396s
I20260709 12:21:59.938053 15823 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 12:21:59.988969 15811 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:00.012428 11002 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.006s	sys 0.017s
W20260709 12:22:00.015272 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 57734.8us
I20260709 12:22:00.127485 15777 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.994652 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:00.102965 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:00.082835 10829 catalog_manager.cc:5697] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: config changed from index 4 to 6, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65), VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66), VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67), VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 6 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:22:00.103754 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:00.105110 15789 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:21:59.966519 15514 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:21:59.932930 15804 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:00.009596 15820 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:00.017236 15732 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:00.086956 15759 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:00.199842 15759 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:00.081094 15826 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:00.122432 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:00.201488 10933 raft_consensus.cc:2393] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 9: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:00.202589 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:00.203219 10933 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
W20260709 12:22:00.111161 15695 consensus_meta.cc:287] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 1.021s	user 0.015s	sys 0.000s
I20260709 12:22:00.011493 15817 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:00.007629 15761 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:00.088307 15812 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:00.204582 10930 raft_consensus.cc:2376] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13. Re-sending same reply.
I20260709 12:22:00.205516 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:00.055395 15688 consensus_queue.cc:260] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:00.206215 10930 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:22:00.206876 15688 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:00.207470 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:00.128815 15731 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.208163 10930 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:00.204207 10931 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 10: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:00.208290 15731 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:00.209450 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:00.210073 10931 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:22:00.210462 15731 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:00.090873 15738 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:00.170295 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:00.211387 11006 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:00.060956 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:00.212037 10928 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 12.
I20260709 12:22:00.212750 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:00.206383 15812 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:00.213523 15761 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:00.206117 15817 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:00.212630 15738 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:00.220427 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:00.221312 10933 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:22:00.221864 11006 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:22:00.210919 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:00.224053 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:00.224648 10930 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:00.225929 15829 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:00.226228 15766 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.226609 15829 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:00.228911 15829 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:00.230053 11010 raft_consensus.cc:1275] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:22:00.230944 15835 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:00.226743 15766 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:00.231997 15323 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:00.233055 15835 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:00.233354 15766 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:00.236038 15644 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:00.238066 10901 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:00.231170 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:00.239217 11004 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:22:00.239846 15797 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:00.240159 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:00.240550 10936 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:22:00.240913 10936 pending_rounds.cc:85] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 8
I20260709 12:22:00.241143 10936 pending_rounds.cc:107] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:22:00.241353 15804 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:00.241375 10936 raft_consensus.cc:2889] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:00.241604 15759 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:00.243083 11009 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:22:00.244568 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:00.244840 15759 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:00.241472 15797 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:00.245210 11006 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:22:00.244982 10936 raft_consensus.cc:1240] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:00.245790 10933 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:22:00.246889 10936 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 12:22:00.245493 15797 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:00.236089 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:00.249344 15814 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:00.247067 10933 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:00.250293 10936 pending_rounds.cc:85] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 11
I20260709 12:22:00.250603 10936 pending_rounds.cc:107] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 12:22:00.250671 10927 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:22:00.250952 10936 raft_consensus.cc:2889] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:00.017151 15860 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:00.253274 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:00.254439 10935 raft_consensus.cc:2410] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:22:00.225994 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3101) took 1194 ms. Trace:
I20260709 12:22:00.255638 11007 rpcz_store.cc:276] 0709 12:21:59.038629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.039794 (+  1165us) service_pool.cc:224] Handling call
0709 12:21:59.040091 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:59.040319 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:21:59.614128 (+573809us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b18004490e0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bb0b084bc 00007f9bade5648b 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade70455 00007f9bb49583c7 00007f9bb0f6a9a7 00007f9bb0f7a0bf
0709 12:21:59.614292 (+   164us) log.cc:844] Serialized 14 byte log entry
0709 12:22:00.023362 (+409070us) log.cc:844] Serialized 14 byte log entry
0709 12:22:00.225485 (+202123us) spinlock_profiling.cc:243] Waited 7.26 ms on lock 0x7b18004490e0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9baddedc0a 00007f9bb752d219 00007f9bade75a40 00007f9bade704e4 00007f9bade70455 00007f9bb0f58060 00007f9bb0f6a716 00007f9bb0f7b287 00007f9bb0f7b208
0709 12:22:00.225661 (+   176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:00.225711 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:00.225761 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:00.225826 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:00.225942 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":194890,"prepare.queue_time_us":267080,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":5427,"raft.queue_time_us":209672,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":11396,"spinlock_wait_cycles":62252544,"thread_start_us":713505,"threads_started":2,"wal-append.queue_time_us":544795}
I20260709 12:22:00.282580 11654 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:22:00.114066 15853 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:00.238580 15515 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:00.328405 15512 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:00.274783 15777 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:00.392482 15863 log.cc:927] Time spent T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 12:22:00.390908 15745 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:00.406633 15868 log.cc:927] Time spent T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 12:22:00.422406 15794 consensus_meta.cc:287] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.931s	user 0.009s	sys 0.001s
I20260709 12:22:00.423552 15794 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:00.425849 15860 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:00.427021 15776 consensus_meta.cc:287] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.500s	user 0.005s	sys 0.001s
I20260709 12:22:00.427893 15789 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:00.428999 15853 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:00.433090 15734 consensus_meta.cc:287] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.828s	user 0.010s	sys 0.000s
I20260709 12:22:00.437206 15776 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13.
I20260709 12:22:00.440837 15777 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:00.441453 15732 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:00.443677 15732 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:00.444645 15811 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:00.445762 15797 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:00.446344 15811 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:00.449244 15794 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:00.439877 15603 consensus_meta.cc:287] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
I20260709 12:22:00.451146 15603 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:00.453352 15603 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:00.453930 15689 consensus_meta.cc:287] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.000s
I20260709 12:22:00.454418 15689 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:00.456919 15689 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:00.458278 15797 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:00.739771 11084 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 13.
I20260709 12:22:01.653563 15740 raft_consensus.cc:3055] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:01.654206 15740 raft_consensus.cc:740] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:01.655200 15740 consensus_queue.cc:260] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:01.656613 15740 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:01.811621 15594 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:01.812371 15594 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:01.927229 10929 raft_consensus.cc:2368] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14.
W20260709 12:22:01.955490 11084 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40200 (request call id 508) took 2547 ms (client timeout 1676 ms). Trace:
W20260709 12:22:01.956086 11084 rpcz_store.cc:269] 0709 12:21:59.407704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.407873 (+   169us) service_pool.cc:224] Handling call
0709 12:22:01.955194 (+2547321us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400219154. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:01.955363 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2700536192}
W20260709 12:22:01.958175 11084 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 3013) took 1730 ms (client timeout 1509 ms). Trace:
I20260709 12:22:01.966048 11008 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:01.972806 15879 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:02.220331 15879 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.222898 15879 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:02.008734 10936 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 12:22:02.223812 10936 pending_rounds.cc:85] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 8
I20260709 12:22:02.224210 10936 pending_rounds.cc:107] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 12:22:02.224529 10936 raft_consensus.cc:2889] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:02.225603 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2775) took 2676 ms. Trace:
I20260709 12:22:02.226064 10936 rpcz_store.cc:276] 0709 12:21:59.549135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.251756 (+702621us) service_pool.cc:224] Handling call
0709 12:22:02.008261 (+1756505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:02.225310 (+217049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.225539 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:02.232738 11084 rpcz_store.cc:269] 0709 12:22:00.227989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:01.957962 (+1729973us) service_pool.cc:211] Skipping call since client already timed out
0709 12:22:01.958085 (+   123us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:22:02.234001 11084 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 3017) took 2003 ms (client timeout 1685 ms). Trace:
W20260709 12:22:02.234452 11084 rpcz_store.cc:269] 0709 12:22:00.230683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.233788 (+2003105us) service_pool.cc:211] Skipping call since client already timed out
0709 12:22:02.233939 (+   151us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:22:02.235370 11084 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 3019) took 1998 ms (client timeout 1809 ms). Trace:
W20260709 12:22:02.236982 15862 log.cc:927] Time spent T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 1.982s	user 0.014s	sys 0.008s
I20260709 12:22:02.246908 11005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2445) took 2912 ms. Trace:
I20260709 12:22:02.247524 11005 rpcz_store.cc:276] 0709 12:21:59.334325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.408618 (+ 74293us) service_pool.cc:224] Handling call
0709 12:21:59.424161 (+ 15543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:00.092803 (+668642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.246595 (+2153792us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54004001d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:02.246826 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1218272000}
W20260709 12:22:02.197009 11624 connection.cc:256] RPC call timeout handler was delayed by -1.3021272270002555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
W20260709 12:22:01.973287 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:02.047937 11002 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.810s	user 0.014s	sys 0.009s
W20260709 12:22:02.364758 11083 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.284s	user 0.055s	sys 0.057s
I20260709 12:22:02.263414 15869 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:22:02.264247 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 2.01168e+06us
W20260709 12:22:02.366196 11002 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.128s	user 0.014s	sys 0.009s
I20260709 12:22:02.299700 15882 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.972870 15594 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:02.329107 11003 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.094s	user 0.008s	sys 0.025s
W20260709 12:22:02.515957 11003 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.281s	user 0.008s	sys 0.026s
I20260709 12:22:02.516769 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3126) took 2284 ms. Trace:
I20260709 12:22:02.344583 15884 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:02.223035 15740 consensus_meta.cc:287] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.559s	user 0.007s	sys 0.000s
I20260709 12:22:02.362123 15885 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:02.614878 15885 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:02.363185 15886 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:02.118536 15865 log.cc:927] Time spent T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 1.826s	user 0.008s	sys 0.026s
W20260709 12:22:02.235777 11084 rpcz_store.cc:269] 0709 12:22:00.236679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.235193 (+1998514us) service_pool.cc:211] Skipping call since client already timed out
0709 12:22:02.235313 (+   120us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:22:02.257268 15879 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:02.286052 10931 raft_consensus.cc:2393] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 12: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:02.622184 15885 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:02.622068 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:02.622803 15879 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:02.366719 11008 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
W20260709 12:22:02.368060 10927 consensus_meta.cc:287] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 2.117s	user 0.016s	sys 0.016s
I20260709 12:22:02.372093 15882 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.382458 15610 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:02.383586 11650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.259s	user 0.038s	sys 0.032s
W20260709 12:22:02.388000 11083 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.308s	user 0.056s	sys 0.057s
I20260709 12:22:02.627489 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3004) took 2699 ms. Trace:
I20260709 12:22:02.391932 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:02.393118 15889 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.397753 15888 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.412531 15887 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:22:02.413002 11625 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 2.305s	user 0.012s	sys 0.058s
W20260709 12:22:02.415756 10928 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53346 (request call id 440) took 2864 ms (client timeout 1938 ms). Trace:
W20260709 12:22:02.629206 10928 rpcz_store.cc:269] 0709 12:21:59.551316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.935637 (+384321us) service_pool.cc:224] Handling call
0709 12:22:02.415523 (+2479886us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b540024c054. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:02.415670 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":301609344}
I20260709 12:22:02.420369 10932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2764) took 2882 ms. Trace:
I20260709 12:22:02.629762 15887 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:02.422889 10929 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 2760) took 2888 ms (client timeout 2011 ms). Trace:
I20260709 12:22:02.438903 15222 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:02.446543 11082 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60046 (request call id 2916) took 3193 ms (client timeout 1990 ms). Trace:
I20260709 12:22:02.631461 15889 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:02.631724 11082 rpcz_store.cc:269] 0709 12:21:59.252863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.252991 (+   128us) service_pool.cc:224] Handling call
0709 12:22:02.446276 (+3193285us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b540011b7d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:02.446456 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435392768}
I20260709 12:22:02.458635 15566 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:02.460147 10930 consensus_meta.cc:287] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 2.235s	user 0.020s	sys 0.014s
I20260709 12:22:02.633298 10930 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:22:02.464072 11011 raft_consensus.cc:2368] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16.
I20260709 12:22:02.465955 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2932) took 2879 ms. Trace:
I20260709 12:22:02.468696 15881 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:02.634465 11085 rpcz_store.cc:276] 0709 12:21:59.586470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.930664 (+344194us) service_pool.cc:224] Handling call
0709 12:21:59.931054 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:00.129230 (+198176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:00.129263 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:00.129307 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:00.129342 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.465634 (+2336292us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b5400216e54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:02.465685 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.465852 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455262592}
W20260709 12:22:02.469246 11622 connection.cc:256] RPC call timeout handler was delayed by -1.4848542719996658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260709 12:22:02.469688 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:02.472429 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57884 (request call id 25) took 3006 ms. Trace:
I20260709 12:22:02.640369 10934 rpcz_store.cc:276] 0709 12:21:59.466111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.466275 (+   164us) service_pool.cc:224] Handling call
0709 12:22:02.472148 (+3005873us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b5400205dd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5a853 00007f9bb5f2860a 00007f9baf4ae7d4 00007f9baf4ae762 00007f9baf4ae691 00007f9baf4ae60c 00007f9baf4ad8c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:02.472297 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1020251008}
I20260709 12:22:02.489847 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:02.490135 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:02.496402 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:02.497572 15736 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:02.517129 11003 rpcz_store.cc:276] 0709 12:22:00.232805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.233962 (+  1157us) service_pool.cc:224] Handling call
0709 12:22:00.234264 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:00.234600 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:00.234630 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:00.235098 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 12:22:02.516408 (+2281310us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:02.516451 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.516520 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:02.516570 (+    50us) raft_consensus.cc:1685] finished
0709 12:22:02.516582 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.516715 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":363,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":2280912,"threads_started":1,"wal-append.queue_time_us":211768,"wal-append.run_cpu_time_us":1560,"wal-append.run_wall_time_us":1001570}
I20260709 12:22:02.520031 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3124) took 2291 ms. Trace:
I20260709 12:22:02.635705 15515 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:02.543349 11010 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.306s	user 0.021s	sys 0.005s
I20260709 12:22:02.355424 15827 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:02.660367 15515 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.562636 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53346 (request call id 436) took 3012 ms. Trace:
I20260709 12:22:02.660889 15827 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.661471 10936 rpcz_store.cc:276] 0709 12:21:59.550381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.227109 (+2676728us) service_pool.cc:224] Handling call
0709 12:22:02.227475 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:02.492970 (+265495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:02.493000 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:02.493499 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 12:22:02.514875 (+ 21376us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:02.514922 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.515000 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:02.562379 (+ 47379us) raft_consensus.cc:1685] finished
0709 12:22:02.562402 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.562556 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":204577,"raft.queue_time_us":285152,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"thread_start_us":81406,"threads_started":2,"wal-append.queue_time_us":16696}
I20260709 12:22:02.631368 15888 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.663098 15827 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:02.586753 15594 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:02.606909 11077 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 3011) took 2379 ms (client timeout 2137 ms). Trace:
I20260709 12:22:02.609107 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2925) took 3316 ms. Trace:
I20260709 12:22:02.539093 15884 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:02.612834 10933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2773) took 3064 ms. Trace:
I20260709 12:22:02.664677 15888 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:02.614027 11659 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:22:02.617447 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53346 (request call id 435) took 3067 ms. Trace:
I20260709 12:22:02.665108 11653 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:22:02.620453 15886 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:02.365849 11624 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.676s (SENT) [suppressed 29 similar messages]
I20260709 12:22:02.665678 15884 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:02.625049 10927 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 13.
I20260709 12:22:02.390771 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:02.627547 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 2997) took 3315 ms. Trace:
I20260709 12:22:02.632835 15887 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:02.675972 11077 rpcz_store.cc:269] 0709 12:22:00.227406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.606527 (+2379121us) service_pool.cc:211] Skipping call since client already timed out
0709 12:22:02.606781 (+   254us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:22:02.682273 11625 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.574s	user 0.012s	sys 0.059s
W20260709 12:22:02.682703 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 2.57861e+06us
I20260709 12:22:02.635092 15222 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:02.631172 10929 rpcz_store.cc:269] 0709 12:21:59.534425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.535094 (+   669us) service_pool.cc:224] Handling call
0709 12:22:02.422659 (+2887565us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b54002053d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:02.422811 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4619573120}
W20260709 12:22:02.631192 10931 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 2341) took 2436 ms (client timeout 2089 ms). Trace:
I20260709 12:22:02.666779 11079 rpcz_store.cc:276] 0709 12:21:59.312498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.319318 (+  6820us) service_pool.cc:224] Handling call
0709 12:21:59.358449 (+ 39131us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:59.925796 (+567347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:59.925824 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:00.252475 (+326651us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x7b2c000040c8. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9baf859a11 00007f9baf869372 00007f9bb0f9ba01 00007f9bb0f6043a 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2
0709 12:22:00.276429 (+ 23954us) log.cc:844] Serialized 26 byte log entry
0709 12:22:02.538946 (+2262517us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:02.538986 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.539056 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:02.625390 (+ 86334us) raft_consensus.cc:1685] finished
0709 12:22:02.625412 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.627492 (+  2080us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97766,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":11986688,"thread_start_us":657466,"threads_started":2,"wal-append.queue_time_us":157398}
I20260709 12:22:02.629989 10932 rpcz_store.cc:276] 0709 12:21:59.537508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.537638 (+   130us) service_pool.cc:224] Handling call
0709 12:21:59.538012 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:59.568673 (+ 30661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:59.568702 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:59.569170 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 12:22:00.015345 (+446175us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:00.015597 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:00.022808 (+  7211us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:02.420124 (+2397316us) raft_consensus.cc:1685] finished
0709 12:22:02.420148 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.420302 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108396,"raft.queue_time_us":31768,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":32213,"thread_start_us":328085,"threads_started":1,"wal-append.queue_time_us":580619,"wal-append.run_cpu_time_us":3288,"wal-append.run_wall_time_us":1223940}
W20260709 12:22:02.630416 11008 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 3119) took 2633 ms (client timeout 1636 ms). Trace:
W20260709 12:22:02.685158 11008 rpcz_store.cc:269] 0709 12:21:59.996904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.997623 (+   719us) service_pool.cc:224] Handling call
0709 12:22:02.630217 (+2632594us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54002d9e54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:02.630323 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4308719872}
W20260709 12:22:02.633824 10930 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 2338) took 2439 ms (client timeout 3191 ms). Trace:
W20260709 12:22:02.639593 11622 connection.cc:256] RPC call timeout handler was delayed by -1.4801112679997459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
I20260709 12:22:02.641512 11655 raft_consensus.cc:2393] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 9: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
W20260709 12:22:02.686044 10930 rpcz_store.cc:269] 0709 12:22:00.194204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.223550 (+ 29346us) service_pool.cc:224] Handling call
0709 12:22:02.633759 (+2410209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:02.641898 11657 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:22:02.627919 11078 rpcz_store.cc:276] 0709 12:21:59.927784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.962782 (+ 34998us) service_pool.cc:224] Handling call
0709 12:21:59.963057 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:59.963256 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:59.998755 (+ 35499us) log.cc:844] Serialized 14 byte log entry
0709 12:22:02.627171 (+2628416us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:02.627226 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:02.627269 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.627331 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.627436 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2419844,"prepare.queue_time_us":43656,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"thread_start_us":232921,"threads_started":2,"wal-append.queue_time_us":326561,"wal-append.run_cpu_time_us":1716,"wal-append.run_wall_time_us":1037446}
I20260709 12:22:02.644279 15881 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:02.634590 11650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.508s	user 0.039s	sys 0.033s
I20260709 12:22:02.650866 15882 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:02.656284 15879 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:02.634128 15610 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.657547 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:02.662377 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53346 (request call id 441) took 3110 ms. Trace:
I20260709 12:22:02.717002 10928 rpcz_store.cc:276] 0709 12:21:59.551663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.661536 (+3109873us) service_pool.cc:224] Handling call
0709 12:22:02.661876 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:02.662066 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:02.662091 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:02.662135 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:02.662170 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.662218 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.662321 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:02.622072 11084 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 3016) took 2393 ms (client timeout 2141 ms). Trace:
W20260709 12:22:02.718138 11084 rpcz_store.cc:269] 0709 12:22:00.228750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.621898 (+2393148us) service_pool.cc:211] Skipping call since client already timed out
0709 12:22:02.622009 (+   111us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:22:02.719542 11084 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:02.720232 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3010) took 2791 ms. Trace:
I20260709 12:22:02.720533 11084 rpcz_store.cc:276] 0709 12:21:59.929220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.718815 (+2789595us) service_pool.cc:224] Handling call
0709 12:22:02.719177 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:02.719975 (+   798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.720175 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:02.633811 15889 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:02.659022 11002 rpcz_store.cc:276] 0709 12:22:00.228762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.237274 (+  8512us) service_pool.cc:224] Handling call
0709 12:22:00.237556 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:00.237755 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:00.238003 (+   248us) log.cc:844] Serialized 14 byte log entry
0709 12:22:02.432270 (+2194267us) log.cc:844] Serialized 14 byte log entry
0709 12:22:02.519625 (+ 87355us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:02.519687 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:02.519740 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.519808 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.519969 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35656,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":74,"raft.queue_time_us":90262,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":213,"spinlock_wait_cycles":1920,"thread_start_us":2279838,"threads_started":4,"wal-append.queue_time_us":258674,"wal-append.run_cpu_time_us":1042,"wal-append.run_wall_time_us":1001144}
I20260709 12:22:02.664341 10933 rpcz_store.cc:276] 0709 12:21:59.548533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.251033 (+702500us) service_pool.cc:224] Handling call
0709 12:22:00.251363 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:02.425199 (+2173836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:02.425231 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:02.425715 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:22:02.568485 (+142770us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:02.568529 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.568614 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:02.612498 (+ 43884us) raft_consensus.cc:1685] finished
0709 12:22:02.612523 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.612757 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2168860,"raft.queue_time_us":2178227,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":142145,"threads_started":1,"wal-append.queue_time_us":184356}
I20260709 12:22:02.663926 11076 rpcz_store.cc:276] 0709 12:21:59.292548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.305457 (+ 12909us) service_pool.cc:224] Handling call
0709 12:21:59.305748 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:59.305946 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:59.546469 (+240523us) log.cc:844] Serialized 14 byte log entry
0709 12:22:02.608724 (+3062255us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:02.608795 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:02.608840 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.608909 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.609046 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2649164,"prepare.queue_time_us":69369,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"thread_start_us":617131,"threads_started":3,"wal-append.queue_time_us":580127,"wal-append.run_cpu_time_us":1285,"wal-append.run_wall_time_us":1080642}
I20260709 12:22:02.680315 11652 raft_consensus.cc:2368] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13.
I20260709 12:22:02.680967 11085 raft_consensus.cc:1275] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:22:02.725682 10929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2340) took 2531 ms. Trace:
I20260709 12:22:02.726176 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3006) took 2797 ms. Trace:
I20260709 12:22:02.665364 10935 rpcz_store.cc:276] 0709 12:21:59.550113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.255054 (+704941us) service_pool.cc:224] Handling call
0709 12:22:02.191214 (+1936160us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:22:02.428661 (+237447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:02.428693 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:22:02.429403 (+   710us) log.cc:844] Serialized 78 byte log entry
0709 12:22:02.540177 (+110774us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:02.540218 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.540289 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:02.617197 (+ 76908us) raft_consensus.cc:1685] finished
0709 12:22:02.617221 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.617379 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":236934,"raft.queue_time_us":243082,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":54,"thread_start_us":110295,"threads_started":1,"wal-append.queue_time_us":179409}
W20260709 12:22:02.632767 11082 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 3021) took 2388 ms (client timeout 2137 ms). Trace:
I20260709 12:22:02.726773 15222 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:02.727087 11082 rpcz_store.cc:269] 0709 12:22:00.244595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.632597 (+2388002us) service_pool.cc:211] Skipping call since client already timed out
0709 12:22:02.632710 (+   113us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:22:02.726642 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:02.687538 11622 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:02.687465 11077 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:22:02.730603 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3007) took 2802 ms. Trace:
I20260709 12:22:02.730962 11077 rpcz_store.cc:276] 0709 12:21:59.928509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.684285 (+2755776us) service_pool.cc:224] Handling call
0709 12:22:02.684624 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:02.730307 (+ 45683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.730543 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:02.709959 11010 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.473s	user 0.021s	sys 0.005s
I20260709 12:22:02.733572 11010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3127) took 2500 ms. Trace:
I20260709 12:22:02.733922 11010 rpcz_store.cc:276] 0709 12:22:00.233106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.235581 (+  2475us) service_pool.cc:224] Handling call
0709 12:22:00.235916 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:00.236275 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:00.236301 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:00.236722 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 12:22:02.733209 (+2496487us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:02.733255 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.733329 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:02.733378 (+    49us) raft_consensus.cc:1685] finished
0709 12:22:02.733390 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.733513 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5533,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":2496082,"threads_started":1,"wal-append.queue_time_us":192696,"wal-append.run_cpu_time_us":1633,"wal-append.run_wall_time_us":1001661}
W20260709 12:22:02.684500 10931 rpcz_store.cc:269] 0709 12:22:00.194987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.210681 (+ 15694us) service_pool.cc:224] Handling call
0709 12:22:02.630990 (+2420309us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b5400202bd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:02.631122 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4743352064}
I20260709 12:22:02.711611 15887 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:02.713415 11078 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:22:02.663825 15594 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:02.739082 10927 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53346 (request call id 442) took 3187 ms (client timeout 1609 ms). Trace:
I20260709 12:22:02.727283 11079 raft_consensus.cc:1240] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:22:02.726209 10929 rpcz_store.cc:276] 0709 12:22:00.194728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.684263 (+2489535us) service_pool.cc:224] Handling call
0709 12:22:02.723461 (+ 39198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:02.723670 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:02.723696 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:02.723741 (+    45us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:02.723791 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.723839 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.725611 (+  1772us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:02.683256 11625 leader_election.cc:336] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 2.036s (SENT)
I20260709 12:22:02.736719 11084 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:02.737924 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3009) took 2809 ms. Trace:
I20260709 12:22:02.740020 11625 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:02.726562 11085 rpcz_store.cc:276] 0709 12:21:59.928293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.680171 (+2751878us) service_pool.cc:224] Handling call
0709 12:22:02.680570 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:02.725875 (+ 45305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.726112 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:02.740657 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3008) took 2811 ms. Trace:
W20260709 12:22:02.739486 10927 rpcz_store.cc:269] 0709 12:21:59.552100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.932001 (+379901us) service_pool.cc:224] Handling call
0709 12:22:02.738916 (+2806915us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b540015f9d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:02.739017 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":546072320}
I20260709 12:22:02.740284 11078 rpcz_store.cc:276] 0709 12:21:59.928978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.687050 (+2758072us) service_pool.cc:224] Handling call
0709 12:22:02.713013 (+ 25963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:02.737634 (+ 24621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.737862 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:02.741616 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3012) took 2513 ms. Trace:
I20260709 12:22:02.741397 11079 rpcz_store.cc:276] 0709 12:21:59.928742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.684874 (+2756132us) service_pool.cc:224] Handling call
0709 12:22:02.727064 (+ 42190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:02.740400 (+ 13336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.740607 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:02.741376 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 58155.2us
W20260709 12:22:02.749485 11625 connection.cc:256] RPC call timeout handler was delayed by -2.3083754049998788s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
W20260709 12:22:02.749924 11625 connection.cc:256] RPC call timeout handler was delayed by -2.2786245119998512s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
W20260709 12:22:02.750340 11625 connection.cc:256] RPC call timeout handler was delayed by -2.2648201039999094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
W20260709 12:22:02.750634 11625 connection.cc:256] RPC call timeout handler was delayed by -2.0014754049998373s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
W20260709 12:22:02.750911 11625 connection.cc:256] RPC call timeout handler was delayed by -1.8368676420000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
I20260709 12:22:02.746349 11084 rpcz_store.cc:276] 0709 12:22:00.227698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.721229 (+2493531us) service_pool.cc:224] Handling call
0709 12:22:02.736373 (+ 15144us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:02.741339 (+  4966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.741548 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:02.737295 15800 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:22:02.758323 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:02.764295 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 398441us
W20260709 12:22:02.767416 10819 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9b6c427f0a234dbab806dced4d3ba0fb with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0b171b6aaedc4f809f2753dcfadb14ce is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:22:02.746618 15884 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:02.773056 15594 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:02.773720 15879 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.753930 11650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59384 (request call id 576) took 3756 ms. Trace:
I20260709 12:22:02.774292 15879 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.774708 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:02.738685 15889 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 12:22:02.776556 15879 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:02.777422 15594 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.778060 15594 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.813237 15910 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:02.813859 15910 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.814862 15594 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:02.811976 15800 raft_consensus.cc:697] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:02.740018 15887 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:02.781864 15879 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.816802 15800 consensus_queue.cc:237] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:02.817425 15879 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.818277 15887 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:02.777456 15514 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.778532 15644 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:02.812211 10977 connection.cc:256] RPC call timeout handler was delayed by -2.3180490649999683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
I20260709 12:22:02.812179 15889 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:02.819723 10977 connection.cc:256] RPC call timeout handler was delayed by -2.0156490649999341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
I20260709 12:22:02.819918 15889 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.820227 15909 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.820307 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:02.820873 15909 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:02.819392 15879 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:02.821879 15879 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.822031 15889 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:02.822690 10977 connection.cc:256] RPC call timeout handler was delayed by -1.9328490649998002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21030000000000004s for a response
W20260709 12:22:02.823052 10977 connection.cc:256] RPC call timeout handler was delayed by -1.9247490650000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
W20260709 12:22:02.823459 10977 connection.cc:256] RPC call timeout handler was delayed by -1.8806490649999432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
W20260709 12:22:02.823740 10977 connection.cc:256] RPC call timeout handler was delayed by -1.877592629999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18100000000000002s for a response
W20260709 12:22:02.824146 10977 connection.cc:256] RPC call timeout handler was delayed by -1.6636769080000704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260709 12:22:02.824463 10977 connection.cc:256] RPC call timeout handler was delayed by -1.5726152140000522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
W20260709 12:22:02.824750 10977 connection.cc:256] RPC call timeout handler was delayed by -1.5312152139999853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
I20260709 12:22:02.825241 15909 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:02.825276 10977 connection.cc:256] RPC call timeout handler was delayed by -1.4170769080001264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
W20260709 12:22:02.826043 10977 connection.cc:256] RPC call timeout handler was delayed by -1.4083523009999226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
I20260709 12:22:02.823884 15594 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:02.826598 15610 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:02.826797 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:02.825558 15881 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:02.827157 15910 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:02.827414 11654 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:22:02.823884 15879 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:02.829926 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:02.830927 11010 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
I20260709 12:22:02.775516 11658 raft_consensus.cc:2393] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 10: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:02.832098 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:02.833145 11002 raft_consensus.cc:2393] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 9: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:02.754927 15892 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:02.833710 11011 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 3128) took 2600 ms (client timeout 1820 ms). Trace:
I20260709 12:22:02.846619 15892 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:02.839224 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:02.849279 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:02.849901 11010 raft_consensus.cc:2376] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 13. Re-sending same reply.
I20260709 12:22:02.851174 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:02.852566 15892 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:02.847092 11011 rpcz_store.cc:269] 0709 12:22:00.233427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.252999 (+ 19572us) service_pool.cc:224] Handling call
0709 12:22:02.833524 (+2580525us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b540047fed4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:02.833647 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5082308992}
I20260709 12:22:02.856119 15879 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:02.860515 15886 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:02.861876 10975 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:02.862545 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 496162us
I20260709 12:22:02.864365 10901 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:02.865291 15879 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:02.865877 10901 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:02.866044 15886 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:02.848989 15515 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:02.868155 15735 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:02.876804 10977 leader_election.cc:336] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 2.103s (SENT)
W20260709 12:22:02.878032 10977 leader_election.cc:336] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 2.140s (SENT)
I20260709 12:22:02.878420 10977 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:02.880975 15886 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:22:02.881745 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:02.882543 11624 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:02.819033 15514 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:02.884188 15586 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:02.884721 15586 raft_consensus.cc:697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:02.885598 15586 consensus_queue.cc:237] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:02.885987 15514 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:02.886198 15776 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.886580 15514 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.887140 15514 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.888046 15731 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:02.888481 15731 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.888835 15731 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:02.889885 15514 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:02.891323 15776 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.893610 15776 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:02.887696 15412 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:02.894685 15412 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.895181 15412 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:02.826642 15594 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.893527 11050 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:02.897279 11051 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:02.899359 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:02.901190 11078 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
I20260709 12:22:02.902469 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:02.903101 11078 raft_consensus.cc:2376] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 13. Re-sending same reply.
I20260709 12:22:02.904031 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:02.904909 11078 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 16.
I20260709 12:22:02.845978 15644 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.865885 15879 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.909039 15853 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.883662 15727 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:22:02.894145 15740 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:02.906401 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:02.919517 11081 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3000) took 3579 ms. Trace:
I20260709 12:22:02.912395 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:02.912978 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2928) took 3356 ms. Trace:
I20260709 12:22:02.882627 15721 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.893908 15905 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:02.921294 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:02.886866 15898 consensus_queue.cc:1048] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:22:02.925830 11078 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 11.
I20260709 12:22:02.924376 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:02.919811 15879 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:02.925781 11083 rpcz_store.cc:276] 0709 12:21:59.556398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.556560 (+   162us) service_pool.cc:224] Handling call
0709 12:21:59.556902 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:59.557255 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:59.557283 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:59.571419 (+ 14136us) log.cc:844] Serialized 26 byte log entry
0709 12:21:59.993486 (+422067us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:02.634298 (+2640812us) log.cc:844] Serialized 14 byte log entry
0709 12:22:02.912696 (+278398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.912763 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:02.912801 (+    38us) raft_consensus.cc:1685] finished
0709 12:22:02.912811 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.912926 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":194236,"prepare.queue_time_us":94172,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":56,"raft.queue_time_us":13444,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":40173,"thread_start_us":2944068,"threads_started":3,"wal-append.queue_time_us":612346,"wal-append.run_cpu_time_us":2259,"wal-append.run_wall_time_us":1094029}
I20260709 12:22:02.928740 11084 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
I20260709 12:22:02.919274 15914 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:02.954707 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 61265.1us
I20260709 12:22:02.917541 15820 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:02.956375 11050 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:02.954205 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 57005.3us
I20260709 12:22:02.957638 11051 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:02.929003 15912 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.961653 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:02.953083 11079 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:22:02.962917 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:02.924121 15906 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:02.964874 11078 raft_consensus.cc:2410] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 14 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:22:02.964689 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:02.966835 11083 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:02.925248 11081 rpcz_store.cc:276] 0709 12:21:59.339792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.339978 (+   186us) service_pool.cc:224] Handling call
0709 12:21:59.369311 (+ 29333us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:21:59.374678 (+  5367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:59.374709 (+    31us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 12:21:59.381030 (+  6321us) log.cc:844] Serialized 104 byte log entry
0709 12:21:59.736873 (+355843us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:59.851130 (+114257us) log.cc:844] Serialized 14 byte log entry
0709 12:22:02.492772 (+2641642us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b1800401740. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9baddedc0a 00007f9bb752d219 00007f9bade75a40 00007f9bade704e4 00007f9bade70455 00007f9bb0f58060 00007f9bb0f6a716 00007f9bb0f7b287 00007f9bb0f7b208
0709 12:22:02.596704 (+103932us) log.cc:844] Serialized 14 byte log entry
0709 12:22:02.912430 (+315726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.912513 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:02.919286 (+  6773us) raft_consensus.cc:1685] finished
0709 12:22:02.919306 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.919450 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":245011,"prepare.queue_time_us":243537,"prepare.run_cpu_time_us":124,"prepare.run_wall_time_us":10078,"raft.queue_time_us":3223713,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":3145,"spinlock_wait_cycles":24813824,"thread_start_us":439902,"threads_started":3,"wal-append.queue_time_us":806373,"wal-append.run_cpu_time_us":4775,"wal-append.run_wall_time_us":1364393}
I20260709 12:22:02.968107 15912 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.926476 15886 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:22:02.973851 15912 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:02.929034 15721 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.975793 15721 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:02.964195 15914 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.961266 15817 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:02.965626 15820 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.976684 15817 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:02.978142 15820 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:02.970860 15906 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:02.980769 15906 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:02.774353 11650 rpcz_store.cc:276] 0709 12:21:58.990180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:58.990346 (+   166us) service_pool.cc:224] Handling call
0709 12:21:58.990700 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:58.991302 (+   602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:58.991335 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:58.991895 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 12:21:59.013668 (+ 21773us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:00.101026 (+1087358us) log.cc:844] Serialized 14 byte log entry
0709 12:22:02.727327 (+2626301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.734720 (+  7393us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:02.735924 (+  1204us) raft_consensus.cc:1685] finished
0709 12:22:02.738336 (+  2412us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.743505 (+  5169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":386175,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":5989,"raft.queue_time_us":7328,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":8511,"thread_start_us":3682758,"threads_started":3,"wal-append.queue_time_us":332087,"wal-append.run_cpu_time_us":2737,"wal-append.run_wall_time_us":2003111}
I20260709 12:22:02.984658 15855 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:02.985272 15855 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.987250 15855 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:02.987793 15855 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:02.988399 11050 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:02.989837 11050 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:02.990921 15914 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:02.991519 15914 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:02.988579 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3005) took 3060 ms. Trace:
I20260709 12:22:02.993297 15908 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:02.993499 15912 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.993156 15467 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:02.992413 11051 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:02.993902 15908 raft_consensus.cc:697] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:02.993997 15912 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.995014 15644 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:02.995325 11051 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:02.928450 15905 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.996210 15860 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:02.995410 15908 consensus_queue.cc:237] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.996644 15860 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:02.994112 15820 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:02.999145 15820 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.994714 15467 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:02.996415 15916 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:03.000943 15467 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:03.001374 15820 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:02.992772 11080 rpcz_store.cc:276] 0709 12:21:59.928054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.031508 (+103454us) service_pool.cc:224] Handling call
0709 12:22:00.077282 (+ 45774us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:02.833758 (+2756476us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:02.833788 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:02.836624 (+  2836us) log.cc:844] Serialized 26 byte log entry
0709 12:22:02.920304 (+ 83680us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:02.920345 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.920411 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:02.987741 (+ 67330us) raft_consensus.cc:1685] finished
0709 12:22:02.987761 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.988508 (+   747us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2539864,"raft.queue_time_us":2800365,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":50,"thread_start_us":283169,"threads_started":2,"wal-append.queue_time_us":83475}
I20260709 12:22:02.998697 15860 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:02.991623 11050 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:02.995615 15644 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:02.996618 11051 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:02.997510 10927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:22:03.015547 10927 raft_consensus.cc:606] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:03.015970 10927 raft_consensus.cc:614] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:02.965919 15776 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:02.926252 15882 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:22:02.926383 15909 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:22:02.926434 15610 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.072s
I20260709 12:22:02.926687 15853 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:02.926606 15889 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 12:22:03.062878 10974 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:02.927614 15740 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:03.039574 11622 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:03.083621 15770 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:03.085682 15770 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:03.086308 15740 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:03.034927 15917 log.cc:927] Time spent T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca: Append to log took a long time: real 0.125s	user 0.002s	sys 0.000s
I20260709 12:22:03.094659 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:03.043833 11051 connection.cc:256] RPC call timeout handler was delayed by -2.055196634999902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
W20260709 12:22:03.083562 11049 connection.cc:256] RPC call timeout handler was delayed by -1.2921297670000058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
I20260709 12:22:03.097164 10974 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:03.106312 15910 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:03.113718 11049 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:02.993758 15594 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:03.122296 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:03.122640 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:03.042078 15644 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.124462 15644 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:03.127417 15908 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:03.128029 15908 raft_consensus.cc:697] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:03.128963 15908 consensus_queue.cc:237] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:03.084579 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 45131.6us
I20260709 12:22:03.132782 11622 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:03.133795 11051 connection.cc:256] RPC call timeout handler was delayed by -1.0492394829998375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260709 12:22:03.136310 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 144758us
I20260709 12:22:03.138155 11050 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:03.000638 15905 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:03.047292 15820 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:03.076743 15916 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:03.084892 15927 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:03.050633 15912 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:03.096163 15884 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:03.152709 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:03.154171 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:03.154830 11084 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:03.155666 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:03.141773 11050 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:03.156692 10974 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:03.082360 15776 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:03.143000 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:03.151576 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3018) took 2915 ms. Trace:
I20260709 12:22:03.146711 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:03.158448 11080 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 8.
I20260709 12:22:03.158887 11078 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:03.139446 15610 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:03.165424 10927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:22:03.166149 10927 raft_consensus.cc:606] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:03.166605 10927 raft_consensus.cc:614] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:03.170384 10974 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:03.144246 15740 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:03.159565 11077 rpcz_store.cc:276] 0709 12:22:00.235875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.731714 (+2495839us) service_pool.cc:224] Handling call
0709 12:22:02.732126 (+   412us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:02.912113 (+179987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:02.912144 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:02.921274 (+  9130us) log.cc:844] Serialized 52 byte log entry
0709 12:22:03.082690 (+161416us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:03.082728 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:03.082798 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:03.151351 (+ 68553us) raft_consensus.cc:1685] finished
0709 12:22:03.151371 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:03.151518 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":179558,"raft.queue_time_us":219364,"spinlock_wait_cycles":8307968,"thread_start_us":126914,"threads_started":1,"wal-append.queue_time_us":149103}
I20260709 12:22:03.146888 15916 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:03.258395 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:03.259208 11081 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:22:03.151117 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:03.157665 15884 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:03.263600 15930 log.cc:927] Time spent T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:22:03.169590 15610 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.157343 15776 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:03.171552 15594 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:03.168725 15905 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:03.212800 15786 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:03.298730 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.309274 15467 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:03.310844 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:03.264307 15884 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:03.322604 15817 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:03.324405 15412 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:03.326675 15412 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:03.169037 15912 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 12:22:03.327324 11079 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:22:03.318814 11080 raft_consensus.cc:2393] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 12: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:03.262519 15916 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:03.330544 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.266109 15889 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:03.342113 10927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:22:03.272493 15853 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:03.277622 15610 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:03.152375 15927 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:03.363021 10927 raft_consensus.cc:606] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:03.363559 10927 raft_consensus.cc:614] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:22:03.359820 11680 debug-util.cc:398] Leaking SignalData structure 0x7b0800227600 after lost signal to thread 9744
W20260709 12:22:03.373114 11680 debug-util.cc:398] Leaking SignalData structure 0x7b080027ce80 after lost signal to thread 10868
W20260709 12:22:03.374126 11680 debug-util.cc:398] Leaking SignalData structure 0x7b080027cb20 after lost signal to thread 10960
W20260709 12:22:03.374390 11680 debug-util.cc:398] Leaking SignalData structure 0x7b080027ca80 after lost signal to thread 10961
W20260709 12:22:03.375190 11680 debug-util.cc:398] Leaking SignalData structure 0x7b0800303740 after lost signal to thread 11035
W20260709 12:22:03.375402 11680 debug-util.cc:398] Leaking SignalData structure 0x7b080008cd00 after lost signal to thread 11036
W20260709 12:22:03.376412 11680 debug-util.cc:398] Leaking SignalData structure 0x7b0800377740 after lost signal to thread 11109
W20260709 12:22:03.376672 11680 debug-util.cc:398] Leaking SignalData structure 0x7b0800250b00 after lost signal to thread 11110
W20260709 12:22:03.378221 11680 debug-util.cc:398] Leaking SignalData structure 0x7b08002ee840 after lost signal to thread 11683
W20260709 12:22:03.378500 11680 debug-util.cc:398] Leaking SignalData structure 0x7b0800369100 after lost signal to thread 11684
I20260709 12:22:03.328158 15905 raft_consensus.cc:697] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:22:03.389451 15922 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:22:03.277961 15731 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:03.345896 15889 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:03.390089 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:03.407163 11080 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:03.312611 15786 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:03.395120 15586 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:03.313056 15879 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:03.408345 15889 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:03.500648 15930 log.cc:927] Time spent T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:22:03.522861 11080 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:03.527300 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:03.527921 11080 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:03.528887 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:03.529415 11080 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:22:03.532857 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:03.533599 11080 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
W20260709 12:22:03.533879 15924 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 12:22:03.534564 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:03.535208 11080 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
W20260709 12:22:03.535907 15925 log.cc:927] Time spent T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:22:03.536160 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:03.537283 11080 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:03.537467 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3020) took 3300 ms. Trace:
I20260709 12:22:03.537137 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3015) took 3308 ms. Trace:
I20260709 12:22:03.537820 11085 rpcz_store.cc:276] 0709 12:22:00.237325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.742280 (+2504955us) service_pool.cc:224] Handling call
0709 12:22:02.742633 (+   353us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:02.913450 (+170817us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:02.927776 (+ 14326us) log.cc:844] Serialized 14 byte log entry
0709 12:22:03.088727 (+160951us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b1800227080. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b 00007f9bb0affd23 00007f9bb0b0023a 00007f9bb0f6aa2a
0709 12:22:03.103003 (+ 14276us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:03.103693 (+   690us) log.cc:844] Serialized 52 byte log entry
0709 12:22:03.103907 (+   214us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:03.104437 (+   530us) log.cc:844] Serialized 14 byte log entry
0709 12:22:03.104886 (+   449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:03.104967 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:03.151390 (+ 46423us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b4800210cd8. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb5e89aa1 00007f9bb5e80b37 00007f9bb5e809ca 00007f9bb5f7826f 00007f9bb5f77f37 00007f9bb5f8c55c 00007f9bb5f8c508 00007f9bb5f8c488 00007f9bb5f8c443 00007f9bb5f8b6ec 00007f9bb4eb5a96
0709 12:22:03.537263 (+385873us) raft_consensus.cc:1685] finished
0709 12:22:03.537285 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:03.537413 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":170380,"prepare.queue_time_us":14422,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":1176,"raft.queue_time_us":209588,"raft.run_cpu_time_us":2591,"raft.run_wall_time_us":204342,"spinlock_wait_cycles":16710144,"thread_start_us":13697,"threads_started":1,"wal-append.queue_time_us":149295}
I20260709 12:22:03.538798 11082 rpcz_store.cc:276] 0709 12:22:00.228495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.727892 (+2499397us) service_pool.cc:224] Handling call
0709 12:22:02.728231 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:02.954595 (+226364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:02.954622 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:02.955106 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:22:03.142539 (+187433us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:03.142579 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:03.142649 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:03.536920 (+394271us) raft_consensus.cc:1685] finished
0709 12:22:03.536950 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:03.537077 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":226231,"raft.queue_time_us":241877,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":181593,"threads_started":1,"wal-append.queue_time_us":207830}
I20260709 12:22:03.548918 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:03.547447 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:03.553660 11085 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:03.554841 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:03.541632 11083 consensus_meta.cc:287] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.574s	user 0.004s	sys 0.004s
I20260709 12:22:03.557767 11083 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:03.558912 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:03.562887 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:03.563673 11082 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:03.564635 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:03.565430 11082 raft_consensus.cc:2410] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 16 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:22:03.567458 11083 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:22:03.555588 11085 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:03.593461 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:03.593710 15909 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:03.594215 15909 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:03.595121 11080 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:03.596370 15909 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:03.596242 15926 log.cc:927] Time spent T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 12:22:03.604187 11085 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:22:03.531255 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:03.541678 15770 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:03.612143 15927 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:03.616078 15467 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:03.618609 15860 consensus_meta.cc:287] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.001s
I20260709 12:22:03.648625 15884 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:03.550221 15905 consensus_queue.cc:237] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:03.657235 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3014) took 3429 ms. Trace:
I20260709 12:22:03.669999 15731 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:03.671201 11076 rpcz_store.cc:276] 0709 12:22:00.228250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.724908 (+2496658us) service_pool.cc:224] Handling call
0709 12:22:02.725273 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:02.907048 (+181775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:02.907089 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:02.918180 (+ 11091us) log.cc:844] Serialized 26 byte log entry
0709 12:22:03.144848 (+226668us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:03.144887 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:03.144963 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:03.656988 (+512025us) raft_consensus.cc:1685] finished
0709 12:22:03.657013 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:03.657164 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":181340,"raft.queue_time_us":186753,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":3773,"thread_start_us":192291,"threads_started":1,"wal-append.queue_time_us":333512}
W20260709 12:22:03.707366 10974 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.000s	sys 0.015s
I20260709 12:22:03.671677 15860 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:03.714612 11051 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.004s	sys 0.010s
W20260709 12:22:03.715987 10974 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.001s	sys 0.015s
W20260709 12:22:03.716799 11622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.010s	sys 0.006s
W20260709 12:22:03.717308 11051 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.005s	sys 0.010s
I20260709 12:22:03.720819 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
W20260709 12:22:03.727072 11622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.010s	sys 0.006s
W20260709 12:22:03.727109 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 521691us
I20260709 12:22:03.707450 15879 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:03.736302 15884 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:03.727984 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 556498us
I20260709 12:22:03.727769 15860 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:03.757015 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.758198 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.758807 11006 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:22:03.759609 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.761075 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:03.729493 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 592138us
I20260709 12:22:03.762218 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.763098 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.740885 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:03.755275 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.764123 11006 raft_consensus.cc:2410] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:22:03.764320 15610 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:03.764704 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.765136 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.765364 11010 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:22:03.765787 11006 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:03.766223 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.766582 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.766808 11010 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:22:03.755337 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.767714 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.742578 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.768513 11005 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:03.768829 11622 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:03.769356 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.769685 11007 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:22:03.770094 11005 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
W20260709 12:22:03.769268 15820 consensus_meta.cc:287] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.000s
I20260709 12:22:03.741844 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:03.772588 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.772909 11008 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:03.741178 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.772578 11011 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:03.742264 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.775233 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.767692 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:03.767588 15644 consensus_meta.cc:287] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.642s	user 0.010s	sys 0.000s
I20260709 12:22:03.771871 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.771112 11622 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:03.777762 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.780211 11007 raft_consensus.cc:2393] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 13: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:03.780552 11009 raft_consensus.cc:2410] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:22:03.784580 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.784886 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:03.785511 11076 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:03.786453 11006 raft_consensus.cc:2410] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 16 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:22:03.755672 15467 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.789469 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:03.790098 11655 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:22:03.766516 15610 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:03.793421 11008 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 11.
I20260709 12:22:03.731151 15916 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:03.797248 11083 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:03.797979 11655 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:22:03.798156 15731 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.798481 15916 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:03.794116 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 913874us
I20260709 12:22:03.799166 10975 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:03.799608 10901 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:03.800139 15733 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.800809 15879 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:03.800616 15733 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:03.794267 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 910183us
I20260709 12:22:03.775023 15884 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:03.801330 15879 raft_consensus.cc:697] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:03.801723 15884 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:03.802191 15884 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:03.802405 15727 consensus_queue.cc:1048] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:03.802860 11651 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:03.802489 15879 consensus_queue.cc:237] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:03.785399 15881 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:03.804077 15515 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:03.804488 15467 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:03.806231 15733 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:03.803328 15731 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:03.783236 15820 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:03.796165 15734 consensus_queue.cc:1048] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:03.804648 10901 leader_election.cc:400] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16.
I20260709 12:22:03.816282 10901 leader_election.cc:403] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:03.802103 10899 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:03.803020 10900 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:03.795176 11011 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:22:03.813133 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:03.822395 11076 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 11.
I20260709 12:22:03.804281 15881 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:03.822592 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.824420 10900 leader_election.cc:400] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13.
I20260709 12:22:03.827481 10900 leader_election.cc:403] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:03.828775 10899 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:03.838639 11076 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:03.841153 11076 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:03.876809 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:03.806769 15467 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:03.804656 15515 raft_consensus.cc:697] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:03.786571 15644 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:03.902145 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.889356 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:03.903059 10931 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:22:03.890174 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:03.903138 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:03.904455 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:03.905659 10934 raft_consensus.cc:2410] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:22:03.901403 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:03.901635 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 72951.3us
I20260709 12:22:03.903229 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:03.827601 15736 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:22:03.803838 15776 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:03.906968 10935 raft_consensus.cc:2410] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:22:03.907315 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:03.890636 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 66387.7us
I20260709 12:22:03.891073 11007 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:22:03.910800 10899 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:03.890125 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 57685.9us
I20260709 12:22:03.912060 10899 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:03.906913 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:03.887326 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.913803 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:03.914505 10927 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:03.890993 11010 raft_consensus.cc:2393] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 12: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:22:03.915562 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.885826 15897 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:03.826623 15734 consensus_queue.cc:1243] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 1abf4b385a2b493ab83f593a1f8c9cd1 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:22:03.836702 15727 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:03.910867 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:03.903486 15898 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.928416 11076 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:22:03.922017 10974 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:03.902087 15412 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.900290 15797 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.885651 15881 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:03.944594 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:03.941198 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:03.945297 11076 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:03.945847 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:03.946614 11007 raft_consensus.cc:2368] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13.
I20260709 12:22:03.938536 10932 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 15: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:03.891949 15735 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:22:03.903419 15823 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13.
I20260709 12:22:03.941687 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:03.954257 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:03.954804 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:03.940003 11656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59398 (request call id 440) took 1158 ms. Trace:
I20260709 12:22:03.943023 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.905588 15780 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:03.951376 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.959813 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:03.960623 10928 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:22:03.961725 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:03.962468 11010 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:22:03.917827 15897 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:03.935222 15803 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:03.918041 15833 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:03.969874 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:03.974236 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:03.948493 15610 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:03.975193 10932 raft_consensus.cc:2410] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:22:03.974951 11076 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:03.911425 15467 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:22:03.980178 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:03.982402 11076 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:03.976878 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:03.974849 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:03.955567 11656 rpcz_store.cc:276] 0709 12:22:02.781600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.781773 (+   173us) service_pool.cc:224] Handling call
0709 12:22:02.812804 (+ 31031us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:02.848670 (+ 35866us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:22:02.919991 (+ 71321us) log.cc:844] Serialized 14 byte log entry
0709 12:22:03.372258 (+452267us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:03.387795 (+ 15537us) log.cc:844] Serialized 26 byte log entry
0709 12:22:03.387985 (+   190us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:22:03.388024 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:03.925791 (+537767us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b54004df8d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:03.925849 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:03.925907 (+    58us) raft_consensus.cc:1685] finished
0709 12:22:03.939718 (+ 13811us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:03.939918 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":102431,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":11142,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":12189,"spinlock_wait_cycles":81488256,"thread_start_us":472893,"threads_started":3,"wal-append.queue_time_us":224488}
I20260709 12:22:03.983701 11007 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:03.984788 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:03.976508 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 189860us
I20260709 12:22:03.917676 15708 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:22:03.985698 10932 raft_consensus.cc:2393] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 14: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:03.963091 15780 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.987895 11076 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:03.939023 15836 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:22:03.991561 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.992707 11008 raft_consensus.cc:2410] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:22:03.993538 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:03.994110 11008 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:03.995931 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:03.998664 15933 log.cc:927] Time spent T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.608s	user 0.006s	sys 0.030s
I20260709 12:22:04.003917 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.004637 10934 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:04.007201 11005 raft_consensus.cc:1240] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:03.951191 15898 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:04.004808 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3039) took 1042 ms. Trace:
I20260709 12:22:04.009371 11083 rpcz_store.cc:276] 0709 12:22:02.962455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.583326 (+620871us) service_pool.cc:224] Handling call
0709 12:22:03.610733 (+ 27407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:03.797683 (+186950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:04.004564 (+206881us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b5400216454. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:04.004749 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":428497280}
I20260709 12:22:04.009521 10935 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:22:04.012516 11005 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:22:04.014854 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:04.015529 10927 raft_consensus.cc:2376] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13. Re-sending same reply.
I20260709 12:22:04.009145 11622 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:03.986334 15950 log.cc:927] Time spent T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:22:04.017297 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:03.952523 15412 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:03.972421 15897 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:03.951701 15797 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:03.982283 15610 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:04.026844 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 110266us
I20260709 12:22:04.027410 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.028451 10935 raft_consensus.cc:2410] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:22:04.026671 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.030416 10934 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:22:04.019922 11010 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:04.018338 11007 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
W20260709 12:22:04.021682 15949 log.cc:927] Time spent T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
W20260709 12:22:04.069672 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 46268.7us
I20260709 12:22:04.021930 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:04.070788 10933 raft_consensus.cc:2393] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 12: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:04.069780 10899 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:04.073100 10928 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:04.018486 15780 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:04.076594 11010 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:22:04.079519 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 143754us
W20260709 12:22:04.081226 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 54008.5us
I20260709 12:22:04.085044 10930 raft_consensus.cc:2410] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:22:03.975047 15515 consensus_queue.cc:237] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:04.104054 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:04.104827 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.105623 10935 raft_consensus.cc:2410] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:22:04.096872 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:04.106493 10933 raft_consensus.cc:2376] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12. Re-sending same reply.
I20260709 12:22:04.069053 15610 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:04.107669 11083 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:22:04.106309 11051 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:04.096236 11010 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:22:04.083039 15731 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:04.107988 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:04.111299 15905 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:04.109020 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:04.111761 15905 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:04.094360 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 153565us
I20260709 12:22:04.112116 11085 raft_consensus.cc:2393] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 12: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:04.100112 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:04.110766 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:04.101234 15827 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:04.131788 15827 consensus_queue.cc:1243] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:22:04.117019 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:04.111445 11656 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 11: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:04.133628 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2339) took 3939 ms. Trace:
I20260709 12:22:04.117985 15776 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:04.093819 15889 consensus_meta.cc:287] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.574s	user 0.008s	sys 0.002s
I20260709 12:22:04.134052 10936 rpcz_store.cc:276] 0709 12:22:00.194476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.662964 (+2468488us) service_pool.cc:224] Handling call
0709 12:22:02.663269 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:03.775152 (+1111883us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:03.941746 (+166594us) log.cc:844] Serialized 14 byte log entry
0709 12:22:04.130763 (+189017us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:04.131254 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 12:22:04.131445 (+   191us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:04.131480 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:04.131549 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:04.133404 (+  1855us) raft_consensus.cc:1685] finished
0709 12:22:04.133421 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:04.133570 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1186880,"prepare.queue_time_us":198017,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":1140817,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":8410,"thread_start_us":300679,"threads_started":2,"wal-append.queue_time_us":145513}
I20260709 12:22:04.135000 15889 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:04.136425 15222 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.136937 15222 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:04.126552 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3049) took 1143 ms. Trace:
I20260709 12:22:04.138491 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:04.138031 11080 rpcz_store.cc:276] 0709 12:22:02.983361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.597534 (+614173us) service_pool.cc:224] Handling call
0709 12:22:03.609052 (+ 11518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:03.609471 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:03.609501 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:03.642506 (+ 33005us) log.cc:844] Serialized 26 byte log entry
0709 12:22:03.729105 (+ 86599us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:03.729145 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:03.732478 (+  3333us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:04.126323 (+393845us) raft_consensus.cc:1685] finished
0709 12:22:04.126345 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:04.126490 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22045,"spinlock_wait_cycles":2568960,"thread_start_us":45982,"threads_started":1,"wal-append.queue_time_us":99741}
I20260709 12:22:04.139246 11076 raft_consensus.cc:2368] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13.
I20260709 12:22:04.113171 11051 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:04.087031 15909 consensus_queue.cc:1059] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:22:04.078871 15817 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.158015 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:04.086884 15943 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:22:04.083065 15708 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:22:04.128592 15887 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:04.137171 15889 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:04.171708 15884 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:04.140252 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:04.177215 11076 raft_consensus.cc:2368] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16.
I20260709 12:22:04.178092 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:04.178800 11076 raft_consensus.cc:2368] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13.
I20260709 12:22:04.140978 11010 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:22:04.103715 15941 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:22:04.143934 11051 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:04.150668 11004 raft_consensus.cc:2393] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 14: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:04.083223 15735 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:04.154755 15897 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:04.168162 11655 raft_consensus.cc:1240] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:04.192093 15897 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:04.169663 15222 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:04.170540 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:04.112174 15905 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:04.176159 15909 raft_consensus.cc:3055] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:04.194345 15909 raft_consensus.cc:740] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:04.195343 15909 consensus_queue.cc:260] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:04.179560 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:04.142138 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:04.181766 15892 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:22:04.158735 11652 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:22:04.186461 11051 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:04.199175 11051 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:04.196659 15909 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:04.188267 15916 raft_consensus.cc:2764] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:22:04.189535 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:04.173985 15817 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:04.194507 11077 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:22:04.157133 15836 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.156904 15777 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.139195 10928 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:04.114349 10974 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:04.204681 11051 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:04.401863 10819 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9b6c427f0a234dbab806dced4d3ba0fb with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0b171b6aaedc4f809f2753dcfadb14ce is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:22:04.433715 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 228975us
I20260709 12:22:04.410821 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:04.435788 10929 raft_consensus.cc:2376] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 13. Re-sending same reply.
I20260709 12:22:04.436460 11051 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:04.406750 10900 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:04.439286 10929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:22:04.412134 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.410951 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:04.446431 11009 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:04.411477 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:04.419051 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 318115us
I20260709 12:22:04.447523 10927 raft_consensus.cc:2410] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:22:04.456223 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.457031 10927 raft_consensus.cc:2376] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 13. Re-sending same reply.
I20260709 12:22:04.456300 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.458560 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:04.459519 10933 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:22:04.457320 11079 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 3045) took 1474 ms (client timeout 1585 ms). Trace:
I20260709 12:22:04.467031 15467 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:04.481530 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.482663 10931 raft_consensus.cc:2393] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 13: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:04.265508 15586 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:04.467990 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.468588 15734 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:04.295373 15797 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:04.469105 15514 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:04.470338 15222 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.470510 10935 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:22:04.470533 15566 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:04.409044 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 297171us
I20260709 12:22:04.413407 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:04.472982 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 358525us
I20260709 12:22:04.412631 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.473361 11076 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:04.474821 15820 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:04.227442 15853 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:04.475596 15731 raft_consensus.cc:2804] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:04.469027 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:04.241160 15610 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:04.478871 15777 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:04.472971 15817 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:04.482391 15467 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:04.441408 10929 raft_consensus.cc:606] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:04.484408 10935 pending_rounds.cc:85] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 6
I20260709 12:22:04.491593 10935 pending_rounds.cc:107] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:22:04.493134 10935 raft_consensus.cc:2889] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:04.493055 15882 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:04.494827 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.491818 10929 raft_consensus.cc:614] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:04.238963 15780 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:04.499266 15853 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:04.499938 15910 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:04.500908 15734 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:04.525864 10901 leader_election.cc:400] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13.
I20260709 12:22:04.526264 10901 leader_election.cc:403] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:22:04.526384 15734 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:04.526827 15959 consensus_queue.cc:1059] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:04.528247 15959 raft_consensus.cc:3055] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:04.528640 15959 raft_consensus.cc:740] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:04.529744 15777 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:04.529744 15959 consensus_queue.cc:260] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:04.505755 10974 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:04.506639 15586 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:04.489940 15820 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:04.488616 15731 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:04.481283 11079 rpcz_store.cc:269] 0709 12:22:02.982431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.061264 (+ 78833us) service_pool.cc:224] Handling call
0709 12:22:04.456843 (+1395579us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b540044d4d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:04.457064 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":533293824}
I20260709 12:22:04.513623 11050 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:04.513361 15566 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:04.507293 15222 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:04.515105 11651 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:04.516346 15906 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:04.519989 15797 consensus_queue.cc:1059] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:04.520949 15853 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:04.304883 15961 log.cc:927] Time spent T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:22:04.545727 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 79709.7us
I20260709 12:22:04.166378 15776 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:04.199339 15908 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:04.543118 10931 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:22:04.178113 15884 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:04.240440 15951 log.cc:927] Time spent T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 12:22:04.550395 11002 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:04.550928 11076 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:04.551751 15959 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:04.551373 10832 catalog_manager.cc:5697] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:04.591490 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.593137 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:04.594033 10832 catalog_manager.cc:5697] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:04.286619 15644 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:04.597219 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.554476 15836 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:04.541684 15820 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:04.556341 10932 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:04.294179 15412 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:04.568933 15777 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:04.205226 15952 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:22:04.576110 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 70589.8us
I20260709 12:22:04.576331 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.577205 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.230643 15736 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16.
I20260709 12:22:04.577876 10901 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:04.256584 15898 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:04.297797 15786 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:04.579506 15906 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:04.583451 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:04.547602 15887 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:04.584164 15909 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:04.622601 15909 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:04.623029 15909 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:04.624326 10832 catalog_manager.cc:5697] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 9 to 11, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 11 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:04.626601 10832 catalog_manager.cc:5697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:04.329602 15905 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:04.628682 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 115524us
I20260709 12:22:04.628626 10832 catalog_manager.cc:5697] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 6 to 9, leader changed from 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 9 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:22:04.630333 15905 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:04.584873 15776 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:04.631242 15776 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:04.630673 10832 catalog_manager.cc:5697] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 6 to 9, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 9 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:04.588845 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:04.588624 10930 raft_consensus.cc:1275] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:22:04.636044 10930 pending_rounds.cc:85] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 4
I20260709 12:22:04.636344 10930 pending_rounds.cc:107] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:22:04.636623 10930 raft_consensus.cc:2889] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:04.637611 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.597827 11655 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:04.638115 15780 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:04.638971 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.640676 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.641364 10935 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:04.641921 10974 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:04.642410 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:04.643219 10974 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:04.643461 15944 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:04.644093 15944 raft_consensus.cc:697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:04.599186 10934 raft_consensus.cc:2393] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 13: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:04.645414 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.645298 15944 consensus_queue.cc:237] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:04.541635 15731 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:04.646631 15836 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:04.647626 15222 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:04.648234 15910 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:04.648824  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:04.651907 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.613844 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.325721 15881 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:04.653551 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.654816 15881 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:04.655802 10927 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:04.638981 15780 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:04.656958 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.618793 15952 raft_consensus.cc:697] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
W20260709 12:22:04.659227 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 48590us
I20260709 12:22:04.658710 15952 consensus_queue.cc:237] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:04.621840 15906 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:04.622166 15887 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:22:04.661947 11625 leader_election.cc:336] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.597s (SENT)
W20260709 12:22:04.601202 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 58366.4us
I20260709 12:22:04.662523 11625 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:04.662343 15887 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:04.644474 15610 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:04.656229 11650 raft_consensus.cc:1240] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
W20260709 12:22:04.639407 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 61790.7us
I20260709 12:22:04.635723 15794 raft_consensus.cc:3055] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:04.602051 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.620373 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.654843 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.617380 15566 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:04.638142 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.667697 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.630736 11050 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:04.668800 15794 raft_consensus.cc:740] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:04.681324 15908 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:04.687111 15908 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:04.645226 15644 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:04.681808 10901 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:04.687526 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:04.688167 10929 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:22:04.689625 15881 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:04.688898 15610 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:04.709303 10936 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:04.713727 10927 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:04.714931 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:04.715715 11076 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:04.720716 15566 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:04.721280 15566 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.721735 15566 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:04.721922 10932 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:22:04.723481 10932 pending_rounds.cc:85] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 8
I20260709 12:22:04.723724 10932 pending_rounds.cc:107] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:22:04.723961 10932 raft_consensus.cc:2889] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:04.682107 15586 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:04.729941 10929 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:04.730139 10974 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:04.681738 10832 catalog_manager.cc:5697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:04.733467 10931 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:04.708726 15610 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:04.735843 15978 log.cc:927] Time spent T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.062s	user 0.004s	sys 0.000s
W20260709 12:22:04.736186 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 105582us
I20260709 12:22:04.687322 15794 consensus_queue.cc:260] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:04.738801 10901 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:04.741106 15780 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:04.748152 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.742019 15222 consensus_queue.cc:1059] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:04.723008 15644 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:04.745860 11082 raft_consensus.cc:1240] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:04.749017 10901 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:04.748946 11652 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: []
W20260709 12:22:04.750046 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 45439.9us
I20260709 12:22:04.752413 15222 raft_consensus.cc:3055] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:04.750080 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.752925 15222 raft_consensus.cc:740] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:04.744642 15610 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:04.755203 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:22:04.772089 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 110213us
I20260709 12:22:04.773058 11050 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:04.774775 11050 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:04.775543 15906 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:04.775914 10974 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:04.776608 15879 consensus_queue.cc:1059] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:22:04.777043 10974 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:04.777899 15879 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:04.778162 15968 raft_consensus.cc:3055] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:04.779241 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.778805 15968 raft_consensus.cc:740] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:04.782102 10928 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:04.783171 10930 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:04.782727 15968 consensus_queue.cc:260] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:04.784116 15968 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:04.788362  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:04.789255 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:04.789703  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:04.790642 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:04.791321 11085 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:04.792454 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:04.793051 15708 consensus_queue.cc:1059] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:04.793723 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:04.788148 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:04.778328 10974 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:04.799455 15944 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:04.818306 15797 raft_consensus.cc:3055] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:04.818967 15797 raft_consensus.cc:740] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:04.820267 15797 consensus_queue.cc:260] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:04.822034 15797 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:04.824431 15908 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:04.825073 15733 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:04.800022 11653 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:04.799170 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.779558 15836 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:04.778419 15879 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.779029 15910 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:04.836601 10936 raft_consensus.cc:2393] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 12: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:04.793756 15586 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:04.838364 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 60184.1us
I20260709 12:22:04.838752 10933 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:04.834813 11083 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:04.841583 11076 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
W20260709 12:22:04.842160 11625 leader_election.cc:336] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.609s (SENT)
I20260709 12:22:04.792982 15515 consensus_queue.cc:1059] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:22:04.844219 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:04.834052 15944 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:04.840432 15879 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:04.855334 15222 consensus_queue.cc:260] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:04.788872 15786 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:22:04.839756 15910 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:04.858170 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 83536.1us
I20260709 12:22:04.838369 15733 raft_consensus.cc:697] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:04.845328 15644 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:04.865608 15889 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:04.866117 15889 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:04.866472 15889 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:04.863798 15732 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
W20260709 12:22:04.870347 11625 leader_election.cc:336] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 2.016s (SENT)
I20260709 12:22:04.870886 11625 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:04.872388 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:04.873334 11077 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:04.874219 15881 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:04.876827 15898 raft_consensus.cc:3055] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:04.877251 15898 raft_consensus.cc:740] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:04.878208 15898 consensus_queue.cc:260] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:04.879482 15898 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:04.882890 15909 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:04.884179 11084 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:04.887979 15786 consensus_queue.cc:1243] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:04.864215 15910 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:04.892196 15731 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:04.884096 10829 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35620 (request call id 246) took 29222 ms (client timeout 15000 ms). Trace:
I20260709 12:22:04.887151 15853 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:04.898852 11077 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 12.
I20260709 12:22:04.901075 15586 consensus_queue.cc:1059] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:04.901569 11622 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:04.902308 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:04.851388 15836 raft_consensus.cc:697] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:04.851064 15412 consensus_queue.cc:1059] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.292s
I20260709 12:22:05.169441 10974 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:05.073347 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.025301 11085 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:05.173098 15938 raft_consensus.cc:3055] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:05.173622 15938 raft_consensus.cc:740] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:04.903306 15733 consensus_queue.cc:237] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:04.856448 15944 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:05.081506 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 55161.6us
I20260709 12:22:05.085808 15222 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:05.096253 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:05.098399 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.081791 11050 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:05.099304 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:05.093838 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:05.101254 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 230939us
I20260709 12:22:05.026160 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:05.094376 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:05.098829 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:05.096216 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:04.901574 10977 leader_election.cc:336] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.675s (SENT)
I20260709 12:22:05.202026 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:05.091925 15963 log.cc:927] Time spent T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:22:05.202711 10927 raft_consensus.cc:2376] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16. Re-sending same reply.
I20260709 12:22:05.206250 10928 raft_consensus.cc:2376] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14. Re-sending same reply.
I20260709 12:22:05.098121 15905 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:05.211421 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.072688 15777 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13.
I20260709 12:22:05.097689 15909 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:05.221648 10934 raft_consensus.cc:2368] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11.
W20260709 12:22:05.207353 15959 consensus_meta.cc:287] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.611s	user 0.008s	sys 0.003s
W20260709 12:22:05.224035 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 322682us
I20260709 12:22:05.174853 15853 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:05.231498 10929 raft_consensus.cc:2393] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 12: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:22:05.221212 15776 consensus_meta.cc:287] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.584s	user 0.020s	sys 0.000s
I20260709 12:22:05.228469 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:05.223060 11651 consensus_meta.cc:287] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.651s	user 0.012s	sys 0.000s
I20260709 12:22:05.096933 15566 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:05.169633 15820 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:05.236057 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:05.236253 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:05.039789 15610 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:05.235111 10935 raft_consensus.cc:2410] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:22:05.094547 15889 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:05.249693 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 176783us
W20260709 12:22:05.253201 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 351673us
I20260709 12:22:05.256489 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:05.258746 11051 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:05.260102 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:05.264259 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 193177us
I20260709 12:22:05.174818 15938 consensus_queue.cc:260] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:05.238829 11651 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:22:05.254551 15586 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:05.246093 15786 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:05.173002 15836 consensus_queue.cc:237] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:05.267180 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:05.237323 15776 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:05.294752 15882 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:05.295372 11653 raft_consensus.cc:1240] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:05.264899 15853 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:05.253525 15905 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:05.293406 11625 leader_election.cc:336] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.938s (SENT)
I20260709 12:22:05.302583 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:05.298151 10930 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:22:05.301314 10977 leader_election.cc:336] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.695s (SENT)
I20260709 12:22:05.307439 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:05.308184 11006 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:05.308862 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:05.309478 11011 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:22:05.310267 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:05.310829 10927 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:05.311838 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:05.312561 10930 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:05.313220 10936 raft_consensus.cc:1240] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:05.314469 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:05.315209 10936 raft_consensus.cc:2393] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 18: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:05.316155 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:05.316229 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:05.317046 10932 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:05.288720 15906 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:05.318226 10932 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:05.319967 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:05.320969 10929 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:05.318141 11010 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:05.304842 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:05.324913 10935 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:05.326946 10930 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:05.327654 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:05.328052 10927 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:22:05.328440 10929 raft_consensus.cc:2376] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13. Re-sending same reply.
I20260709 12:22:05.333721 11625 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:05.305437 10974 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:05.332806 10977 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:05.342866 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:05.346928 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:05.347152 15644 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:05.347837 15644 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:05.339473 11050 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:05.344357 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:05.300684 15882 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.380095 10936 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:05.379935 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 150548us
W20260709 12:22:05.400959 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 161906us
I20260709 12:22:05.352054 15882 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:05.399048 10900 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:05.407675 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 111758us
I20260709 12:22:05.349047 15786 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:05.411612 10974 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:05.436965 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 56135.1us
I20260709 12:22:05.401908 15938 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:05.178493 10829 rpcz_store.cc:269] 0709 12:21:35.626111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.654013 (+ 27902us) service_pool.cc:224] Handling call
0709 12:22:04.843648 (+29189635us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:02.624618 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:02.630143 (+  5525us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:02.630178 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:22:02.630194 (+    16us) tablet.cc:662] Decoding operations
0709 12:22:02.631033 (+   839us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:02.631092 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:02.631118 (+    26us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:22:02.631687 (+   569us) tablet.cc:701] Row locks acquired
0709 12:22:02.631703 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:22:02.634802 (+  3099us) write_op.cc:270] Start()
0709 12:22:02.669661 (+ 34859us) write_op.cc:276] Timestamp: P: 1783599722631808 usec, L: 0
0709 12:22:02.681444 (+ 11783us) op_driver.cc:348] REPLICATION: starting
0709 12:22:02.811760 (+130316us) log.cc:844] Serialized 2896 byte log entry
0709 12:22:03.536345 (+724585us) op_driver.cc:464] REPLICATION: finished
0709 12:22:03.732854 (+196509us) write_op.cc:301] APPLY: starting
0709 12:22:03.732948 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:03.772692 (+ 39744us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:03.778266 (+  5574us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:04.118777 (+340511us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:04.119032 (+   255us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 12:22:04.119080 (+    48us) write_op.cc:312] APPLY: finished
0709 12:22:04.119330 (+   250us) log.cc:844] Serialized 73 byte log entry
0709 12:22:04.119505 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:04.119618 (+   113us) write_op.cc:454] Released schema lock
0709 12:22:04.119658 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:04.120084 (+   426us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:04.120111 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":417459,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":196279,"apply.run_cpu_time_us":12238,"apply.run_wall_time_us":387191,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33345,"num_ops":7,"prepare.queue_time_us":162949,"prepare.run_cpu_time_us":11612,"prepare.run_wall_time_us":247698,"raft.queue_time_us":320404,"raft.run_cpu_time_us":26383,"raft.run_wall_time_us":194313,"replication_time_us":851418,"thread_start_us":509805,"threads_started":4,"wal-append.queue_time_us":97838,"wal-append.run_cpu_time_us":94298,"wal-append.run_wall_time_us":2326526}]]}
I20260709 12:22:05.490027 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:05.490890 11003 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18. Ops: []
W20260709 12:22:05.492036 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 80611.9us
W20260709 12:22:05.504056 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 226398us
W20260709 12:22:05.506457 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 211006us
I20260709 12:22:05.442829 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:05.512470 11625 leader_election.cc:336] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 2.008s (SENT)
I20260709 12:22:05.514932 11011 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16. Ops: []
W20260709 12:22:05.515064 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 57453.5us
I20260709 12:22:05.412629 15731 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:05.522207 11010 raft_consensus.cc:2410] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:22:05.523741 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:05.525355 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:05.477172 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:05.528532 11051 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:05.529587 15889 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:05.530650 15827 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:05.531127 15827 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.531462 15827 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:05.516537 15610 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:05.539279 15887 consensus_meta.cc:287] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.875s	user 0.000s	sys 0.009s
I20260709 12:22:05.492400 16004 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:05.544726 15906 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:05.545329 15906 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:05.545620 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 249437us
I20260709 12:22:05.552747 15905 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:05.553187 15786 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:05.522678 15820 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:05.554925 15820 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:05.555498 15820 raft_consensus.cc:697] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:05.556571 15820 consensus_queue.cc:237] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:05.557557 15989 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.260s	user 0.001s	sys 0.001s
I20260709 12:22:05.492054 15995 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:05.561962 15794 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:05.563060 15797 consensus_meta.cc:287] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.740s	user 0.009s	sys 0.001s
I20260709 12:22:05.563740 11050 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:05.564957 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 47923.3us
I20260709 12:22:05.565734 11050 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:05.568126 15566 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:05.569366 15908 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:05.569787 15908 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:05.570166 15908 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:05.539783 15887 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:05.575515 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:05.576036 15906 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:05.576264 11007 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:22:05.580396 15644 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:05.581213 15644 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:05.581568 15644 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.581890 15644 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:05.577064 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:22:05.585132 15879 consensus_meta.cc:287] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.636s	user 0.002s	sys 0.009s
I20260709 12:22:05.525972 10934 raft_consensus.cc:2376] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16. Re-sending same reply.
I20260709 12:22:05.589519 11050 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:05.465006 15869 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:05.591869 10935 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
W20260709 12:22:05.594111 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 81785us
I20260709 12:22:05.545192 16001 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:05.576992 15887 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:05.603624 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:05.607884 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:05.613013 10974 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
W20260709 12:22:05.600548 15898 consensus_meta.cc:287] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.697s	user 0.010s	sys 0.001s
I20260709 12:22:05.616302 10901 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:05.620329 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.611307 11651 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:05.626259 10901 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:05.585632 15879 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:05.613961 15869 raft_consensus.cc:697] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:22:05.687093 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 60909.8us
W20260709 12:22:05.689090 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 280492us
I20260709 12:22:05.693466 11004 raft_consensus.cc:2393] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 15: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:05.626118 15776 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:05.638019 15898 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:05.692629 11622 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
W20260709 12:22:05.685228 15910 consensus_meta.cc:287] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.511s	user 0.003s	sys 0.006s
W20260709 12:22:05.699640 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 131831us
I20260709 12:22:05.630434 16006 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:22:05.701256 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 180113us
I20260709 12:22:05.697858 10935 raft_consensus.cc:1217] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 10.6->[11.7-15.9]   Dedup: 11.7->[13.8-15.9]
I20260709 12:22:05.703472 10935 pending_rounds.cc:85] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 7
I20260709 12:22:05.703881 10935 pending_rounds.cc:107] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:22:05.704156 10935 raft_consensus.cc:2889] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:05.704597 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 156500us
I20260709 12:22:05.687589 15995 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:05.706759 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:05.696084 15898 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:05.716945 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.703333 16001 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:05.702359 16006 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:05.714805 15222 consensus_queue.cc:1059] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:22:05.713487 15586 raft_consensus.cc:697] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:05.732200 11050 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:05.733721 10974 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:05.732122 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 203724us
I20260709 12:22:05.717895 15898 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:05.739718 11051 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:05.701295 15910 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:05.725565 16006 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:05.717492 15776 consensus_queue.cc:1059] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:22:05.725210 15708 consensus_queue.cc:1059] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:22:05.725766 15797 consensus_queue.cc:1059] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:22:05.758793 11003 raft_consensus.cc:1240] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:05.744700 16004 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:05.764462 10929 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 12:22:05.739476 16001 raft_consensus.cc:697] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
W20260709 12:22:05.766830 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.751901 16000 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:22:05.774638 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 73741.5us
I20260709 12:22:05.770079 16004 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:05.786428 10929 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:05.735452 15995 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:05.804600 11625 leader_election.cc:336] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 2.175s (SENT)
I20260709 12:22:05.775255 16000 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:22:05.811874 10977 leader_election.cc:336] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.769s (SENT)
W20260709 12:22:05.817854 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 112144us
I20260709 12:22:05.781030 16004 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:05.752126 15869 consensus_queue.cc:237] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:05.811585 15992 log.cc:927] Time spent T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:22:05.804296 15586 consensus_queue.cc:237] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:05.894302 10934 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:05.879833 11007 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
W20260709 12:22:05.840768 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 56139.9us
I20260709 12:22:05.873421 10929 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
W20260709 12:22:05.881539 16008 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:22:05.940210 11050 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:05.942938 15959 consensus_queue.cc:1059] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:22:05.943989 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 63363.9us
I20260709 12:22:05.920611 15827 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:05.945581 11050 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:05.881170 15566 raft_consensus.cc:3055] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:05.843993 15879 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:05.920867 15944 consensus_meta.cc:287] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.000s
I20260709 12:22:05.869858 15644 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:05.970623 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.946705 10933 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:22:05.813035 16000 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:05.816183 15905 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:22:05.918183 15999 log.cc:927] Time spent T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.129s	user 0.000s	sys 0.002s
I20260709 12:22:05.863999 15412 raft_consensus.cc:3055] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:05.981387 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:05.982316 10928 raft_consensus.cc:2393] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 13: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:22:05.843010 10977 leader_election.cc:336] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.810s (SENT)
I20260709 12:22:05.864281 15777 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:05.950646 10936 consensus_meta.cc:287] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.000s
I20260709 12:22:05.984131 10936 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:05.985054 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:05.918395 15887 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:05.876296 16015 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:05.809938 16005 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.137s
W20260709 12:22:05.986451 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 81014.4us
I20260709 12:22:05.986778 10936 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:05.963454 15566 raft_consensus.cc:740] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:05.946087 15908 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.001590 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:06.002372 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 262712us
I20260709 12:22:06.005600 10901 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:05.975579 15905 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:05.990442 15959 raft_consensus.cc:3055] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:05.986261 15731 raft_consensus.cc:2764] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:22:05.979272 15412 raft_consensus.cc:740] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:05.990063 16015 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:22:06.028750 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.053681 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:06.058645 15736 raft_consensus.cc:2804] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:06.059298 15908 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:05.869115 16001 consensus_queue.cc:237] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:05.976176 15944 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.016008 15959 raft_consensus.cc:740] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:06.062052 15959 consensus_queue.cc:260] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:06.064522 15882 consensus_meta.cc:287] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.597s	user 0.007s	sys 0.005s
I20260709 12:22:06.064981 15882 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.066229 11011 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15. Ops: [10.6-14.8]
I20260709 12:22:06.067219 15882 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:05.994901 15777 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:06.068279 15566 consensus_queue.cc:260] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.070137 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:06.071657 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:06.072710 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:06.074020 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:06.076050 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:06.081725 10932 raft_consensus.cc:2393] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 13: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:06.012136 15905 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:06.004061 15827 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:06.109658 15938 consensus_meta.cc:287] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.601s	user 0.009s	sys 0.001s
I20260709 12:22:06.059382 15736 raft_consensus.cc:697] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:06.024947 16015 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:06.119280 15736 consensus_queue.cc:237] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:06.130862 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 125339us
I20260709 12:22:06.125439 11655 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
W20260709 12:22:06.157078 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 148283us
I20260709 12:22:06.159893 11051 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:06.160717 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 145800us
I20260709 12:22:06.164693 15820 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:06.165280 15820 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.165673 15820 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:06.165712 15995 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:06.112301 16030 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:22:06.175841 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:06.177320 11625 leader_election.cc:336] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.516s (SENT)
I20260709 12:22:06.177821 11625 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:06.190483 11051 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:06.194036 10936 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:22:06.197896 10934 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 12:22:06.212283 10934 pending_rounds.cc:85] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 9
I20260709 12:22:06.201577 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:06.207233 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:06.184353 15959 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:06.204231 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2954) took 1411 ms. Trace:
I20260709 12:22:06.200054 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:06.219775 10927 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:22:06.189910 15566 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:06.195226 15938 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:22:06.236080 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 58800.1us
W20260709 12:22:06.249413 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 406426us
I20260709 12:22:06.250135 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:22:06.250615 10977 leader_election.cc:336] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.969s (SENT)
I20260709 12:22:06.251034 10977 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:06.217247 11083 rpcz_store.cc:276] 0709 12:22:04.786499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.846105 (+ 59606us) service_pool.cc:224] Handling call
0709 12:22:04.859917 (+ 13812us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:05.098415 (+238498us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:05.098772 (+   357us) log.cc:844] Serialized 14 byte log entry
0709 12:22:05.503297 (+404525us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:05.527174 (+ 23877us) log.cc:844] Serialized 26 byte log entry
0709 12:22:05.527333 (+   159us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:05.700521 (+173188us) log.cc:844] Serialized 14 byte log entry
0709 12:22:05.701738 (+  1217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:05.701814 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:05.878537 (+176723us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b1800352ba0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade73522 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:22:06.195456 (+316919us) raft_consensus.cc:1685] finished
0709 12:22:06.195487 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:06.197823 (+  2336us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9992,"prepare.queue_time_us":966,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":72,"raft.queue_time_us":76461,"raft.run_cpu_time_us":415,"raft.run_wall_time_us":21990,"spinlock_wait_cycles":8395648,"thread_start_us":574059,"threads_started":3,"wal-append.queue_time_us":643168}
I20260709 12:22:06.253556 15644 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:06.213379 15853 consensus_queue.cc:1059] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:22:06.254761 16005 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:06.255925 10974 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:06.256400 15908 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:06.256804 15887 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:22:06.257444 15906 consensus_meta.cc:287] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.681s	user 0.013s	sys 0.006s
I20260709 12:22:06.257881 15906 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.235441 15909 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:06.260331 15909 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:06.262873 15909 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:06.226693 16007 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:06.197382 15910 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:06.260664 15222 raft_consensus.cc:3055] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:06.246907 15944 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:06.256980 15908 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:06.256186 15879 consensus_queue.cc:1059] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
W20260709 12:22:06.262742 11651 consensus_meta.cc:287] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.571s	user 0.006s	sys 0.001s
I20260709 12:22:06.214785 10934 pending_rounds.cc:107] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:22:06.273756 15222 raft_consensus.cc:740] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:06.257346 15887 raft_consensus.cc:697] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:06.256946 10974 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:06.280869 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 90477.9us
I20260709 12:22:06.284116 10934 raft_consensus.cc:2889] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:06.284961 11051 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:06.239444 15777 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:06.308755 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 363213us
I20260709 12:22:06.272153 16030 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:06.221112 15776 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
W20260709 12:22:06.310937 16006 consensus_meta.cc:287] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.538s	user 0.000s	sys 0.009s
W20260709 12:22:06.318939 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 62128.6us
I20260709 12:22:06.317256 11653 raft_consensus.cc:1240] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:06.317718 11050 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:06.320133 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 69560.1us
I20260709 12:22:06.271255 15412 consensus_queue.cc:260] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:06.316205 15898 consensus_meta.cc:287] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.563s	user 0.009s	sys 0.000s
I20260709 12:22:06.281623 16007 raft_consensus.cc:697] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:06.281296 15906 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:06.253602 16012 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 12:22:06.334542 15222 consensus_queue.cc:260] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.335654 11051 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:06.317153 15644 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:22:06.358893 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.267835 16004 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.326572 15879 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:06.288125 11651 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:22:06.333290 15412 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:06.333531 16043 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:06.383885 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 66235.9us
I20260709 12:22:06.321123 16006 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.333578 15898 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.387125 15222 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:06.390146 10977 leader_election.cc:336] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 2.011s (SENT)
I20260709 12:22:06.364501 16045 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:06.384006 15644 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:06.393585 15909 consensus_queue.cc:1059] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:06.394058 10974 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:06.394582 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 60651.7us
I20260709 12:22:06.395609 16004 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:06.396090 10977 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:06.365350 16030 raft_consensus.cc:697] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:22:06.424355 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:06.432206 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 48086.5us
I20260709 12:22:06.376202 15910 consensus_queue.cc:1059] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:22:06.384438 15879 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:06.387617 16031 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:06.445087 11625 leader_election.cc:336] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.561s (SENT)
W20260709 12:22:06.445535 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 51580.3us
I20260709 12:22:06.365509 16015 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.449209 11050 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:06.391322 15887 consensus_queue.cc:237] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.428234 15906 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:06.435531 15836 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.435019 15708 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.463132 16057 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:06.392776 16050 consensus_queue.cc:1059] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
W20260709 12:22:06.521874 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 76829.3us
W20260709 12:22:06.523504 16049 log.cc:927] Time spent T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 12:22:06.525252 16053 log.cc:927] Time spent T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:22:06.527324 16047 log.cc:927] Time spent T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 12:22:06.528285 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 99594.2us
I20260709 12:22:06.532845 16045 raft_consensus.cc:697] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:06.534111 16045 consensus_queue.cc:237] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.536834 16061 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:06.529960 16057 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:06.503350 15906 raft_consensus.cc:697] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:06.424644 16043 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.461040 15776 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:06.558274 15776 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:06.560489 15776 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:06.562387 16051 log.cc:927] Time spent T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:22:06.453689 15879 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:06.530501 10899 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:06.575098 15222 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:22:06.575344 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 73782.4us
I20260709 12:22:06.575774 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:06.576223 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:06.576831 11083 raft_consensus.cc:2376] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16. Re-sending same reply.
I20260709 12:22:06.515700 16031 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.576261 10899 leader_election.cc:400] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13.
I20260709 12:22:06.432971 16030 consensus_queue.cc:237] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.556370 16063 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.557190 15906 consensus_queue.cc:237] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.572968 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:06.573246 16043 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:06.573849 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:06.604418 11080 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:06.574129 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:06.605358 11085 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 12: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:06.578099 11077 raft_consensus.cc:1240] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:06.436134 15905 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:06.588236 10819 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9b6c427f0a234dbab806dced4d3ba0fb with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:22:06.593633 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:06.606576 11083 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:06.438494 16007 consensus_queue.cc:237] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.496201 15836 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.520269 15708 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.612630 11082 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:06.553666 15908 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:06.613837 11076 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:06.613920 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:06.609650 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:06.616341 11084 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:06.592938 15898 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:06.617340 16058 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:06.617974 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:06.618387 10899 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:06.618578 16015 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:06.620146 15708 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:06.592262 15882 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.580330 16057 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:06.626627 15222 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.626580 11081 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:06.633239 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 91060.8us
I20260709 12:22:06.635828 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:06.641148 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.657368 15222 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:06.658181 11077 raft_consensus.cc:2410] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:22:06.614919 15910 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.661424 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:06.656925 11076 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:06.666196 15222 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:06.670969 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:06.681752 15222 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:22:06.684738 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.594424 16031 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.691522 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:06.680925 16000 consensus_meta.cc:287] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.684s	user 0.012s	sys 0.003s
I20260709 12:22:06.707158 11076 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
W20260709 12:22:06.712210 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 93912.6us
I20260709 12:22:06.659734 15882 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:06.715147 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:06.697667 16006 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:06.632673 16063 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:06.680172 15910 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.714921 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:06.724556 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:06.726434 11085 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
W20260709 12:22:06.731940 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 294597us
I20260709 12:22:06.738996 16063 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:06.739917 16015 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.740049 16041 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:06.740500 15905 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:06.740773 16041 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:06.741891 15882 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:06.743923 15910 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:06.744345 11079 raft_consensus.cc:2410] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:22:06.744673 11050 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:06.745252 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:06.745896 11079 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:22:06.746083 11050 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:06.746294 15820 consensus_meta.cc:287] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.580s	user 0.012s	sys 0.000s
I20260709 12:22:06.746816 15820 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.748564 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:06.743618 16041 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:06.749300 11079 raft_consensus.cc:2393] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 12: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:06.749822 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:06.751108 15853 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:06.753021 11655 raft_consensus.cc:1275] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:06.750125 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:06.759819 15222 consensus_queue.cc:1059] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:22:06.759145 10900 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:06.762888 11080 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:22:06.755762 11083 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
W20260709 12:22:06.763963 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.764686 11079 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 13: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:06.758509 10933 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:06.767529 11007 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:06.727512 16056 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:06.775794 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:06.774938 11082 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:06.776870 15222 consensus_queue.cc:1243] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:06.778928 10899 leader_election.cc:400] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16.
I20260709 12:22:06.711624 16000 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:06.780865 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:06.789206 11083 raft_consensus.cc:2393] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 10: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:06.789826 15222 raft_consensus.cc:3055] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:06.789728 15959 consensus_queue.cc:1048] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:06.755960 16009 raft_consensus.cc:3055] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:06.781574 11011 raft_consensus.cc:1240] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:06.782068 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:06.779791 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:06.783648 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:06.789743 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:06.781013 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:06.798774 11010 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:06.799017 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:06.784956 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:06.790302 15222 raft_consensus.cc:740] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:06.780845 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:06.790098 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:06.800899 11083 raft_consensus.cc:2393] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 15: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:06.800762 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:06.801041 11079 raft_consensus.cc:2410] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:22:06.801373 10936 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:22:06.793798 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:06.799906 11081 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:06.756793 16031 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:06.803397 11082 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:06.803877 11005 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:06.793910 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:06.784266 16041 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:06.805714 11080 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:06.806980 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:06.781013 15836 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:06.809459 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:06.811316 11083 raft_consensus.cc:2410] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:22:06.812335 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:06.814839 11007 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:22:06.815423 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:06.795419 15959 consensus_queue.cc:1243] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 0b171b6aaedc4f809f2753dcfadb14ce log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:22:06.816828 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:06.817174 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:06.818611 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 72638.9us
I20260709 12:22:06.740521 16015 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.796149 16030 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.821225 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:06.823125 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:06.823252 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:06.823439 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:06.823933 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:06.824648 15222 consensus_queue.cc:260] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.796861 16009 raft_consensus.cc:740] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:06.802827 15644 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:06.827006 11080 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:22:06.836133 11050 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:06.838919 11007 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:22:06.839498 11084 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:06.802691 16050 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:06.837172 11653 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:06.828068 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:06.831423 11081 raft_consensus.cc:1240] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:06.832093 11008 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:06.832892 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:06.849000 11009 raft_consensus.cc:2368] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15.
W20260709 12:22:06.834438 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 61379.9us
I20260709 12:22:06.834791 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:06.827275 16005 raft_consensus.cc:3055] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:06.837127 16000 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:06.837656 11082 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:22:06.839613 11002 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:06.856842 11083 pending_rounds.cc:85] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 4
I20260709 12:22:06.857146 11083 pending_rounds.cc:107] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:22:06.857380 11083 raft_consensus.cc:2889] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:06.829209 11079 raft_consensus.cc:1240] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:06.810336 16041 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:06.877375 16041 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:06.839305 11007 pending_rounds.cc:85] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 6
I20260709 12:22:06.878155 11007 pending_rounds.cc:107] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:22:06.878417 11007 raft_consensus.cc:2889] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:06.878650 11076 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:06.852977 11085 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:22:06.809392 16056 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:06.858806 15820 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:06.861249 11080 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:06.893443 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:06.893908 16056 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:06.862874 15879 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:06.863194 11650 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:06.840592 15836 consensus_queue.cc:1059] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:22:06.871748 16015 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:06.850769 16005 raft_consensus.cc:740] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:06.874607 10899 leader_election.cc:400] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13.
I20260709 12:22:06.876833 15644 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:06.886047 11084 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:06.886621 15222 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:06.888388 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 52380.9us
I20260709 12:22:06.930524 11085 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:06.932291 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:06.935024 11050 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:06.938200 11003 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15. Ops: []
W20260709 12:22:06.939024 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 124676us
I20260709 12:22:06.949700 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:06.950490 10934 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:06.951459 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:06.952718 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:06.953367 10932 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:06.952075 10934 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:22:06.840324 16030 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:06.969465 11084 raft_consensus.cc:1240] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:06.977959 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:06.978628 10934 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:22:06.926723 16000 consensus_queue.cc:1059] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:22:06.984607 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:06.981850 11080 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 12:22:06.981786 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 51367.9us
I20260709 12:22:06.982071 11051 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:07.003513 11002 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:07.007671 10928 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:22:07.003535 10974 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:06.977643 16015 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:07.009440 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:07.014510 10975 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:07.016263 16023 log.cc:927] Time spent T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.792s	user 0.003s	sys 0.000s
I20260709 12:22:07.017242 11050 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:07.018549 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:07.019204 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:07.019522 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.020973 16030 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:07.021132 15905 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:07.020985 16050 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:07.023746 15889 raft_consensus.cc:3055] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:07.024175 15889 raft_consensus.cc:740] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:07.024855 16061 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:07.019421 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 144967us
I20260709 12:22:07.026746 10899 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:07.018016 16005 consensus_queue.cc:260] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.029912 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:07.033223 10933 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:22:07.033195 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:07.035701 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 78510.7us
I20260709 12:22:07.034258 11651 pending_rounds.cc:85] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce: Aborting all ops after (but not including) 8
I20260709 12:22:07.009032 15644 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:07.037257 10932 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:07.039983 15222 consensus_queue.cc:1059] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:07.036372 11050 leader_election.cc:400] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15.
I20260709 12:22:07.044241 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:07.040843 10974 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:07.047039 10899 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:07.044225 11050 leader_election.cc:403] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:22:07.027458 16000 consensus_queue.cc:1243] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 0b171b6aaedc4f809f2753dcfadb14ce log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:22:07.032503 16015 raft_consensus.cc:697] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:07.053424 10974 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:07.056382 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:07.043758 11651 pending_rounds.cc:107] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:22:07.045187 15644 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.041252 15887 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:07.040741 16048 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:07.062546 10934 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:22:07.062471 10974 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:07.073273 15222 raft_consensus.cc:3055] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:07.073772 15222 raft_consensus.cc:740] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:06.978933 16009 consensus_queue.cc:260] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:07.054883 15959 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:07.054497 16005 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:07.089929 16041 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:07.070288 15887 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.077879 16000 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:07.059046 15708 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:22:07.092327 16000 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:07.092883 16000 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:07.094833 16057 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.058845 16039 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:22:07.097838 16009 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:07.098836 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:07.099470 11076 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:07.100327 10899 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:07.100790 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:07.058895 16059 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:07.042924 15827 consensus_queue.cc:1059] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:22:07.086782 16055 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:07.101068 16000 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:07.070392 15644 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:07.101748 15827 raft_consensus.cc:3055] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:07.102420 15827 raft_consensus.cc:740] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:07.103374 15827 consensus_queue.cc:260] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.104542 15827 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:07.104817 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:07.105435 16059 raft_consensus.cc:697] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:07.106406 16059 consensus_queue.cc:237] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.057710 16079 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:07.025012 15889 consensus_queue.cc:260] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.101776 11076 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:07.109261 10899 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:07.088336 15879 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:07.108642 15889 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:07.101975 15412 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:07.101854 16055 raft_consensus.cc:697] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:07.092207 15887 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:07.100464 16015 consensus_queue.cc:237] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.112125 16055 consensus_queue.cc:237] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:07.103498 16044 log.cc:927] Time spent T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.588s	user 0.008s	sys 0.008s
I20260709 12:22:07.115718 15222 consensus_queue.cc:260] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.116668 15995 raft_consensus.cc:3055] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:07.116952 15222 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:07.108229 16079 raft_consensus.cc:697] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:22:07.121227 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.121999 16079 consensus_queue.cc:237] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.124989 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:07.120543 16057 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:07.126227 11007 raft_consensus.cc:1240] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:07.127924 10974 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:07.128352 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:07.116931 11010 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:07.129806 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:07.130141 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:07.130599 11654 raft_consensus.cc:2393] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 17: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:07.132009 16048 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:07.134210 11079 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 12:22:07.136379 11008 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:22:07.128786 10933 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:22:07.136322 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 58616.4us
I20260709 12:22:07.128966 11077 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
W20260709 12:22:07.125958 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 691348us
I20260709 12:22:07.138859 10974 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:07.127411 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:07.151975 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:07.067646 11651 raft_consensus.cc:2889] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:07.150122 10974 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:07.148600 16000 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:07.136627 16057 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:07.173393 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:07.181716 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:07.189936 10899 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:07.191087 15222 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.161768 11051 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:07.191608 15222 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.187147 10974 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:07.192874 11076 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:07.194636 10901 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:07.196234 15222 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:07.143440 15995 raft_consensus.cc:740] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:07.198925 11011 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:07.195787 11076 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:07.204248 11003 raft_consensus.cc:1240] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:07.183537 15909 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:07.211196 10974 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:07.187697 16057 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:07.211056 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:07.217396 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.220005 10974 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:07.194767 15869 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.010s	sys 0.036s
I20260709 12:22:07.200033 15944 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:07.232897 11658 raft_consensus.cc:1240] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:07.200289 15777 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:07.229185 11076 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16. Ops: []
W20260709 12:22:07.228253 10977 connection.cc:256] RPC call timeout handler was delayed by -1.3422047440003553s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 12:22:07.240784 10977 connection.cc:256] RPC call timeout handler was delayed by -1.3233047440003247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
I20260709 12:22:07.237283 10974 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:07.244421 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.247632 16032 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:07.247946 11076 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:07.248426 16032 raft_consensus.cc:697] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:07.249492 16032 consensus_queue.cc:237] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.251152 15733 consensus_queue.cc:1059] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:07.252111 15733 raft_consensus.cc:3055] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:07.252501 15733 raft_consensus.cc:740] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:07.253378 15733 consensus_queue.cc:260] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.254604 15733 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:07.255923 15959 consensus_queue.cc:1059] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:07.256397 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:07.249315 11076 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 12:22:07.251957 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.225183 16000 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:22:07.232043 15869 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.011s	sys 0.036s
I20260709 12:22:07.224563 16057 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:07.207614 15708 consensus_queue.cc:1059] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:22:07.223475 15909 raft_consensus.cc:697] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:07.234665 15910 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:07.284453 10974 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:07.286643 10974 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:07.241549 16041 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:07.289918 10932 raft_consensus.cc:1240] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:07.243826 15944 raft_consensus.cc:697] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:07.257931 15938 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:07.293094 11078 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: []
W20260709 12:22:07.309744 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 80721.2us
I20260709 12:22:07.294692 11656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59414 (request call id 335) took 1269 ms. Trace:
I20260709 12:22:07.295281 16072 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:07.292024 15898 raft_consensus.cc:3055] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:07.300534 16071 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:07.301381 16059 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:07.320910 16059 raft_consensus.cc:697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:07.301973 15412 raft_consensus.cc:3055] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:07.299397 16100 consensus_queue.cc:1059] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
W20260709 12:22:07.317734 11625 leader_election.cc:336] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.962s (SENT)
I20260709 12:22:07.317958 15644 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.314389 15898 raft_consensus.cc:740] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:07.292248 15995 consensus_queue.cc:260] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.319380 16072 raft_consensus.cc:697] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:07.320114 16071 raft_consensus.cc:697] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:07.323915 11009 raft_consensus.cc:2410] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:22:07.326560 11652 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:22:07.325094 16059 consensus_queue.cc:237] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:07.331805 15909 consensus_queue.cc:237] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.292157 15910 raft_consensus.cc:697] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:22:07.336350 16085 log.cc:927] Time spent T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.302s	user 0.004s	sys 0.000s
I20260709 12:22:07.289345 16055 consensus_queue.cc:1059] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 12:22:07.380939 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 56370.1us
W20260709 12:22:07.399060 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 81398us
I20260709 12:22:07.321738 15938 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:07.310454 11656 rpcz_store.cc:276] 0709 12:22:05.933655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.966243 (+ 32588us) service_pool.cc:224] Handling call
0709 12:22:05.966601 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:06.000640 (+ 34039us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:22:06.013733 (+ 13093us) log.cc:844] Serialized 14 byte log entry
0709 12:22:06.334386 (+320653us) log.cc:844] Serialized 14 byte log entry
0709 12:22:06.755358 (+420972us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b180035d100. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade73522 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:22:07.102814 (+347456us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:22:07.118285 (+ 15471us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b180035d100. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9baddedc0a 00007f9bb752d219 00007f9bade75a40 00007f9bade704e4 00007f9bade70455 00007f9bb0f58060 00007f9bb0f6a716 00007f9bb0f7b287 00007f9bb0f7b208
0709 12:22:07.202661 (+ 84376us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:07.202716 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:07.202761 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:07.202822 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:07.202941 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":404542,"prepare.queue_time_us":72447,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":788686,"raft.run_cpu_time_us":10243,"raft.run_wall_time_us":54719,"spinlock_wait_cycles":263085184,"thread_start_us":401006,"threads_started":2,"wal-append.queue_time_us":434930}
W20260709 12:22:07.402858 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.336397 15644 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:07.419139 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 156798us
I20260709 12:22:07.323045 15412 raft_consensus.cc:740] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:22:07.423271 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 98996.9us
W20260709 12:22:07.393901 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.500361 10899 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:07.422945 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 135364us
I20260709 12:22:07.486804 11081 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:22:07.516835 10977 connection.cc:256] RPC call timeout handler was delayed by -1.2324047440001777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
I20260709 12:22:07.484740 10900 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:07.521569 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 359833us
W20260709 12:22:07.518962 11625 leader_election.cc:336] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.500s (SENT)
I20260709 12:22:07.522929 11051 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:07.535969 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:07.526046 10977 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.744s (SENT) [suppressed 52 similar messages]
I20260709 12:22:07.422271 16000 raft_consensus.cc:697] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:07.443686 15995 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:07.488242 16098 raft_consensus.cc:3055] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:07.438496 16075 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:07.569175 16075 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:07.569618 16075 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:07.574615 16050 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15.
I20260709 12:22:07.576149 16000 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.581004 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3063) took 1008 ms. Trace:
I20260709 12:22:07.448060 15898 consensus_queue.cc:260] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.581979 15898 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:07.584072 15906 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:22:07.584327 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 564408us
W20260709 12:22:07.584843 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:07.584892 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 62030.1us
I20260709 12:22:07.560415 16114 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:22:07.586871 15906 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.587301 15906 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:07.587625 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:07.588246 11084 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:07.582163 16058 raft_consensus.cc:3055] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:07.589664 16058 raft_consensus.cc:740] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:07.586580 11051 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:07.591709 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:07.592061 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:07.593799 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.537974 16063 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:07.481503 16057 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:07.538093 15794 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:07.614138 15794 raft_consensus.cc:697] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:07.615131 15794 consensus_queue.cc:237] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:07.530222 15853 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.616441 15853 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:07.605335 15908 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:22:07.619417 15853 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:07.451642 16071 consensus_queue.cc:237] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.449421 16072 consensus_queue.cc:237] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:07.605139 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 104868us
I20260709 12:22:07.632400 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:07.591709 11051 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:07.581427 11078 rpcz_store.cc:276] 0709 12:22:06.572734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:06.573661 (+   927us) service_pool.cc:224] Handling call
0709 12:22:06.573981 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:07.309965 (+735984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:07.580768 (+270803us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b540030edd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:07.580940 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342441856}
I20260709 12:22:07.636200 10899 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:07.597565 10977 leader_election.cc:336] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 2.112s (SENT)
I20260709 12:22:07.505946  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:07.532083 16032 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:07.608520 11084 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:07.540355 16100 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:07.456210 15887 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:07.497072 15910 consensus_queue.cc:237] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.593442 15644 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:22:07.562368 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.537258 15889 consensus_queue.cc:1059] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:22:07.619299 15827 raft_consensus.cc:3055] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:07.646481 10899 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:07.651456 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.609098 16063 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:07.562150 16108 consensus_queue.cc:1059] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
W20260709 12:22:07.642560 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 50921.4us
I20260709 12:22:07.659261 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:07.659685 10977 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:07.666205 16063 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:07.668624 15889 raft_consensus.cc:3055] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:07.669047 15889 raft_consensus.cc:740] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:07.669839 15889 consensus_queue.cc:260] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.671041 15889 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:07.661155 16100 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:07.673662 16057 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:07.674695 16100 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:07.662866 15827 raft_consensus.cc:740] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:07.677060 15827 consensus_queue.cc:260] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.678231 15827 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:07.444015 15944 consensus_queue.cc:237] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.662770 15708 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:07.682075 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:07.644289 15869 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:22:07.690527 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 44211.4us
I20260709 12:22:07.691301 10899 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:07.658403 15853 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:07.712836 11002 raft_consensus.cc:2368] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 17. Current term is 18.
I20260709 12:22:07.565649 16098 raft_consensus.cc:740] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:07.697300 11051 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:07.721695 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:07.722313 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.681028 15906 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.684543 15644 raft_consensus.cc:697] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:07.737952 15881 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:07.725805 15853 raft_consensus.cc:697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:07.738579 16098 consensus_queue.cc:260] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:07.736263 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:07.749069 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:07.749636 10832 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 114) took 13503 ms (client timeout 15000 ms). Trace:
I20260709 12:22:07.713414 16059 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:07.751605 10928 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:07.753623 10932 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:07.756325 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:07.758345 10927 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:22:07.724856 16048 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:22:07.752878 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 190372us
I20260709 12:22:07.760537 11078 raft_consensus.cc:1240] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:07.760867 10899 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:07.660533 15412 consensus_queue.cc:260] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.762539 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:07.764205 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:07.765619 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:07.769256 11010 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:07.770120 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:07.772163 11005 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 14: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:07.772603 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:07.772845 10933 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:22:07.713202 15820 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:22:07.752117 16050 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:07.777197 16050 raft_consensus.cc:697] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:07.768569 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:07.778138 16050 consensus_queue.cc:237] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:07.752466 10832 rpcz_store.cc:269] 0709 12:21:54.317404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.356589 (+ 39185us) service_pool.cc:224] Handling call
0709 12:21:55.347493 (+990904us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b5400096d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0eca090 00007f9bb0f68f3a 00007f9bb6d1ee9c 00007f9bb6e1d04e 00007f9bb52de2a4 00007f9bb52de232 00007f9bb52de161 00007f9bb52de0dc 00007f9bb52dd392 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:07.739800 (+12392307us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:05.707341 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:05.862968 (+155627us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:05.863024 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:22:05.863043 (+    19us) tablet.cc:662] Decoding operations
0709 12:22:05.970058 (+107015us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:05.990734 (+ 20676us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:05.995474 (+  4740us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:22:06.110410 (+114936us) tablet.cc:701] Row locks acquired
0709 12:22:06.110465 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:22:06.110664 (+   199us) write_op.cc:270] Start()
0709 12:22:06.110834 (+   170us) write_op.cc:276] Timestamp: P: 1783599726110588 usec, L: 0
0709 12:22:06.110864 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:22:06.111693 (+   829us) log.cc:844] Serialized 2810 byte log entry
0709 12:22:06.753493 (+641800us) op_driver.cc:464] REPLICATION: finished
0709 12:22:06.837473 (+ 83980us) write_op.cc:301] APPLY: starting
0709 12:22:06.837590 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:06.867420 (+ 29830us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:06.867557 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:06.892973 (+ 25416us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:06.971467 (+ 78494us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 12:22:06.977508 (+  6041us) write_op.cc:312] APPLY: finished
0709 12:22:07.012353 (+ 34845us) log.cc:844] Serialized 73 byte log entry
0709 12:22:07.034460 (+ 22107us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:07.037198 (+  2738us) write_op.cc:454] Released schema lock
0709 12:22:07.040297 (+  3099us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:07.073370 (+ 33073us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:07.077728 (+  4358us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":432956,"reported_tablets":16,"spinlock_wait_cycles":57753216,"child_traces":[["op",{"apply.queue_time_us":83690,"apply.run_cpu_time_us":11499,"apply.run_wall_time_us":219434,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33345,"num_ops":7,"prepare.queue_time_us":512058,"prepare.run_cpu_time_us":19483,"prepare.run_wall_time_us":546389,"raft.queue_time_us":184478,"raft.run_cpu_time_us":5902,"raft.run_wall_time_us":75104,"replication_time_us":613872,"thread_start_us":434693,"threads_started":4,"wal-append.queue_time_us":207630}]]}
I20260709 12:22:07.781476 15853 consensus_queue.cc:237] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.786164 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:07.786427 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:07.788568 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:07.747543 16063 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.789366 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:07.790787 16063 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:07.791015 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:07.792728 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:22:07.792943 10977 leader_election.cc:336] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 2.161s (SENT)
I20260709 12:22:07.793454 11011 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 12: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:07.793375 10977 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:07.795043 10977 leader_election.cc:336] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 2.186s (SENT)
I20260709 12:22:07.795251 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:07.747718 16057 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.797560 16057 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:07.800333 16105 log.cc:927] Time spent T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 12:22:07.801184 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:07.801612 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:07.804844 16116 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:22:07.806952 11081 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:07.748229 16032 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:07.813464 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.815878 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:07.822154 10932 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:07.799693 16057 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:07.826839 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:07.832420 11007 raft_consensus.cc:1275] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:22:07.838946 10977 connection.cc:256] RPC call timeout handler was delayed by -1.0596103850002692s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 12:22:07.839376 10977 connection.cc:256] RPC call timeout handler was delayed by -1.0173047440002847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
I20260709 12:22:07.840027 15644 consensus_queue.cc:237] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:07.841596 16123 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.841902 15938 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:07.843416 16005 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:07.844467 16108 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:07.848062 16123 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:07.848592 15887 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:07.850128 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:07.850821 11650 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:07.851509 15887 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:07.855614 16098 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:07.860256 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:07.860886 15906 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:07.816193 15879 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:07.911204 15794 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:22:07.911094 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 150287us
I20260709 12:22:07.915470 10899 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:07.919227 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:07.850940 16123 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:07.924584 10977 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:07.918345 16048 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:07.934273 10899 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:07.935339 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:07.936074 11007 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:22:07.945380 10899 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:07.932862 16123 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:07.959034 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:07.946174 15836 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:07.963581 11007 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 13: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:07.953100 11650 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:07.966663 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:07.967092 16120 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.268s	user 0.003s	sys 0.000s
I20260709 12:22:07.968688 10975 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:07.984555 10899 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:22:07.984951 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.985798 10899 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:07.987160 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:07.943457 16059 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:22:07.964298 11003 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:22:07.995522 10931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:22:07.960976 15869 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:08.011157 10931 raft_consensus.cc:606] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:08.011364 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2385) took 1204 ms. Trace:
I20260709 12:22:07.988488 15995 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:07.988081 15879 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:08.011686 10931 raft_consensus.cc:614] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:07.990026 15708 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.990209 16032 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.998878 16048 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:08.014017 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:08.011852 10935 rpcz_store.cc:276] 0709 12:22:06.799067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:06.800136 (+  1069us) service_pool.cc:224] Handling call
0709 12:22:06.818555 (+ 18419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:06.851088 (+ 32533us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:22:07.482714 (+631626us) log.cc:844] Serialized 14 byte log entry
0709 12:22:07.897771 (+415057us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b18004656a0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9baddedc0a 00007f9bb752d219 00007f9bade75a40 00007f9bade704e4 00007f9bade70455 00007f9bb0f58060 00007f9bb0f6a716 00007f9bb0f7b287 00007f9bb0f7b208
0709 12:22:07.996719 (+ 98948us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:07.996781 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:08.003267 (+  6486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:08.003346 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:08.003474 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":644774,"prepare.queue_time_us":631925,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":178174,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":10664,"spinlock_wait_cycles":31423104,"thread_start_us":337246,"threads_started":2,"wal-append.queue_time_us":215304}
I20260709 12:22:07.963194 16075 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:08.004629 15869 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:08.025555 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:08.028884 11007 raft_consensus.cc:2393] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 12: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:08.030647 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:08.031400 11005 raft_consensus.cc:2393] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 10: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:08.033763 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:07.997217 16072 consensus_queue.cc:1059] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:22:08.042068 11081 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:22:08.029386 15869 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:08.044003 11085 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:08.046054 16075 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:08.048359 16128 log.cc:927] Time spent T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:22:08.049942 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:08.050251 16127 log.cc:927] Time spent T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:22:08.050769 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:22:08.051681 16121 log.cc:927] Time spent T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:22:08.027829 16032 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:08.051993 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:08.053087 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:08.054425 11006 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:22:08.054826 15794 consensus_queue.cc:1059] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:08.055653 15794 consensus_queue.cc:1059] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:22:08.057971 16119 log.cc:927] Time spent T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.360s	user 0.002s	sys 0.000s
I20260709 12:22:08.058744 16048 raft_consensus.cc:3055] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:08.059141 16048 raft_consensus.cc:740] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:08.061035 15836 raft_consensus.cc:3055] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:08.061450 15836 raft_consensus.cc:740] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:08.019098 15910 consensus_queue.cc:1059] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:22:08.063045 11002 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:08.064623 11078 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:08.026461 15708 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:08.067456 15708 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:08.068809 16125 log.cc:927] Time spent T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.207s	user 0.001s	sys 0.001s
I20260709 12:22:08.070441 10931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07467552f78d410bb9e5774f3340f134"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:22:08.071049 10931 raft_consensus.cc:606] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:08.071498 10931 raft_consensus.cc:614] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:08.026676 15879 raft_consensus.cc:697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:08.073297 15879 consensus_queue.cc:237] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:08.075667 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 61729.1us
I20260709 12:22:08.076189 15910 raft_consensus.cc:3055] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:08.076658 15910 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:08.077585 15910 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:08.078795 16122 log.cc:927] Time spent T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:22:08.084399 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 56633.1us
I20260709 12:22:08.085779 11011 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:08.087308 11011 raft_consensus.cc:3055] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:08.087790 11011 raft_consensus.cc:740] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:08.029821 15959 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:08.091266 11008 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:22:08.035401 15995 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:08.096520 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:08.078809 15910 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:08.101922 10974 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:08.101336 11011 consensus_queue.cc:260] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:08.105365 11011 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:08.106226 16059 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:08.102927 15938 consensus_queue.cc:1059] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:22:08.108640 15938 raft_consensus.cc:3055] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:08.109045 15938 raft_consensus.cc:740] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:08.109889 15938 consensus_queue.cc:260] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:08.110428 10974 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:08.111060 16039 consensus_queue.cc:1048] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:08.102496 16098 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:22:08.115322 16058 consensus_queue.cc:260] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:08.116496 16058 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:08.116719 15827 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:08.116838 15938 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:08.118656 15827 raft_consensus.cc:697] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:08.102895 15881 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:22:08.125763 15827 consensus_queue.cc:237] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:08.129756 11002 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:08.130821 10931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:22:08.112198 16057 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:22:08.136591 16134 log.cc:927] Time spent T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:22:08.153201 10931 raft_consensus.cc:606] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:08.153764 10931 raft_consensus.cc:614] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:08.141247 11009 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
W20260709 12:22:08.159425 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.143162 10974 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:08.160128 10927 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:08.160609 10929 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:22:08.141642 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.150156 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:08.141736 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 108321us
I20260709 12:22:08.163240 10932 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:08.176828 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:08.177634 11011 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:08.180999 11002 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:22:08.181414 11002 pending_rounds.cc:85] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 7
I20260709 12:22:08.181620 11002 pending_rounds.cc:107] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:22:08.181852 11002 raft_consensus.cc:2889] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:08.186784 11003 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:08.189513 10930 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:08.193423 11050 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:08.194721 11050 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:08.195485 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:08.196342 11083 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:08.199718 10932 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:08.200373 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:08.223542 16141 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:08.225756 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:08.227293 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:08.228228 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:08.228880 10929 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 11.
I20260709 12:22:08.230118 10927 raft_consensus.cc:1240] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:08.231212 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:08.233234 10934 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:22:08.239172 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:08.242983 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:08.253347 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:08.254927 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:08.175879 15889 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:08.174055 16039 consensus_queue.cc:1059] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 12:22:08.266618 10977 leader_election.cc:336] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.809s (SENT)
I20260709 12:22:08.266990 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:08.275338 11082 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:08.268785 10931 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 12.
W20260709 12:22:08.278754 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:08.264678 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 70030.3us
I20260709 12:22:08.282704 11050 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:08.273974 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:08.283625 11080 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:22:08.279793 10974 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:08.174265 15881 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 12:22:08.187829 16059 consensus_queue.cc:1059] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
W20260709 12:22:08.297164 16117 log.cc:927] Time spent T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.436s	user 0.002s	sys 0.000s
I20260709 12:22:08.299520 10974 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:08.300243 15887 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:08.333895 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:08.334587 11003 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:08.304219 15853 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:08.304551 11050 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:08.308002 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.310478 11002 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:22:08.312243 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:08.340911 11011 raft_consensus.cc:2410] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:22:08.318691 11078 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:08.216917 15644 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:08.320699 15898 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.353139 15898 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:08.320880 16137 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.354302 16137 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:08.355192 15898 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:08.339233 16009 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:22:08.355870 16002 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:08.288158 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:08.358142 11076 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:08.358814 11078 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:22:08.359577 10901 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:08.325250 10930 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:08.330559 11051 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:08.333010 11082 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:08.336477 10927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:22:08.337153 10931 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:08.333763 15887 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:08.320250 15959 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:08.343447 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 44020.8us
I20260709 12:22:08.213807 16114 consensus_queue.cc:1059] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.110s
I20260709 12:22:08.269488 16129 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:08.343757 10934 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 11.
I20260709 12:22:08.344738 11050 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:08.348213 11085 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 12:22:08.347663 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 128469us
I20260709 12:22:08.350334 11650 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:08.353798 16032 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:08.363034 11080 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:08.364861 15222 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:08.476570 15222 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:08.476935 15222 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:08.366295 11051 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:08.347643 15820 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:08.372318 10974 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:08.368157 15887 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:08.356323 16137 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:08.470436 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 125786us
I20260709 12:22:08.367007 16005 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:08.347733 15869 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:08.489006 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 116761us
I20260709 12:22:08.495086 11050 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:08.499116 11076 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:08.484977 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:08.505502 16138 log.cc:927] Time spent T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:22:08.475329 16050 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:08.507427 16129 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:08.375669 16057 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.117s
I20260709 12:22:08.501215 15879 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:08.574126 15820 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:08.373301 15959 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:08.578140 10927 raft_consensus.cc:606] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:08.578500 10927 raft_consensus.cc:614] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:08.579131 10935 raft_consensus.cc:2393] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 15: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:08.579587 15959 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:08.370043 15853 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.120s
W20260709 12:22:08.561000 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.502980 16141 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:08.565361 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 70347.6us
I20260709 12:22:08.572484 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:08.573223 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 65634us
W20260709 12:22:08.564637 16145 log.cc:927] Time spent T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.056s	user 0.001s	sys 0.006s
I20260709 12:22:08.585911 15222 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:08.557431 16032 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.478097 16009 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:22:08.591313 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:08.573601 16144 log.cc:927] Time spent T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.201s	user 0.003s	sys 0.000s
I20260709 12:22:08.517159 15736 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.594601 11050 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:08.600701 11007 raft_consensus.cc:2410] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:22:08.608036 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:08.608459 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:08.626657 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.577963 15869 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:08.576893 15879 raft_consensus.cc:697] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:08.634400 10934 raft_consensus.cc:2393] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 15: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:08.639263 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:08.655398 10931 raft_consensus.cc:2368] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15.
I20260709 12:22:08.574333 15827 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:22:08.638384 15222 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:08.642917 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:08.645324 10929 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 13: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:08.667313 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:08.648947 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 54432.4us
I20260709 12:22:08.624285 15898 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.665343 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:08.669902 11050 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:08.595412 16129 raft_consensus.cc:697] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:08.671626 11076 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:08.673152 11081 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:22:08.676452 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:08.634202 16041 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.681241 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:08.681443 16136 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:22:08.681828 11003 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:08.686051 16150 log.cc:927] Time spent T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
W20260709 12:22:08.685283 16142 log.cc:927] Time spent T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 12:22:08.686714 16059 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:08.655128 15820 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.688191 15820 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:08.688978 10929 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:22:08.689879 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:08.690260 15820 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:08.690529 10929 raft_consensus.cc:2368] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14.
I20260709 12:22:08.690833 15820 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:08.691641 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:08.624281 16002 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:08.675730 11050 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:08.599980 16137 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 12:22:08.645125 15794 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.697268 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:08.645890 15736 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:08.704698 15736 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:08.705662 15794 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:08.706113 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:08.707008 10936 raft_consensus.cc:2410] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:22:08.707768 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:08.707808 15794 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:08.708046 15820 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:08.708648 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:08.709626 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 343266us
I20260709 12:22:08.713876 15836 consensus_queue.cc:260] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:08.715140 10936 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:22:08.716442 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:08.717213 10936 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 12: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:08.718124 15995 raft_consensus.cc:3055] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:08.718595 15995 raft_consensus.cc:740] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:08.718247 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:08.719188 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:08.720062 10933 raft_consensus.cc:2393] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 12: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:08.719514 15995 consensus_queue.cc:260] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:08.720927 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:08.721519 15995 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:08.722010 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:08.724058 10933 raft_consensus.cc:2410] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:22:08.724923 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:08.732244 10933 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:08.734537 11625 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:08.734355 15820 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:08.733351 10936 raft_consensus.cc:2410] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:22:08.667109 16050 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:08.699751 11050 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:08.734788 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:08.746852 11051 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:08.715037 15836 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:08.748744 11083 raft_consensus.cc:1217] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 7.9->[9.10-9.10]   Dedup: 9.10->[]
I20260709 12:22:08.748914 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:08.788282 11083 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 12:22:08.749501 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 49856us
I20260709 12:22:08.790423 11050 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:08.629747 16032 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:08.738442 16098 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:08.758823 11078 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:22:08.665151 16072 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 12:22:08.767128 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:08.767843 11003 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:08.796192 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:08.769711 16158 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:08.770444 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3097) took 1044 ms. Trace:
W20260709 12:22:08.774318 10977 leader_election.cc:336] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.621s (SENT)
I20260709 12:22:08.748970 15908 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:22:08.799429 10977 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:08.744956 15898 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:08.749174 15995 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:08.757239 16145 log.cc:927] Time spent T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:22:08.681176 16041 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:08.795126 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 48358.2us
I20260709 12:22:08.798295 11011 raft_consensus.cc:1240] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:08.803108 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:08.801091 11050 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:08.750639 15820 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:22:08.801925 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:08.821244 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.799242 11077 rpcz_store.cc:276] 0709 12:22:07.726257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.726409 (+   152us) service_pool.cc:224] Handling call
0709 12:22:07.726746 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:07.744667 (+ 17921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:07.744695 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:07.755134 (+ 10439us) log.cc:844] Serialized 26 byte log entry
0709 12:22:08.376474 (+621340us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b18002c3080. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b 00007f9bb0affd23 00007f9bb0b000d1 00007f9bb0f1ba0f
0709 12:22:08.647641 (+271167us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:08.647684 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:08.647751 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:08.770160 (+122409us) raft_consensus.cc:1685] finished
0709 12:22:08.770181 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:08.770369 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5101,"raft.queue_time_us":35926,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":6041,"spinlock_wait_cycles":48486656,"thread_start_us":176404,"threads_started":1,"wal-append.queue_time_us":978976}
I20260709 12:22:08.821769 10933 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:08.787261 15644 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:08.826725 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:08.827545 10936 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 13: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:08.802207 15853 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:22:08.832361 16146 log.cc:927] Time spent T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:22:08.830641 10932 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:22:08.832338 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:08.833037 16159 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:08.799187 16158 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:08.817832 16058 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:08.835793 10929 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:08.863833 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:08.736455 16002 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:08.840381 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:08.848223 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 73924us
I20260709 12:22:08.864714 10932 raft_consensus.cc:2410] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 12:22:08.865029 10977 leader_election.cc:336] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.673s (SENT)
I20260709 12:22:08.865455 10977 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:08.606323 16141 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:08.833570 15820 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:22:08.866118 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:08.796988 15879 consensus_queue.cc:237] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:08.685293 16129 consensus_queue.cc:237] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:08.833683 16048 consensus_queue.cc:260] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:08.848862 15644 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:08.816785 16032 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:08.872963 15412 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:08.877231 16002 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:08.828440 16165 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:08.866680 15910 consensus_meta.cc:287] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.753s	user 0.005s	sys 0.007s
I20260709 12:22:08.862772 16159 raft_consensus.cc:697] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:08.866852 10928 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:22:08.866408 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:08.867966 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:08.886466 10936 raft_consensus.cc:2376] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18. Re-sending same reply.
I20260709 12:22:08.886648 10932 raft_consensus.cc:2393] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 15: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:08.869194 16057 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:08.871083 10931 raft_consensus.cc:2376] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14. Re-sending same reply.
I20260709 12:22:08.868690 16158 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:08.824612 15995 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:08.883502 16048 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:08.891919 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:08.908032 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 81658.1us
W20260709 12:22:08.908274 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 84457.6us
I20260709 12:22:08.937453 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:08.892373 15944 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
W20260709 12:22:08.942996 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.949508 10932 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:22:08.949923 10932 pending_rounds.cc:85] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 7
I20260709 12:22:08.950145 10932 pending_rounds.cc:107] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:22:08.950364 10932 raft_consensus.cc:2889] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:08.957741 16166 log.cc:927] Time spent T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:22:08.962041 10977 leader_election.cc:400] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15.
I20260709 12:22:08.962371 10977 leader_election.cc:403] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:22:08.964414 11010 raft_consensus.cc:1240] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:08.972676 10977 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:08.976161 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2489) took 1177 ms. Trace:
I20260709 12:22:08.976608 11009 rpcz_store.cc:276] 0709 12:22:07.787874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.789065 (+  1191us) service_pool.cc:224] Handling call
0709 12:22:08.964708 (+1175643us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b540029c2d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:08.964815 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":756130688}
I20260709 12:22:08.982124 15853 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:08.985548 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:08.986286 11084 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:08.986891 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:08.987587 11082 raft_consensus.cc:2393] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 10: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:08.988124 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:08.988597 11082 raft_consensus.cc:1240] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:08.989559 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:08.989662 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:08.990190 10936 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:08.992887 10977 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:08.994233 10977 leader_election.cc:400] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14.
I20260709 12:22:08.983465 15853 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:08.986519 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:09.000943 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:09.002316 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:09.002945 11085 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 9.
I20260709 12:22:09.003739 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:09.003213 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.000311 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:08.952214 16108 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:22:08.978722 16171 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.009693 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:09.005594 11082 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:22:08.984347 16072 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:09.027341 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:09.027791 11078 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:08.980340 15827 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15.
I20260709 12:22:08.984089 16143 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:09.056270 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:08.998193 15944 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:09.066253 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:09.079414 11078 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:09.057164 11079 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:09.073945 11082 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:08.991508 16067 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:22:08.984707 15887 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:09.075090 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 65904.5us
I20260709 12:22:09.088291 10977 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:09.028254 11085 raft_consensus.cc:2393] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 15: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:09.058036 11076 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:22:09.083107 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:09.096415 16173 log.cc:927] Time spent T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:22:09.062390 16143 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:09.101466 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.101600 10901 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:09.102351 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:09.102839 16039 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.103313 16039 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:09.081324 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:09.045583 16171 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:09.104450 11078 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:09.105597 11078 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:09.106027 16171 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:09.106441 16165 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:09.103946 15836 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:09.107925 15836 raft_consensus.cc:697] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:09.108824 15836 consensus_queue.cc:237] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:09.109933 11084 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
W20260709 12:22:09.101995 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.118532 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:09.119196 11011 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:22:09.077847 15944 raft_consensus.cc:697] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:08.984165 16159 consensus_queue.cc:237] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:09.123528 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:09.127732 11085 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:09.128961 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:09.153815 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 198268us
W20260709 12:22:09.184476 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 96260.4us
W20260709 12:22:09.185987 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 74655.7us
I20260709 12:22:09.194813 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:09.195595 11011 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 16: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:09.196633 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:09.202992 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:09.204396 16005 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:09.193526 16160 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:09.205664 16160 raft_consensus.cc:697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:09.206519 16160 consensus_queue.cc:237] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:09.194299 10977 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:09.212110 10934 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:09.213923 10927 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:09.216403 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:09.225613 10927 raft_consensus.cc:2376] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9. Re-sending same reply.
I20260709 12:22:09.227298 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:09.229933 10927 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:09.228819 10901 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:09.187330 15995 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:09.213892 15869 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:09.273358 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 294009us
I20260709 12:22:09.230674 16057 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:09.201262 16108 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:22:09.236757 16164 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:09.292073 11050 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:09.302574 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:09.303941 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 116987us
I20260709 12:22:09.319741 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:09.303701 10927 raft_consensus.cc:2410] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 16 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:22:09.321362 10927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:22:09.321983 10927 raft_consensus.cc:606] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:09.296000 16067 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:22:09.295645 16169 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:22:09.270915 15869 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:09.340214  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:09.342346 16158 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:09.346145 16158 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:09.318773 15908 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:09.348671 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:09.361941 10932 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:09.342294  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:09.299135 16164 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.316324 11050 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:09.371565 16175 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:09.372251 16175 raft_consensus.cc:697] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:09.373198 16175 consensus_queue.cc:237] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:09.378396 15908 raft_consensus.cc:697] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:09.380584 15908 consensus_queue.cc:237] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:09.386870 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 70641.4us
I20260709 12:22:09.390441 15887 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:09.390787 15938 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.391304 15938 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:09.396399 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:09.397027 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:09.397666 11085 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:09.399693 11011 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:09.352408 15995 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:22:09.364346 16164 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:09.403648 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:09.413686 15777 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.414206 15777 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:09.418431 11085 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:09.412904 10932 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:22:09.420114 10974 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:09.420197 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:09.302835 15944 consensus_queue.cc:237] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:09.424643 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:09.453279 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:09.471601 11009 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15. Ops: []
W20260709 12:22:09.480659 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:09.518932 10930 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.006s	sys 0.024s
W20260709 12:22:09.520268 10930 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.006s	sys 0.024s
W20260709 12:22:09.522123 11624 leader_election.cc:336] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 2.015s (SENT)
I20260709 12:22:09.555271 11624 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:09.424446 16048 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:09.431478 16071 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:09.431836 15412 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:09.457086 15959 consensus_queue.cc:1059] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 12:22:09.567409 10936 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:22:09.516237 16123 raft_consensus.cc:3055] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:09.569820 11003 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 13. Current term is 14. Ops: []
W20260709 12:22:09.574182 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 334353us
I20260709 12:22:09.573351 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 2411) took 1418 ms. Trace:
I20260709 12:22:09.574849 10935 rpcz_store.cc:276] 0709 12:22:08.149153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.149319 (+   166us) service_pool.cc:224] Handling call
0709 12:22:09.567029 (+1417710us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b5400169754. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:09.567186 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":923363072}
W20260709 12:22:09.575773 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 381513us
I20260709 12:22:09.578246 10977 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:09.572605 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 326642us
W20260709 12:22:09.572784 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 50691.8us
W20260709 12:22:09.589021 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.519304 15938 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:09.562704 15777 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:09.600160 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:09.573478 16123 raft_consensus.cc:740] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:09.611707 10935 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:22:09.590907 16071 raft_consensus.cc:697] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:09.573046 15412 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:09.600900 15959 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.573604 16048 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:09.658329 11658 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:22:09.598011 15708 consensus_queue.cc:1059] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:22:09.607126 16184 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:09.615635 15836 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:09.704668 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 126467us
W20260709 12:22:09.706336 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 280840us
I20260709 12:22:09.707089 10977 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:09.662344 16123 consensus_queue.cc:260] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:09.663105 15959 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:09.663872 16071 consensus_queue.cc:237] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:09.656931 16009 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:09.666580 16048 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:09.656190 10935 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:22:09.693764 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.654044 15879 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:09.707135 10899 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:09.664819 11005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2505) took 1618 ms. Trace:
I20260709 12:22:09.750043 10899 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:09.751649 10899 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:09.746094 11005 rpcz_store.cc:276] 0709 12:22:08.046856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.049664 (+  2808us) service_pool.cc:224] Handling call
0709 12:22:09.664622 (+1614958us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b5400470754. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:09.664758 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":950383360}
W20260709 12:22:09.773237 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 195844us
I20260709 12:22:09.712035 16059 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:09.775347 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 2863) took 1148 ms. Trace:
I20260709 12:22:09.783583 16184 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:09.775777 10934 rpcz_store.cc:276] 0709 12:22:08.626922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.665086 (+ 38164us) service_pool.cc:224] Handling call
0709 12:22:09.775194 (+1110108us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b540017b6d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:09.775292 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":986746240}
W20260709 12:22:09.786137 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 79103.3us
I20260709 12:22:09.753890 16123 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:09.748890 15708 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.753301 16009 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:09.797930 10934 raft_consensus.cc:1240] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:22:09.712493 15777 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:09.798579 10977 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:09.711548 16190 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.082s
I20260709 12:22:09.804237 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:09.772343 16067 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.772902 16179 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:09.873703 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.874701 16214 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:09.875258 16214 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:09.875594 15898 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:09.876185 15898 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:09.876811 15898 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.877279 15898 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:09.877872 16214 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:09.879273 15898 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:09.883391 10931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 2856) took 1273 ms. Trace:
I20260709 12:22:09.886328 10932 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:22:09.771333 16072 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.710899 15836 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:09.794648 16048 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:09.797695 16177 log.cc:927] Time spent T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 12:22:09.849674 10935 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:09.801247 16165 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:09.842051 11050 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:09.863692 10934 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:09.866113 11049 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:09.866510 16212 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:22:09.919564 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 53539.8us
I20260709 12:22:09.866385 16041 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:09.858003 16180 log.cc:927] Time spent T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:22:09.883790 10931 rpcz_store.cc:276] 0709 12:22:08.610069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.708416 (+ 98347us) service_pool.cc:224] Handling call
0709 12:22:09.883187 (+1174771us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54002049d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:09.883309 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368788736}
W20260709 12:22:09.909917 16187 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
I20260709 12:22:09.864600 15777 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:09.809811 15708 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:09.948252 10934 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 12:22:09.947050 16216 log.cc:927] Time spent T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:22:09.859167 16000 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:09.876767 16199 log.cc:927] Time spent T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:22:09.953225 10935 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:09.968307 10931 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:09.910282 16190 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:22:09.919448 16182 log.cc:927] Time spent T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:22:09.959120 16165 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:09.964288 10934 raft_consensus.cc:1240] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: []
W20260709 12:22:09.950882 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 152347us
I20260709 12:22:09.945087 15908 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 12:22:09.916055 16189 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 12:22:09.988184 10929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 2854) took 1378 ms. Trace:
I20260709 12:22:09.970129 10935 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:09.965194 16139 raft_consensus.cc:3055] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:09.908927 16067 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:10.002887 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.006878 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2890) took 1007 ms. Trace:
I20260709 12:22:10.007340 10935 rpcz_store.cc:276] 0709 12:22:08.999774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.969694 (+969920us) service_pool.cc:224] Handling call
0709 12:22:09.969973 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.006597 (+ 36624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.006816 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.996805 10929 rpcz_store.cc:276] 0709 12:22:08.609569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.691298 (+ 81729us) service_pool.cc:224] Handling call
0709 12:22:09.987975 (+1296677us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b540024ca54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:09.988123 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329365376}
I20260709 12:22:09.920616 16072 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:10.013145 11085 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:10.015733 11078 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:22:09.990301 16171 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:22:10.032155 16203 log.cc:927] Time spent T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.072s	user 0.001s	sys 0.001s
W20260709 12:22:10.032550 16201 log.cc:927] Time spent T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 12:22:10.034891 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 2992) took 1046 ms. Trace:
I20260709 12:22:10.035290 11077 rpcz_store.cc:276] 0709 12:22:08.988598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.998861 (+ 10263us) service_pool.cc:224] Handling call
0709 12:22:08.999188 (+   327us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:09.310782 (+311594us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:09.355448 (+ 44666us) log.cc:844] Serialized 14 byte log entry
0709 12:22:09.598727 (+243279us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:09.606012 (+  7285us) log.cc:844] Serialized 52 byte log entry
0709 12:22:09.606153 (+   141us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:09.606577 (+   424us) log.cc:844] Serialized 14 byte log entry
0709 12:22:09.666943 (+ 60366us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b180008c1a0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:22:09.745752 (+ 78809us) log.cc:844] Serialized 14 byte log entry
0709 12:22:09.757123 (+ 11371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.791672 (+ 34549us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:10.034678 (+243006us) raft_consensus.cc:1685] finished
0709 12:22:10.034699 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.034833 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92181,"prepare.queue_time_us":46995,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":439,"raft.queue_time_us":248343,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":49030,"spinlock_wait_cycles":24627456,"thread_start_us":665542,"threads_started":3,"wal-append.queue_time_us":399917}
I20260709 12:22:09.998473 16139 raft_consensus.cc:740] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:10.041018 15777 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:10.040732 16139 consensus_queue.cc:260] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:09.975142 16000 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:09.889335 16179 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:10.042061 16139 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:10.042933 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2875) took 1310 ms. Trace:
I20260709 12:22:10.043722 16179 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:10.043629 11011 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:22:10.043298 10928 rpcz_store.cc:276] 0709 12:22:08.732328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.945874 (+213546us) service_pool.cc:224] Handling call
0709 12:22:08.967285 (+ 21411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:08.967661 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:08.967689 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:08.968166 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 12:22:09.109479 (+141313us) spinlock_profiling.cc:243] Waited 6.03 ms on lock 0x7b4800002958. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb5e89aa1 00007f9bb5e80b37 00007f9bb5e809ca 00007f9bb5f7826f 00007f9bb5f77f37 00007f9bb5f8c55c 00007f9bb5f8c508 00007f9bb5f8c488 00007f9bb5f8c443 00007f9bb5f8b6ec 00007f9bb4eb5a96
0709 12:22:09.458382 (+348903us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:09.556945 (+ 98563us) log.cc:844] Serialized 14 byte log entry
0709 12:22:09.745369 (+188424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.747370 (+  2001us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:10.042666 (+295296us) raft_consensus.cc:1685] finished
0709 12:22:10.042762 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.042878 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3776,"prepare.queue_time_us":98802,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":57500,"raft.run_cpu_time_us":2261,"raft.run_wall_time_us":135254,"spinlock_wait_cycles":13867776,"thread_start_us":617963,"threads_started":2,"wal-append.queue_time_us":605938}
I20260709 12:22:10.048377 11011 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:22:10.050452 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 57596.2us
I20260709 12:22:10.050258 10930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2876) took 1317 ms. Trace:
I20260709 12:22:10.052824 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:10.053431 16126 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:10.054190 16126 consensus_queue.cc:1243] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:22:10.054384 16000 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:10.055089 11005 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:10.051213 10930 rpcz_store.cc:276] 0709 12:22:08.732569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.948687 (+216118us) service_pool.cc:224] Handling call
0709 12:22:08.956091 (+  7404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:08.967705 (+ 11614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:08.967733 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:08.968166 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 12:22:09.522703 (+554537us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:09.734879 (+212176us) log.cc:844] Serialized 14 byte log entry
0709 12:22:09.749017 (+ 14138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.749106 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:10.050065 (+300959us) raft_consensus.cc:1685] finished
0709 12:22:10.050085 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.050204 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48356,"prepare.queue_time_us":77934,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2666,"raft.queue_time_us":44408,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":23960,"spinlock_wait_cycles":13696,"thread_start_us":670120,"threads_started":2,"wal-append.queue_time_us":676295}
W20260709 12:22:10.062347 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 310768us
I20260709 12:22:10.063202 10899 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:10.019465 16174 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.007s	sys 0.003s
I20260709 12:22:10.064513 10899 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:22:10.042039 16163 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.008s	sys 0.002s
I20260709 12:22:10.048175 16171 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:10.046680 15959 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:10.035537 16067 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:10.075412 10977 connection.cc:256] RPC call timeout handler was delayed by -1.2437183929996536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18600000000000003s for a response
I20260709 12:22:10.069769 11624 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:10.078781 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 236776us
I20260709 12:22:10.082794 10899 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:10.071225 16163 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.975s	user 0.008s	sys 0.003s
W20260709 12:22:10.067528 16174 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.007s	sys 0.003s
I20260709 12:22:10.090641 16214 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:10.092860 10899 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:10.095160 16184 consensus_queue.cc:1059] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:10.081840 15412 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:10.093576 15733 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:10.112978 16129 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.026s	user 0.004s	sys 0.015s
I20260709 12:22:10.118302 10899 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:10.119359 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:10.120069 11658 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
W20260709 12:22:10.119508 10977 connection.cc:256] RPC call timeout handler was delayed by -1.1249183929994615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
I20260709 12:22:10.104441 16048 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:10.097136 15777 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:10.121629 11049 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
W20260709 12:22:10.127624 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.133652 16207 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:10.134219 16207 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.133971 16163 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:10.134559 10899 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:10.135674 10899 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:10.122098 16129 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.005s	sys 0.015s
I20260709 12:22:10.143939 11653 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:10.120255 16213 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.134586 16207 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:10.147127 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60046 (request call id 2989) took 1159 ms. Trace:
I20260709 12:22:10.121124 16171 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:10.148430 10899 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:10.155150 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:10.130133 16048 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.156009 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:10.169122 11004 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 13.
I20260709 12:22:10.147382 11082 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:10.141309 15898 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:10.171597 11624 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:10.173384 11007 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2506) took 2121 ms (client timeout 2319 ms). Trace:
W20260709 12:22:10.173782 11007 rpcz_store.cc:269] 0709 12:22:08.047239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.079923 (+ 32684us) service_pool.cc:224] Handling call
0709 12:22:10.168424 (+2088501us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b5400150754. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:10.168560 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1142881536}
I20260709 12:22:10.157971 11084 rpcz_store.cc:276] 0709 12:22:08.987751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.987894 (+   143us) service_pool.cc:224] Handling call
0709 12:22:10.146939 (+1159045us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54000c2bd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:10.147071 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278715648}
I20260709 12:22:10.155275 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:10.138314 15836 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:10.143072 15910 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.146718 15827 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.152570 15995 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.142824 15733 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:10.164182 11080 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:10.176550 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:10.177685 10930 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:10.171128 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3120) took 1068 ms. Trace:
I20260709 12:22:10.155901 16071 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:10.197682 11076 rpcz_store.cc:276] 0709 12:22:09.102494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.112521 (+ 10027us) service_pool.cc:224] Handling call
0709 12:22:09.135056 (+ 22535us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:22:09.135600 (+   544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:09.135632 (+    32us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 12:22:09.972444 (+836812us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b2c000040c8. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9baf859a11 00007f9baf869372 00007f9bb0f9ba01 00007f9bb0f6043a 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2
0709 12:22:09.984926 (+ 12482us) log.cc:844] Serialized 104 byte log entry
0709 12:22:10.067959 (+ 83033us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:10.140582 (+ 72623us) log.cc:844] Serialized 14 byte log entry
0709 12:22:10.164137 (+ 23555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.164213 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:10.164312 (+    99us) raft_consensus.cc:1685] finished
0709 12:22:10.170908 (+  6596us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.171061 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23248,"raft.queue_time_us":24383,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":19192,"spinlock_wait_cycles":4137856,"thread_start_us":104133,"threads_started":2,"wal-append.queue_time_us":115228}
I20260709 12:22:10.170434 16048 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:10.177572 15898 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:10.182226 16205 log.cc:927] Time spent T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
W20260709 12:22:10.234076 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 64387.9us
I20260709 12:22:10.234578 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:10.235107 11625 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:10.235186 10930 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:10.236812 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:10.175020 16221 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:10.233625 16176 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:10.196484 15708 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:10.199909 16184 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:10.170212 16171 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:10.234163 15898 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:10.166324 16213 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:10.196250 15910 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:10.240532 16221 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.230888 16206 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:22:10.254467 10933 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 2870) took 1523 ms (client timeout 1658 ms). Trace:
W20260709 12:22:10.255287 10977 leader_election.cc:336] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.860s (SENT)
I20260709 12:22:10.174765 15412 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:22:10.200239 15995 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:10.200034 15827 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:10.246317 16184 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:10.271248 10933 rpcz_store.cc:269] 0709 12:22:08.730598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.734408 (+  3810us) service_pool.cc:224] Handling call
0709 12:22:10.254293 (+1519885us) spinlock_profiling.cc:243] Waited 74.8 ms on lock 0x7b5400203fd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:10.254397 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172013440}
I20260709 12:22:10.261968 16171 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:10.273873 16221 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:10.278748 15995 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:10.300741 16234 log.cc:927] Time spent T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:22:10.245738 16176 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:10.302763 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:10.304630 16176 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:10.305338 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:10.305821 16231 log.cc:927] Time spent T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:22:10.306531 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:10.306900 16226 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.307415 16226 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:10.279399 15827 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:10.280228 10899 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:10.280354 16228 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:22:10.281742 16164 consensus_meta.cc:287] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.857s	user 0.004s	sys 0.007s
I20260709 12:22:10.309052 16228 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:10.309201 16164 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:10.246608 16072 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:10.283600 16233 log.cc:927] Time spent T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:22:10.310225 16178 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:10.310765 16178 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:10.311434 16228 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:10.311820 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:10.312508 11078 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:10.312902 16178 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:10.313373 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:10.314165 11078 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 16: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:10.314951 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:10.316346 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2425) took 1240 ms. Trace:
I20260709 12:22:10.317209 10931 raft_consensus.cc:1240] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: [10.8-12.9]
W20260709 12:22:10.281913 10977 leader_election.cc:336] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.992s (SENT)
I20260709 12:22:10.307163 11077 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:10.320657 16195 raft_consensus.cc:3055] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:10.321089 16195 raft_consensus.cc:740] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:10.285028 11002 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:22:10.321995 16195 consensus_queue.cc:260] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:10.321552 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:10.321445 16190 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:22:10.324330 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:10.324695 16190 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:10.325141 11077 raft_consensus.cc:2410] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:22:10.326120 16190 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:10.328672  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:10.319483 16228 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:10.286063 16184 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:10.329897 11084 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 13.
I20260709 12:22:10.331198 15869 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:10.280158 16229 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:10.332646 16228 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:10.279007 16213 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:10.286617 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:10.309796 16243 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:10.284333 15910 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:10.320842 15995 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:10.237763 16071 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:10.332581 16229 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:10.285707 16174 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:10.316761 10935 rpcz_store.cc:276] 0709 12:22:09.076311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.008331 (+932020us) service_pool.cc:224] Handling call
0709 12:22:10.008682 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:10.048998 (+ 40316us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:10.049027 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:10.057542 (+  8515us) log.cc:844] Serialized 26 byte log entry
0709 12:22:10.315823 (+258281us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b54001e8aa0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0eca090 00007f9bb0ed76b8 00007f9bb0f6092b 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c
0709 12:22:10.315904 (+    81us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:10.315954 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.316023 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:10.316071 (+    48us) raft_consensus.cc:1685] finished
0709 12:22:10.316084 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.316288 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46284,"raft.queue_time_us":48011,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":11783,"spinlock_wait_cycles":5049088,"thread_start_us":16382,"threads_started":1,"wal-append.queue_time_us":26711}
I20260709 12:22:10.344226 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:10.323042 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41098 (request call id 417) took 1565 ms. Trace:
W20260709 12:22:10.342276 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 107251us
I20260709 12:22:10.309677 16226 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:10.349438 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:10.323385 16195 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:10.348565 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 255602us
I20260709 12:22:10.344326 10933 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:10.351092 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2424) took 1297 ms. Trace:
I20260709 12:22:10.345019 11002 rpcz_store.cc:276] 0709 12:22:08.758078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.758200 (+   122us) service_pool.cc:224] Handling call
0709 12:22:10.168711 (+1410511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.321769 (+153058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.322340 (+   571us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400150754. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:10.322825 (+   485us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400150750. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:10.322961 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3509726464}
I20260709 12:22:10.351588 10934 rpcz_store.cc:276] 0709 12:22:09.053510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.993442 (+939932us) service_pool.cc:224] Handling call
0709 12:22:09.993819 (+   377us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:22:09.994228 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:09.994257 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:22:10.003505 (+  9248us) log.cc:844] Serialized 78 byte log entry
0709 12:22:10.229531 (+226026us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:10.229577 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.229650 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:10.350870 (+121220us) raft_consensus.cc:1685] finished
0709 12:22:10.350891 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.351034 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41119,"raft.queue_time_us":1828,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":6646,"thread_start_us":182035,"threads_started":1,"wal-append.queue_time_us":288971}
I20260709 12:22:10.353394 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:10.354004 10934 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:10.272696 16224 log.cc:927] Time spent T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 12:22:10.263748 16214 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:10.272533 16219 log.cc:927] Time spent T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:22:10.348737 10899 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:10.327507 16190 consensus_queue.cc:1059] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:22:10.558044 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 209381us
I20260709 12:22:10.558167 16032 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:10.271178 16206 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.480439 16229 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:10.518580 16240 log.cc:927] Time spent T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 12:22:10.558827 16032 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.348157 16243 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:10.479020 16239 log.cc:927] Time spent T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:22:10.341171 16165 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:10.559499 16032 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:10.559610 16243 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:10.510603 16123 consensus_meta.cc:287] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.703s	user 0.007s	sys 0.001s
I20260709 12:22:10.560916 10929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2426) took 1460 ms. Trace:
I20260709 12:22:10.530956 16221 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:10.480530 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3238) took 1293 ms. Trace:
I20260709 12:22:10.562479 10935 raft_consensus.cc:2368] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 18. Current term is 19.
I20260709 12:22:10.561295 10929 rpcz_store.cc:276] 0709 12:22:09.100105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.009312 (+909207us) service_pool.cc:224] Handling call
0709 12:22:10.009626 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:10.061694 (+ 52068us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:10.061731 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:10.076275 (+ 14544us) log.cc:844] Serialized 26 byte log entry
0709 12:22:10.177174 (+100899us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:10.177217 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.177290 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:10.560698 (+383408us) raft_consensus.cc:1685] finished
0709 12:22:10.560719 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.560856 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44350,"raft.queue_time_us":47153,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":11342,"thread_start_us":72155,"threads_started":1,"wal-append.queue_time_us":161696}
I20260709 12:22:10.561857 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2523) took 1130 ms. Trace:
I20260709 12:22:10.435493 16002 consensus_queue.cc:1059] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.128s
I20260709 12:22:10.479972 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2881) took 1746 ms. Trace:
I20260709 12:22:10.563253 11003 rpcz_store.cc:276] 0709 12:22:09.431683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.610034 (+178351us) service_pool.cc:224] Handling call
0709 12:22:09.610378 (+   344us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:09.612809 (+  2431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:09.612843 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:09.617173 (+  4330us) log.cc:844] Serialized 52 byte log entry
0709 12:22:09.772862 (+155689us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:09.772917 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.773013 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:10.561615 (+788602us) raft_consensus.cc:1685] finished
0709 12:22:10.561642 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.561797 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4894,"raft.queue_time_us":2629,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":39509,"thread_start_us":60408,"threads_started":1,"wal-append.queue_time_us":329651}
I20260709 12:22:10.532637 16071 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:10.462074 16174 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.103s
I20260709 12:22:10.481005 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2880) took 1747 ms. Trace:
I20260709 12:22:10.565166 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:10.565814 10929 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:22:10.477910 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:10.564697 16221 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:10.544795 16171 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:10.567011 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:10.567013 16171 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:10.568195 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:10.424047 15910 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:10.560609 16214 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:10.569478 15910 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:10.568719 10929 raft_consensus.cc:2376] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15. Re-sending same reply.
I20260709 12:22:10.571957 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:10.564255 10927 rpcz_store.cc:276] 0709 12:22:08.733822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.323368 (+589546us) service_pool.cc:224] Handling call
0709 12:22:09.988575 (+665207us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:09.988984 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:22:10.005965 (+ 16981us) log.cc:844] Serialized 14 byte log entry
0709 12:22:10.132521 (+126556us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:10.132971 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 12:22:10.133143 (+   172us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:10.133357 (+   214us) log.cc:844] Serialized 14 byte log entry
0709 12:22:10.133545 (+   188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.133613 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:10.233979 (+100366us) raft_consensus.cc:1685] finished
0709 12:22:10.233998 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.479779 (+245781us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b540024ca50. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:10.479915 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18614,"prepare.queue_time_us":21320,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":67,"raft.queue_time_us":14699,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":8361,"spinlock_wait_cycles":1529026304,"thread_start_us":53032,"threads_started":1,"wal-append.queue_time_us":61865}
I20260709 12:22:10.506318 16164 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:10.573048 15910 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:10.573553 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:10.426959 10934 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:10.560287 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:10.521968 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2427) took 1335 ms. Trace:
I20260709 12:22:10.362089 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:10.528761 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:10.451745 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:10.550854 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:10.508642 11652 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:22:10.562553 11009 rpcz_store.cc:276] 0709 12:22:09.187156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.193410 (+  6254us) service_pool.cc:224] Handling call
0709 12:22:09.216794 (+ 23384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:09.472134 (+255340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.480321 (+1008187us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b540029b3d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:10.480475 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":585515264}
I20260709 12:22:10.380708 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:10.593139 10899 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:10.576825 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:10.585043 11656 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 9.
I20260709 12:22:10.433326 11005 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 9.
I20260709 12:22:10.576997 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:10.576130 10929 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:10.577422 10928 rpcz_store.cc:276] 0709 12:22:09.186222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.048903 (+862681us) service_pool.cc:224] Handling call
0709 12:22:10.049181 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.049366 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:22:10.055029 (+  5663us) log.cc:844] Serialized 14 byte log entry
0709 12:22:10.521597 (+466568us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:10.521656 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:10.521709 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.521780 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.521905 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7451,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":110,"thread_start_us":466189,"threads_started":1}
I20260709 12:22:10.596220 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:10.596884 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:10.594158 10927 raft_consensus.cc:2368] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14.
I20260709 12:22:10.594547 10899 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:10.565419 10936 rpcz_store.cc:276] 0709 12:22:08.733577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.990800 (+257223us) service_pool.cc:224] Handling call
0709 12:22:09.567160 (+576360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:09.567935 (+   775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.480837 (+912902us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b5400169750. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:10.480954 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1324812672}
W20260709 12:22:10.584828 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.599035 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:10.599592 10936 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 9.
I20260709 12:22:10.595058 10934 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:10.584471 10933 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:10.602730 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:10.603410 11078 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
I20260709 12:22:10.603925 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:10.604717 10930 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:10.395812 16058 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:10.395582 16160 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:10.600430 16172 log.cc:927] Time spent T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 1.514s	user 0.004s	sys 0.000s
I20260709 12:22:10.603947 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:10.607903 11622 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:10.610111 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:10.573654 16171 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:10.607511 10934 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:10.558918 16206 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:10.530687 16213 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:10.633447 10977 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:10.638667 10933 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:10.600452 16164 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:10.641283 10977 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:10.643782 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 103079us
W20260709 12:22:10.614101 16009 consensus_meta.cc:287] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.771s	user 0.009s	sys 0.001s
I20260709 12:22:10.646586 10977 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:10.657289 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:10.658026 11078 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:10.629520 16041 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:10.635448 16178 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:10.695273 10927 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:10.698383 10930 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:10.709833 10977 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:10.627781 16184 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:10.672648 16123 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:10.632767 16058 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:10.674383 16041 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.636358 16160 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:10.834141 10934 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:10.674485 16190 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:10.693852 16178 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:10.669821 16009 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:10.655342 16213 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:10.713786 16228 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:10.835759 16229 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:10.844197 16139 consensus_meta.cc:287] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.799s	user 0.006s	sys 0.004s
I20260709 12:22:10.850977 11081 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3117) took 2157 ms. Trace:
I20260709 12:22:10.835507 16214 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:10.838016 16041 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:10.697530 16048 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:10.866662 10933 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:10.860656 11081 rpcz_store.cc:276] 0709 12:22:08.689487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.689640 (+   153us) service_pool.cc:224] Handling call
0709 12:22:08.689934 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:08.799944 (+110010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:08.799974 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:08.802110 (+  2136us) log.cc:844] Serialized 26 byte log entry
0709 12:22:08.966105 (+163995us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:08.966143 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:08.966205 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:10.530110 (+1563905us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:22:10.834911 (+304801us) raft_consensus.cc:1685] finished
0709 12:22:10.834934 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.846335 (+ 11401us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1424,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":54,"spinlock_wait_cycles":62284544,"thread_start_us":240496,"threads_started":2,"wal-append.queue_time_us":179180}
I20260709 12:22:10.870587 15222 raft_consensus.cc:3055] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:22:10.853219 16253 log.cc:927] Time spent T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:22:10.847566 16190 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.874217 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:10.877635 10931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2423) took 1866 ms. Trace:
I20260709 12:22:10.898222 10931 rpcz_store.cc:276] 0709 12:22:09.010806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.969780 (+958974us) service_pool.cc:224] Handling call
0709 12:22:09.987790 (+ 18010us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:10.317702 (+329912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.877341 (+559639us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b5400202bd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:10.877568 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":756965632}
I20260709 12:22:10.878422 11653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59398 (request call id 461) took 1308 ms. Trace:
I20260709 12:22:10.879336 16141 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:10.864975 11655 consensus_queue.cc:237] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:10.901986 10929 raft_consensus.cc:2393] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 15: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:10.881053 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3121) took 1778 ms. Trace:
I20260709 12:22:10.846490 16178 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:10.880887 11650 raft_consensus.cc:2368] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14.
I20260709 12:22:10.886687 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:10.887394 11051 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:10.888195 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:10.888159 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:10.855880 16255 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:10.851904 16165 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:10.899221 11653 rpcz_store.cc:276] 0709 12:22:09.569555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.569690 (+   135us) service_pool.cc:224] Handling call
0709 12:22:09.591156 (+ 21466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.144280 (+553124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.878202 (+733922us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b540009d3d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:10.878362 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1270823296}
I20260709 12:22:10.926774 11084 raft_consensus.cc:1240] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:10.904346 11082 rpcz_store.cc:276] 0709 12:22:09.102804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.103510 (+   706us) service_pool.cc:224] Handling call
0709 12:22:10.147070 (+1043560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.169911 (+ 22841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.880849 (+710938us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000c2bd0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:10.880983 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2399432064}
I20260709 12:22:10.884258 15222 raft_consensus.cc:740] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:10.910040 16129 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.916263 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:10.882727 11077 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 13.
I20260709 12:22:10.918731 11004 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:22:10.918797 11051 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:10.919896 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:10.930869 11010 raft_consensus.cc:2393] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 16: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:22:10.883315 16207 consensus_meta.cc:287] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.712s	user 0.009s	sys 0.001s
I20260709 12:22:10.918751 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:10.922590 11002 raft_consensus.cc:2393] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 10: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:10.924454 10936 raft_consensus.cc:1240] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:10.925071 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:10.930310 11008 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:22:10.932137 11009 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:10.905448 16190 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:10.935624 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:10.936681 16009 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:10.975183 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:10.980813 11004 raft_consensus.cc:2410] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:22:10.937222 16243 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:10.939242 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:10.983333 11008 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:10.941978 16213 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:10.942545 11081 raft_consensus.cc:3055] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:22:10.946623 16247 log.cc:927] Time spent T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:22:10.948892 15853 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:10.867801 16229 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:10.957201 16048 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:10.957562 16164 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.008507 16164 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.009034 16206 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.010761 16164 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:10.921849 16123 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.011224 16206 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:10.862428 16228 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.013485 16228 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:10.964129 15222 consensus_queue.cc:260] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.014586 15222 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:10.965494 16207 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:11.031248 15898 consensus_meta.cc:287] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.762s	user 0.007s	sys 0.002s
I20260709 12:22:10.972293 16129 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:10.984543 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:11.055483 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 345703us
I20260709 12:22:11.056319 11002 raft_consensus.cc:2410] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:22:10.986765 11081 raft_consensus.cc:740] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:10.987900 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:11.058225 11004 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:22:10.951663 16169 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:10.988591 16071 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:10.979324 16255 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:11.032831 16160 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:11.000370 15853 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.038014 16262 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.038702 16184 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:10.933435 16165 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:11.041326 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.044001 16229 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:10.971383 11078 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:22:11.059401 10977 leader_election.cc:400] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14.
I20260709 12:22:11.059823 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:11.061061 16071 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.035360 16032 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.037582 16243 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.084847 16129 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:11.065299 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:11.011502 16123 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.089993 16123 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:11.055572 16195 consensus_meta.cc:287] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.677s	user 0.005s	sys 0.005s
I20260709 12:22:11.076056 16262 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.094350 16262 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.068477 15853 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:11.060113 15898 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.104250 15910 raft_consensus.cc:3055] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:11.104635 15910 raft_consensus.cc:740] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:11.105656 15898 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.106406 16039 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.107064 16143 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.107784 16032 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.108065 10932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2882) took 2374 ms. Trace:
I20260709 12:22:11.108421 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:11.082304 16071 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:11.114050 16200 log.cc:927] Time spent T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 1.262s	user 0.000s	sys 0.001s
I20260709 12:22:11.119280 16165 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:11.119837 16165 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:11.120309 16165 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.074096 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:11.122182 10927 raft_consensus.cc:1217] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 5.4->[7.5-15.8]   Dedup: 7.5->[9.6-15.8]
I20260709 12:22:11.122722 10927 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16. Ops: [7.5-15.8]
I20260709 12:22:11.059504 16207 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.057245 11081 consensus_queue.cc:260] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.062660 16255 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.082180 10977 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:11.126114 11081 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:11.126375 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 44280.8us
I20260709 12:22:11.108393 10932 rpcz_store.cc:276] 0709 12:22:08.734053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.431808 (+697755us) service_pool.cc:224] Handling call
0709 12:22:09.885995 (+454187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:09.886721 (+   726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.107835 (+1221114us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b54002049d0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:11.108003 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1043727616}
I20260709 12:22:11.130380 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 553) took 2149 ms. Trace:
I20260709 12:22:11.130836 11083 rpcz_store.cc:276] 0709 12:22:08.980999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.995288 (+ 14289us) service_pool.cc:224] Handling call
0709 12:22:08.995570 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.097799 (+1102229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:10.097834 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:10.097887 (+    53us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:10.097918 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.130123 (+1032205us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400277ed4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:11.130177 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:11.130316 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2534452992}
I20260709 12:22:11.133765 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3115) took 2478 ms. Trace:
I20260709 12:22:11.137446 10934 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:22:11.103253 16190 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:11.146958 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.147841 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:11.135193 16129 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:11.152935 16123 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:11.161931 16123 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.155745 16041 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:11.141409 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 222686us
I20260709 12:22:11.143721 11011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2528) took 1349 ms. Trace:
I20260709 12:22:11.134155 11080 rpcz_store.cc:276] 0709 12:22:08.655290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.655451 (+   161us) service_pool.cc:224] Handling call
0709 12:22:08.676580 (+ 21129us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.198078 (+1521498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.133539 (+935461us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400278dd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:11.133710 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3420644224}
I20260709 12:22:11.148823 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:11.166070 11011 rpcz_store.cc:276] 0709 12:22:09.794647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.044921 (+250274us) service_pool.cc:224] Handling call
0709 12:22:10.045256 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.049694 (+  4438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.143521 (+1093827us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b54002d9454. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:11.143675 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3074944}
I20260709 12:22:11.170001 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:11.122221 16165 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:11.166029 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:11.178452 11083 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:22:11.180707 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.183621 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:11.173245 10900 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:11.186137 11011 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:11.141162 16000 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:11.135458 16059 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:11.191897 11083 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:11.195302 11080 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:11.154556 16255 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.165510 16123 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.203053 11051 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:11.198276 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:11.200083 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:11.205020 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:11.203374 11004 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:22:11.206077 11004 pending_rounds.cc:85] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 8
I20260709 12:22:11.206297 11004 pending_rounds.cc:107] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:22:11.206548 11004 raft_consensus.cc:2889] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:11.207180 11081 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 12:22:11.207522 11081 pending_rounds.cc:85] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 6
I20260709 12:22:11.207729 11081 pending_rounds.cc:107] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 12:22:11.205348 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:11.208760 11009 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:11.189159 16207 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:11.210736 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:11.208050 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:11.202327 16000 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.208061 11081 raft_consensus.cc:2889] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:11.212937 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:11.214161 11051 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:11.161372 16129 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.149839 16178 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:11.182793 16229 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:22:11.218811 11083 raft_consensus.cc:1275] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:11.188863 16169 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:22:11.209988 15995 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.210271 16259 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:11.220325 16264 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.217640 16000 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:11.231726 16159 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:11.239609 16159 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.218706 11080 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:11.204037 16071 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.215951 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:11.216905 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:11.243184 11081 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:11.230527 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:11.229532 11011 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 14.
I20260709 12:22:11.214989 16261 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:11.219875 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:11.245406 11009 raft_consensus.cc:2368] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14.
I20260709 12:22:11.237494 11651 raft_consensus.cc:1240] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:11.245187 11624 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:11.242131 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:11.247320 11080 raft_consensus.cc:2393] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 16: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:11.212440 16165 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:22:11.248271 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:11.248385 11008 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:11.250075 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:11.251039 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:11.251763 11011 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:22:11.204425 16059 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:11.254675 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:11.229729 16072 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:11.266742 16178 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.272243 16190 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.239993 16159 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:11.273831 15938 raft_consensus.cc:3055] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:11.274309 15938 raft_consensus.cc:740] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:11.242106 16264 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.278074 16264 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.279672 16071 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.241017 16259 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.282699 16259 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.283103 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41098 (request call id 428) took 1032 ms. Trace:
I20260709 12:22:11.283526 11007 rpcz_store.cc:276] 0709 12:22:10.250933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.251090 (+   157us) service_pool.cc:224] Handling call
0709 12:22:10.271668 (+ 20578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.271924 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:10.349099 (+ 77175us) log.cc:844] Serialized 14 byte log entry
0709 12:22:11.282504 (+933405us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b1800064660. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bb0b084bc 00007f9bade5648b 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b 00007f9bb0affd23 00007f9bb0b0023a
0709 12:22:11.282723 (+   219us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:11.282775 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:11.282833 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.282918 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:11.283044 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":88166,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":553,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":89,"spinlock_wait_cycles":45726080,"thread_start_us":92678,"threads_started":1,"wal-append.queue_time_us":208257}
I20260709 12:22:11.285766 16129 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:11.285775 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:11.286605 11007 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:11.287541 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:11.288707 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:11.289695 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:11.263725 16072 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.292457 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:11.293671 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:11.294379 16072 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.252956 16248 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:11.295370 16248 raft_consensus.cc:697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:11.296324 16248 consensus_queue.cc:237] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:11.298293 16059 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:11.264302 15853 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.259747 16265 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:22:11.272106 16041 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.239133 15995 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.301959 15995 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.275246 15938 consensus_queue.cc:260] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:11.302735 15938 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:11.249572 16261 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:11.305558 16208 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 1.386s	user 0.000s	sys 0.003s
I20260709 12:22:11.306885 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3122) took 2203 ms. Trace:
I20260709 12:22:11.307596 11011 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:22:11.307322 11079 rpcz_store.cc:276] 0709 12:22:09.103073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.103357 (+   284us) service_pool.cc:224] Handling call
0709 12:22:09.103667 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:09.433194 (+329527us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:22:09.433228 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:09.433720 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:22:09.706254 (+272534us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:09.706294 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.706366 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:11.304999 (+1598633us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:22:11.306557 (+  1558us) raft_consensus.cc:1685] finished
0709 12:22:11.306611 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:11.306822 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2851,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":48,"spinlock_wait_cycles":57565440,"thread_start_us":601234,"threads_started":2,"wal-append.queue_time_us":410466}
I20260709 12:22:11.307263 11004 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:11.309221 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:11.309319 15853 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:11.295002 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:11.324709 11005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41098 (request call id 427) took 1170 ms. Trace:
I20260709 12:22:11.330921 11005 rpcz_store.cc:276] 0709 12:22:10.153899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.155081 (+  1182us) service_pool.cc:224] Handling call
0709 12:22:11.324482 (+1169401us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54002d9e54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:11.324631 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589769472}
I20260709 12:22:11.332319 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:11.334187 11624 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:11.328677 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3134) took 1728 ms. Trace:
I20260709 12:22:11.335973 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:11.336591 11002 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:22:11.332448 10901 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:11.337194 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:11.336023 11076 rpcz_store.cc:276] 0709 12:22:09.600565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.238769 (+638204us) service_pool.cc:224] Handling call
0709 12:22:10.247625 (+  8856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.433963 (+186338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:10.433996 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:10.434038 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:10.434074 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.328400 (+894326us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b5400217d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:11.328460 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:11.328608 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":428073856}
I20260709 12:22:11.306635 16261 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.341361 10901 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:22:11.342792 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 193408us
I20260709 12:22:11.347733 10901 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:11.348610 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:11.349499 11005 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:22:11.353298 10901 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:11.345887 15898 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.359947 15222 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:11.354351 16032 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:11.346881 16141 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:11.347441 16178 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:11.357353 16243 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:11.364331 10901 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:11.363045 16141 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.370054 10901 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:11.371400 10975 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.004s	sys 0.013s
W20260709 12:22:11.372382 10975 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.004s	sys 0.013s
I20260709 12:22:11.375626 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:11.376341 11658 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:11.384613 11002 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:11.390635 10901 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:11.409662 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:11.388820 16143 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:11.410977 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:11.412317 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:11.412814 10901 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:11.413846 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:11.414927 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:22:11.415788 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.362090 16032 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:11.418145 10975 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:11.418408 15222 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:11.363121 16243 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:11.369959 16141 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:11.363332 16178 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:11.418692 10901 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:11.432641 11002 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:11.439260 15222 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:22:11.440147 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.438421 10901 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:11.409649 16262 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:11.413462 16207 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:11.363903 15898 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:11.418023 16039 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:11.429198 16032 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:11.449033 10975 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:11.436256 15995 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:11.432189 16243 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:22:11.452435 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 219957us
I20260709 12:22:11.436851 16178 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:11.458187 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 239221us
I20260709 12:22:11.442567 16048 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:22:11.453009 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 238907us
I20260709 12:22:11.462226 11051 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:11.417727 16126 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 12:22:11.454053 16071 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:11.453820 16160 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.453702 15995 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:11.462658 11002 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:22:11.465307 11051 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:11.468112 16071 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.448916 16262 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.465617 16226 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:11.470904 15995 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:11.480281 16264 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:11.481401 16258 consensus_queue.cc:1059] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:11.482738 16269 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:11.483731 16190 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:11.484916 10974 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:11.488695 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2899) took 1218 ms. Trace:
I20260709 12:22:11.465183 16048 raft_consensus.cc:697] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:11.470098 16195 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.495007 10936 rpcz_store.cc:276] 0709 12:22:10.270154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.641523 (+371369us) service_pool.cc:224] Handling call
0709 12:22:10.641858 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.933248 (+291390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.488447 (+555199us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400178ed4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:11.488632 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646083456}
I20260709 12:22:11.474592 16071 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:11.489645 16226 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:11.470655 16160 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.498020 16207 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:11.495728 16213 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:22:11.488958 16039 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:22:11.525552 11005 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:11.526399 16143 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:11.531455 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 46626us
I20260709 12:22:11.555598 10974 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:11.503984 16258 consensus_queue.cc:1243] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 1abf4b385a2b493ab83f593a1f8c9cd1 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:22:11.517300 16226 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:11.551767 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 86528.7us
I20260709 12:22:11.551295 10901 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:11.565814 15222 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:11.546238 16190 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:22:11.556118 16273 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:22:11.544675 16278 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:11.504631 16195 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:11.512540 16271 consensus_queue.cc:1059] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:22:11.561065 16143 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.599080 16165 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:11.599774 16165 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.600199 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:11.600800 15898 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:11.601451 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:11.601673 15898 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.602123 15898 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.603742 16165 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:11.604506 16165 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:11.605085 16195 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.605682 16262 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.570808 16264 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:11.549628 16207 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.577221 16278 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:11.583709 16228 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:11.572225 16126 consensus_queue.cc:1048] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:22:11.623473 16039 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:22:11.624584 16282 log.cc:927] Time spent T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:22:11.625712 16249 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.929s	user 0.001s	sys 0.002s
I20260709 12:22:11.572424 16260 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:22:11.588279 16175 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:22:11.638067 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:11.650483 10977 leader_election.cc:336] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.581s (SENT)
W20260709 12:22:11.705319 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 54892.3us
W20260709 12:22:11.698563 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 135894us
I20260709 12:22:11.708698 11051 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:11.709794 11051 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:11.699048 15222 raft_consensus.cc:697] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:22:11.702611 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 128588us
I20260709 12:22:11.711954 15222 consensus_queue.cc:237] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.712826 11050 leader_election.cc:400] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14.
I20260709 12:22:11.714389 11050 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:11.717065 11051 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:11.717721 11050 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:11.717813 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:11.739187 11622 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:11.570595 16048 consensus_queue.cc:237] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.607990 16159 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.695600 16264 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:11.627672 16278 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:11.717058 16284 log.cc:927] Time spent T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.091s	user 0.000s	sys 0.003s
I20260709 12:22:11.753656 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:11.715229 16229 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:11.716434 16295 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:22:11.761086 16000 consensus_meta.cc:287] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.000s
I20260709 12:22:11.783165 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2909) took 1453 ms. Trace:
I20260709 12:22:11.784180 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3131) took 2382 ms. Trace:
I20260709 12:22:11.696849 16243 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.759100 16287 consensus_queue.cc:1059] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:22:11.760138 16297 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 12:22:11.786165 16294 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:11.782019 16264 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.780463 16195 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:11.801550 16195 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:11.802035 16195 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:11.786077 11085 rpcz_store.cc:276] 0709 12:22:09.402115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.806006 (+403891us) service_pool.cc:224] Handling call
0709 12:22:09.843604 (+ 37598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.013557 (+169953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.783893 (+1770336us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b540031e554. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:11.784109 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389071744}
I20260709 12:22:11.785754 10934 rpcz_store.cc:276] 0709 12:22:10.329447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.847825 (+518378us) service_pool.cc:224] Handling call
0709 12:22:11.137183 (+289358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:11.137875 (+   692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.782924 (+645049us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54001e5ad0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:11.783095 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":664472832}
I20260709 12:22:11.706300 16039 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:11.718827 16175 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.787678 16229 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:11.834355 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 116684us
W20260709 12:22:11.793883 16283 log.cc:927] Time spent T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
W20260709 12:22:11.788877 16280 log.cc:927] Time spent T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 12:22:11.810273 16071 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:11.792486 16159 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:11.759368 16289 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:22:11.792016 16258 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:11.787976 16143 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.792615 16243 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.787781 16295 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.793385 16207 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.840195 11050 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:11.766044 15820 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:22:11.844715 16276 log.cc:927] Time spent T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:22:11.838315 15898 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.852092 16160 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.847276 16178 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:11.788031 16000 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.870812 16071 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:11.838862 16303 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:11.884395 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:11.860199 16058 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.794271 15910 consensus_queue.cc:260] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.935104 11656 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:11.891688 16297 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:11.879298 15820 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.945441 15820 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:11.937191 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:11.950237 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:11.879289 16143 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:22:11.952014 16141 consensus_meta.cc:287] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.002s
I20260709 12:22:11.952201 16143 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:11.954627 16143 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:11.883958 16295 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:11.957309 16039 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:11.959553 16000 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.960166 11007 raft_consensus.cc:2393] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 19: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:11.961148 16175 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:11.961496 15938 consensus_meta.cc:287] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.658s	user 0.007s	sys 0.006s
I20260709 12:22:11.962268 11653 raft_consensus.cc:2410] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:22:11.951601 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:11.964306 16281 log.cc:927] Time spent T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.403s	user 0.002s	sys 0.003s
I20260709 12:22:11.966001 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:11.967180 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:22:11.968534 16032 consensus_meta.cc:287] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.002s
I20260709 12:22:11.968973 16032 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:11.971078 16032 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.971999 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:11.972637 11005 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:11.973690 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 3018) took 1707 ms. Trace:
I20260709 12:22:11.974071 11082 rpcz_store.cc:276] 0709 12:22:10.266641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.927693 (+661052us) service_pool.cc:224] Handling call
0709 12:22:10.928013 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:11.194207 (+266194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:11.194236 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:11.204373 (+ 10137us) log.cc:844] Serialized 26 byte log entry
0709 12:22:11.458807 (+254434us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:11.581080 (+122273us) log.cc:844] Serialized 14 byte log entry
0709 12:22:11.581929 (+   849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.582502 (+   573us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:11.973495 (+390993us) raft_consensus.cc:1685] finished
0709 12:22:11.973514 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:11.973635 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":604,"prepare.queue_time_us":240147,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":57537,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":76962,"thread_start_us":614139,"threads_started":3,"wal-append.queue_time_us":346858}
I20260709 12:22:11.979609 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 3022) took 1631 ms. Trace:
I20260709 12:22:11.969136 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:11.980072 11078 rpcz_store.cc:276] 0709 12:22:10.347942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.076853 (+728911us) service_pool.cc:224] Handling call
0709 12:22:11.077192 (+   339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:11.077580 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:11.125502 (+ 47922us) log.cc:844] Serialized 14 byte log entry
0709 12:22:11.373648 (+248146us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:11.389257 (+ 15609us) log.cc:844] Serialized 52 byte log entry
0709 12:22:11.389464 (+   207us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:11.389802 (+   338us) log.cc:844] Serialized 14 byte log entry
0709 12:22:11.390135 (+   333us) log.cc:844] Serialized 14 byte log entry
0709 12:22:11.409699 (+ 19564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.409775 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:11.966887 (+557112us) spinlock_profiling.cc:243] Waited 7.62 ms on lock 0x7b18003455e0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade73522 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:22:11.979343 (+ 12456us) raft_consensus.cc:1685] finished
0709 12:22:11.979368 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:11.979545 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44606,"prepare.queue_time_us":48031,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":3859,"raft.queue_time_us":38196,"raft.run_cpu_time_us":452,"raft.run_wall_time_us":103530,"spinlock_wait_cycles":31933696,"thread_start_us":235916,"threads_started":1,"wal-append.queue_time_us":316610}
I20260709 12:22:11.994553 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:11.928454 16229 consensus_queue.cc:1059] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 12:22:12.000206 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:11.890487 16294 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 12:22:11.978439 16297 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:11.974959 15820 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:12.002417 11650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59414 (request call id 353) took 1570 ms (client timeout 1735 ms). Trace:
W20260709 12:22:12.030476 11650 rpcz_store.cc:269] 0709 12:22:10.432210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.433465 (+  1255us) service_pool.cc:224] Handling call
0709 12:22:12.002194 (+1568729us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b540053b454. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:12.002332 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642901760}
I20260709 12:22:11.992909 16312 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:12.032101 16312 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:12.034627 16312 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:11.995841 16175 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:12.036191 16175 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:12.037784 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:12.038460 16175 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:12.039386 11007 raft_consensus.cc:1240] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:22:12.003064 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:11.988101 15910 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:12.044734 16195 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:11.880106 16258 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:12.047030 11004 raft_consensus.cc:2410] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:22:11.979053 16228 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:12.048158 16228 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:12.047063 16195 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:12.050366 16228 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:11.995522 16280 log.cc:927] Time spent T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:22:11.978850 16287 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:12.051388 16287 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:12.029318 16297 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:11.941426 16303 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:12.053954 16303 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:11.975001 16295 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:12.055187 10977 leader_election.cc:336] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.658s (SENT)
I20260709 12:22:12.056470 16295 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:12.012387 16229 raft_consensus.cc:3055] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:12.057199 16229 raft_consensus.cc:740] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:12.058202 16229 consensus_queue.cc:260] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:12.058779 11659 raft_consensus.cc:1240] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:12.059522 16229 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:12.014470 16226 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:12.065979 16226 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:12.016835 16264 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:12.020226 15644 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.020759 16299 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:12.021253 10974 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:11.997350 15995 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:11.980278 16141 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:12.023038 16178 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:12.025966 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.111182 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:12.028865 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:11.996757 16307 log.cc:927] Time spent T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:22:12.063551 11656 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:12.081355 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:12.082994 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 61831.7us
I20260709 12:22:12.086310 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:12.130389 11076 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:22:12.086997 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:12.087620 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:12.111370 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:12.111653 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.027345 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:12.132601 11085 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:12.048488 16258 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:12.117110 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:12.134847 10930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53346 (request call id 474) took 1855 ms. Trace:
I20260709 12:22:12.138216 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:12.148535 11656 raft_consensus.cc:1813] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Handling vote request from an unknown peer 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:12.149184 11656 raft_consensus.cc:2410] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:22:12.137585 10975 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:12.156291 11653 raft_consensus.cc:1240] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:12.158136 11050 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:12.085764 16264 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:12.134298 16256 log.cc:927] Time spent T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 1.152s	user 0.004s	sys 0.000s
I20260709 12:22:12.120118 16278 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:12.188359 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.189199 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.189929 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.197537 10929 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:22:12.192279 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:12.196197 10935 raft_consensus.cc:1240] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:22:12.200044 10932 raft_consensus.cc:1240] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:12.167327 16058 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:12.171540 16228 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:12.133903 16268 consensus_queue.cc:1059] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:22:12.202167 16278 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:12.205928 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:12.094385 16299 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:12.148039 10930 rpcz_store.cc:276] 0709 12:22:10.279662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.718123 (+438461us) service_pool.cc:224] Handling call
0709 12:22:10.822978 (+104855us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:10.880659 (+ 57681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:10.880697 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:10.895636 (+ 14939us) log.cc:844] Serialized 26 byte log entry
0709 12:22:11.852870 (+957234us) spinlock_profiling.cc:243] Waited 933 us on lock 0x7b18000d0fc0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b 00007f9bb0affd23 00007f9bb0b000d1 00007f9bb0f1ba0f
0709 12:22:11.991277 (+138407us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:12.071810 (+ 80533us) log.cc:844] Serialized 14 byte log entry
0709 12:22:12.088532 (+ 16722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.088622 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:12.088662 (+    40us) raft_consensus.cc:1685] finished
0709 12:22:12.134110 (+ 45448us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.134783 (+   673us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57304,"raft.queue_time_us":96879,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":39999,"spinlock_wait_cycles":2146560,"thread_start_us":211241,"threads_started":2,"wal-append.queue_time_us":1103836}
I20260709 12:22:12.213212 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:12.213905 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:12.195741 16039 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:12.185316 16032 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:12.153963 16298 consensus_queue.cc:1059] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:22:12.218533 10928 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:22:12.219604 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.176636 16312 consensus_queue.cc:1059] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:22:12.245887 10927 raft_consensus.cc:2376] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16. Re-sending same reply.
I20260709 12:22:12.220798 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.220971 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41098 (request call id 429) took 1654 ms. Trace:
I20260709 12:22:12.221459 10935 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: [14.11-16.12]
I20260709 12:22:12.222230 11076 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: [14.11-16.12]
I20260709 12:22:12.222429 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.084847 15644 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:12.230015 16228 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:12.236035 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 54020.8us
I20260709 12:22:12.243022 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.243527 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:12.170230 16303 consensus_queue.cc:1059] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 12:22:12.222316 15995 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:12.234151 16058 raft_consensus.cc:697] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:12.247241 11003 rpcz_store.cc:276] 0709 12:22:10.566985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.568032 (+  1047us) service_pool.cc:224] Handling call
0709 12:22:10.568331 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:10.606523 (+ 38192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:10.606553 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:10.606984 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 12:22:10.698959 (+ 91975us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:10.707741 (+  8782us) log.cc:844] Serialized 14 byte log entry
0709 12:22:10.833943 (+126202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.834032 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:12.066216 (+1232184us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:22:12.220677 (+154461us) raft_consensus.cc:1685] finished
0709 12:22:12.220770 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.220908 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61297,"prepare.queue_time_us":8177,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":254109,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":26450,"spinlock_wait_cycles":7699328,"thread_start_us":215805,"threads_started":2,"wal-append.queue_time_us":253274}
I20260709 12:22:12.280848 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:12.167649 16258 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:22:12.263131 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:12.283933 16312 raft_consensus.cc:3055] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:12.284407 16312 raft_consensus.cc:740] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:12.285198 16312 consensus_queue.cc:260] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:12.285991 16274 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.286577 16274 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:12.287130 16278 raft_consensus.cc:3055] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:12.287557 16278 raft_consensus.cc:740] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:12.289179 16298 raft_consensus.cc:3055] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:12.289054 16274 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:12.290211 16274 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.290676 16274 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:12.292801 16274 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:12.260744 16032 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:12.293366 16248 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.994s	user 0.022s	sys 0.006s
W20260709 12:22:12.293756 16248 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.994s	user 0.022s	sys 0.006s
I20260709 12:22:12.294766 16032 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:12.295807 16141 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:12.296869 16268 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.297395 16268 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:12.298020 16303 raft_consensus.cc:3055] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:12.298442 16303 raft_consensus.cc:740] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:12.300113 15820 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:12.301697 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.302021 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 3020) took 1954 ms. Trace:
I20260709 12:22:12.302984 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:12.303215 15820 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:12.269605 11006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3246) took 1372 ms. Trace:
I20260709 12:22:12.299486 16303 consensus_queue.cc:260] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:12.319929 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:12.320295 10927 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:12.270918 16299 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:12.274117 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:12.321920 11008 raft_consensus.cc:2393] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 16: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:12.320514 10933 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:12.279132 16277 raft_consensus.cc:3055] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:12.280598 16058 consensus_queue.cc:237] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:12.323899 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.289625 16298 raft_consensus.cc:740] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:12.286401 16312 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:12.311784 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.313227 10934 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:12.314687 10930 raft_consensus.cc:1275] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:12.302359 11084 rpcz_store.cc:276] 0709 12:22:10.347424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.929824 (+582400us) service_pool.cc:224] Handling call
0709 12:22:11.332903 (+403079us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:11.333168 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:11.333192 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:11.334506 (+  1314us) log.cc:844] Serialized 26 byte log entry
0709 12:22:11.490955 (+156449us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:11.699343 (+208388us) log.cc:844] Serialized 14 byte log entry
0709 12:22:11.702580 (+  3237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.702666 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:11.802695 (+100029us) raft_consensus.cc:1685] finished
0709 12:22:11.802715 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.301852 (+499137us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b540031ea50. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:12.301965 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":208356,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":1393,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":137,"spinlock_wait_cycles":899354880,"thread_start_us":349836,"threads_started":2,"wal-append.queue_time_us":284806}
I20260709 12:22:12.268183 10901 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:12.270208 15644 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:12.267495 16228 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:12.268517 16287 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:12.325700 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.325147 10929 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:12.319262 11006 rpcz_store.cc:276] 0709 12:22:10.897050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.897254 (+   204us) service_pool.cc:224] Handling call
0709 12:22:11.330929 (+433675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:11.331134 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:11.331159 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:11.331198 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:11.331233 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.331285 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.269435 (+938150us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b54002d9e50. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:12.269544 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":996598144}
I20260709 12:22:12.338081 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:12.246655 16039 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:12.324714 16277 raft_consensus.cc:740] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:22:12.332552 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 64432.6us
I20260709 12:22:12.327955 10935 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:12.333545 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:12.360906 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 292311us
I20260709 12:22:12.299515 16268 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:12.338742 11084 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 13.
I20260709 12:22:12.325119 16303 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:12.348322 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.349584 10974 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:12.348013 10901 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:12.394300 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 46372.2us
I20260709 12:22:12.334834 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.396088 10930 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:22:12.396961 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.359468 10933 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:12.398240 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.398809 10933 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:22:12.393819 10931 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:12.400537 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:12.402168 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 47535us
I20260709 12:22:12.404379 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:12.350888 16322 log.cc:927] Time spent T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.074s	user 0.006s	sys 0.000s
I20260709 12:22:12.323927 16297 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:12.323663 15820 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:12.402429 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:12.408459 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.436564 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:12.426789 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 77275.5us
I20260709 12:22:12.430497 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:12.462769 10974 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:12.457975 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:12.405586 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:12.464751 10936 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 14: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:12.407744 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.346798 16032 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:12.427973 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:12.471637 10931 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:12.427034 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.472781 10927 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:12.449309 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:12.473832 11084 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:12.469640 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.474723 10928 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:12.475562 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:12.476264 10928 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:12.478510 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.479238 10936 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:12.480506 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.482565 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:12.481179 10936 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
W20260709 12:22:12.463898 16005 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.021s	sys 0.004s
I20260709 12:22:12.484526 11083 raft_consensus.cc:2410] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:22:12.491395 11080 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 12: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:12.491919 11085 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:22:12.386124 16141 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:12.489076 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:12.405071 16268 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:12.448052 16319 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.488130 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:12.536818 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:12.537569 10928 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:12.498764 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.538334 10936 raft_consensus.cc:2393] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 10: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:12.499497 11079 raft_consensus.cc:2393] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 15: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:12.435685 16277 consensus_queue.cc:260] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:12.436657 15910 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:12.437085 15644 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.518457 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.519088 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:12.519201 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:12.544914 11003 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:22:12.440775 16262 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:12.519143 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:12.478734 15889 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:12.477427 16258 consensus_queue.cc:1059] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:22:12.526329 10931 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:22:12.557425 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.558127 10931 raft_consensus.cc:2393] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 19: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:12.558835 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.559532 10931 raft_consensus.cc:2393] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:12.528298 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:12.560026 11084 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:22:12.560418 16324 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:22:12.527514 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:12.564492 11081 raft_consensus.cc:2368] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16.
I20260709 12:22:12.565442 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:12.566048 11081 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:12.490171 16005 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.022s	sys 0.004s
I20260709 12:22:12.521039 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:12.559645 16258 raft_consensus.cc:3055] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:12.569451 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:12.569723 16258 raft_consensus.cc:740] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:12.570668 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:12.571286 11080 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 18.
I20260709 12:22:12.538467 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.572791 11622 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:12.573652 10928 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: [12.10-13.11]
I20260709 12:22:12.575083 10928 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:12.523695 11006 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:22:12.552731 16277 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:12.530148 16141 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:12.549005 15644 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:12.543264 15910 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:12.554276 16262 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:12.570785 16258 consensus_queue.cc:260] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:12.552601 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:12.549657 15889 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:12.577965 10931 raft_consensus.cc:1240] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:22:12.552611 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.587666 10936 raft_consensus.cc:2410] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:22:12.439199 16278 consensus_queue.cc:260] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:12.590021 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 260399us
W20260709 12:22:12.591176 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:12.592032 10977 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.811s (SENT) [suppressed 19 similar messages]
W20260709 12:22:12.592870 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.593379 11084 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:22:12.586517 10933 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 12: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:12.586781 10927 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 17: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:12.579381 11080 raft_consensus.cc:1217] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Deduplicated request from leader. Original: 10.9->[12.10-13.11]   Dedup: 12.10->[13.11-13.11]
I20260709 12:22:12.393798 16298 consensus_queue.cc:260] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:12.588397 16248 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:12.613493 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:12.585656 11085 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:12.597858 10932 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:12.600229 11080 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: [12.10-13.11]
I20260709 12:22:12.584197 15910 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:12.543849 16319 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:12.606969 11081 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 14.
I20260709 12:22:12.589762 15889 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:12.596711 10931 raft_consensus.cc:1240] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16. Ops: [14.9-15.10]
I20260709 12:22:12.614382 10927 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:12.596527 16039 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:12.621939 16323 log.cc:927] Time spent T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:22:12.623728 16262 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:12.626330 16123 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:12.627038 16261 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:12.628813 16191 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:12.631460 10933 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:12.606248 16258 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:12.606041 16296 raft_consensus.cc:3055] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:12.609952 16278 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:12.608912 16248 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:22:12.644121 16330 log.cc:927] Time spent T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:22:12.732112 16329 log.cc:927] Time spent T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
W20260709 12:22:12.733611 16335 log.cc:927] Time spent T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:22:12.661532 16108 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
W20260709 12:22:12.736470 16334 log.cc:927] Time spent T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:22:12.737743 15644 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:12.739637 16319 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:12.677125 16071 consensus_queue.cc:1059] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:22:12.741120 16071 raft_consensus.cc:3055] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:12.741458 16071 raft_consensus.cc:740] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:12.742267 16071 consensus_queue.cc:260] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:12.676791 16259 consensus_queue.cc:1059] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:22:12.743834 16259 raft_consensus.cc:3055] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:22:12.744166 16325 log.cc:927] Time spent T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:22:12.714380 15820 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:12.718331 16296 raft_consensus.cc:740] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:12.634534 16298 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:12.749477 16296 consensus_queue.cc:260] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:12.750613 16296 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:12.752581 10933 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:22:12.753225 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:12.754355 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:12.755296 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:12.648690 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:12.650534 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:12.659235 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 193469us
I20260709 12:22:12.680783 10899 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:12.760953 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:12.681304 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:12.677670 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.763199 10931 raft_consensus.cc:2393] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 17: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:12.684571 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:12.763690 11080 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:12.700695 11010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2550) took 1122 ms. Trace:
I20260709 12:22:12.761262 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:12.613309 16228 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:12.704133 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 204864us
W20260709 12:22:12.780790 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 100119us
I20260709 12:22:12.781348 11006 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:12.781524 10899 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:12.782482 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.784025 15222 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:22:12.703540 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 206503us
W20260709 12:22:12.784624 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.709622 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:12.712154 10932 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:22:12.728111 16248 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:12.765194 11656 raft_consensus.cc:2410] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:22:12.778580 11082 raft_consensus.cc:2393] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 16: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:12.661232 15995 consensus_queue.cc:1059] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:22:12.778883 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:12.796152 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:12.797350 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:12.779132 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:12.798053 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.764425 11010 rpcz_store.cc:276] 0709 12:22:11.578254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.578392 (+   138us) service_pool.cc:224] Handling call
0709 12:22:11.580421 (+  2029us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.320906 (+740485us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:12.320941 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:12.320984 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:12.321023 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.394379 (+ 73356us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b1800468880. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade412a6 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419
0709 12:22:12.700404 (+306025us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b540012cad4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:12.700466 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.700616 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42402,"raft.queue_time_us":29747,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":93,"spinlock_wait_cycles":1637222016}
I20260709 12:22:12.798390 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:12.706867 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:12.799592 11082 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:12.661669 16297 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:12.787748 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.802270 10936 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:12.792590 11657 raft_consensus.cc:1240] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:12.782341 10927 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:12.801522 11076 raft_consensus.cc:2410] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:22:12.798172 10931 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:12.808274 11080 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:12.812433 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:12.815296 15995 consensus_queue.cc:1243] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:22:12.816079 16255 raft_consensus.cc:3055] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:12.816447 16255 raft_consensus.cc:740] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:12.817076 10927 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:12.817303 16255 consensus_queue.cc:260] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:12.816110 16032 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.818622 16255 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:12.818886 16032 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:12.819169 16319 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:12.823239 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:12.824410 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:12.824991 11081 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:22:12.825757 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:12.829398 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:12.830550 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:12.831511 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:12.832787 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:12.835126 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.835709 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:12.837716 15944 consensus_queue.cc:1059] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:12.744210 16259 raft_consensus.cc:740] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:12.839082 10977 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:12.839216 10974 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:12.840843 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:12.848177 11078 raft_consensus.cc:2410] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:22:12.841079 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:12.842170 10899 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:12.849006 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:12.842696 15222 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:12.846660 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:12.851141 10929 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:12.851482 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:12.852310 11081 raft_consensus.cc:2410] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:22:12.850915 10899 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:12.853472 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.856575 10899 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:12.857090 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.857753 10977 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:12.857705 10936 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:12.856492 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:12.860594 11050 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:12.862599 11080 raft_consensus.cc:1240] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:12.865342 10974 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:12.866533 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:12.869872 10929 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:12.870142 11076 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:22:12.870783 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:12.871338 10929 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:12.872227 11005 raft_consensus.cc:2393] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 15: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:12.873641 10899 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:12.877030 11076 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:22:12.877660 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.878286 10934 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:22:12.879400 10934 raft_consensus.cc:1240] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: [10.8-12.9]
I20260709 12:22:12.881143 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:12.882524 10977 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:12.883896 10974 leader_election.cc:400] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16.
I20260709 12:22:12.884374 10974 leader_election.cc:403] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:12.863533 11081 raft_consensus.cc:1240] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:12.886370 10977 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:12.887151 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:12.888010 11078 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 17: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:12.875785 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:12.847625 16041 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:12.892478 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:12.895011 11076 raft_consensus.cc:1240] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:12.913326 11078 raft_consensus.cc:1240] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:12.913482 11076 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:12.855628 16048 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:22:12.932791 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.933306 11077 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:22:12.933566 10932 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:22:12.885848 16271 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:12.880045 16191 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:22:12.899997 16312 consensus_meta.cc:287] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.568s	user 0.010s	sys 0.000s
I20260709 12:22:12.892974 15995 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:12.892446 16123 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:12.875172 16039 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:12.940284 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:13.003103 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:12.888397 16319 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:12.980749 11081 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:12.982048 10929 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:12.855175 16261 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 12:22:12.855315 16108 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 12:22:12.986852 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:12.864707 16262 consensus_queue.cc:1048] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 12:22:12.919193 16299 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:13.003598 10927 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:22:12.973886 16269 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:13.029843 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:12.936262 16041 raft_consensus.cc:697] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:12.985872 16271 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:13.008592 10932 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:13.014596 11051 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:13.035914 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:12.997123 15995 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:13.045514 11051 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:13.046926 11051 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:13.016170 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:13.014746 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:13.010582 15944 raft_consensus.cc:3055] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:13.041422 16271 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:13.021591 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:13.093918 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 333472us
I20260709 12:22:13.022687 11009 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:22:13.021184 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:12.989248 16264 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16.
I20260709 12:22:12.987771 16191 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:13.037298 16319 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.063179 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:13.109525 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:13.004063 16005 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:13.095404 11002 raft_consensus.cc:1240] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:13.061157 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:13.047508 15995 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:13.043694 16048 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:13.028770 16269 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:13.112913 11004 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:22:13.112605 16343 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 12:22:13.051488 16299 raft_consensus.cc:697] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:12.983362 16259 consensus_queue.cc:260] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:13.061738 16267 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:13.055089 15944 raft_consensus.cc:740] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:13.060719 16229 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:22:13.124018 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 51460.2us
I20260709 12:22:13.096537 15853 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:13.110858 16191 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:22:13.133554 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 249796us
W20260709 12:22:13.121929 16303 consensus_meta.cc:287] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.713s	user 0.011s	sys 0.000s
I20260709 12:22:13.138762 11051 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:13.141495 10974 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:13.127377 16269 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:13.143913 10930 raft_consensus.cc:2410] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:22:13.132560 16005 raft_consensus.cc:697] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:13.162271 11051 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:13.136124 16229 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:13.130412 16289 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:22:13.144841 16228 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:13.156044 16108 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:13.156359 16259 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:13.152988 15644 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:13.166280 16277 consensus_meta.cc:287] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.001s
I20260709 12:22:13.131510 16041 consensus_queue.cc:237] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:13.167346 16005 consensus_queue.cc:237] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:13.174131 16229 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:13.205084 16141 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:13.200342 16299 consensus_queue.cc:237] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:13.180253 16274 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:13.133389 16048 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:13.172294 15853 consensus_queue.cc:1059] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:22:13.245829 16255 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:13.246718 15889 consensus_meta.cc:287] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.543s	user 0.004s	sys 0.004s
I20260709 12:22:13.246418 16255 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:13.247128 15889 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:13.250177 11011 raft_consensus.cc:1240] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:13.123252 16319 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:13.248952 16255 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:13.255044 16278 consensus_meta.cc:287] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.002s
I20260709 12:22:13.180775 15944 consensus_queue.cc:260] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:13.280236 15910 consensus_meta.cc:287] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.577s	user 0.010s	sys 0.000s
I20260709 12:22:13.178838 11051 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:13.298146 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 400955us
W20260709 12:22:13.140482 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 266889us
I20260709 12:22:13.301991 10899 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:13.282814 15889 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:13.359591 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 57699.2us
I20260709 12:22:13.360497 10899 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:13.362146 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 475818us
I20260709 12:22:13.363060 10977 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:13.274263 16032 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:13.295620 16258 consensus_meta.cc:287] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.570s	user 0.006s	sys 0.003s
I20260709 12:22:13.367913 10899 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:13.373875 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.413829 15222 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:22:13.415915 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:13.418424 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 267021us
W20260709 12:22:13.440629 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 264113us
I20260709 12:22:13.291194 15944 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:13.443755 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 75925.1us
I20260709 12:22:13.281329 16183 consensus_queue.cc:1059] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 12:22:13.446655 10899 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:13.475675 10899 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:13.477555 10899 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:13.475225 15222 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:13.480782 15222 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:13.481148 15222 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:13.481452 15222 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:22:13.513306 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 93863.7us
I20260709 12:22:13.517017 10899 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:13.401437 16296 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:13.374954 16309 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.382709 16354 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:13.296029 15910 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:13.518790 11051 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:13.530083 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 167110us
I20260709 12:22:13.480813 16289 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:13.533202 10977 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:13.482447 16275 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:13.531198 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 422120us
I20260709 12:22:13.524276 16303 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:13.565656 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:13.567560 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:13.573426 15222 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:13.578155 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:13.582301 10901 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:13.520913 16258 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 12:22:13.547542 16296 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:13.583278 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:13.583940 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 284330us
I20260709 12:22:13.592792  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:13.590216 10974 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:13.566989 16346 log.cc:927] Time spent T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.388s	user 0.000s	sys 0.001s
I20260709 12:22:13.518106 16165 consensus_queue.cc:1059] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
W20260709 12:22:13.594820 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 496348us
I20260709 12:22:13.536794 16309 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:13.565412 16357 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:13.584859 16354 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:13.613478 16349 raft_consensus.cc:3055] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:22:13.608130 16350 log.cc:927] Time spent T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.365s	user 0.001s	sys 0.001s
I20260709 12:22:13.573390 16255 raft_consensus.cc:2764] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 12:22:13.622824 16363 log.cc:927] Time spent T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:22:13.563098 16275 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:13.619719 16349 raft_consensus.cc:740] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:13.568017 16289 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:13.597538 11625 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:13.626155 10901 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:13.574894 16355 consensus_queue.cc:1059] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:22:13.609290 16319 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:13.611050 16357 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:13.596552 16303 consensus_queue.cc:1059] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:22:13.581153 16271 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:13.615980 16351 log.cc:927] Time spent T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:22:13.614887 16183 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.621255 16261 consensus_queue.cc:1059] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:22:13.619169 16195 consensus_queue.cc:1059] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:22:13.642289 15222 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:13.663869 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 66397.6us
I20260709 12:22:13.734663 11625 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:13.735791 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 109732us
I20260709 12:22:13.664966 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3173) took 1373 ms. Trace:
I20260709 12:22:13.718354 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:13.736804 10901 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:13.715155 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.681753 11003 raft_consensus.cc:2393] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 16: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:22:13.730337 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 211616us
I20260709 12:22:13.742923 11051 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:13.737800 15222 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:13.719769 16298 consensus_meta.cc:287] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.970s	user 0.010s	sys 0.001s
W20260709 12:22:13.724514 16269 consensus_meta.cc:287] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.560s	user 0.008s	sys 0.003s
I20260709 12:22:13.775507 11051 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:13.653362 16277 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:13.665117 16353 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
I20260709 12:22:13.628288 16370 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:13.736666 11084 rpcz_store.cc:276] 0709 12:22:12.291971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.600800 (+308829us) service_pool.cc:224] Handling call
0709 12:22:12.601109 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:12.752183 (+151074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:12.752214 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:12.752733 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 12:22:13.034553 (+281820us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:13.034621 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:13.034704 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:13.664737 (+630033us) raft_consensus.cc:1685] finished
0709 12:22:13.664758 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:13.664898 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":150693,"raft.queue_time_us":151863,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":84,"thread_start_us":278346,"threads_started":1,"wal-append.queue_time_us":380022}
I20260709 12:22:13.738886 10901 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:13.732690 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 167101us
I20260709 12:22:13.789543 11051 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:13.790462 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:13.745313 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 142349us
W20260709 12:22:13.692229 16358 log.cc:927] Time spent T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:22:13.713022 15910 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:13.777531 16191 consensus_meta.cc:287] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.631s	user 0.005s	sys 0.006s
I20260709 12:22:13.661001 16357 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:13.812557 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 73744.6us
I20260709 12:22:13.661204 16354 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:13.794775 11051 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:13.796669 10977 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:13.809449 15222 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.819041 15222 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:13.746898 16309 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:13.650728 16108 raft_consensus.cc:697] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:13.816558 10901 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:13.739723 16366 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:13.827785 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:13.716012 16032 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:13.715296 16375 raft_consensus.cc:3055] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:13.851594 16375 raft_consensus.cc:740] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:13.852525 16375 consensus_queue.cc:260] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:13.853809 16375 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:13.696585 16195 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:13.824011 11051 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:13.856791 16312 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:13.857211 16312 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:13.857573 16312 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:22:13.858748 16267 consensus_meta.cc:287] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.719s	user 0.008s	sys 0.000s
I20260709 12:22:13.859267 16267 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:22:13.863049 15995 consensus_meta.cc:287] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.735s	user 0.006s	sys 0.002s
I20260709 12:22:13.823645 16388 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:13.808331 16165 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:13.823257 16298 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:22:13.865341 16312 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:13.866242 16248 consensus_meta.cc:287] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 1.026s	user 0.009s	sys 0.000s
I20260709 12:22:13.818011 15853 consensus_queue.cc:1059] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:22:13.866654 16248 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:13.867741 11658 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:13.787835 16269 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:13.870217 16269 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:13.827171 16303 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:13.818323 16005 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:13.819352 16385 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:13.813445 16213 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:13.825870 16382 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.834688 11002 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16. Ops: []
W20260709 12:22:13.798482 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:13.894290 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 70363.5us
I20260709 12:22:13.895591 11051 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
W20260709 12:22:13.895905 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 161336us
I20260709 12:22:13.678817 16183 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:13.794189 15820 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:13.743639 16376 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:13.847579 16261 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:13.847942 16381 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:13.849153 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:13.849933 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2455) took 1368 ms. Trace:
I20260709 12:22:13.850519 16390 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.847456 16309 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:13.883361 16382 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:13.911845 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3176) took 1619 ms. Trace:
W20260709 12:22:13.901400 16123 consensus_meta.cc:287] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.896s	user 0.010s	sys 0.001s
I20260709 12:22:13.902251 11625 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:13.924105 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:13.812358 16299 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.007s	sys 0.012s
W20260709 12:22:13.851132 16383 log.cc:927] Time spent T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:22:13.875792 15644 consensus_meta.cc:287] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.683s	user 0.006s	sys 0.002s
W20260709 12:22:13.900362 16378 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.187s	user 0.000s	sys 0.002s
I20260709 12:22:13.692276 16349 consensus_queue.cc:260] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:13.906607 10928 rpcz_store.cc:276] 0709 12:22:12.481166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.575764 (+ 94598us) service_pool.cc:224] Handling call
0709 12:22:12.580042 (+  4278us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:12.607655 (+ 27613us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:12.689127 (+ 81472us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b18001d34a0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9baddedc0a 00007f9bb752d219 00007f9bade75a40 00007f9bade704e4 00007f9bade70455 00007f9bb49583c7 00007f9bb0f6a9a7 00007f9bb0f7a0bf 00007f9bb0f7a038
0709 12:22:12.996707 (+307580us) log.cc:844] Serialized 14 byte log entry
0709 12:22:13.288572 (+291865us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:13.290266 (+  1694us) log.cc:844] Serialized 52 byte log entry
0709 12:22:13.290434 (+   168us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:13.290468 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:13.290540 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:13.834046 (+543506us) raft_consensus.cc:1685] finished
0709 12:22:13.849647 (+ 15601us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:13.849813 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":258,"prepare.queue_time_us":112656,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":12153,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":22396,"spinlock_wait_cycles":13139712,"thread_start_us":519418,"threads_started":2,"wal-append.queue_time_us":574630}
I20260709 12:22:13.824853 16264 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.897888 16165 raft_consensus.cc:697] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:13.878960 16108 consensus_queue.cc:237] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:13.899670 15222 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:13.901562 16259 consensus_meta.cc:287] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.708s	user 0.007s	sys 0.004s
I20260709 12:22:13.863541 15995 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:13.922734 11083 rpcz_store.cc:276] 0709 12:22:12.292692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.859627 (+566935us) service_pool.cc:224] Handling call
0709 12:22:12.859965 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:12.935106 (+ 75141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:12.935140 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:12.935651 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:22:13.297873 (+362222us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:13.297918 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:13.298005 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:13.911655 (+613650us) raft_consensus.cc:1685] finished
0709 12:22:13.911674 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:13.911791 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94224,"raft.queue_time_us":136445,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":6081,"thread_start_us":361809,"threads_started":1,"wal-append.queue_time_us":545736}
I20260709 12:22:13.878921 16275 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:13.882328 16271 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:13.880904 16213 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:13.912571 16312 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:13.903368 15820 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:13.822700 16191 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:13.929595 11051 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:13.946882 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 150277us
I20260709 12:22:13.934482 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:14.125871 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:14.154316 10935 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 14.
I20260709 12:22:13.910663 16390 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:13.912961 16248 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:14.138654 16303 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.139787 16349 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:14.140131 16165 consensus_queue.cc:237] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.141124 16388 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:14.185871 11625 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:14.140069 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:14.141930 16368 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:22:13.928108 16371 log.cc:927] Time spent T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.231s	user 0.001s	sys 0.001s
I20260709 12:22:13.932196 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:14.155114 10977 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:22:13.928062 16299 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.008s	sys 0.013s
W20260709 12:22:14.159842 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:14.161002 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 231920us
I20260709 12:22:14.195636 11051 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:14.196853 11051 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:13.920039 16382 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:14.066778 15853 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:14.162554 11005 raft_consensus.cc:2393] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 15: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:14.164007 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:14.070609 16005 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:14.067349 15944 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:13.937376 16123 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:13.906806 16039 consensus_queue.cc:1059] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.240s
I20260709 12:22:14.144040 15644 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:14.124325 16309 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:22:14.180074 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.135568 16385 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:14.238071 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:13.908421 16261 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.185588 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:14.141541 16370 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:14.146962 16213 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:14.160553 15820 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:13.928287 16381 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:14.194123 10977 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:14.165758 16275 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:13.967260 16389 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:14.202764 11051 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:14.204135 11656 raft_consensus.cc:2368] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14.
I20260709 12:22:14.138734 16264 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.197552 16368 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.203881 16298 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:14.205842 15853 raft_consensus.cc:697] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:14.210094 16005 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.210958 16191 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:14.195218 16388 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:14.216464 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 108093us
W20260709 12:22:14.218788 16229 consensus_meta.cc:287] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.985s	user 0.009s	sys 0.000s
I20260709 12:22:14.259285 16229 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.259594 11049 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:14.260630 15644 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:14.261536 16229 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:14.201076 15910 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:14.261891 11049 leader_election.cc:400] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14.
I20260709 12:22:13.910563 16376 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:14.197170 16271 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:14.262833 16271 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:14.203939 16312 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:14.206028 16287 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:14.182999 16303 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:14.268112 10930 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 11.
I20260709 12:22:14.247567 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:14.268965 10933 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 12.
I20260709 12:22:14.236956 16385 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:14.251320 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 48659.4us
I20260709 12:22:14.278525 11051 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:14.227002 16392 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:22:14.255226 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 61183.5us
I20260709 12:22:14.213847 16071 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:14.280797 10977 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:14.281029 11051 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:14.262246 11049 leader_election.cc:403] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:14.249807 11653 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:22:14.271235 16390 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:14.285790 10977 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:14.285969 16388 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:14.287253 16277 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:14.288275 16312 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14.
I20260709 12:22:14.254456 16298 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.289089 15995 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:14.272115 11625 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:14.290403 16255 raft_consensus.cc:3055] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:14.290756 16298 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:14.291589 16384 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:14.292166 16384 raft_consensus.cc:697] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:14.293268 16048 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:14.292990 16384 consensus_queue.cc:237] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.294001 16392 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:14.294413 16392 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.294749 16392 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:14.296563 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:14.273393 16303 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:14.275345 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:14.298080 11656 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:22:14.275390 11002 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 12:22:14.298962 11002 pending_rounds.cc:85] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 9
I20260709 12:22:14.299247 11002 pending_rounds.cc:107] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 12:22:14.299489 11002 raft_consensus.cc:2889] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:14.241019 16370 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.262221 15910 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:14.300431 15910 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:14.301645 16370 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:14.250880 16275 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.302361 16275 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:14.305233 10900 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:14.306881 10900 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:14.307174 16005 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:14.255847 16366 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:14.256572 16175 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:14.308645 16303 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:14.308386 15853 consensus_queue.cc:237] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:14.309069 16303 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.309552 16303 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:14.251976 16381 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:14.311643 16366 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.312736 16287 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:14.313197 16287 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:14.313570 16287 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:14.313967 16381 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:14.244197 16309 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.316180 16309 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:14.290798 16255 raft_consensus.cc:740] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:14.308117 16048 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:14.274694 16264 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:14.336905 15889 raft_consensus.cc:3055] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:14.337389 15889 raft_consensus.cc:740] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:14.338476 16271 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:14.331501 11081 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 3028) took 1696 ms. Trace:
I20260709 12:22:14.339082 11081 rpcz_store.cc:276] 0709 12:22:12.634783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.907772 (+272989us) service_pool.cc:224] Handling call
0709 12:22:12.980550 (+ 72778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:13.007054 (+ 26504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:14.331291 (+1324237us) spinlock_profiling.cc:243] Waited 72.4 ms on lock 0x7b54000e0e50. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:14.331438 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166444288}
I20260709 12:22:14.308207 16175 raft_consensus.cc:697] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:14.334534 15644 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:14.321990 16373 raft_consensus.cc:3055] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:14.276872 16368 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:14.326438 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 45572.8us
I20260709 12:22:14.271075 16108 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:22:14.343019 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 57299.2us
I20260709 12:22:14.320492 16261 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:14.338182 15889 consensus_queue.cc:260] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.385394 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:22:14.316310 16289 consensus_meta.cc:287] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.658s	user 0.010s	sys 0.000s
I20260709 12:22:14.389148 11051 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:14.279667 16191 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.318024 16385 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:14.333529 16041 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:14.333489 16388 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:14.388302 16271 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:14.396334 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:22:14.405922 16395 log.cc:927] Time spent T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:22:14.408919 11051 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:14.405247 10933 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:22:14.410527 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:14.412112 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 3287) took 1374 ms. Trace:
I20260709 12:22:14.385521 16373 raft_consensus.cc:740] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:14.414858 16274 raft_consensus.cc:3055] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:14.416401 16388 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:14.427743 10931 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:22:14.428049 11003 rpcz_store.cc:276] 0709 12:22:13.037816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.037944 (+   128us) service_pool.cc:224] Handling call
0709 12:22:14.411774 (+1373830us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b54002db754. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:14.412050 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1297937792}
I20260709 12:22:14.395812 16108 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:14.401729 15644 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:14.424530 16165 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:14.413924 15889 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:14.414937 16264 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:14.407426 16191 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.425108 16171 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:14.448143 16175 consensus_queue.cc:237] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:14.453574 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:14.497378 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:14.497970 10929 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:14.503466 11004 pending_rounds.cc:85] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 10
I20260709 12:22:14.504073 11004 pending_rounds.cc:107] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:22:14.504319 11004 raft_consensus.cc:2889] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:14.457881 15944 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:14.417764 16041 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.519318 10901 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:14.453718 15853 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:14.459510 16373 consensus_queue.cc:260] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.417577 16255 consensus_queue.cc:260] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.463533 11655 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:14.464600 11011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3288) took 1415 ms. Trace:
I20260709 12:22:14.526849 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:14.526597 11011 rpcz_store.cc:276] 0709 12:22:13.049257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.049675 (+   418us) service_pool.cc:224] Handling call
0709 12:22:13.049973 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:13.250676 (+200703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:14.464345 (+1213669us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b540012acd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:14.464540 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":459966208}
I20260709 12:22:14.529225 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:14.468245 11051 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:14.406379 16375 consensus_meta.cc:287] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.552s	user 0.012s	sys 0.000s
I20260709 12:22:14.408087 16289 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:22:14.469732 16357 consensus_meta.cc:287] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.001s
I20260709 12:22:14.491775 11656 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:22:14.476851 16298 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.466884 16274 raft_consensus.cc:740] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:14.495496 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:14.496080 16264 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:14.509104 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:14.510003 16229 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.510610 16287 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.511365 16388 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:14.479894 16108 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:14.484519 16165 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:14.562585 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:14.512389 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:14.513767 16303 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:14.517159 11003 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:22:14.524344 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.522104 16355 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:14.538554 10929 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:14.491394 16261 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.580575 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:14.581275 10932 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:14.547415 16255 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:14.548236 16373 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:14.582214 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:14.544941 11050 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:14.550153 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 81976.8us
I20260709 12:22:14.583163 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:14.583964 10929 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 13: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:14.584682 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:14.585352 10929 raft_consensus.cc:2393] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 15: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:14.531992 16382 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.523097 15853 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:22:14.558779 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.594547 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:14.595115 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:14.544471 16381 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:22:14.492430 15644 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:14.547518 16377 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.004s	sys 0.019s
I20260709 12:22:14.575747 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:14.568089 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:14.616143 10934 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:14.551118 16141 consensus_queue.cc:1059] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:22:14.550563 16357 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.553458 16129 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:14.591636 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:14.620872 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:14.624266 11006 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:22:14.592618 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:14.551934 15944 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:14.528261 16171 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:14.560436 16268 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.595731 10932 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:22:14.597126 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:14.597980 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:14.598908 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 58899.3us
I20260709 12:22:14.599419 16265 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:14.646580 11008 raft_consensus.cc:1240] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 10. Current term is 11. Ops: []
W20260709 12:22:14.603830 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.575829 16165 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:14.614549 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.606225 10977 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:14.540313 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:14.552706 15820 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.551239 16059 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:22:14.589684 16385 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:14.625257 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:14.551716 16298 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:14.624788 10928 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 11.
I20260709 12:22:14.555104 16229 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.597138 15853 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:14.690680 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:14.631516 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:14.620087 16377 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.004s	sys 0.020s
I20260709 12:22:14.649214 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:14.696053 10929 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 13.
W20260709 12:22:14.661628 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:14.663335 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 66402.9us
I20260709 12:22:14.698997 11077 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:14.686445 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:14.663834 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:14.593993 16261 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.671829 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:14.678005 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:14.701654 11081 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:14.701781 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:14.596758 16382 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.590574 16355 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.685110 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:14.706949 10928 raft_consensus.cc:2393] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 18: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:22:14.687119 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 80947.8us
I20260709 12:22:14.688027 11078 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:22:14.713089 11078 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:14.693567 16041 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:14.641065 15944 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.696485 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:14.716431 11006 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:14.704260 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:14.718451 10929 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:14.699031 11625 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:14.706063 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:14.682623 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:14.722656 11083 raft_consensus.cc:2393] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 11: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:14.719961 11625 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:14.711380 10977 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:14.726437 10932 raft_consensus.cc:2393] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 13: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:14.727207 10934 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:14.730422 15944 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:14.731027 11010 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:14.731513 16041 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:14.736178 11007 raft_consensus.cc:1240] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:14.747629 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:14.739305 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:14.742519 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:14.748282 11081 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:14.611142 16274 consensus_queue.cc:260] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.646917 16268 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.750159 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:14.755306 11076 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:14.675300 16141 consensus_queue.cc:1059] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
W20260709 12:22:14.762777 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.764549 11007 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:14.764673 10934 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:22:14.734372 16262 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:14.769694 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:14.740582 16375 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:14.773320 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:14.741045 16183 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:14.740491 16389 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:14.786912 11078 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:14.802977 11079 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:22:14.749743 16267 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:14.760475 16298 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:14.818598 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:14.826030 11078 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:22:14.824674 11076 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:14.761726 16041 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.828263 16355 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:14.800691 16389 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:14.829704 16389 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:14.829844 16275 consensus_meta.cc:287] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.000s
I20260709 12:22:14.830281 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:14.830986 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:14.777292 16375 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:14.831670 11078 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:14.832847 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:14.833210 16275 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:14.834339 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:14.836042 16275 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:14.836895 16382 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:14.839259 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:14.830116 16267 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:14.832051 16375 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:14.861384 16406 log.cc:927] Time spent T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 12:22:14.861984 16267 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:14.865167 16213 consensus_meta.cc:287] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.000s
I20260709 12:22:14.865932 16357 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:14.867146 16261 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:14.868201 15820 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:14.818336 16271 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:22:14.869472 16392 consensus_meta.cc:287] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.574s	user 0.010s	sys 0.000s
W20260709 12:22:14.870278 16404 log.cc:927] Time spent T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:22:14.871673 16366 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:14.877215 16297 raft_consensus.cc:3055] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:14.779115 16274 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:14.772158 16262 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:14.859462 16229 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:14.888599 15910 consensus_meta.cc:287] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.588s	user 0.008s	sys 0.002s
I20260709 12:22:14.801182 16032 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:14.889364 16071 consensus_meta.cc:287] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.001s
I20260709 12:22:14.829818 16041 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:14.813482 16191 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:14.845670 16287 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:14.902263 16271 raft_consensus.cc:697] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:22:14.933507 16380 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 1.119s	user 0.008s	sys 0.005s
I20260709 12:22:14.933724 16271 consensus_queue.cc:237] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.902107 16392 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:14.900099 16264 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:14.939070 16228 raft_consensus.cc:3055] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:14.943519 16376 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:14.918793 16297 raft_consensus.cc:740] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:14.923195 16262 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:14.935784 16269 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.964937 16389 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:14.967170 16389 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:14.965083 16392 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:14.971951 16375 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:15.009769 10831 catalog_manager.cc:5697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 11 to 14, leader changed from 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 14 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:15.020958 10831 catalog_manager.cc:5697] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 11 to 12, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 12 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:15.025523 10831 catalog_manager.cc:5697] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 10 to 16, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 16 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:15.019413 10927 raft_consensus.cc:1240] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:22:15.030193 10927 raft_consensus.cc:1240] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:22:15.029440 10831 catalog_manager.cc:5697] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 6 to 7, leader changed from 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 7 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:15.034437 10927 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:15.033735 10831 catalog_manager.cc:5697] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 9 to 11, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 11 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:22:15.036433 10831 catalog_manager.cc:5697] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 7 to 12, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 12 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:22:15.041594 10931 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:15.052855 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:15.054448 11002 raft_consensus.cc:2393] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 18: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:15.056864 11002 raft_consensus.cc:1240] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:15.060659 10933 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:15.074745 11011 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
W20260709 12:22:15.087283 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 443565us
I20260709 12:22:15.090785 11050 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:15.112811 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.112872 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:14.894104 16213 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.151705 10931 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:15.244951 16269 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.247237 16268 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:15.248842 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:14.946285 16228 raft_consensus.cc:740] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:15.251675 16228 consensus_queue.cc:260] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.252290 16041 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.934463 16039 raft_consensus.cc:3055] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:14.926587 15910 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:15.296481 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.302253 16228 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:22:15.308323 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.309028 11009 raft_consensus.cc:1240] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:15.308108 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:15.174805 10831 catalog_manager.cc:5697] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:22:14.922072 15644 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:14.946990 16171 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:15.327162 16375 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:15.327962 16366 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:15.328744 16366 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:14.959510 16297 consensus_queue.cc:260] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.333155 16297 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:15.332445 10831 catalog_manager.cc:5697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 9 to 11, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 11 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:15.273386 16041 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.337930 16041 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:15.340219 16213 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:15.342818 16303 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:15.328122 11084 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.010s	sys 0.049s
I20260709 12:22:14.935725 16032 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.343700 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:15.345614 11657 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 13: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:15.346537 16032 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:15.348338 16361 raft_consensus.cc:3055] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:15.348829 16361 raft_consensus.cc:740] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:15.350215 16361 consensus_queue.cc:260] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.351373 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:15.352286 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.352308 11077 raft_consensus.cc:2393] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 10: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:15.354012 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:15.354874 11077 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:15.334661 10831 catalog_manager.cc:5697] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 8 to 13, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 13 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:15.364413 11083 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:15.365379 10831 catalog_manager.cc:5697] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 4 to 6, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 6 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:15.366860 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:15.295787 15910 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:15.367763 10831 catalog_manager.cc:5697] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 9 to 12, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 12 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:15.370536 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:15.372289 10900 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.003s	sys 0.008s
W20260709 12:22:15.372682 10900 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.003s	sys 0.008s
W20260709 12:22:15.372949 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:15.375277 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 124049us
I20260709 12:22:15.376268 10901 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:15.376855 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:15.378249 10900 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:15.327975 16039 raft_consensus.cc:740] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:15.380110 16416 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:15.381116 16416 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:15.382364 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:15.383234 11650 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:15.384047 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:15.385010 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.385872 16421 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.386588 16421 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.387499 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:15.388598 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:22:15.392858 16287 consensus_queue.cc:1175] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2201bad9e18849b09cf82de29dd032d3" responder_term: 12 status { last_received { term: 12 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 12 index: 11 } }
I20260709 12:22:15.396848 16421 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:15.396689 16411 consensus_queue.cc:1059] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:15.397588 16299 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:15.398041 16299 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.398370 16299 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:15.398833 11652 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:22:15.402297 11081 consensus_meta.cc:287] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.653s	user 0.003s	sys 0.007s
I20260709 12:22:15.402783 11081 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:15.404376 16408 consensus_queue.cc:1059] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 12:22:15.405395 16408 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:15.407061 16408 raft_consensus.cc:3055] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:15.407435 16408 raft_consensus.cc:740] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:15.408082 16309 consensus_queue.cc:1059] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.095s
I20260709 12:22:15.408586 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:22:15.411499 16255 consensus_meta.cc:287] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.818s	user 0.007s	sys 0.009s
I20260709 12:22:15.412706 10831 catalog_manager.cc:5697] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 7 to 11, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 11 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:15.352581 11659 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:15.386531 10974 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:15.428326 11652 raft_consensus.cc:1240] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:15.429051 11650 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:22:15.429733 16041 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.429890 16373 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:15.430359 16373 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:15.430786 16373 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:15.431937 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:15.432337 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:15.433004 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:15.434015 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:15.434262 16420 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:15.435214 16032 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:15.434995 16420 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.438237 11653 raft_consensus.cc:1240] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:15.431056 16041 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.442006 16041 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:15.436836 11010 raft_consensus.cc:2410] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:22:15.443838 16032 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.444463 16032 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:15.449970 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:15.439363 16420 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:15.450806 11076 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:22:15.453603 16427 consensus_queue.cc:1059] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:15.455143 16427 raft_consensus.cc:3055] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:15.458590 11051 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:15.459115 16123 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.001s	sys 0.010s
W20260709 12:22:15.459910 11655 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.010s	sys 0.007s
W20260709 12:22:15.461205 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 74653.8us
I20260709 12:22:15.461294 16376 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:15.469687 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:15.462512 16361 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:15.463261 16366 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:15.465965 10930 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:15.462543 16269 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:15.467669 16262 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.455579 16427 raft_consensus.cc:740] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:15.468777 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:15.467952 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:15.468678 16267 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.469569 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:15.460572 11658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59398 (request call id 482) took 2702 ms. Trace:
I20260709 12:22:15.461831 16309 raft_consensus.cc:3055] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:22:15.415946 16108 consensus_meta.cc:287] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.835s	user 0.005s	sys 0.008s
I20260709 12:22:15.434078 11656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59384 (request call id 637) took 1102 ms. Trace:
W20260709 12:22:15.423357 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 45331.9us
W20260709 12:22:15.473515 11655 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.011s	sys 0.007s
I20260709 12:22:15.417521 10831 catalog_manager.cc:5697] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:15.509703 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:15.472220 16376 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:15.527410 15853 consensus_meta.cc:287] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.805s	user 0.009s	sys 0.004s
I20260709 12:22:15.517562 16376 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:15.528115 10931 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:15.511543 16228 consensus_queue.cc:1059] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
W20260709 12:22:15.535374 16165 consensus_meta.cc:287] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.853s	user 0.010s	sys 0.002s
I20260709 12:22:15.487574 11656 rpcz_store.cc:276] 0709 12:22:14.333882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.334047 (+   165us) service_pool.cc:224] Handling call
0709 12:22:15.433732 (+1099685us) spinlock_profiling.cc:243] Waited 87.7 ms on lock 0x7b5400528854. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:15.433878 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201723136}
I20260709 12:22:15.536240 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:15.540599 10831 catalog_manager.cc:5697] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 12 to 15, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 15 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:15.573446 10831 catalog_manager.cc:5697] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 6 to 9, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 9 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:15.576536 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:15.542776 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:15.577389 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:15.577929 11083 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:15.578994 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:15.543380 10936 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:15.580821 10932 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:22:15.544251 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 85896.1us
I20260709 12:22:15.518375 16108 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.571770 10928 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 16: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:15.545433 16262 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:15.547104 16267 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.524005 16416 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:15.551986 16287 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.601007 16287 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.602156 16267 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:15.487262 16309 raft_consensus.cc:740] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:15.603124 16287 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:15.551994 11085 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.004s	sys 0.007s
W20260709 12:22:15.552359 10977 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.004s	sys 0.007s
I20260709 12:22:15.583693 11051 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:15.553326 16408 consensus_queue.cc:260] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.553925 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:15.553892 10929 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:15.556921 16427 consensus_queue.cc:260] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:15.557807 15944 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.439437 16039 consensus_queue.cc:260] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.486560 11658 rpcz_store.cc:276] 0709 12:22:12.757785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.761811 (+  4026us) service_pool.cc:224] Handling call
0709 12:22:12.762084 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:13.868174 (+1106090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.460051 (+1591877us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54004df8d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:15.460370 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2542336256}
W20260709 12:22:15.564446 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 76899.7us
I20260709 12:22:15.577411 11009 raft_consensus.cc:2410] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:22:15.575387 10831 catalog_manager.cc:5697] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 12 to 13, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 13 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
W20260709 12:22:15.584923 16438 log.cc:927] Time spent T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.068s	user 0.002s	sys 0.000s
I20260709 12:22:15.614698 16408 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:15.591593 16400 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.615911 16400 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:15.618185 16400 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:15.592866 16428 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.230s	user 0.004s	sys 0.000s
I20260709 12:22:15.619277 16228 raft_consensus.cc:3055] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:15.594564 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:15.619724 16228 raft_consensus.cc:740] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:15.595201 16165 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.620703 16228 consensus_queue.cc:260] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:15.622155 16228 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:15.622810 16165 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:15.595947 16255 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:15.624814 11080 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:15.625089 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:15.625419 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:15.625994 11085 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:22:15.626416 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:15.627207 11082 raft_consensus.cc:2393] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:22:15.627605 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.605286 11076 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:15.607005 10900 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:15.608364 10977 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.004s	sys 0.007s
I20260709 12:22:15.603652 16309 consensus_queue.cc:260] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.647979 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:15.613583 16443 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.097s	user 0.000s	sys 0.002s
I20260709 12:22:15.628194 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:15.620813 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:15.608404 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:15.628273 16416 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:15.629228 15944 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.603750 15820 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:15.610682 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:15.656944 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 67362.4us
I20260709 12:22:15.656117 10831 catalog_manager.cc:5697] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:15.587108 15853 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.599645 16373 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.662402 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:15.658973 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:15.667265 11658 raft_consensus.cc:2368] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12.
I20260709 12:22:15.669458 11002 raft_consensus.cc:1240] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:15.671345 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:15.676720 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:15.664317 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 952957us
W20260709 12:22:15.676549 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 92963us
I20260709 12:22:15.673933 10900 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:15.679400 11081 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 13: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:15.681445 11079 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 17: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:15.685549 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:15.686894 15995 consensus_queue.cc:1059] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
W20260709 12:22:15.687284 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 394321us
W20260709 12:22:15.690418 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.692232 15222 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:15.692849 15222 raft_consensus.cc:697] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:15.694006 15222 consensus_queue.cc:237] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:15.695711 16381 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:15.696188 16381 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:15.696725 16381 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:15.698966 16262 consensus_queue.cc:1059] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:22:15.699970 16262 raft_consensus.cc:3055] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:15.700328 16262 raft_consensus.cc:740] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:15.702097 16108 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:15.696292 16427 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:15.705119 11051 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:15.705914 15853 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:15.706483 11051 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:15.706689 15853 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:15.708192 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:15.710086 11081 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:15.712553 11049 leader_election.cc:400] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12.
I20260709 12:22:15.712930 11049 leader_election.cc:403] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:15.685125 10831 catalog_manager.cc:5697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 5 to 8, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 8 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:15.713644 16381 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:15.703783 10974 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:15.715553 10974 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:15.713214 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:15.716723 11076 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:22:15.714929 16427 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:15.717573 16427 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:15.718185 16427 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:15.718760 11051 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:15.717504 10974 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:15.654528 16299 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:15.692414 16129 consensus_meta.cc:287] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 1.063s	user 0.013s	sys 0.000s
I20260709 12:22:15.711639 11081 raft_consensus.cc:1240] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:15.694008 11083 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:22:15.715029 10831 catalog_manager.cc:5697] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 10 to 15, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 15 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:15.720541 11080 raft_consensus.cc:2410] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:22:15.718588 16369 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:15.707597 15853 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:15.709986 15944 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:15.727171 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:15.662204 16032 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:15.718067 10977 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:15.726096 11083 pending_rounds.cc:85] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 9
I20260709 12:22:15.696224 16366 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.752357 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:15.729403 16309 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:15.730161 15853 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.738348 16267 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:15.732626 16408 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:22:15.740095 16400 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.752288 11083 pending_rounds.cc:107] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:22:15.738720 16268 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:22:15.770309 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.745512 10831 catalog_manager.cc:5697] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 12 to 15, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 15 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:22:15.772171 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:15.769032 11083 raft_consensus.cc:2889] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:15.728051 16369 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:15.726366 16381 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:15.758502 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3195) took 1075 ms. Trace:
I20260709 12:22:15.764424 11076 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 12:22:15.765753 16366 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.767151 16373 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:15.752600 16269 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:15.757364 11078 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 14.
I20260709 12:22:15.763790 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:15.773975 11081 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:15.743625 16129 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:15.775228 10933 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 12: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:22:15.779919 16265 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.004s	sys 0.026s
I20260709 12:22:15.781409 16032 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:15.782315 11082 raft_consensus.cc:1240] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:15.782629 15995 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:15.784137 16433 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.760151 15853 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:15.768340 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:15.786727 10936 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:22:15.770009 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:15.790504 11655 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 12: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:15.796103 11051 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:15.794087 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:15.785244 16369 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:15.801241 16319 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.801484 16385 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:15.790912 16265 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.989s	user 0.004s	sys 0.026s
W20260709 12:22:15.805326 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 87923.9us
I20260709 12:22:15.805912 11078 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:15.806147 11079 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:22:15.794322 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:15.805094 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:15.809284 16385 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.812395 16303 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.794963 16268 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.819821 16303 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.820189 16385 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:15.821424 16108 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.822189 16108 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:15.822953 16299 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:15.826728 15910 raft_consensus.cc:3055] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:15.827190 15910 raft_consensus.cc:740] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:15.827953 16433 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.830323 16433 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:15.826678 11085 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:22:15.833838 16297 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12.
I20260709 12:22:15.836398 10929 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:15.837244 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 52352.6us
W20260709 12:22:15.831414 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 113430us
I20260709 12:22:15.840566 11658 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:15.786036 16400 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:15.841722 11080 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:22:15.820402 16039 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:15.846755 11077 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:15.794245 16416 consensus_queue.cc:1059] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:22:15.856570 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:15.853328 10974 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:15.821491 16268 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:15.822101 16303 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:15.785674 11084 rpcz_store.cc:276] 0709 12:22:14.677601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.678625 (+  1024us) service_pool.cc:224] Handling call
0709 12:22:14.693997 (+ 15372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:14.694211 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:22:15.344491 (+650280us) log.cc:844] Serialized 14 byte log entry
0709 12:22:15.612650 (+268159us) spinlock_profiling.cc:243] Waited 88.4 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:22:15.678912 (+ 66262us) log.cc:844] Serialized 14 byte log entry
0709 12:22:15.686658 (+  7746us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:15.724075 (+ 37417us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:15.729033 (+  4958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.732074 (+  3041us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:15.752775 (+ 20701us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124518,"prepare.queue_time_us":283587,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":95,"raft.queue_time_us":92395,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":29858,"spinlock_wait_cycles":203226880,"thread_start_us":707339,"threads_started":2,"wal-append.queue_time_us":171622}
I20260709 12:22:15.861673 11051 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:15.843582 16299 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:15.864764 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:15.860714 10928 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
I20260709 12:22:15.867091 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:15.867962 11007 raft_consensus.cc:2410] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:22:15.869410 16262 consensus_queue.cc:260] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:15.868067 16355 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:15.871083 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:15.871835 11004 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:22:15.872756 11009 raft_consensus.cc:2410] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:22:15.844167 16319 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.873095 16262 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:15.882216 11010 raft_consensus.cc:2410] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:22:15.865612 10977 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:15.887179 10901 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:15.891731 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 49257.5us
I20260709 12:22:15.861052 15820 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.896224 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:15.880805 16376 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:15.866262 16299 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.828055 15910 consensus_queue.cc:260] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.892943 16268 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:15.894174 16408 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:15.911980 16048 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:22:15.912307 16451 log.cc:927] Time spent T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:22:15.912122 11009 raft_consensus.cc:2410] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:22:15.913632 16319 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:15.914575 10974 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:15.916106 16355 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:22:15.916340 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 57351.3us
I20260709 12:22:15.922165 16048 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.922267 15820 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.902269 16299 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:15.906199 16268 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:15.898641 16287 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:22:15.931172 11002 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:22:15.935940 10929 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 14.
W20260709 12:22:15.942184 16450 log.cc:927] Time spent T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:22:15.928356 11658 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
W20260709 12:22:15.947582 16447 log.cc:927] Time spent T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.425s	user 0.004s	sys 0.000s
I20260709 12:22:15.947845 10900 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:15.948913 16319 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:15.949442 16319 raft_consensus.cc:697] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:15.949605 16255 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.945889 15944 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:15.950182 16255 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.950771 16319 consensus_queue.cc:237] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:15.952544 16255 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:15.953245 16269 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:15.956027 10974 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:15.956897 16255 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:15.957806 16255 consensus_queue.cc:1059] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:15.958810 15995 raft_consensus.cc:3055] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:15.959195 15995 raft_consensus.cc:740] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:15.959748 16041 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:15.960623 16298 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:15.960180 15995 consensus_queue.cc:260] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.961324 16298 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.962536 15995 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:15.937036 16355 raft_consensus.cc:697] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:15.963852 16298 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:15.964112 15853 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.960599 16041 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.965373 15944 raft_consensus.cc:697] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:15.957981 10974 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:15.967780 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.938599 16268 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:15.956593 16299 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.979506 15222 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:15.961391 15820 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:15.985370 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:15.985877 11658 raft_consensus.cc:1813] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Handling vote request from an unknown peer 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:15.986181 11658 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 13: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:15.982479 15222 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.972726 15910 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:15.988737 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:15.992273 10936 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 14.
I20260709 12:22:15.992934 15853 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:15.996172 15944 consensus_queue.cc:237] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:15.997337 16267 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.997983 16267 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:16.005100 16048 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:16.006366 16267 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:16.007773 10934 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:16.008282 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:15.975800 16108 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:15.977200 16123 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:16.011631 11003 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:22:16.010867 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2943) took 1501 ms. Trace:
W20260709 12:22:16.013507 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 46808.8us
I20260709 12:22:16.018451 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:16.021234 10932 raft_consensus.cc:1240] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:16.021735 10931 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:16.022521 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:16.022910 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:16.023305 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:16.015606 16048 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:16.024472 16048 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:16.025569 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:16.024122 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:16.021807 10927 raft_consensus.cc:2393] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 16: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:16.027026 10936 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:16.012822 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:16.024117 10933 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:22:16.028035 10934 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:16.041637 10977 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:15.964848 16355 consensus_queue.cc:237] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:16.042580 10930 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:16.015926 16123 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:15.989457 16255 consensus_queue.cc:1059] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:22:16.059827 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:16.060441 11076 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:16.060530 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:16.061170 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:16.060786 11081 raft_consensus.cc:2410] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:22:16.061468 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:16.061923 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:16.062094 11082 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:16.062532 11084 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:22:16.063423 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:16.064205 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:16.064582 10977 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:16.065061 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:16.062687 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:16.056922 16165 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.066471 16165 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:16.041095 16267 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.072129 11080 raft_consensus.cc:2410] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:22:16.065896 11077 raft_consensus.cc:2410] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 20 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:22:16.014734 10935 rpcz_store.cc:276] 0709 12:22:14.396840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.397787 (+   947us) service_pool.cc:224] Handling call
0709 12:22:14.398131 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:14.398523 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:15.044046 (+645523us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b18003ad4a0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade70455 00007f9bb49583c7 00007f9bb0f6a9a7 00007f9bb0f7a0bf 00007f9bb0f7a038
0709 12:22:15.470249 (+426203us) log.cc:844] Serialized 14 byte log entry
0709 12:22:15.752571 (+282322us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:15.774806 (+ 22235us) log.cc:844] Serialized 26 byte log entry
0709 12:22:15.774938 (+   132us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:15.791916 (+ 16978us) log.cc:844] Serialized 14 byte log entry
0709 12:22:15.875579 (+ 83663us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b18003ad4a0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9baddedc0a 00007f9bb752d219 00007f9bb0b16d70 00007f9bb0b0a293 00007f9bb0affcea 00007f9bb0b0023a 00007f9bb0f6aa2a 00007f9bb0f7a0bf 00007f9bb0f7a038
0709 12:22:15.884903 (+  9324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.895221 (+ 10318us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:15.895255 (+    34us) raft_consensus.cc:1685] finished
0709 12:22:15.895265 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:15.897770 (+  2505us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87465,"prepare.queue_time_us":181047,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":79,"raft.queue_time_us":14202,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":15777,"spinlock_wait_cycles":10626688,"thread_start_us":456918,"threads_started":2,"wal-append.queue_time_us":310253}
I20260709 12:22:16.065061 11083 raft_consensus.cc:2410] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:22:16.070827 11081 raft_consensus.cc:2410] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:22:16.043810 16303 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.075816 15222 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:16.050381 16123 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:16.078584 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 89569.8us
I20260709 12:22:16.058411 16400 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:16.088411 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:16.092245 11077 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 13: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:16.090062 11051 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:16.078251 16267 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:16.104223 16414 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:16.079114 16376 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:16.106258 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 58022.1us
I20260709 12:22:16.097405 10974 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:16.108011 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:16.109491 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:16.107419 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:16.106971 16414 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.111549 16414 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:16.112277 16345 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:16.074668 16287 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
W20260709 12:22:16.118706 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.120705 10928 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:16.122339 16345 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:16.122848 16427 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:16.124028 10977 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:16.088378 16421 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:16.127353 11079 raft_consensus.cc:2393] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 10: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:16.133541 10936 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
W20260709 12:22:16.134745 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 65278.7us
I20260709 12:22:16.127491 10901 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:16.139386 10928 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:16.141134 11003 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20. Ops: []
I20260709 12:22:16.137151 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:16.141600 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:16.142544 11002 raft_consensus.cc:2410] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:22:16.142795 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:16.144753 10936 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:16.146011 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:16.146670 10935 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:16.147415 10899 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:16.085723 16303 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:16.149401 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:16.140331 10901 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:16.095964 16408 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:22:16.152182 10928 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:22:16.122848 16345 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.153231 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:16.154008 15222 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:16.156615 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:16.159691 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:16.160372 10936 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:22:16.149719 16373 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:16.149840 15944 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:16.168856 16427 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:16.169411 15944 raft_consensus.cc:697] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:16.170370 15944 consensus_queue.cc:237] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:16.172048 16373 raft_consensus.cc:697] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:16.173036 16373 consensus_queue.cc:237] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:16.162144 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 62909.9us
I20260709 12:22:16.156221 16345 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:16.188537 16355 consensus_queue.cc:1059] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:16.144172 16165 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:16.156213 16361 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:16.193723 16361 raft_consensus.cc:697] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:16.194713 16361 consensus_queue.cc:237] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:16.196919 11622 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:16.165606 10928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07467552f78d410bb9e5774f3340f134"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:22:16.215070 10928 raft_consensus.cc:606] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:16.215454 10928 raft_consensus.cc:614] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:16.181888 15820 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:16.183061 16041 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:16.188143 10899 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:16.165901 16455 log.cc:927] Time spent T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:22:16.198768 11657 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:16.202045 10933 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:16.202436 16165 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.206444 16268 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:16.209425 16267 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:16.211016 16303 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:16.157968 16421 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.221999 11622 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:16.223711 11084 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 14.
I20260709 12:22:16.224442 10930 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:16.227041 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:16.227749 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:16.232190 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 106704us
I20260709 12:22:16.234588 16414 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:16.235589 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 47561.4us
I20260709 12:22:16.248374 16421 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:16.231410 15820 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:16.249533 10974 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:16.288199 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:16.417294 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 167875us
I20260709 12:22:16.418483 11082 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:16.421454 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:16.257539 16400 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:16.225193 16352 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:16.257925 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
W20260709 12:22:16.272701 16452 log.cc:927] Time spent T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:22:16.276039 16165 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:16.279362 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:16.272177 16456 log.cc:927] Time spent T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:22:16.283155 10899 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:16.283504 16108 raft_consensus.cc:3055] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:16.284621 10935 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:16.294333 10929 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:16.230341 16041 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:16.422796 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 200859us
I20260709 12:22:16.222687 16255 raft_consensus.cc:3055] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:16.426368 10933 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:22:16.426924 11085 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 11: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:16.432233 11078 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:16.409225 16309 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:16.424664 15910 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:22:16.459820 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 300569us
I20260709 12:22:16.288549 16303 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.142s
I20260709 12:22:16.424525 16375 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:22:16.462499 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:16.464818 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.456990 10933 raft_consensus.cc:606] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:16.468071 10933 raft_consensus.cc:614] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:16.431113 16352 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:16.456357 16255 raft_consensus.cc:740] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:16.472998 11622 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:16.468478 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:16.455422 16108 raft_consensus.cc:740] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:16.474655 11082 raft_consensus.cc:2376] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 14. Re-sending same reply.
I20260709 12:22:16.475644 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:16.460433 15910 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.476456 11076 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 13: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:16.484915 15222 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:16.487764 10974 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
W20260709 12:22:16.488727 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 205660us
I20260709 12:22:16.469030 16373 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:16.473613 16408 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.475096 16352 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:16.493786 15222 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:16.476305 16465 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.497668 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:16.487488 15910 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:16.472993 16289 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:16.485982 16287 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.502126 10933 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:16.502553 10899 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:16.470003 16309 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:16.536191 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 48541.1us
I20260709 12:22:16.491031 16269 consensus_queue.cc:1059] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:22:16.540045 16376 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:16.540483 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:16.541524 11009 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 12: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:16.544339 15222 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:16.550048 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:16.550989 11007 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 12: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:16.548249 10935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83b4e206b7694af695234c0e758055e2"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:57884
W20260709 12:22:16.536311 16369 consensus_meta.cc:287] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.720s	user 0.006s	sys 0.005s
W20260709 12:22:16.553927 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 55964.2us
I20260709 12:22:16.501530 16466 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:16.501267 16408 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:16.535742 16041 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:16.566799 10935 raft_consensus.cc:606] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:16.576020 16165 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:16.580101 16466 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:16.582870 16466 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:16.585180 16408 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:16.585948 16369 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:16.588151 10899 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:16.558561 16255 consensus_queue.cc:260] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:16.592783 16255 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:16.594322 16319 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:16.540504 16376 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:16.596029 15222 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:16.596491 16376 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:16.597280 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 60311.7us
I20260709 12:22:16.592119 16041 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:16.604403 10935 raft_consensus.cc:614] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:16.603681 10933 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:22:16.553635 16414 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:16.608500 16470 log.cc:927] Time spent T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca: Append to log took a long time: real 0.066s	user 0.002s	sys 0.000s
I20260709 12:22:16.536507 16465 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:16.612489 16464 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:22:16.614100 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:16.620220 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:16.620694 11004 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
I20260709 12:22:16.623039 11007 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 12: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:16.547972 16287 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:16.605031 16375 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:16.627447 16375 raft_consensus.cc:697] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:16.628451 16375 consensus_queue.cc:237] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:16.632071 16262 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:22:16.635048 16467 log.cc:927] Time spent T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 12:22:16.566229 16268 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:16.539667 16289 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:16.646093 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 176351us
I20260709 12:22:16.561537 16108 consensus_queue.cc:260] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:16.649577 16108 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:16.651082 10935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:22:16.652817 10935 raft_consensus.cc:606] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:16.654058 10935 raft_consensus.cc:614] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:16.646858 16421 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:16.676209 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 84756.7us
I20260709 12:22:16.645233 16466 consensus_queue.cc:1059] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:22:16.702172 16298 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.676308 16373 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.663230 16369 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:16.648346 16352 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:16.680092 16414 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:16.725822 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 78705us
I20260709 12:22:16.731168 10899 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:16.732714 11085 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 19. Current term is 20. Ops: []
I20260709 12:22:16.722823 16421 raft_consensus.cc:3055] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:16.730893 16414 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:16.738636 16465 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:16.739941 16309 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:16.740592 16123 consensus_meta.cc:287] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.001s
I20260709 12:22:16.743955 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:16.744158 16123 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:16.744602 11084 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:22:16.746191 16123 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:16.749017 16287 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:16.752218 11051 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:16.753823 11051 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:16.754654 11051 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:16.756376 16165 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:16.756759 16165 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.757074 16165 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:16.718274 16408 consensus_queue.cc:1059] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:22:16.706657 16298 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:16.770874 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:16.771474 16289 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:16.772289 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:16.775519 16048 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:16.776270 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:16.776940 11082 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:22:16.778179 11085 raft_consensus.cc:1240] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:16.780004 16376 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:16.780695 16298 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:16.782238 16376 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:16.783511 16376 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.791123 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:16.804757 11078 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 19.
I20260709 12:22:16.789192 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:16.806068 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:16.806682 11007 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
W20260709 12:22:16.806977 16345 consensus_meta.cc:287] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.618s	user 0.002s	sys 0.007s
I20260709 12:22:16.805977 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:16.784318 11080 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:16.809752 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:22:16.809303 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 79297.9us
I20260709 12:22:16.813687 11007 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:16.737653 16421 raft_consensus.cc:740] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:16.722450 16373 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:16.808825 11010 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:22:16.783739 16352 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:16.807381 16345 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:16.828727 16373 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:16.814327 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:16.739941 16414 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:16.736294 16361 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:22:16.817169 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:16.814354 10899 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:16.821234 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:16.821729 11077 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:16.822232 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:16.910069 11083 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
W20260709 12:22:16.910218 16433 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.964s	user 0.009s	sys 0.008s
I20260709 12:22:16.829331 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:16.831664 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:16.911233 11085 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:16.835932 16345 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:16.836267 16366 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:16.839061 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:16.912559 11656 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:22:16.817598 16039 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:16.839793 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:16.825901 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:22:16.813249 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.742873 16309 consensus_queue.cc:1059] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 12:22:16.914192 11008 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:16.914762 16414 raft_consensus.cc:3055] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:16.915143 16414 raft_consensus.cc:740] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:16.789321 16287 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:16.916224 16287 raft_consensus.cc:697] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:16.916069 16414 consensus_queue.cc:260] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:16.897699 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 46670.9us
I20260709 12:22:16.917780 10975 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:16.917186 16287 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:16.917183 16414 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:16.921732 11008 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
W20260709 12:22:16.922497 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.903065 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:16.923414 11080 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 13: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:16.924163 16345 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:16.924604 16345 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.924961 16345 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:16.841173 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 101808us
I20260709 12:22:16.817756 16289 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:16.921732 11085 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
W20260709 12:22:16.910665 16433 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.009s	sys 0.008s
I20260709 12:22:16.835824 15820 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:16.930855 11084 raft_consensus.cc:1240] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:22:16.810614 16376 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:16.932163 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:16.959106 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:16.934218 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 119948us
W20260709 12:22:17.010301 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:17.017560 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.016390 10899 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:16.947243 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.934132 11004 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:16.955191 11011 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 10. Current term is 11. Ops: []
W20260709 12:22:17.018829 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.982266 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.014767 11002 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:16.994032 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:16.932719 11624 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:16.964618 10901 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:16.993525 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:16.933035 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:17.021136 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 266530us
I20260709 12:22:17.022234 11081 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:22:17.022236 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:22:17.025954 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 61439.2us
I20260709 12:22:17.023702 11051 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:16.967510 16289 raft_consensus.cc:697] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:17.032673 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.035041 10899 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:17.032485 11051 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:16.986066 16366 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:22:17.026530 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 185548us
I20260709 12:22:16.928995 16165 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:17.043557 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:17.042313 11051 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:17.044654 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.045444 11008 raft_consensus.cc:2368] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17.
I20260709 12:22:17.038127 10899 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:17.038959 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.045837 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:16.964013 16039 consensus_queue.cc:1059] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 12:22:17.033161 16298 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:17.027650 16352 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:16.947359 15910 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:17.035387 10901 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:17.041808 10929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2512) took 1036 ms. Trace:
I20260709 12:22:17.046794 11002 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:17.047154 11007 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:17.034137 16048 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:17.047993 11082 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:17.037523 16366 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.036199 16228 raft_consensus.cc:3055] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:17.050395 11006 raft_consensus.cc:2393] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:17.055573 11051 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:17.050364 10929 rpcz_store.cc:276] 0709 12:22:16.005534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.014045 (+  8511us) service_pool.cc:224] Handling call
0709 12:22:16.014342 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:16.455844 (+441502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:17.041042 (+585198us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b5400060754. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:17.041745 (+   703us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643469568}
I20260709 12:22:17.052476 10901 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:17.052546 11624 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:17.056476 10899 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:17.039937 16268 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:17.039317 15820 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:17.076613 11007 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:22:16.995949 16421 consensus_queue.cc:260] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:17.079825 11007 pending_rounds.cc:85] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 9
W20260709 12:22:17.080438 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.082139 11007 pending_rounds.cc:107] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:22:17.061759 16228 raft_consensus.cc:740] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:17.060817 16366 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:22:17.085765 16463 log.cc:927] Time spent T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.610s	user 0.004s	sys 0.000s
I20260709 12:22:17.087468 10931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2525) took 1046 ms. Trace:
I20260709 12:22:17.075932 16287 consensus_queue.cc:1059] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:22:17.088456 10931 rpcz_store.cc:276] 0709 12:22:16.041169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.041993 (+   824us) service_pool.cc:224] Handling call
0709 12:22:16.057193 (+ 15200us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:16.057449 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:16.057474 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:16.076796 (+ 19322us) log.cc:844] Serialized 26 byte log entry
0709 12:22:16.221463 (+144667us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:16.221498 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:16.221563 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:17.084923 (+863360us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:22:17.087007 (+  2084us) raft_consensus.cc:1685] finished
0709 12:22:17.087036 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:17.087394 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5844736,"thread_start_us":117014,"threads_started":1,"wal-append.queue_time_us":338147}
I20260709 12:22:17.089342 15910 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:17.089674 16475 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:17.090564 16475 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.090898 16475 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:17.064654 11051 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:17.093559 16287 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:17.094094 16287 raft_consensus.cc:697] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:17.096279 11007 raft_consensus.cc:2889] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:17.050774 16414 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:17.052922 16481 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:17.102555 16481 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.103029 16481 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:17.103317 16376 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:17.053848 16048 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:17.090008 16298 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:17.087638 16303 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:17.100713 11004 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:17.080176 15820 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.080942 16041 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:17.063532 16108 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.080533 16265 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:17.052827 16319 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:17.120991 11006 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:17.104796 16421 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:17.122428 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 66006.3us
I20260709 12:22:17.103744 16287 consensus_queue.cc:237] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:17.122179 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.136441 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:17.136855 11004 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 18: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:17.137809 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.138391 11004 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:17.139252 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:17.088661 15944 raft_consensus.cc:3055] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:17.140097 15944 raft_consensus.cc:740] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:17.140475 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.140951 15944 consensus_queue.cc:260] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:17.141717 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.142416 11006 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:22:17.143227 11004 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:17.142042 15944 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:17.116151 16298 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.144577 16298 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:17.145874 16299 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:17.134373 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:17.135170 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.148391 11011 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:22:17.127745 10899 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:17.105353 16414 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.121639 16352 consensus_queue.cc:1059] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:22:17.139720 11007 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14. Ops: []
W20260709 12:22:17.158386 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 65663.7us
I20260709 12:22:17.116125 16048 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:17.168192 11011 raft_consensus.cc:1240] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:22:17.164769 11009 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:22:17.170147 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:17.170819 11008 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:17.164644 16265 raft_consensus.cc:697] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:17.122118 15820 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:17.126528 16319 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.180831 11051 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:17.182806 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:17.168768 16414 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:17.189210 16265 consensus_queue.cc:237] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:17.125581 16108 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:17.193233 16487 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:17.193696 16108 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:17.196504 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.116339 16228 consensus_queue.cc:260] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:17.161688 16373 consensus_queue.cc:1059] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:22:17.202270 11009 raft_consensus.cc:1275] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:22:17.181095 16319 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:17.204648 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:17.206218 11008 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:17.207659 11003 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:17.186640 16471 consensus_queue.cc:1059] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:22:17.211578 11656 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:22:17.212067 16373 raft_consensus.cc:3055] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:17.212497 16373 raft_consensus.cc:740] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:17.213088 10975 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:17.213307 16373 consensus_queue.cc:260] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:17.213958 16108 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:17.214387 16108 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.214753 16108 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:17.196749 16408 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:17.216166 16482 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.216636 16482 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:17.218744 16482 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:17.223146 16108 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:17.225205 11625 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:17.225862 16108 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:17.229112 10901 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:17.229125 16433 raft_consensus.cc:3055] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:22:17.230999 16433 raft_consensus.cc:740] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:17.123539 16289 consensus_queue.cc:237] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:17.233855 15222 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:17.242020 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:17.242786 11656 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:17.214829 16373 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:17.247836 16408 raft_consensus.cc:697] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:17.249126 16408 consensus_queue.cc:237] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:17.251907 16048 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:17.256264 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 46554.1us
I20260709 12:22:17.256592 16373 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.257602 16373 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:17.259366 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 92525.8us
I20260709 12:22:17.211221 16267 raft_consensus.cc:3055] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:17.272675 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:17.274075 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:17.226163 16165 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:17.278254 11008 raft_consensus.cc:2393] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 16: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:17.279160 10932 raft_consensus.cc:1240] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:17.276006 16267 raft_consensus.cc:740] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:17.273870 16228 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:17.290622 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:17.291689 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.293927 10932 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
W20260709 12:22:17.295488 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.292200 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.296583 11009 raft_consensus.cc:2368] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20.
I20260709 12:22:17.298368 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:17.299041 10929 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:17.301103 10931 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:17.294620 11011 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:22:17.305667 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:17.309028 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.309738 11008 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:17.316829 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:17.317582 10929 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:17.318771 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:17.319376 10933 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:22:17.319227 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:17.321022 10935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:22:17.321303 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:17.321643 10935 raft_consensus.cc:606] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:17.304697 16352 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:17.322003 10935 raft_consensus.cc:614] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:17.323796 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.324856 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.327255 11009 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:22:17.328227 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:17.328727 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:17.329169 11078 raft_consensus.cc:2410] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:22:17.293241 16287 consensus_queue.cc:1059] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:22:17.329407 10928 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:17.331526 16490 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:17.332105 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:17.332399 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:17.331722 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:17.354058 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.336609 10930 raft_consensus.cc:1240] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:17.282239 16433 consensus_queue.cc:260] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:17.317433 16471 raft_consensus.cc:3055] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:17.324432 16352 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:17.358574 11079 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:17.368548 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:17.368142 10936 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:17.322767 16400 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:17.308163 16366 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:17.372119 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:17.369200 10934 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:22:17.374926 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:17.375828 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 76784.4us
I20260709 12:22:17.382541 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:17.383054 10928 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:17.384720 10901 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:17.385993 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:17.386144 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:17.387174 11084 raft_consensus.cc:2393] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:17.385996 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:17.386821 11083 raft_consensus.cc:2393] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 10: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:17.388393 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.388622 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:17.389286 11078 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 16: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:17.386921 11622 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:17.391163 11077 raft_consensus.cc:2410] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:22:17.391119 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:17.391881 11081 raft_consensus.cc:2376] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15. Re-sending same reply.
I20260709 12:22:17.364842 11002 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:17.394160 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:17.394881 11083 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:17.397086 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:17.397823 10936 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:17.392685 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:17.397732 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:17.398676 11076 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 17: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:17.399111 11084 raft_consensus.cc:2393] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 16: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:17.370400 16490 raft_consensus.cc:697] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:17.377571 16433 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:17.360514 16471 raft_consensus.cc:740] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:17.402534 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.404318 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:17.414767 11083 raft_consensus.cc:2393] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 11: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:17.405393 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:17.407917 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:17.417912 11079 raft_consensus.cc:1275] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:22:17.419317 11079 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:17.408682 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:17.375557 16352 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:17.429744 16352 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:17.430917 11651 raft_consensus.cc:1240] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:17.413913 11010 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:17.436291 10936 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:17.435712 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:17.435492 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:17.438056 11081 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:17.440749 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:17.434741 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:17.439947 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:17.400496 16493 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:17.441526 11084 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:22:17.370285 16345 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:17.444301 11080 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:17.432678  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:17.443305 11051 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:17.378542 16481 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:17.447415 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:17.452155 11051 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:17.380415 16400 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:17.448611  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:17.449101 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:17.435487 16373 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:17.357396 16267 consensus_queue.cc:260] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:17.455567 11051 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:17.450469 16493 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.432916 16498 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:17.468864 10928 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
W20260709 12:22:17.505266 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.452967 16309 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:22:17.517647 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 62168.7us
I20260709 12:22:17.522338 11051 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:17.520002 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.522505 11077 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:17.442762 16475 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:17.544163 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.533078 11010 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:17.522924 16287 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:17.523264 11051 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:17.517899 16495 log.cc:927] Time spent T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:22:17.572129 10928 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 19. Current term is 20. Ops: []
W20260709 12:22:17.581454 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 58250.9us
I20260709 12:22:17.520088 16373 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.520262 16493 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:17.516811 16494 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:17.591419 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.526424 16309 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.603951  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:17.586576 16500 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:17.605247 16500 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.605615 16500 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:22:17.612583 16511 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:22:17.580390 16265 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:17.613878 16265 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:17.614440 16265 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:17.614451 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.613488 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.615640 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.613965 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.624078 11656 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:22:17.628991 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:17.629805 11085 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:17.630795 11009 raft_consensus.cc:2393] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:17.631304 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:17.583190 16287 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:17.597049 16502 log.cc:927] Time spent T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.194s	user 0.000s	sys 0.002s
W20260709 12:22:17.635141 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:17.649217 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.646840 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:17.650789 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:17.592379 16494 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:17.613512 16267 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:17.658383 11085 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:17.630592 16309 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:17.657755 11084 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:22:17.648329 16287 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:17.742766 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:17.629510 16499 raft_consensus.cc:2764] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 12:22:17.603149 16298 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:17.648054 16421 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.754902 15222 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.615216 16373 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:17.830264 16373 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:17.755967 11011 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 18: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:17.580015 16498 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:17.809141 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:17.841531 11077 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
W20260709 12:22:17.812361 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.633895 16490 consensus_queue.cc:237] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:17.813414 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:17.816458 16508 log.cc:927] Time spent T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 12:22:17.817248 16506 log.cc:927] Time spent T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
I20260709 12:22:17.582770 16471 consensus_queue.cc:260] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:17.821496 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:17.824844 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:17.881560 11080 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 15: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:17.826934 16352 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:17.828229 15820 consensus_meta.cc:287] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.641s	user 0.010s	sys 0.000s
I20260709 12:22:17.828363 16481 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:17.819730 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 432858us
W20260709 12:22:17.881412 16414 consensus_meta.cc:287] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.676s	user 0.010s	sys 0.000s
I20260709 12:22:17.835976 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.901585 11002 raft_consensus.cc:2393] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 11: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:17.693559 16494 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:17.840734 10929 raft_consensus.cc:2393] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 16: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:17.848726 15222 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:17.871018 11084 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:17.872295 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:17.906088 11077 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:22:17.849975 10977 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.526s (SENT) [suppressed 22 similar messages]
I20260709 12:22:17.759675 16366 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:17.907331 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:17.908031 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:17.908468 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:17.909037 11080 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:22:17.835834 16421 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:17.835327 16345 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:17.898761 11622 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:17.834758 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:17.900007 16361 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:17.918437 11077 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:17.920720 11004 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 20
W20260709 12:22:17.923014 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.893216 16373 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:22:17.895401 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:17.909566 16289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.001s	sys 0.006s
W20260709 12:22:17.918874 16487 consensus_meta.cc:287] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.717s	user 0.007s	sys 0.003s
I20260709 12:22:17.951525 11084 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:22:17.987286 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:17.990411 15222 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:17.930660 16496 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:17.937273 16289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.003s	sys 0.006s
I20260709 12:22:18.000697 11084 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16. Ops: []
W20260709 12:22:18.001688 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 151750us
I20260709 12:22:17.905818 16414 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:17.994448 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:18.003449 11002 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:17.898473 15820 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:17.990432 16492 log.cc:927] Time spent T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.612s	user 0.020s	sys 0.011s
I20260709 12:22:17.931399 16518 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:17.985210 16361 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:18.038132 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:18.047698 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.032550 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:17.950047 16487 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:18.029667 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:18.049746 10975 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:18.051066 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 47982.3us
W20260709 12:22:18.051541 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.066764 16255 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.067377 16255 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:18.069810 16255 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:18.069566 16309 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:18.072211 11081 raft_consensus.cc:2393] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:22:18.028599 16513 log.cc:927] Time spent T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 12:22:18.073194 10899 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:18.076116 11004 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
W20260709 12:22:18.066237 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 146027us
I20260709 12:22:18.073447 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:18.088555 11080 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:17.950673 16373 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:18.088508 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:18.091737 10899 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:18.092095 11651 raft_consensus.cc:2393] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 11: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:18.093003 10899 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:18.093868 11002 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:18.016206 16531 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.100203 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:18.032037 16475 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:18.120630 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:18.071760 16309 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:18.009776 16500 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:18.100945 11651 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:22:18.074700 16352 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:22:18.104331 15222 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:18.132059 10974 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:18.163398 10927 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:18.096165 16255 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:22:18.104401 16228 consensus_meta.cc:287] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.804s	user 0.010s	sys 0.000s
I20260709 12:22:18.133955 16487 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:22:18.173137 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 69217.9us
I20260709 12:22:18.104108 16298 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:18.120092 16303 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:18.169595 16319 consensus_meta.cc:287] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.945s	user 0.013s	sys 0.005s
I20260709 12:22:18.186401 10974 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:18.186518 10928 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:22:18.192524 16421 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:18.199373 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:18.220440 10929 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:18.178952 16500 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:18.072893 16408 consensus_queue.cc:1059] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.095s
I20260709 12:22:18.180850 11077 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:18.123068 16531 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:18.183096 16521 log.cc:927] Time spent T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:22:18.183717 16268 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.183873 10934 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:18.033939 16496 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:18.184530 11005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2615) took 1130 ms. Trace:
I20260709 12:22:18.201200 16361 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:18.261847 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:18.202854 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:18.205430 16493 consensus_meta.cc:287] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.575s	user 0.007s	sys 0.004s
I20260709 12:22:18.206080 15820 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:18.208067 16414 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:18.208101 16498 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:18.213397 16373 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:18.214792 16494 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:18.217761 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 50397.1us
W20260709 12:22:18.167070 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:18.192363 16433 consensus_meta.cc:287] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.759s	user 0.008s	sys 0.001s
W20260709 12:22:18.183736 16265 consensus_meta.cc:287] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.540s	user 0.005s	sys 0.004s
I20260709 12:22:18.195690 16400 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:18.280593 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:18.280941 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:18.232820 16319 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:18.279367 16493 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:18.314360 16255 raft_consensus.cc:697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:22:18.359781 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 173431us
I20260709 12:22:18.429319 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3244) took 1600 ms. Trace:
I20260709 12:22:18.475477 11082 rpcz_store.cc:276] 0709 12:22:16.828747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.855950 (+ 27203us) service_pool.cc:224] Handling call
0709 12:22:16.856183 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:17.052019 (+195836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:18.249388 (+1197369us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b540011bcd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:18.429247 (+179859us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440654208}
I20260709 12:22:18.434677 16489 raft_consensus.cc:3055] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:18.435618 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:18.477535 16489 raft_consensus.cc:740] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:18.478466 16489 consensus_queue.cc:260] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:18.479534 16489 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:18.479990 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:18.480628 11080 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:22:18.484238 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:18.432464 16531 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:18.487650 16471 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:18.477142 11077 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 12:22:18.492604 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 3098) took 1115 ms. Trace:
I20260709 12:22:18.493091 11083 rpcz_store.cc:276] 0709 12:22:17.378388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.415705 (+ 37317us) service_pool.cc:224] Handling call
0709 12:22:17.427814 (+ 12109us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:17.449772 (+ 21958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:17.449801 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:17.454040 (+  4239us) log.cc:844] Serialized 26 byte log entry
0709 12:22:17.845405 (+391365us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:17.904903 (+ 59498us) log.cc:844] Serialized 14 byte log entry
0709 12:22:17.905092 (+   189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:17.905161 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:18.429521 (+524360us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b1800062f80. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade412a6 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade73522 00007f9bade757c1
0709 12:22:18.465960 (+ 36439us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b1800062f80. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade412a6 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1
0709 12:22:18.466426 (+   466us) spinlock_profiling.cc:243] Waited 6.85 ms on lock 0x7b1800062f80. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:22:18.492398 (+ 25972us) raft_consensus.cc:1685] finished
0709 12:22:18.492419 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:18.492549 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60040,"prepare.queue_time_us":59398,"prepare.run_wall_time_us":5655,"raft.queue_time_us":33094,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":7066,"spinlock_wait_cycles":70936704,"thread_start_us":276439,"threads_started":1,"wal-append.queue_time_us":401865}
I20260709 12:22:18.479465 11051 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:18.493153 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.248695 10936 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:18.261445 16375 raft_consensus.cc:3055] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:18.496735 16375 raft_consensus.cc:740] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:18.497462 16228 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.496783 16482 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:18.249595 11005 rpcz_store.cc:276] 0709 12:22:17.047176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.047322 (+   146us) service_pool.cc:224] Handling call
0709 12:22:17.059804 (+ 12482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:17.060120 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:17.060148 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:17.109702 (+ 49554us) log.cc:844] Serialized 26 byte log entry
0709 12:22:17.254681 (+144979us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:17.254719 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:17.254786 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:18.177319 (+922533us) raft_consensus.cc:1685] finished
0709 12:22:18.177341 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:18.177485 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":85117,"threads_started":1,"wal-append.queue_time_us":165601}
I20260709 12:22:18.415113 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:18.498816 16482 raft_consensus.cc:697] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:18.499431 11004 raft_consensus.cc:2393] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 16: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:18.415408 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:18.499790 16482 consensus_queue.cc:237] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:18.416630 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:18.417152 16532 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:18.417574 11003 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:22:18.418440 10934 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:18.497988 16228 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:18.420054 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 327120us
I20260709 12:22:18.437090 11650 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:18.423022 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:18.423849 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:18.505342 16228 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:18.424537 11651 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 12:22:18.425320 16267 consensus_meta.cc:287] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.684s	user 0.010s	sys 0.020s
I20260709 12:22:18.438216 10977 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:18.425925 16048 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:18.505746 10899 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:18.506865 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 68726.2us
I20260709 12:22:18.507990 10977 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:18.278165 16345 consensus_queue.cc:1059] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:22:18.439188 10975 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:18.508958 10899 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:18.505235 11657 raft_consensus.cc:2393] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 11: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:18.497769 16375 consensus_queue.cc:260] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:18.444556 10931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 2975) took 1141 ms. Trace:
I20260709 12:22:18.419075 16268 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:18.447515 10932 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 14: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:18.445158 10929 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:18.461170 11085 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:18.500942 16532 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:18.447053 10933 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:22:18.510377 10931 rpcz_store.cc:276] 0709 12:22:17.303337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.305252 (+  1915us) service_pool.cc:224] Handling call
0709 12:22:18.444334 (+1139082us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b5400060754. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:18.444466 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1989692800}
I20260709 12:22:18.450726 11659 raft_consensus.cc:1240] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:18.456600 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 3104) took 1049 ms. Trace:
I20260709 12:22:18.492331 10974 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:18.533171 10934 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:22:18.434841 10930 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:22:18.461521 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:18.465473 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:18.599807 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 90920.3us
I20260709 12:22:18.436755 10927 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:18.461807 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:18.602062 11050 leader_election.cc:400] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17.
I20260709 12:22:18.626046 10899 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:18.626417 11050 leader_election.cc:403] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:22:18.599418 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 85303.7us
I20260709 12:22:18.465610 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:18.629873 11076 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:18.457218 16032 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:18.469377 10901 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:18.437402 16287 consensus_meta.cc:287] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.009s
I20260709 12:22:18.629451 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:18.440680 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.444811 10928 raft_consensus.cc:2368] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 19. Current term is 20.
I20260709 12:22:18.662624 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:18.663234 10928 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:18.631217 11007 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:18.664490 10934 raft_consensus.cc:2368] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14.
I20260709 12:22:18.513376 16048 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:22:18.448474 16433 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:22:18.666985 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 65931.1us
I20260709 12:22:18.665650 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:18.627388 11078 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:22:18.656380 11081 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 3248) took 1028 ms. Trace:
W20260709 12:22:18.458292 16528 log.cc:927] Time spent T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.276s	user 0.002s	sys 0.000s
I20260709 12:22:18.448534 16373 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.661291 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:18.665423 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 196105us
I20260709 12:22:18.671998 10901 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:18.668565 10935 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:18.450064 16493 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:18.514899 16414 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.681402 16268 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:18.681905 16414 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:18.602567 11079 rpcz_store.cc:276] 0709 12:22:17.407616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.419967 (+ 12351us) service_pool.cc:224] Handling call
0709 12:22:17.420268 (+   301us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:17.441979 (+ 21711us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:17.590619 (+148640us) log.cc:844] Serialized 14 byte log entry
0709 12:22:18.041537 (+450918us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:18.086064 (+ 44527us) log.cc:844] Serialized 52 byte log entry
0709 12:22:18.088527 (+  2463us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:18.088885 (+   358us) log.cc:844] Serialized 14 byte log entry
0709 12:22:18.102493 (+ 13608us) log.cc:844] Serialized 14 byte log entry
0709 12:22:18.445236 (+342743us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b180023a220. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade412a6 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1
0709 12:22:18.446635 (+  1399us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b180023a220. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:22:18.456078 (+  9443us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b180023a220. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9baddedc0a 00007f9bb752d219 00007f9bade75a40 00007f9bade704e4 00007f9bade70455 00007f9bb0f58060 00007f9bb0f6a716 00007f9bb0f7b287 00007f9bb0f7b208
0709 12:22:18.456268 (+   190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:18.456357 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:18.456400 (+    43us) raft_consensus.cc:1685] finished
0709 12:22:18.456414 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:18.456542 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":341755,"prepare.queue_time_us":169802,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":142,"raft.queue_time_us":406746,"raft.run_cpu_time_us":545,"raft.run_wall_time_us":56623,"spinlock_wait_cycles":101223808,"thread_start_us":439231,"threads_started":2,"wal-append.queue_time_us":531407}
I20260709 12:22:18.683332 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:18.670126 16287 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:18.670497 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:18.669188 11081 rpcz_store.cc:276] 0709 12:22:17.627884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.628229 (+   345us) service_pool.cc:224] Handling call
0709 12:22:18.656202 (+1027973us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b540011c6d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:18.656329 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":964301184}
I20260709 12:22:18.448522 16319 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:18.462092 16525 raft_consensus.cc:3055] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:18.670184 10899 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:18.601893 16541 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.463060 15853 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.654042 10900 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:18.458145 16255 consensus_queue.cc:237] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:18.684623 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:18.660514 16032 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:18.695959 16525 raft_consensus.cc:740] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:18.697041 16525 consensus_queue.cc:260] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:18.697872 16032 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:18.698261 16541 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:18.700035 16542 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:18.700500 10899 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:18.670436 16487 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:18.701316 16361 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:18.701530 16487 raft_consensus.cc:697] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:18.702554 16487 consensus_queue.cc:237] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:18.462663 16421 consensus_queue.cc:1059] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.241s
I20260709 12:22:18.600395 16531 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:18.627954 16228 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.466086 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:18.709604 11011 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:18.461213 16536 consensus_queue.cc:1059] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.219s
I20260709 12:22:18.674489 16299 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17.
I20260709 12:22:18.680207 16433 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:18.680469 16478 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:22:18.679670 16041 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:18.601539 16532 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:18.437191 16494 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:18.599236 16543 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:18.692065 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:18.839025 10934 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:18.679162 11007 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
W20260709 12:22:18.839560 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.706874 10936 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:22:18.707461 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:18.840842 10927 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:18.707623 10901 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:18.473251 16533 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:18.713440 11076 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:22:18.660856 16039 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:22:18.715691 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 61718.1us
I20260709 12:22:18.452507 16496 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:18.444216 16265 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:18.700770 16498 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:18.516837 16548 consensus_queue.cc:1059] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.190s
W20260709 12:22:18.743700 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 303752us
I20260709 12:22:18.746523 10928 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
W20260709 12:22:18.856822 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.741219 16228 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:18.733639 11050 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:18.685957 16287 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:18.761092 10935 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:18.764693 10932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 2541) took 1459 ms. Trace:
I20260709 12:22:18.715384 16352 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.704669 10899 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:18.840301 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 2997) took 1009 ms. Trace:
W20260709 12:22:18.845304 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 137766us
I20260709 12:22:18.865819 10901 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:18.859138 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 125585us
I20260709 12:22:18.857185 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:18.744686 16481 consensus_queue.cc:1059] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 12:22:18.864305 10932 rpcz_store.cc:276] 0709 12:22:17.305261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.305401 (+   140us) service_pool.cc:224] Handling call
0709 12:22:18.764477 (+1459076us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54001928d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:18.764630 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2623913728}
I20260709 12:22:18.864709 10936 rpcz_store.cc:276] 0709 12:22:17.831026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.669760 (+838734us) service_pool.cc:224] Handling call
0709 12:22:18.840227 (+170467us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.729161 16482 consensus_queue.cc:1059] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.123s
I20260709 12:22:18.715075 15853 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:18.752866 16531 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:18.720291 15820 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.144s
I20260709 12:22:18.889542 16032 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:18.872345 10932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2552) took 1425 ms. Trace:
I20260709 12:22:18.868021 16498 raft_consensus.cc:697] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:18.897310 10933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 2992) took 1067 ms. Trace:
I20260709 12:22:18.844884 16533 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:18.856019 16319 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:18.895996 10932 rpcz_store.cc:276] 0709 12:22:17.447067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.871592 (+1424525us) service_pool.cc:224] Handling call
0709 12:22:18.871847 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:18.872036 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:18.872060 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:18.872100 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:18.872136 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:18.872188 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:18.872289 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:18.897632 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.897785 10933 rpcz_store.cc:276] 0709 12:22:17.829767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.032252 (+202485us) service_pool.cc:224] Handling call
0709 12:22:18.897118 (+864866us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54001e5ad4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:18.897243 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":896655616}
I20260709 12:22:18.855716 16298 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:18.845098 16039 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:18.906148 11659 raft_consensus.cc:1240] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:18.883137 11050 leader_election.cc:400] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20.
I20260709 12:22:18.911599 11050 leader_election.cc:403] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:18.710343 16373 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:18.885036 16433 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:18.885507 16228 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:18.886722 16345 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:18.887872 16503 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.901484 10934 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:22:18.862231 16255 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:18.861644 16494 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:18.873576 10901 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:18.926959 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 222351us
W20260709 12:22:18.928027 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 435767us
I20260709 12:22:18.928632 10974 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:18.929126 10899 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:18.929404 10974 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:18.910876 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:18.902441 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2983) took 1443 ms. Trace:
I20260709 12:22:18.930413 10936 rpcz_store.cc:276] 0709 12:22:17.458744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.872113 (+1413369us) service_pool.cc:224] Handling call
0709 12:22:18.872408 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:18.902125 (+ 29717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:18.902150 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:18.902193 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:18.902229 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:18.902290 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:18.902392 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.916309 16039 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:18.859625 16542 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:22:18.880118 16366 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:18.887761 16554 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:18.875839 16352 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:18.916333 16361 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:18.924352 16345 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:18.896766 16498 consensus_queue.cc:237] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:18.903378 16543 raft_consensus.cc:3055] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:22:18.929533 11050 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:18.934327 11651 raft_consensus.cc:2393] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 15: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:18.908319 16531 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:18.938395 10929 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 13: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:22:18.938480 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 64980.5us
I20260709 12:22:18.939577 10932 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:18.903724 16533 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:18.914945 10927 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:18.974385 11051 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:18.978900 10927 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:18.927630 16287 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20.
I20260709 12:22:18.984488 10933 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:18.974644 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:18.985610 11004 raft_consensus.cc:2393] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 11: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:18.941274 16433 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:18.990077 16433 raft_consensus.cc:697] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:18.991044 16433 consensus_queue.cc:237] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:18.991899 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:18.995503 15222 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.996106 15222 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:18.976540 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 49903.3us
I20260709 12:22:18.945657 10899 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:18.979496 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2996) took 1148 ms. Trace:
I20260709 12:22:18.940970 16536 raft_consensus.cc:3055] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:18.979480 11051 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:18.982174 10932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2986) took 1333 ms. Trace:
I20260709 12:22:18.998167 11050 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:18.998368 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 52795us
I20260709 12:22:18.998059 10927 rpcz_store.cc:276] 0709 12:22:17.830790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.978461 (+1147671us) service_pool.cc:224] Handling call
0709 12:22:18.978742 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:18.979287 (+   545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:18.979447 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.988302 16548 raft_consensus.cc:3055] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:19.005729 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:19.006346 11005 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:22:18.948465 16493 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:18.933007 16503 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:18.974532 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:18.998826 10932 rpcz_store.cc:276] 0709 12:22:17.649005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.909537 (+1260532us) service_pool.cc:224] Handling call
0709 12:22:18.919626 (+ 10089us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:18.971662 (+ 52036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:18.982105 (+ 10443us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:19.015198 10932 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:19.015843 10932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3004) took 1112 ms. Trace:
W20260709 12:22:19.016016 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.016225 10932 rpcz_store.cc:276] 0709 12:22:17.903265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.014686 (+1111421us) service_pool.cc:224] Handling call
0709 12:22:19.015017 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.015590 (+   573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.015786 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:19.017933 10932 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:19.018365 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2551) took 1574 ms. Trace:
I20260709 12:22:19.018532 10932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3007) took 1079 ms. Trace:
I20260709 12:22:19.018975 10932 rpcz_store.cc:276] 0709 12:22:17.938884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.017112 (+1078228us) service_pool.cc:224] Handling call
0709 12:22:19.017427 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.018283 (+   856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.018477 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.965583 16541 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:19.003808 10930 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 2985) took 1406 ms (client timeout 1526 ms). Trace:
I20260709 12:22:18.969949 16345 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:18.945494 16048 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:22:18.968760 16543 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:19.021695 10899 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:19.026427 10927 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18. Ops: []
W20260709 12:22:19.020390 10930 rpcz_store.cc:269] 0709 12:22:17.597470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.821167 (+223697us) service_pool.cc:224] Handling call
0709 12:22:19.003607 (+1182440us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b5400178ed4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:19.003746 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1273199872}
I20260709 12:22:18.983029 16471 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.028556 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3002) took 1146 ms. Trace:
I20260709 12:22:19.029031 10927 rpcz_store.cc:276] 0709 12:22:17.881898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.000243 (+1118345us) service_pool.cc:224] Handling call
0709 12:22:19.026235 (+ 25992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.028262 (+  2027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.028492 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.997396 16482 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:18.984184 16494 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:18.982864 16366 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:19.018800 10935 rpcz_store.cc:276] 0709 12:22:17.444052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.870637 (+1426585us) service_pool.cc:224] Handling call
0709 12:22:18.870947 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:18.871151 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:18.887191 (+ 16040us) log.cc:844] Serialized 14 byte log entry
0709 12:22:19.017367 (+130176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:19.017428 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:19.017495 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.018172 (+   677us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:19.018305 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19094,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":49,"thread_start_us":129837,"threads_started":1}
I20260709 12:22:19.031821 10932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53346 (request call id 502) took 1088 ms. Trace:
I20260709 12:22:19.033751 10932 rpcz_store.cc:276] 0709 12:22:17.943244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.019765 (+1076521us) service_pool.cc:224] Handling call
0709 12:22:19.031243 (+ 11478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.031458 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.031486 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:19.031533 (+    47us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:19.031568 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.031629 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:19.031748 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:19.008002 16268 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:19.005318 16481 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:18.999511 16536 raft_consensus.cc:740] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:19.043000 10933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2993) took 1213 ms. Trace:
I20260709 12:22:19.044880 10929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 2990) took 1215 ms. Trace:
I20260709 12:22:19.045353 10929 rpcz_store.cc:276] 0709 12:22:17.829260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.600143 (+770883us) service_pool.cc:224] Handling call
0709 12:22:19.044643 (+444500us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54001a72d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:19.044812 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":612754816}
I20260709 12:22:19.043547 10933 rpcz_store.cc:276] 0709 12:22:17.830021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.910975 (+1080954us) service_pool.cc:224] Handling call
0709 12:22:18.911248 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:18.985002 (+ 73754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.042648 (+ 57646us) spinlock_profiling.cc:243] Waited 73 ms on lock 0x7b5400203fd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:19.042905 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167945600}
I20260709 12:22:19.051321 10932 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:19.005118 16548 raft_consensus.cc:740] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:19.021179 16361 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
W20260709 12:22:19.053501 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 55416.4us
I20260709 12:22:19.012401 16228 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:19.076828 11011 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:22:19.077508 11050 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:19.055673 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53346 (request call id 504) took 1043 ms. Trace:
I20260709 12:22:19.056710 10930 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:19.059512 16265 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:19.035573 16494 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.065162 16352 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:19.066529 16503 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:19.067155 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 45555.7us
I20260709 12:22:19.050683 16366 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.037879 16375 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:19.023917 16493 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.072924 16041 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:19.011215 16032 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:22:19.074049 10929 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:19.112924 10927 rpcz_store.cc:276] 0709 12:22:18.012098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.032932 (+1020834us) service_pool.cc:224] Handling call
0709 12:22:19.055112 (+ 22180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.055309 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.055335 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:19.055379 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:19.055412 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.055468 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:19.055608 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:19.074954 10933 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 12:22:19.083940 10977 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.006s	sys 0.033s
W20260709 12:22:19.123996 10977 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.011s	sys 0.034s
W20260709 12:22:19.124682 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 616713us
I20260709 12:22:19.109584 10899 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:19.030113 16556 raft_consensus.cc:2764] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:22:19.133711 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:19.111564 10930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53346 (request call id 503) took 1124 ms. Trace:
I20260709 12:22:19.082727 10935 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:22:19.110899 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:19.134567 10930 rpcz_store.cc:276] 0709 12:22:17.987485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.032822 (+1045337us) service_pool.cc:224] Handling call
0709 12:22:19.056360 (+ 23538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.111080 (+ 54720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.111494 (+   414us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:19.118737 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:19.135627 11080 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 13.
W20260709 12:22:19.092620 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.122043 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:19.137181 11076 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 15.
I20260709 12:22:19.067633 16298 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:19.133561 10899 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:19.134950 10932 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:19.072440 16549 log.cc:927] Time spent T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:22:19.107131 16267 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.132094 16536 consensus_queue.cc:260] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.061686 16560 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:19.150391 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:19.035655 16471 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:19.079284 16531 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.120149 16557 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:22:19.061046 16482 raft_consensus.cc:697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:19.147576 10899 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:19.142056 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2995) took 1311 ms. Trace:
I20260709 12:22:19.110747 16494 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:19.148437 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:19.162078 10927 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:19.111402 16481 raft_consensus.cc:697] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:19.061432 16541 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:19.152406 10935 raft_consensus.cc:2393] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 12: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:19.146652 16319 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:19.154433 10934 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16. Ops: []
W20260709 12:22:19.145978 10977 connection.cc:256] RPC call timeout handler was delayed by -1.0804266439999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
I20260709 12:22:19.151077 16478 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:19.204973 16478 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.205364 16478 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:19.205971 15222 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:19.207257 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:19.208123 11659 raft_consensus.cc:2410] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
W20260709 12:22:19.157130 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:19.209719 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.163039 10936 rpcz_store.cc:276] 0709 12:22:17.830554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.931440 (+1100886us) service_pool.cc:224] Handling call
0709 12:22:18.931777 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:18.932035 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:18.939369 (+  7334us) log.cc:844] Serialized 14 byte log entry
0709 12:22:19.141696 (+202327us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:19.141750 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:19.141802 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.141878 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:19.141998 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1230,"prepare.queue_time_us":7096,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":94,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":123,"thread_start_us":201876,"threads_started":1}
W20260709 12:22:19.167146 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.141597 16361 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:19.151845 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:19.174052 16536 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:19.163908 16421 consensus_queue.cc:1243] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 1abf4b385a2b493ab83f593a1f8c9cd1 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:22:19.175361 16366 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:19.177062 16268 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:19.175464 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:19.180006 16041 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:19.145124 16299 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:19.182400 15820 raft_consensus.cc:3055] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:19.184312 16414 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:19.185312 16525 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:19.187249 16471 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:19.250557 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:19.253538 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:19.192294 11622 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
W20260709 12:22:19.254782 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 62576.1us
I20260709 12:22:19.169096 16543 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.193117 16493 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:19.154771 16267 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.193526 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:19.258389 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:19.258249 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:19.196473 16481 consensus_queue.cc:237] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.153497 16548 consensus_queue.cc:260] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.198117 16373 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:19.210948 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:19.210965 10929 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:19.211925 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:19.271943 10936 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:19.212831 10927 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
W20260709 12:22:19.217375 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 287156us
I20260709 12:22:19.273694 10974 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:19.220950 16228 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:19.223485 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 2994) took 1393 ms. Trace:
I20260709 12:22:19.251355 16041 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.231372 10928 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 11.
W20260709 12:22:19.240363 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.241480 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:18.922258  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:19.247048 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:19.248908 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:19.248947 10930 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:22:19.191975 16496 raft_consensus.cc:3055] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:19.257603 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:19.258984 11080 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:19.195591 15853 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:19.258678 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:19.296100 11077 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 11.
I20260709 12:22:19.296337 11084 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:19.260773 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:19.255445 11622 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:19.250478 15820 raft_consensus.cc:740] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:19.264398 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:19.265038 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:19.265668 11078 raft_consensus.cc:2393] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 16: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:19.300726 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53346 (request call id 507) took 1242 ms. Trace:
I20260709 12:22:19.273823 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:19.230647 10932 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:22:19.281049 10934 rpcz_store.cc:276] 0709 12:22:17.830276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.923610 (+1093334us) service_pool.cc:224] Handling call
0709 12:22:18.927081 (+  3471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.204121 (+277040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.223248 (+ 19127us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54001621d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:19.223430 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522450176}
I20260709 12:22:19.248452 16554 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:19.284926 16228 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.303759 16501 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:19.306094 16501 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.173333 16531 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:19.286299 10974 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:19.296866 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:19.301124 10928 rpcz_store.cc:276] 0709 12:22:18.058051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.856943 (+798892us) service_pool.cc:224] Handling call
0709 12:22:19.300566 (+443623us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54002044d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:19.300672 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":666715520}
I20260709 12:22:19.315956 10935 raft_consensus.cc:2376] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16. Re-sending same reply.
I20260709 12:22:19.307305 11082 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:19.304533 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:19.316284 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:19.317143 10933 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:19.306705 16501 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:19.317890 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:19.308491 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 53125.4us
I20260709 12:22:19.321643 10932 raft_consensus.cc:2393] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 11: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:19.308385 10927 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:19.314250 10929 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
W20260709 12:22:19.323622 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.295033 16041 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:19.332933 10974 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:19.298619 16255 raft_consensus.cc:3055] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:19.324764 11084 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
W20260709 12:22:19.328055 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 250595us
I20260709 12:22:19.326642 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:19.337997 10928 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:19.339105 11050 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:19.329178 16553 raft_consensus.cc:2764] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:22:19.330230 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:19.342000 10935 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:19.330454 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:19.342921 10930 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:19.331424 10933 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:19.304814 16548 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:19.312749 10936 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:19.298947 16496 raft_consensus.cc:740] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:19.307945 16562 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:19.352618 10932 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:22:19.353907 10899 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:19.354722 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:19.365316 10936 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 13.
I20260709 12:22:19.265511 16556 consensus_queue.cc:1059] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 12:22:19.378315 16366 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:19.378728 10899 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:19.266191 16545 consensus_queue.cc:1059] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 12:22:19.318414 16554 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.335671 16255 raft_consensus.cc:740] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:19.406750 11080 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:19.396728 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:19.348670 16421 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.346947 16268 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:22:19.423822 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 45172.3us
I20260709 12:22:19.432181 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:19.432960 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:19.435105 11051 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:19.440172 11011 raft_consensus.cc:2410] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 14 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
W20260709 12:22:19.438870 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.440940 10899 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:19.437512 10927 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:22:19.356156 16493 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.443607 16493 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.445848 16493 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:19.442945 10901 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:19.438830 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 223231us
I20260709 12:22:19.452847 11003 raft_consensus.cc:2393] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 15: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:19.392761 16560 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:19.462343 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:19.463099 11625 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:19.462384 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:19.464957 11005 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:19.417770 16366 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:19.475608 15222 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:19.419355 16564 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:19.483737 10901 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:19.494503 15222 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:19.494948 15222 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.495033 10901 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:19.438571 16299 raft_consensus.cc:2764] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:22:19.319020 16482 consensus_queue.cc:237] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.438953 16568 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:19.424022 16567 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:19.495409 15222 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:19.474952 10899 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:19.502749 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 150389us
I20260709 12:22:19.477285 16366 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:19.473502 15853 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:19.438371 16553 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:22:19.481173 16560 raft_consensus.cc:697] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:19.455356 16421 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.397814 15820 consensus_queue.cc:260] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:19.533893 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 248019us
W20260709 12:22:19.545702 10831 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35614 (request call id 246) took 26866 ms (client timeout 15000 ms). Trace:
I20260709 12:22:19.512112 16319 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:19.453300 16268 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:19.524462 16433 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:19.503729 16571 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:22:19.481024 16503 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:22:19.548491 16267 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:19.497159 16265 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:22:19.524302 16255 consensus_queue.cc:260] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:19.578234 16345 consensus_meta.cc:287] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.001s
I20260709 12:22:19.578685 16345 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:19.580094 11004 raft_consensus.cc:1240] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
W20260709 12:22:19.582360 16533 consensus_meta.cc:287] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.559s	user 0.007s	sys 0.001s
I20260709 12:22:19.582825 16533 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.585486 16421 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:19.546756 10831 rpcz_store.cc:269] 0709 12:21:52.640122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.640299 (+   177us) service_pool.cc:224] Handling call
0709 12:22:19.506349 (+26866050us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:16.273122 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:16.273847 (+   725us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:16.273899 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:22:16.273933 (+    34us) tablet.cc:662] Decoding operations
0709 12:22:16.275596 (+  1663us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:16.275691 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:16.275719 (+    28us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:22:16.284158 (+  8439us) tablet.cc:701] Row locks acquired
0709 12:22:16.284201 (+    43us) write_op.cc:260] PREPARE: finished
0709 12:22:16.284370 (+   169us) write_op.cc:270] Start()
0709 12:22:16.284511 (+   141us) write_op.cc:276] Timestamp: P: 1783599736284306 usec, L: 0
0709 12:22:16.284526 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 12:22:16.285353 (+   827us) log.cc:844] Serialized 7840 byte log entry
0709 12:22:17.047742 (+762389us) op_driver.cc:464] REPLICATION: finished
0709 12:22:17.111919 (+ 64177us) write_op.cc:301] APPLY: starting
0709 12:22:17.112050 (+   131us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:17.254528 (+142478us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:17.254710 (+   182us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:18.190271 (+935561us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:18.190783 (+   512us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=0,mrs_lookups=0
0709 12:22:18.190834 (+    51us) write_op.cc:312] APPLY: finished
0709 12:22:18.191315 (+   481us) log.cc:844] Serialized 180 byte log entry
0709 12:22:18.420594 (+229279us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:18.420780 (+   186us) write_op.cc:454] Released schema lock
0709 12:22:18.420861 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:18.421511 (+   650us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:18.421543 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":668695,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":61775,"apply.run_cpu_time_us":53842,"apply.run_wall_time_us":1309457,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87607,"num_ops":20,"prepare.queue_time_us":210239,"prepare.run_cpu_time_us":136613,"prepare.run_wall_time_us":188218,"raft.queue_time_us":311306,"raft.run_cpu_time_us":7619,"raft.run_wall_time_us":82388,"replication_time_us":749371,"spinlock_wait_cycles":1280,"thread_start_us":539905,"threads_started":5,"wal-append.queue_time_us":434241,"wal-append.run_cpu_time_us":20002,"wal-append.run_wall_time_us":2423193}]]}
W20260709 12:22:19.588434 16532 consensus_meta.cc:287] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.742s	user 0.010s	sys 0.000s
I20260709 12:22:19.588877 16532 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.588949 16560 consensus_queue.cc:237] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.591073 16532 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:19.595270 16494 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.595713 16567 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:19.596319 16567 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:19.599457 16545 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:19.600143 16545 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.602607 16545 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:19.608217 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:19.609782 11085 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 14: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:19.522632 16048 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:19.523312 10832 catalog_manager.cc:5697] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:19.527186 16471 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:22:19.552515 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 89486.2us
W20260709 12:22:19.615834 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.616417 15222 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.486451 16496 consensus_queue.cc:260] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.550648 16287 consensus_queue.cc:1059] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:22:19.504177 16564 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:19.570979 16228 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:19.571774 16268 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:19.567934 16433 raft_consensus.cc:697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:19.572983 16554 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:19.498211 16493 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:22:19.612174 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.614697 11655 raft_consensus.cc:2393] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 15: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:19.618520 10832 catalog_manager.cc:5697] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:19.624774 15222 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:19.629565 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.659114 16041 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:19.818718 11050 leader_election.cc:336] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.694s (SENT)
W20260709 12:22:19.711841 10931 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 2991) took 1882 ms (client timeout 2188 ms). Trace:
I20260709 12:22:19.699148 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:19.821419 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:19.822347 10929 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:19.821895 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.770542 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:19.625155 16471 raft_consensus.cc:697] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
W20260709 12:22:19.704788 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 199132us
W20260709 12:22:19.689344 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 342811us
W20260709 12:22:19.827126 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 348402us
I20260709 12:22:19.809777 16287 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.757248 16557 raft_consensus.cc:3055] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:19.838610 10974 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:22:19.832849 10931 rpcz_store.cc:269] 0709 12:22:17.829523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.670361 (+840838us) service_pool.cc:224] Handling call
0709 12:22:19.709192 (+1038831us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b54002053d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:19.711750 (+  2558us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1960240896}
I20260709 12:22:19.834753 11050 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:19.852166 11051 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:19.839124 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:19.855409 11007 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 10. Current term is 11. Ops: []
W20260709 12:22:19.856747 11050 leader_election.cc:336] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.744s (SENT)
I20260709 12:22:19.859531 11624 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:19.860184 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:19.860776 10930 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:19.861718 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:19.840015 10901 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:19.862861 15222 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:19.864202 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:19.864936 10936 raft_consensus.cc:2393] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 12: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:19.865682 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:19.744675 16533 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:19.726900 16564 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:19.655035 16569 log.cc:927] Time spent T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:22:19.770717 16255 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:19.623140 16573 consensus_queue.cc:1059] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.216s
I20260709 12:22:19.819813 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
W20260709 12:22:19.715721 16572 log.cc:927] Time spent T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:22:19.629971 16562 raft_consensus.cc:697] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:19.887935 16562 consensus_queue.cc:237] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.889293 16471 consensus_queue.cc:237] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:19.812613 16482 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.891252 16482 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.752852 16501 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:19.893416 16482 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:19.893893 16501 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:19.752614 15820 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:19.854234 10929 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 15.
I20260709 12:22:19.877024 16352 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:19.895383 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:19.709157 16433 consensus_queue.cc:237] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.895968 10929 raft_consensus.cc:2376] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20. Re-sending same reply.
I20260709 12:22:19.896845 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:19.897907 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:19.898555 10929 raft_consensus.cc:2368] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13.
I20260709 12:22:19.899231 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:19.899910 10929 raft_consensus.cc:2393] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 11: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:19.900676 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:19.901629 10929 raft_consensus.cc:2393] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 11: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:19.902438 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:19.903026 10929 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:19.903489 16041 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:19.766469 16567 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:19.862260 11004 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 15.
I20260709 12:22:19.622118 16478 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.682332 16582 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.730348 16543 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:19.751950 16494 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:19.724972 16345 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:19.868341 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:19.915485 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:19.919238 10931 raft_consensus.cc:2376] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16. Re-sending same reply.
W20260709 12:22:19.642551 16565 log.cc:927] Time spent T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.259s	user 0.001s	sys 0.001s
I20260709 12:22:19.863065 10901 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:19.920976 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 57996.7us
W20260709 12:22:19.871260 11050 leader_election.cc:336] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.951s (SENT)
I20260709 12:22:19.922375 11050 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:19.654386 16574 log.cc:927] Time spent T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:22:19.819898 10832 catalog_manager.cc:5697] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 10 to 11, leader changed from 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 11 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:22:19.872134 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:19.876250 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:19.868650 16265 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:19.839594 16560 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.878273 10974 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:19.877342 11051 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:19.929708 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 51530.1us
I20260709 12:22:19.881853 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:19.842244 15853 raft_consensus.cc:697] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:19.868867 16287 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.853582 16557 raft_consensus.cc:740] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:19.913599 11625 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:22:19.900619 16592 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:22:19.752125 16039 consensus_meta.cc:287] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.803s	user 0.011s	sys 0.000s
I20260709 12:22:19.924351 10935 raft_consensus.cc:2376] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16. Re-sending same reply.
I20260709 12:22:19.944347 11007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "015a67e38c364985be24b18358579506"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:22:19.727988 16531 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:19.923600 10832 catalog_manager.cc:5697] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:19.944904 11007 raft_consensus.cc:606] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:19.945338 11007 raft_consensus.cc:614] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:19.945441 10929 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 14.
I20260709 12:22:19.902709 16585 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:19.958469 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:19.930549 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:19.959851 11076 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:19.683305 16366 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.933058 10934 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: []
W20260709 12:22:19.933862 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 56629.5us
I20260709 12:22:19.962503 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:19.963177 11009 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 12:22:19.963584 11082 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:19.882351 16525 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
W20260709 12:22:19.937881 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 66662.3us
I20260709 12:22:19.938120 11081 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:19.940543 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:19.968333 11085 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:19.966810 11003 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:19.875317 16586 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:22:19.943190 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:19.924368 11006 raft_consensus.cc:2393] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 11: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:19.877079 16580 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:19.961035 11002 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:22:19.960983 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:19.951398 11078 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:19.978786 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:19.958910 16319 consensus_queue.cc:1059] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:22:19.980261 11002 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:22:19.980651 11002 pending_rounds.cc:85] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 9
I20260709 12:22:19.980857 11002 pending_rounds.cc:107] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:22:19.981074 11002 raft_consensus.cc:2889] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:19.982463 16568 raft_consensus.cc:3055] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:19.982896 16568 raft_consensus.cc:740] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:19.984233 15853 consensus_queue.cc:237] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.984808 11007 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:22:19.986614 16478 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:19.966037 16556 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.988263 16556 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.983793 16568 consensus_queue.cc:260] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:19.966259 16554 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.991707 16554 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.992235 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:19.993801 16554 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:19.995785 16366 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:19.999217 11006 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:22:20.000753 16558 consensus_queue.cc:1059] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 12:22:20.001752 16558 raft_consensus.cc:3055] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:20.002117 16558 raft_consensus.cc:740] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:20.002871 16558 consensus_queue.cc:260] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:19.934006 16560 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.006389 16560 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:19.964473 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:19.961403 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:19.940968 16482 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:20.018256 16482 raft_consensus.cc:697] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:19.934175 16533 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:22:19.969319 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.969344 10832 catalog_manager.cc:5697] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 8 to 13, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 13 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:22:19.963748 11051 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:19.972431 11625 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:20.024595 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 60918us
I20260709 12:22:19.971503 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:19.959512 16352 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:19.969833 16584 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.973762 16557 consensus_queue.cc:260] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:20.030637 10832 catalog_manager.cc:5697] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 7 to 10, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 10 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:19.946012 16548 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 12:22:19.915331 16582 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:19.977300 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:19.950747 11084 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:22:20.008486 16585 raft_consensus.cc:697] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:20.004261 16041 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:20.009259 11004 raft_consensus.cc:2376] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13. Re-sending same reply.
I20260709 12:22:19.965273 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:20.049579 11009 raft_consensus.cc:2376] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16. Re-sending same reply.
I20260709 12:22:20.012140 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:19.946779 16494 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:19.965724 16583 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.053033 16583 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.033757 16584 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.055326 16583 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:20.014446 11005 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:20.055913 16375 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.056522 16375 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:20.057741 16582 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:20.058584 16375 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:19.990445 16556 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:20.015568 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:20.059798 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 44303.2us
I20260709 12:22:20.021006 11651 raft_consensus.cc:1240] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16. Ops: []
W20260709 12:22:20.024629 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 52291.6us
I20260709 12:22:20.030282 16533 raft_consensus.cc:697] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:20.025425 11051 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:19.972671 11011 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:20.028653 16265 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:22:20.052621 16593 log.cc:927] Time spent T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:22:20.060525 10977 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:20.069679 10977 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:20.026119 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:20.070454 11010 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:20.071166 10977 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:20.061679 16568 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:20.014245 16496 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:20.082043 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:20.027315 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:20.026000 16501 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:19.974488 16567 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:19.935009 16564 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:22:20.036016 10832 catalog_manager.cc:5697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:20.037149 11003 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:20.023483 16558 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:20.052439 16557 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:20.054100 11008 raft_consensus.cc:2376] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11. Re-sending same reply.
I20260709 12:22:20.084542 16553 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:20.019200 16482 consensus_queue.cc:237] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.117681 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:20.117911 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:20.118505 11006 raft_consensus.cc:2393] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 12: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:20.119119 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:20.119349 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:20.119550 16287 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:20.120098 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:20.023757 11050 leader_election.cc:336] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.614s (SENT)
I20260709 12:22:20.121840 11050 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:20.084779 16583 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:20.124761 16583 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.125102 16583 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:20.126549 16586 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:20.084611 16563 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:20.062947 16525 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:20.109601 16319 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:22:20.128147 16525 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.128233 16345 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:22:20.128647 16525 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:20.130873 16563 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.131286 16563 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:20.077064 11011 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:22:20.132515 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:20.133282 11007 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:20.134008 10901 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:20.134229 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:20.134865 11007 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:20.083542 10977 leader_election.cc:400] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13.
I20260709 12:22:20.136484 10977 leader_election.cc:403] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 12:22:20.137296 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 62301.1us
I20260709 12:22:20.062762 11051 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:20.138489 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 75807.4us
I20260709 12:22:20.138593 16586 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:20.139114 16586 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:20.139199 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:20.139516 16586 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:20.140029 16557 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:20.141580 10977 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:20.142910 16557 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:20.143431 16557 raft_consensus.cc:697] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:20.144544 16567 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.144302 16557 consensus_queue.cc:237] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.145032 16567 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:20.147186 16567 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:20.151894 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:20.152032 16554 consensus_queue.cc:1059] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:20.152741 10933 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 15: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:20.034904 16493 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 12:22:20.110013 16433 consensus_queue.cc:1059] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 12:22:20.126430 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:20.156654 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:20.157392 11005 raft_consensus.cc:2393] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 12: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:20.158164 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:20.158808 11005 raft_consensus.cc:2393] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 11: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:20.161320 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:20.162087 10933 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:20.062700 16265 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.062463 16533 consensus_queue.cc:237] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.060117 16585 consensus_queue.cc:237] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.169267 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:20.170106 11078 raft_consensus.cc:2393] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 16: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:20.082870 11009 raft_consensus.cc:2393] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 11: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:20.022084 16366 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:22:20.034821 16352 raft_consensus.cc:697] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:20.055989 16584 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:19.964254 16039 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.115732 10832 catalog_manager.cc:5697] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 5 to 12. New cstate: current_term: 12 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:20.063082 16556 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:20.083834 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:20.135001 16048 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:20.135349 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:20.127576 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 103836us
I20260709 12:22:20.137791 16345 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13.
I20260709 12:22:20.127400 16501 raft_consensus.cc:697] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:20.085989 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:20.176357 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:20.191207 11002 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 12:22:20.267441 11002 pending_rounds.cc:85] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 12
I20260709 12:22:20.248665 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:20.190747 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:20.183017 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:20.182525 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:20.243491 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:20.268759 10932 raft_consensus.cc:2376] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17. Re-sending same reply.
I20260709 12:22:20.268934 11011 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:20.267971 11002 pending_rounds.cc:107] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 12:22:20.187144 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:20.182790 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:20.212358 11010 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:20.159590 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:20.268857 11082 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:22:20.196888 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:20.181542 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:20.270989 11078 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:20.272158 10927 raft_consensus.cc:2368] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14.
I20260709 12:22:20.185326 10977 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:20.272382 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:20.177212 11624 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:20.273160 11010 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 14: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:20.249006 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:20.273524 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 96406.8us
I20260709 12:22:20.267249 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:20.275517 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:20.247205 11007 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:19.934691 16571 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:20.279338 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:20.183379 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:20.282888 10935 raft_consensus.cc:2368] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14.
I20260709 12:22:20.283715 10832 catalog_manager.cc:5697] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:22:20.284716 11007 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:22:20.285848 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:20.285991 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 100766us
I20260709 12:22:20.286487 11005 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:20.286689 10977 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:20.139478 11051 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:20.287583 11003 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:20.288622 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:20.286808 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:20.289654 11007 raft_consensus.cc:2376] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17. Re-sending same reply.
I20260709 12:22:20.291203 11007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:22:20.290061 10933 raft_consensus.cc:2393] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:20.296079 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:20.296453 11076 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:20.295805 11002 raft_consensus.cc:2889] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:20.297320 11011 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 11.
I20260709 12:22:20.301010 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:20.302873 10931 raft_consensus.cc:2393] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 11: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:20.304899 16352 consensus_queue.cc:237] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:20.306113 16414 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:20.308298 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:20.308938 10929 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:20.309036 16039 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:20.309813 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:20.310385 10929 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:20.311182 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:20.182283 16583 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.312668 16501 consensus_queue.cc:237] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:20.296875 16361 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.316274 16361 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.318423 16361 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:20.319527 16048 raft_consensus.cc:697] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:20.319938 16567 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:20.320405 16567 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.320806 16567 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:20.298341 16584 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:20.152889 16554 raft_consensus.cc:3055] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:20.321874 16554 raft_consensus.cc:740] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:20.298488 16548 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:22:20.322685 16554 consensus_queue.cc:260] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.323844 16554 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:20.324222 11011 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:22:20.324573 11011 pending_rounds.cc:85] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 9
I20260709 12:22:20.324772 11011 pending_rounds.cc:107] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 12:22:20.324994 11011 raft_consensus.cc:2889] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:20.325487 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:20.326141 10930 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:20.326989 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:20.299721 11624 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:20.164224 16265 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:20.327683 10930 raft_consensus.cc:2393] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 16: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:20.305186 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:20.329025 11079 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:20.319018 10832 catalog_manager.cc:5697] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:22:20.311684 10929 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
W20260709 12:22:20.332647 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 193219us
I20260709 12:22:20.336273 11050 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:20.340093 11009 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 12:22:20.340622 11009 pending_rounds.cc:85] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 10
I20260709 12:22:20.340899 11009 pending_rounds.cc:107] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:22:20.341184 11009 raft_consensus.cc:2889] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:20.341543 11009 pending_rounds.cc:107] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 12:22:20.341822 11009 raft_consensus.cc:2889] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:20.342653 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:20.343554 11010 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:20.345901 10974 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:20.344159 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:20.348621 11003 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 15.
I20260709 12:22:20.185170 16433 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.353910 10929 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:22:20.357307 11050 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:20.360781 11004 raft_consensus.cc:2393] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 19: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:20.290441 16571 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:20.364059 10832 catalog_manager.cc:5697] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 8 to 13, leader changed from 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 13 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:22:20.390059 10832 catalog_manager.cc:5697] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:20.344815 16503 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:20.181846 16525 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:20.410554 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 46832.7us
I20260709 12:22:20.408651 11624 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:20.414147 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 56922.6us
I20260709 12:22:20.414816 10974 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:20.414911 11050 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:20.328464 16586 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:20.416702 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 83247.4us
I20260709 12:22:20.380002 16571 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:20.381657 16494 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:20.336596 15853 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 12:22:20.354162 16366 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.352672 16414 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:20.431988 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:20.352486 16573 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:22:20.416816 16375 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:20.409641 16548 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:20.410228 16562 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.320518 16048 consensus_queue.cc:237] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.432646 10832 catalog_manager.cc:5697] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 7 to 11, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 11 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:22:20.411787 16503 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.470716 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:20.406564 16564 consensus_queue.cc:1059] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 12:22:20.471669 10977 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:20.458750 16039 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.431428 15820 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:20.411979 16345 consensus_queue.cc:1059] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:22:20.379397 16433 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.413878 16563 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.467576 16375 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.432999 16553 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.051s
I20260709 12:22:20.487274 16503 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:20.458837 16366 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.496177 10977 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:20.475575 16548 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:20.488097 16268 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:20.485224 16494 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:20.505254 16375 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:20.498066 16588 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 12:22:20.516741 11007 raft_consensus.cc:606] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:20.442863 16556 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:20.546361 11007 raft_consensus.cc:614] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:20.484719 16562 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.576411 11002 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:20.496507 16039 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.523635 16548 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:20.542488 16564 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:20.591962 16039 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:20.550160 16345 raft_consensus.cc:3055] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:22:20.596896 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 156756us
W20260709 12:22:20.600344 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 162003us
W20260709 12:22:20.605233 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 190506us
I20260709 12:22:20.606858 10974 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:20.544245 16268 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.581758 16494 raft_consensus.cc:697] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:20.586570 16543 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:20.588375 16564 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.614562 10974 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:20.618829 10974 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:20.603761 11051 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:20.623019 11051 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:20.626597 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 211752us
I20260709 12:22:20.598667 16345 raft_consensus.cc:740] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:20.597770 16583 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:20.630347 11050 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:20.616883 16557 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:20.635792 11050 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:20.630399 11051 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:20.640702 11085 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:20.617262 16564 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:20.655369 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 181805us
I20260709 12:22:20.661197 11651 raft_consensus.cc:1240] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:20.661585 11050 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:20.664434 11085 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:22:20.665189 11050 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:20.672062 16493 consensus_queue.cc:1059] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:22:20.668061 16600 log.cc:927] Time spent T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.072s	user 0.003s	sys 0.000s
I20260709 12:22:20.632591 16573 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:20.678174 16573 raft_consensus.cc:697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:20.679229 16573 consensus_queue.cc:237] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.668490 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:20.675292 11050 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:20.613723 16543 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.609555 15853 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:22:20.629814 16531 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:20.635923 16533 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:22:20.697875 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 201777us
I20260709 12:22:20.698693 10977 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:20.656123 16525 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:20.640437 16482 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:20.708985 10977 leader_election.cc:400] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14.
I20260709 12:22:20.683818 16583 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:20.683928 16588 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:20.720896 16588 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:20.721342 16588 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:20.724824 16041 raft_consensus.cc:3055] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:20.743017 16041 raft_consensus.cc:740] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:20.720291 16039 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:22:20.744479 16605 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:22:20.744271 16039 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.746565 16583 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.746738 16039 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:20.747041 16583 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:20.710389 16345 consensus_queue.cc:260] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.693861 16543 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:20.724686 10931 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:20.733229 16560 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:20.691222 16586 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:20.697108 16533 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:20.712991 16602 log.cc:927] Time spent T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 12:22:20.703042 16433 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:20.757763 10977 leader_election.cc:400] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14.
I20260709 12:22:20.746416 16580 raft_consensus.cc:3055] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:20.764750 10977 leader_election.cc:403] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:22:20.750326 16319 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.752427 16531 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:20.784968 10977 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:20.789644 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:20.754130 16563 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:20.757752 16533 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:20.789517 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:20.790585 11007 raft_consensus.cc:2410] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 15 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:22:20.758358 16525 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:20.802675 16525 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.803103 16525 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:20.811765 11007 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:20.815376 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:20.816685 11007 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:20.764966 16287 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:20.781569 16586 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:20.763593 15820 raft_consensus.cc:697] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:20.780515 16580 raft_consensus.cc:740] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:22:20.831324 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 46427.1us
I20260709 12:22:20.835047 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:20.840646 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:20.842667 10977 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:20.846889 11011 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.010s	sys 0.003s
W20260709 12:22:20.848474 11011 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.010s	sys 0.003s
I20260709 12:22:20.858343 10977 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:20.828189 16287 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.831035 16366 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:20.865214 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:20.808735 16582 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:22:20.865864 10928 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:20.759181 16041 consensus_queue.cc:260] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:20.801079 16319 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.763594 16494 consensus_queue.cc:237] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.882448 10929 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
W20260709 12:22:20.883493 16568 consensus_meta.cc:287] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.811s	user 0.005s	sys 0.005s
I20260709 12:22:20.856940 16556 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14.
I20260709 12:22:20.944262 16556 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:20.944355 16375 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:20.944770 16556 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.854568 16562 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:20.885471 16554 consensus_meta.cc:287] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.000s
W20260709 12:22:20.942162 16501 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.011s	sys 0.008s
W20260709 12:22:20.947646 16501 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.012s	sys 0.008s
I20260709 12:22:20.947151 16375 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:20.895121 16583 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:20.898701 16567 consensus_meta.cc:287] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.577s	user 0.002s	sys 0.007s
I20260709 12:22:20.904212 16580 consensus_queue.cc:260] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.879623 16287 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:20.916329 16557 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:20.924198 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:20.961009 10930 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:20.948885 16588 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:20.925503 16268 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:20.926735 16617 consensus_queue.cc:1059] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:20.912107 16618 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:20.928069 16493 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:20.929693 16621 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:20.930727 10901 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:20.931550 15820 consensus_queue.cc:237] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:20.924803 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:20.935285 16345 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:20.936173 16558 consensus_meta.cc:287] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.000s
I20260709 12:22:20.935812 16571 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:20.943253 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:20.944499 16548 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.948112 16319 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:20.954164 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 276980us
I20260709 12:22:20.924737 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:20.923450 16564 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:20.964087 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 333723us
W20260709 12:22:20.953200 16601 log.cc:927] Time spent T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.647s	user 0.000s	sys 0.007s
W20260709 12:22:20.953557 16608 log.cc:927] Time spent T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.243s	user 0.003s	sys 0.002s
I20260709 12:22:21.027014 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:20.959887 16611 log.cc:927] Time spent T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.142s	user 0.000s	sys 0.004s
W20260709 12:22:20.960104 16265 consensus_meta.cc:287] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.000s
I20260709 12:22:20.957579 16041 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:20.991833 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 295486us
I20260709 12:22:20.959120 16525 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:20.958546 16567 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:20.958009 16563 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:21.004055 10931 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:20.957568 16414 raft_consensus.cc:697] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:22:21.000174 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 69536.1us
I20260709 12:22:21.019254 11006 raft_consensus.cc:2410] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:22:21.019297 11007 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
W20260709 12:22:21.004002 16609 log.cc:927] Time spent T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:22:21.019722 10930 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:20.997959 16580 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:21.022532 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:21.024425 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:21.027808 10974 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:21.028429 10928 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:21.070163 11082 raft_consensus.cc:2410] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:22:21.069391 11651 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:22:21.005504 16268 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:21.007498 16556 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:21.032742 11009 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:20.999332 16610 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:21.035429 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:21.060873 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:21.074069 11076 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:22:21.074586 11080 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:21.004596 16493 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:21.077333 16493 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:21.078868 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 403605us
I20260709 12:22:21.080353 11050 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:21.029191 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:21.071452 11084 raft_consensus.cc:2368] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16.
I20260709 12:22:21.072060 10901 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:21.081771 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:20.971123 16533 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:21.083348 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 55630.6us
I20260709 12:22:21.091303 11050 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:21.085162 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:21.095893 11084 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:21.088279 11007 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:22:21.064199 16586 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.100435 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:21.036074 16255 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:22:21.099164 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:21.104127 11010 raft_consensus.cc:2410] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:22:21.028189 16503 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:21.098582 11077 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:21.072542 16268 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.111534 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:21.105588 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:21.114167 11011 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:21.107059 11080 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: []
W20260709 12:22:21.107463 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:21.107683 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.090975 16557 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.056892 16265 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:21.116581 16375 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:21.124521 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:21.094267 16568 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:21.127846 11076 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:22:21.094710 16562 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:21.097489 16585 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:22:21.124557 16623 log.cc:927] Time spent T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:22:21.134574 11078 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 12:22:21.146891 10931 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:22:21.138855 11011 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 16.
I20260709 12:22:21.149642 11079 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:21.142977 11084 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:22:21.124590 16268 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:21.096278 15853 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
W20260709 12:22:21.154820 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 64272.1us
I20260709 12:22:21.155632 11085 raft_consensus.cc:2393] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 19: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:21.104467 16613 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 12:22:21.161612 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:21.157114 16618 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.179091 10931 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:21.110882 16586 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:21.141487 16568 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:21.177753 10928 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:22:21.132577 16616 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.158082 16641 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:21.132447 16614 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:22:21.194489 11011 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:22:21.118834 16639 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:22:21.166708 16585 raft_consensus.cc:697] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:21.140976 16557 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:21.163962 16531 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:21.147429 16375 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:21.166493 16496 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:21.191536 16642 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:21.202060 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:21.200233 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:21.172708 16583 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:21.180465 16612 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.254424 11080 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:22:21.157640 16629 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:22:21.262669 11651 raft_consensus.cc:2368] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16.
W20260709 12:22:21.263667 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 68443.5us
I20260709 12:22:21.196702 16568 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:21.212260 16628 log.cc:927] Time spent T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:22:21.146235 16414 consensus_queue.cc:237] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:21.274603 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:21.253717 16634 log.cc:927] Time spent T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:22:21.203162 16588 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:21.277813 10977 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:21.254606 16493 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.295562 16655 consensus_queue.cc:1059] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:21.261783 16548 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:21.298878 11049 leader_election.cc:400] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16.
I20260709 12:22:21.319383 11049 leader_election.cc:403] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:22:21.294332 10977 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:21.316252 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:21.274410 16366 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:21.271340 16503 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:21.192056 16618 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:21.270926 16564 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:21.317075 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 162422us
I20260709 12:22:21.272049 16496 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:21.336238 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:21.263046 16531 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:21.251082 16641 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:21.267590 16543 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:21.358959 11011 raft_consensus.cc:606] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:21.363147 11011 raft_consensus.cc:614] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:21.213132 16616 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:21.326462 16494 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:21.361917 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:21.324988 16571 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:21.280339 16583 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.051s
I20260709 12:22:21.368891 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:21.330906 16366 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:21.367771 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:21.330518 16533 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:21.333801 16548 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:21.369746 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:21.280565 16612 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:21.320917 16493 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:21.326239 16567 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:21.373162 11082 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:22:21.376351 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3395) took 1018 ms. Trace:
I20260709 12:22:21.376994 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:21.374081 16644 log.cc:927] Time spent T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:22:21.374425 16619 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:21.369839 16585 consensus_queue.cc:237] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:21.377375 11003 rpcz_store.cc:276] 0709 12:22:20.357720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.489134 (+131414us) service_pool.cc:224] Handling call
0709 12:22:20.500925 (+ 11791us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:20.734711 (+233786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.734750 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:20.735281 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 12:22:20.969013 (+233732us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:20.969111 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.969243 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:21.376134 (+406891us) raft_consensus.cc:1685] finished
0709 12:22:21.376154 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.376292 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12390,"raft.queue_time_us":78808,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":3231,"thread_start_us":453897,"threads_started":2,"wal-append.queue_time_us":271528}
I20260709 12:22:21.373752 11077 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 17: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:21.377856 11082 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:21.383177 16543 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:21.384083 16496 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:21.373495 16633 log.cc:927] Time spent T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.262s	user 0.001s	sys 0.001s
W20260709 12:22:21.386730 16640 log.cc:927] Time spent T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 12:22:21.387787 16645 log.cc:927] Time spent T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:22:21.367643 16564 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:21.272240 16642 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:21.388784 16618 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:21.394585 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:21.399047 11002 raft_consensus.cc:2376] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15. Re-sending same reply.
I20260709 12:22:21.400022 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:21.400614 11002 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:21.401150 16651 raft_consensus.cc:3055] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:21.401602 16651 raft_consensus.cc:740] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:21.401364 11006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2658) took 1387 ms. Trace:
I20260709 12:22:21.404410 11006 rpcz_store.cc:276] 0709 12:22:20.014029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.119079 (+105050us) service_pool.cc:224] Handling call
0709 12:22:21.401077 (+1281998us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b54000dded4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:21.401278 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2048117504}
I20260709 12:22:21.408309 11076 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:22:21.401765 16616 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:21.410535 16655 consensus_queue.cc:1059] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:22:21.417248 16493 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:21.382018 16548 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.402252 16641 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:21.420428 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:21.420784 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:21.422353 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:21.424834 11079 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:21.425814 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:21.427003 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:21.389683 16265 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:21.428550 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:21.429409 11079 raft_consensus.cc:2393] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 13: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:21.430315 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:21.431519 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:21.433444 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:21.434906 11651 raft_consensus.cc:2368] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16.
W20260709 12:22:21.435756 16657 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:22:21.436918 16366 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:21.439322 11082 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:22:21.422603 16548 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:21.441983 16612 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:21.440093 16631 log.cc:927] Time spent T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 12:22:21.447168 11082 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:21.454957 16618 raft_consensus.cc:3055] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:21.459955 11002 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:21.464216 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:21.457229 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 162939us
I20260709 12:22:21.457549 11082 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:22:21.440117 16643 log.cc:927] Time spent T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:22:21.417634 16642 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:21.418704 16564 raft_consensus.cc:697] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:21.476905 16564 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:21.480424 16586 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:21.471927 10977 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:21.475780 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:21.476063 16648 log.cc:927] Time spent T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:22:21.459930 16618 raft_consensus.cc:740] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:22:21.498421 16287 consensus_meta.cc:287] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.000s
W20260709 12:22:21.570041 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 98206us
I20260709 12:22:21.407663 16651 consensus_queue.cc:260] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:21.592383 16375 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:21.499811 16557 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:21.612154 15820 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:21.612783 15820 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:21.616544 16646 log.cc:927] Time spent T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
I20260709 12:22:21.602648 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:21.606056 11002 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:22:21.625775 10977 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:21.604350 16287 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:21.627126 16557 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:21.627756 16557 consensus_queue.cc:1243] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:22:21.628887 11084 raft_consensus.cc:2368] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12.
I20260709 12:22:21.512061 16533 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.634833 11624 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:21.628326 16560 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:22:21.643020 16661 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.644279 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3393) took 1287 ms. Trace:
I20260709 12:22:21.632437 11050 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:21.643718 16661 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:21.644680 11009 rpcz_store.cc:276] 0709 12:22:20.357203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.489906 (+132703us) service_pool.cc:224] Handling call
0709 12:22:20.490198 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.078732 (+588534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.643982 (+565250us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b540012cfd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:21.644173 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1241747712}
I20260709 12:22:21.645931 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:21.646173 16580 consensus_meta.cc:287] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.003s
I20260709 12:22:21.647245 16554 raft_consensus.cc:3055] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:21.647653 16554 raft_consensus.cc:740] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:21.648450 16554 consensus_queue.cc:260] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:21.648523 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:21.649444 16554 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:21.650556 16661 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:21.611753 16268 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:21.631954 11006 raft_consensus.cc:2368] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16.
I20260709 12:22:21.623623 16641 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:22:21.630954 16631 log.cc:927] Time spent T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.131s	user 0.004s	sys 0.004s
I20260709 12:22:21.651275 16548 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:21.663757 16482 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:21.658092 16375 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:22:21.679323 16345 consensus_meta.cc:287] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.667s	user 0.008s	sys 0.000s
I20260709 12:22:21.679764 16618 consensus_queue.cc:260] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:21.640884 16655 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:21.653959 16268 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:21.711376 11007 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:21.717078 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:21.714435 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2668) took 1693 ms. Trace:
I20260709 12:22:21.719280 11050 leader_election.cc:400] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16.
I20260709 12:22:21.721009 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:21.682969 16265 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:21.723690 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:21.719820 11008 rpcz_store.cc:276] 0709 12:22:20.021256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.328119 (+306863us) service_pool.cc:224] Handling call
0709 12:22:20.334525 (+  6406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:20.380783 (+ 46258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.380813 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:20.412030 (+ 31217us) log.cc:844] Serialized 26 byte log entry
0709 12:22:20.950072 (+538042us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:20.981682 (+ 31610us) log.cc:844] Serialized 14 byte log entry
0709 12:22:20.981927 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.982015 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:21.714211 (+732196us) raft_consensus.cc:1685] finished
0709 12:22:21.714233 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.714375 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62593,"prepare.queue_time_us":28936,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":47115,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":32367,"spinlock_wait_cycles":9862400,"thread_start_us":487798,"threads_started":1,"wal-append.queue_time_us":655805}
I20260709 12:22:21.709944 16375 raft_consensus.cc:697] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:21.659107 16533 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:21.711160 16641 raft_consensus.cc:697] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:21.818140 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:21.728396 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:21.714684 16496 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.819087 11008 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 13: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:21.938544 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:21.939574 11008 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:21.759650 16265 raft_consensus.cc:697] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:21.944154 11009 raft_consensus.cc:2393] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 15: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:21.818701 16662 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:21.839453 16627 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:21.946363 16630 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.999569 16662 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:22.000043 16630 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:22.002375 16630 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:22.003684 16669 log.cc:927] Time spent T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 12:22:22.004469 16548 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:22.006599 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:22.007925 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:22.008801 11005 raft_consensus.cc:2410] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
W20260709 12:22:22.009002 16664 log.cc:927] Time spent T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
I20260709 12:22:22.009595 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:22.010676 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:22.012656 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 3284) took 1344 ms. Trace:
I20260709 12:22:22.012956 11010 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 12:22:22.002609 16662 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:22.013342 11010 pending_rounds.cc:85] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 11
I20260709 12:22:22.013648 11010 pending_rounds.cc:107] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 12:22:22.014046 11010 raft_consensus.cc:2889] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:22.015671 16580 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.016180 16580 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:22.018240 16580 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:22.013535 11085 rpcz_store.cc:276] 0709 12:22:20.668025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.668176 (+   151us) service_pool.cc:224] Handling call
0709 12:22:22.012452 (+1344276us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b54000e0954. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:22.012571 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085763840}
I20260709 12:22:22.020511 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:22.011608 11005 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:22:22.022265 11005 raft_consensus.cc:606] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:22.022651 11005 raft_consensus.cc:614] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:22.024236 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:22.024889 11005 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:22.027616 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:21.947283 16287 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:21.986063 16494 consensus_meta.cc:287] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.002s
I20260709 12:22:22.035166 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:21.984676 16268 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.040609 11008 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 12.
I20260709 12:22:22.039636 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:22.042289 11084 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:22:22.042097 11624 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:21.936111 16496 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:21.993678 16612 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:22.054396 11008 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:22:22.051297 11084 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 16.
I20260709 12:22:22.056665 11008 raft_consensus.cc:606] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:22.057068 11008 raft_consensus.cc:614] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:22.058249 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:22.007759 16627 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:22.062332 11084 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:22.041533 16494 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16.
I20260709 12:22:22.065200 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:22.052124 16501 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:22.053447 16584 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.081796 11082 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 16.
I20260709 12:22:22.052078 16265 consensus_queue.cc:237] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:22.052728 16268 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:22.087066 16619 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:22.088512 16496 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:22.090163 16533 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:22.092199 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:22.093834 10927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:57884
W20260709 12:22:22.096589 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.096926 16531 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:22.057639 16612 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:22.115901 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:22.127523 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:22.128695 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:22.129480 11002 raft_consensus.cc:2410] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 12:22:22.130190 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:22.120635 10927 raft_consensus.cc:606] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:22.131021 10927 raft_consensus.cc:614] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:22.115067 16525 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:22.053030 16641 consensus_queue.cc:237] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:22.121745 11651 raft_consensus.cc:2393] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 16: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:22.054131 16375 consensus_queue.cc:237] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:22.136462 11002 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 17: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:22.121333 11005 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:22:22.137697 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:22.139966  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:22:22.146679 11085 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
I20260709 12:22:22.121215 16619 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:22.079207 16584 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:22.148394 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 466130us
W20260709 12:22:22.148774 16564 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.006s	sys 0.005s
W20260709 12:22:22.154326 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:22.125125 16568 consensus_meta.cc:287] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.832s	user 0.008s	sys 0.003s
W20260709 12:22:22.151636 16564 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.006s	sys 0.005s
W20260709 12:22:22.166716 10930 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.049s	sys 0.033s
W20260709 12:22:22.159801 16554 consensus_meta.cc:287] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.510s	user 0.011s	sys 0.000s
W20260709 12:22:22.167914 10930 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.049s	sys 0.033s
W20260709 12:22:22.167977 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 150231us
I20260709 12:22:22.182767 11004 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:22:22.158313 11622 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:22.160157 16568 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:22.172063 16621 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.220333 16564 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.240309 16564 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:22.242923 16564 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:22.216408 16676 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:22.260921 16268 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:22.261586 16268 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.262043 16268 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:22.262722 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:22.263208 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.266139 11011 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:22.267527 11011 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:22:22.225486 16621 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:22.270766 16621 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:22.271955 16554 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:22.272588 16554 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:22.273424 16616 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.273955 16616 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:22.274698 16554 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:22.276378 16352 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:22.267554 16568 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:22.277352 11010 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:22:22.281654 16667 log.cc:927] Time spent T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.568s	user 0.003s	sys 0.000s
I20260709 12:22:22.283360 16501 raft_consensus.cc:697] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:22.284696 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3293) took 1135 ms. Trace:
I20260709 12:22:22.284482 16501 consensus_queue.cc:237] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:22.285123 11080 rpcz_store.cc:276] 0709 12:22:21.148850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.148955 (+   105us) service_pool.cc:224] Handling call
0709 12:22:21.149270 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.264932 (+115662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.284461 (+1019529us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b540030edd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:22.284633 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231734144}
I20260709 12:22:22.290243 15820 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:22.295993 16568 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:22.296700 16568 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:22.298453 16621 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.301712 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:22.303830 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:22.309019 11050 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:22.319804 11011 raft_consensus.cc:2368] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12.
I20260709 12:22:22.260993 16649 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:22.266392 16584 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:22.353894 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:22.354046 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:22.358381 11011 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:22:22.359448 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:22.317242 16616 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:22.391286 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:22.316910 16525 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:22:22.391708 16649 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:22.388276 16287 consensus_queue.cc:1059] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:22:22.388222 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:22.398092 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:22.395792 11010 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:22.399029 16649 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:22.388566 11007 raft_consensus.cc:2410] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:22:22.353554 16621 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:22.402303 16621 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:22.255646 16676 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:22.411907 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:22.358289 16639 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:22.345019 16268 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:22.419292 16619 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:22.394191 16612 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:22.432410 16677 log.cc:927] Time spent T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:22:22.433492 16676 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:22.417063 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:22.434911 11650 raft_consensus.cc:2410] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:22:22.420382 16582 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:22.436467 16582 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:22.438774 16582 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:22.444270 10930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53346 (request call id 525) took 1125 ms. Trace:
I20260709 12:22:22.444717 10930 rpcz_store.cc:276] 0709 12:22:21.318669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.318850 (+   181us) service_pool.cc:224] Handling call
0709 12:22:21.330857 (+ 12007us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:21.331234 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.331265 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:21.331734 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 12:22:21.653979 (+322245us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b18002ac220. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b 00007f9bb0affd23 00007f9bb0b000d1 00007f9bb0f1ba0f
0709 12:22:22.168469 (+514490us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:22.168509 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.168579 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:22.443942 (+275363us) raft_consensus.cc:1685] finished
0709 12:22:22.443965 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.444203 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":23801,"spinlock_wait_cycles":3645824,"thread_start_us":514277,"threads_started":1,"wal-append.queue_time_us":924555}
I20260709 12:22:22.409292 16662 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:22:22.413455 16494 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:22:22.630067 16287 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:22.575598 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:22.628952 16621 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.533408 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:22.639503 16621 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:22.553169 10931 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260709 12:22:22.495672 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 337435us
I20260709 12:22:22.641310 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:22.641848 16688 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:22.564316 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:22.529695 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2695) took 1070 ms. Trace:
I20260709 12:22:22.578200 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:22.638717 16287 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:22.642639 16688 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:22.643520 10932 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:22:22.644490 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:22.644692 16287 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:22.627336 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:22.642208 16621 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:22.463529 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:22.642707 10929 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:22.531991 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:22.650939 10930 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:22.639919 10928 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:22.559387 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:22.652715 10933 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:22.653057 10932 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 14: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:22.641959 10931 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:22.642696 11008 rpcz_store.cc:276] 0709 12:22:21.458888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.070315 (+611427us) service_pool.cc:224] Handling call
0709 12:22:22.071753 (+  1438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:22.072194 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:22.072221 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:22.072689 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 12:22:22.227804 (+155115us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:22.227843 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.227930 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:22.529435 (+301505us) raft_consensus.cc:1685] finished
0709 12:22:22.529456 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.529627 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1747,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":2277,"thread_start_us":140681,"threads_started":1,"wal-append.queue_time_us":319017}
I20260709 12:22:22.633980 10899 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:22.640113 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:22.645155 16688 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:22.671409 10936 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:22.672078 10932 raft_consensus.cc:1217] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 5.4->[7.5-17.9]   Dedup: 7.5->[9.6-17.9]
I20260709 12:22:22.673162 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:22.677977 10935 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:22.673806 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:22.679286 10934 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:22.680720 10932 pending_rounds.cc:85] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 5
I20260709 12:22:22.682328 10932 pending_rounds.cc:107] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:22:22.684088 10932 raft_consensus.cc:2889] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:22.528947 16679 log.cc:927] Time spent T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:22:22.686537 10932 pending_rounds.cc:107] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:22:22.688735 10932 raft_consensus.cc:2889] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:22.532411 16612 raft_consensus.cc:3055] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:22.627012 16265 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:22.697729 10927 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:22:22.708374 10933 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:22:22.710752 10930 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:22.694801 10929 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:22.529006 16268 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:22.727258 10936 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:22:22.729688 10928 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:22.672719 16533 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.711790 16612 raft_consensus.cc:740] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:22.743072 16533 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:22.774060 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40200 (request call id 609) took 1050 ms. Trace:
I20260709 12:22:22.774466 11082 rpcz_store.cc:276] 0709 12:22:21.724469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.027343 (+302874us) service_pool.cc:224] Handling call
0709 12:22:22.773869 (+746526us) spinlock_profiling.cc:243] Waited 43 ms on lock 0x7b5400277ed4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:22.774003 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98951936}
W20260709 12:22:22.777900 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 106833us
I20260709 12:22:22.737242 16268 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:22.733906 16265 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:22.793655 10899 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:22.805631 16268 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:22.806780 16268 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:22.809442 16265 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:22.810655 16690 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.813542 16714 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.814215 16714 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:22.811501 16690 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:22.819305 16690 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:22.822283 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.823547 16268 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:22.827426 11622 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:22.828872 16714 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:22.822769 16690 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.832309 11004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2686) took 1436 ms. Trace:
I20260709 12:22:22.832806 11004 rpcz_store.cc:276] 0709 12:22:21.395696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.395802 (+   106us) service_pool.cc:224] Handling call
0709 12:22:21.419586 (+ 23784us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:22.183368 (+763782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.832042 (+648674us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b540029c7d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:22.832247 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1754303872}
I20260709 12:22:22.832264 16690 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:22.840045 16687 log.cc:927] Time spent T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:22:22.841223 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41098 (request call id 473) took 1200 ms. Trace:
I20260709 12:22:22.841452 16711 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:22.841884 11002 rpcz_store.cc:276] 0709 12:22:21.640769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.140384 (+499615us) service_pool.cc:224] Handling call
0709 12:22:22.140898 (+   514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:22.142264 (+  1366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:22.142296 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:22.143835 (+  1539us) log.cc:844] Serialized 26 byte log entry
0709 12:22:22.322614 (+178779us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:22.322656 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.322733 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:22.840974 (+518241us) raft_consensus.cc:1685] finished
0709 12:22:22.840996 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.841154 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":186,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":75,"thread_start_us":177852,"threads_started":1,"wal-append.queue_time_us":522357}
I20260709 12:22:22.844544 16690 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:22.846273 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.766398 16696 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:22:22.852550 16627 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:22.852938 16707 log.cc:927] Time spent T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:22:22.798101 16568 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:22.854604 16619 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:22.858966 11049 leader_election.cc:400] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16.
I20260709 12:22:22.800442 16612 consensus_queue.cc:260] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:22.859297 11049 leader_election.cc:403] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:22.860447 16533 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:22.861266 16702 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16.
I20260709 12:22:22.861950 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40200 (request call id 606) took 1139 ms. Trace:
I20260709 12:22:22.862315 11085 rpcz_store.cc:276] 0709 12:22:21.722502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.020256 (+297754us) service_pool.cc:224] Handling call
0709 12:22:22.861777 (+841521us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b540011cbd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:22.861894 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288594304}
W20260709 12:22:22.835879 16692 log.cc:927] Time spent T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.318s	user 0.002s	sys 0.000s
W20260709 12:22:22.873119 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.880478 11084 raft_consensus.cc:3055] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:22.881474 11084 raft_consensus.cc:740] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:22.795579 16621 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:22.892094 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:22.894529 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:22.906345 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:22.915753 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:22.882289 11084 consensus_queue.cc:260] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:22.940095 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:23.058339 11084 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:23.050247 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:23.061590 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 267985us
I20260709 12:22:22.880388 16659 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:23.067894 10899 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:23.083735 16694 log.cc:927] Time spent T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
I20260709 12:22:22.973986 16638 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:22:23.084864 16686 log.cc:927] Time spent T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.768s	user 0.009s	sys 0.002s
I20260709 12:22:23.102475 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:23.086802 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:23.087549 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:23.103434 11076 raft_consensus.cc:2410] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for term 21 because replica has last-logged OpId of term: 20 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 16.
I20260709 12:22:23.088157 16586 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:23.088245 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:23.094002 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:23.048533 16612 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:23.097097 11051 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.554s (SENT) [suppressed 31 similar messages]
W20260709 12:22:23.084514 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 215496us
I20260709 12:22:23.098395 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:22.915455 16533 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:23.093395 16708 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.036034 16709 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.099107 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:23.117836 16708 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.117959 16709 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.120040 16586 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:23.120874 16709 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:23.104337 11080 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:22:23.106518 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:22.940553 16584 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:23.122277 16586 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:23.122737 16584 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.108989 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:23.124275 11081 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:23.107247 11083 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 10.
I20260709 12:22:23.110134 10899 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:23.110648 10901 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:23.112552 16696 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:23.113099 16690 consensus_queue.cc:1059] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:23.099079 16702 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:23.116211 16618 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:23.101075 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:22.991616 16665 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:23.142042 16568 raft_consensus.cc:3055] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:23.142516 16568 raft_consensus.cc:740] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:23.142138 16665 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.143312 16568 consensus_queue.cc:260] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.144397 16665 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:23.144634 16568 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:23.146130 16584 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:23.138681 16621 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:23.106463 11049 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:23.137253 10899 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:23.138023 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:23.099247 16496 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:23.102600 16619 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.148350 11083 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:23.148911 10899 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:23.152010 11083 raft_consensus.cc:3055] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:23.152405 11083 raft_consensus.cc:740] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:22:23.158332 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 51978us
I20260709 12:22:23.158721 11084 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:22:23.159336 11084 pending_rounds.cc:85] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 9
I20260709 12:22:23.159667 11084 pending_rounds.cc:107] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:22:23.160056 11084 raft_consensus.cc:2889] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:23.160529 10899 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:23.160974 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.147723 16621 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:23.162148 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.162966 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:23.104890 16638 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.166350 10899 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:23.157764 16690 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:23.153172 11083 consensus_queue.cc:260] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.168933 11083 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:23.160914 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 610) took 1436 ms. Trace:
I20260709 12:22:23.164930 11078 raft_consensus.cc:2393] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 16: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:23.140997 16709 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:23.169631 11084 rpcz_store.cc:276] 0709 12:22:21.724735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.065681 (+340946us) service_pool.cc:224] Handling call
0709 12:22:22.066052 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:22.880361 (+814309us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b54002141a0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0ed7dc0 00007f9bb0f621c0 00007f9bb0f63231 00007f9bb0f5fd8f 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c
0709 12:22:23.160612 (+280251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:23.160853 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5716224}
I20260709 12:22:23.168139 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:22:23.152177 16525 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.001s	sys 0.026s
I20260709 12:22:23.177740 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:23.180384 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:23.137934 16533 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.163096 16716 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.162269 16642 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:23.181219 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2696) took 1717 ms. Trace:
I20260709 12:22:23.183393 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:23.181131 10928 raft_consensus.cc:2393] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 16: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:23.166952 16621 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:22:23.149681 16639 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.001s	sys 0.019s
I20260709 12:22:23.219411 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:23.178874 16714 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:23.206360 11084 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:23.243778 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:23.103426 16659 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.215193 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:23.246569 10935 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:22:23.248027 11050 leader_election.cc:400] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12.
I20260709 12:22:23.248387 11050 leader_election.cc:403] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:23.249157 11050 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:23.221719 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.162454 16619 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:23.206066 11009 rpcz_store.cc:276] 0709 12:22:21.463471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.101923 (+638452us) service_pool.cc:224] Handling call
0709 12:22:22.102315 (+   392us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:22.102728 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:22.102757 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:22.103371 (+   614us) log.cc:844] Serialized 52 byte log entry
0709 12:22:22.285992 (+182621us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:22.286039 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.286111 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:23.084324 (+798213us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:22:23.177315 (+ 92991us) raft_consensus.cc:1685] finished
0709 12:22:23.177338 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:23.181156 (+  3818us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8603,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":109,"spinlock_wait_cycles":4616576,"thread_start_us":182090,"threads_started":1,"wal-append.queue_time_us":212812}
I20260709 12:22:23.250578 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:23.148322 16702 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.227774 10928 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:23.150467 16496 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:23.200019 16525 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.001s	sys 0.029s
I20260709 12:22:23.244545 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:23.266480 10931 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:23.267131 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:23.244678 11078 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:23.173702 16690 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.263182 16619 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:23.251253 11085 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:23.203524 16708 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:23.245074 16639 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.001s	sys 0.019s
I20260709 12:22:23.278899 11077 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 12.
I20260709 12:22:23.261037 11081 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:22:23.260182 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:23.263101 16638 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:23.246223 16695 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:23.270090 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:23.271576 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 105550us
I20260709 12:22:23.250589 16696 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.246989 16712 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:23.285593 11084 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:23.260449 16665 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.289927 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:23.267683 16345 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:23.275068 16586 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:23.275107 16563 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.290576 11656 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:23.286594 10899 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:23.265739 16676 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:22:23.269635 16690 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:23.287328 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:23.274253 10974 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:23.216037 16716 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.267519 16642 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 12
W20260709 12:22:23.296398 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 199334us
I20260709 12:22:23.278679 16639 raft_consensus.cc:697] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:23.316095 16639 consensus_queue.cc:237] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.320847 16712 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:23.331326 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:23.287365 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:22:23.332342 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 504980us
I20260709 12:22:23.332690 11650 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:22:23.332273 11652 raft_consensus.cc:2393] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 16: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:23.334234 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:23.334918 11622 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:23.336407 11655 raft_consensus.cc:1240] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:23.337457 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:23.338785 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:23.297749 16665 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.339990 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:23.340166 16684 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:23.340972 16684 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:23.341614 16665 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:23.308763 16659 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:23.297103 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 147419us
I20260709 12:22:23.343451 16716 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:23.311594 16533 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:23.293648 16696 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:23.346778 16696 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:23.295949 16586 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:23.347544 16586 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:23.337576 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 504698us
I20260709 12:22:23.302955 16563 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.298560 16345 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.331497 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:23.306839 16702 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:23.306901 16496 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:23.351007 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 76804.1us
I20260709 12:22:23.333290 16352 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:22:23.355724 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:23.378441 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.379136 10974 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:23.292107 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:23.389657 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.392066 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:23.391508 10931 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:22:23.400923 10935 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:22:23.356271 16627 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.356119 16562 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:23.355908 16584 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:22:23.404749 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.338690 16375 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 12:22:23.368619 16533 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.450610 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:23.451321 10931 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:23.452811 10929 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:22:23.454180 10929 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:23.391602 16543 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 12:22:23.456319 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:23.456816 16543 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:23.457350 16543 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:23.457741 16543 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:23.462844 16690 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.465175 16690 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:23.465806 16563 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:23.448573 16627 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:23.467795 16627 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:23.451066 16562 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.474357 16562 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:23.456907 10935 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:22:23.477813 10928 raft_consensus.cc:2393] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 21: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:23.478485 11009 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:22:23.491489 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.404564 16721 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.532135 10929 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:23.543645 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:23.544523 10929 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 17: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:23.545327 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:23.546015 10929 raft_consensus.cc:2393] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 19: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:22:23.536543 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.381172 16659 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.133s
I20260709 12:22:23.462941 16618 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.538771 10931 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:23.479451 16714 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:23.463570 16584 raft_consensus.cc:697] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:23.476202 16583 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.574843 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:23.585451  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:23.586504  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:22:23.592425 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:23.599627 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 313091us
I20260709 12:22:23.475802 16586 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.568598 16651 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:23.475960 16533 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.608390 10899 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:23.610208 10935 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:23.609432 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:23.614324 10929 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:23.624949 10899 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:23.562343 16721 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.606827 16553 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:23.628204 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:23.628433 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 249357us
I20260709 12:22:23.633495 10974 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:23.629134 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:23.594246 16618 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.626794 16709 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:22:23.599496 16583 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.613968 16665 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:23.639519 11657 consensus_queue.cc:237] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:23.641960 11002 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:22:23.620043 16734 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:22:23.638001 10832 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 115) took 15523 ms (client timeout 15000 ms). Trace:
I20260709 12:22:23.616350 16720 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:22:23.664592 10931 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:22:23.711902 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:23.712821 10931 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 17: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:23.628167 16352 raft_consensus.cc:697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:23.702495 16734 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:23.649855 16584 consensus_queue.cc:237] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.705529 16621 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.707168 16721 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:23.709126 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:23.722536 10929 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:23.640110 16553 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.714416 10900 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:23.715174 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:23.716264 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:23.727221 10931 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:23.657990 16659 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:22:23.705444 16737 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:22:23.720423 10935 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17. Ops: []
W20260709 12:22:23.669387 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 44535.2us
I20260709 12:22:23.655833 16655 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:23.724314 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:23.650094 10832 rpcz_store.cc:269] 0709 12:22:08.114915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.122452 (+  7537us) service_pool.cc:224] Handling call
0709 12:22:23.637908 (+15515456us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:20.912585 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:20.913163 (+   578us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:20.913194 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:22:20.913211 (+    17us) tablet.cc:662] Decoding operations
0709 12:22:20.914312 (+  1101us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:20.914377 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:20.914402 (+    25us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:22:20.915419 (+  1017us) tablet.cc:701] Row locks acquired
0709 12:22:20.915433 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:22:20.915581 (+   148us) write_op.cc:270] Start()
0709 12:22:20.915681 (+   100us) write_op.cc:276] Timestamp: P: 1783599740915532 usec, L: 0
0709 12:22:20.915695 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 12:22:20.983702 (+ 68007us) log.cc:844] Serialized 5218 byte log entry
0709 12:22:21.618353 (+634651us) op_driver.cc:464] REPLICATION: finished
0709 12:22:21.818380 (+200027us) write_op.cc:301] APPLY: starting
0709 12:22:21.818488 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:22.010033 (+191545us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:22.010141 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:22.023325 (+ 13184us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:22.023602 (+   277us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 12:22:22.023646 (+    44us) write_op.cc:312] APPLY: finished
0709 12:22:22.078132 (+ 54486us) log.cc:844] Serialized 121 byte log entry
0709 12:22:22.086227 (+  8095us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:22.086410 (+   183us) write_op.cc:454] Released schema lock
0709 12:22:22.086467 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:22.086958 (+   491us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:22.086988 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2509,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":173584,"apply.run_cpu_time_us":17317,"apply.run_wall_time_us":268572,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58389,"num_ops":13,"prepare.queue_time_us":251566,"prepare.run_cpu_time_us":47385,"prepare.run_wall_time_us":189637,"raft.queue_time_us":215446,"raft.run_cpu_time_us":45963,"raft.run_wall_time_us":96607,"replication_time_us":702496,"thread_start_us":444172,"threads_started":4,"wal-append.queue_time_us":196244,"wal-append.run_cpu_time_us":17901,"wal-append.run_wall_time_us":1894314}]]}
W20260709 12:22:23.720109 16741 log.cc:927] Time spent T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:22:23.719233 16710 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:23.653795 16665 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.653064 10974 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:23.733388 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 251220us
I20260709 12:22:23.733587 10933 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20. Ops: []
I20260709 12:22:23.741189 10899 leader_election.cc:400] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12.
I20260709 12:22:23.743018 10900 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:23.746253 10899 leader_election.cc:403] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:22:23.747058 10931 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:22:23.748172 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:23.749385 16543 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.749854 16352 consensus_queue.cc:237] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:23.750524 10935 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:22:23.755339 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 102361us
I20260709 12:22:23.756444 10974 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:23.757354 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:23.740759 16345 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:23.808619 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 52305.7us
W20260709 12:22:23.817883 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.818645 10935 raft_consensus.cc:1240] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:23.788554 16745 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:22:23.804649 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 69199.4us
I20260709 12:22:23.819585 16659 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.824537 16659 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.826712 16659 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:23.760401 16738 log.cc:927] Time spent T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:22:23.829169 10931 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:23.754048 16711 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12.
I20260709 12:22:23.829802 10974 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:23.822086 16745 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.771184 16618 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:23.813321 16642 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12.
I20260709 12:22:23.743656 16655 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.754499 16710 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:23.761508 16586 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:23.813365 16638 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:23.757687 16543 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:23.838158 16617 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.832953 10974 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:23.836591 16659 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.829838 10899 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:23.838198 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:23.836383 16745 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:23.840530 11084 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:22:23.753991 16696 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:23.835417 16554 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:23.844525 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:23.858335 10927 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:23.858510 10899 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:23.751978 16709 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:23.832847 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:23.856029 10974 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:23.856876 10929 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:22:23.861373 10974 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:23.861367 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:23.862001 10935 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:23.862417 10927 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:22:23.850090 16665 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:23.866204 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:23.867063 10935 raft_consensus.cc:2410] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:22:23.859230 16554 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:23.868032 16562 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:23.868623 16562 raft_consensus.cc:697] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:23.868913 10899 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:23.864246 16711 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:22:23.864996 10974 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:23.869699 16712 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:23.876963 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:23.879925 16627 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:23.880424 16627 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.856890 16543 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:23.857838 16696 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.859632 16651 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:23.859647 16621 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:23.901118 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:23.867650 16720 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:23.856979 16617 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.857187 16659 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.867842 16554 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:23.886891 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:23.859589 16655 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:23.880790 16627 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:23.865615 16618 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:23.869462 16562 consensus_queue.cc:237] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:23.893381 16543 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:23.893553 16696 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:23.933437 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:23.934406 11002 raft_consensus.cc:2410] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:22:23.934453 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:23.861028 16709 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.890252 16665 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:23.908151 16651 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:23.939435 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:23.940780 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:23.957446 11007 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
W20260709 12:22:23.922364 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 47790.4us
W20260709 12:22:23.948854 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:23.963076 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.956916 11011 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:22:23.958621 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:23.960436 16746 log.cc:927] Time spent T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.256s	user 0.004s	sys 0.000s
W20260709 12:22:23.961030 16759 log.cc:927] Time spent T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:22:23.961926 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:23.929808 16618 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:23.958477 16651 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:23.973014 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:23.949400 16709 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:23.985008 10901 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:23.972189 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:23.974717 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 326003us
I20260709 12:22:23.977789 11010 raft_consensus.cc:1240] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:23.979737 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:23.990373 11005 raft_consensus.cc:2410] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 19 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:22:23.986254 10901 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:23.995098 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:23.995342 10901 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:23.997773 10936 raft_consensus.cc:2393] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 16: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:23.960352 16764 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:22:24.002786 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:24.003943 10936 raft_consensus.cc:2376] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16. Re-sending same reply.
I20260709 12:22:24.006759 11622 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:24.004925 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:23.972291 16618 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:24.014145 16753 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:24.014657 16753 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:24.015051 16753 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:24.003491 16712 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:23.997390 16621 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:22:24.026430 16760 log.cc:927] Time spent T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:22:24.032953 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:24.034461 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:24.035061 11005 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:24.060518 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:24.061964 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:24.062950 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:23.958372 16665 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:24.066771 11625 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:24.072492 11005 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:22:23.995921 16711 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:24.068429 10977 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:24.074574 10901 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:24.076874 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:24.077204 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 112821us
I20260709 12:22:24.078100 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:24.079617 11051 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:24.081007 11051 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:24.082576 10934 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 17: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:24.083655 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:24.087502 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:24.093288 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 86610.3us
I20260709 12:22:24.014269 16690 consensus_queue.cc:1059] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:22:24.099195 11051 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:24.102734 16773 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:24.105666 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:24.108206 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:24.119949 11083 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:24.075464 16711 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:24.087157 16630 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:22:24.123109 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:24.086681 16655 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:24.110232 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:24.112855 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:24.113571 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:24.128225 11085 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 10.
I20260709 12:22:24.128371 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:24.116189 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:24.063840 16676 consensus_queue.cc:1059] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:22:24.064644 16708 consensus_queue.cc:1059] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:22:24.108903 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:24.123006 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:24.117594 16621 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:24.074157 16662 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:22:24.109584 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:24.143558 11081 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:22:24.144524 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:24.125319 11083 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:24.075137 16586 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:22:24.087563 16639 consensus_queue.cc:1059] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:22:24.130353 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:24.123834 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:24.135807 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:24.137257 16568 raft_consensus.cc:3055] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:24.137416 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:24.134305 11078 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:24.142472 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:24.126601 16711 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:24.129733 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:24.115378 16721 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:24.087007 16642 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:22:24.156088 11005 raft_consensus.cc:2410] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 15 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:22:24.150622 11077 raft_consensus.cc:2393] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 15: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:24.168452 11083 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:24.118889 16619 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 12:22:24.176980 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 49575.4us
I20260709 12:22:24.125700 16531 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:24.168000 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:24.180457 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:24.181041 10933 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:24.181924 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:24.177784 10974 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:24.183187 11085 pending_rounds.cc:85] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 7
I20260709 12:22:24.183492 11085 pending_rounds.cc:107] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:22:24.183748 10974 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:24.184870 11051 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:24.160614 16621 raft_consensus.cc:697] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:24.183712 11085 raft_consensus.cc:2889] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:24.161995 16287 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:22:24.187876 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:24.162166 16659 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:24.161374 11081 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:22:24.157428 16568 raft_consensus.cc:740] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:24.193671 10974 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:24.194979 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:24.203389 10933 raft_consensus.cc:2393] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 17: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:24.186112 16639 raft_consensus.cc:3055] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:24.200016 16781 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:24.186439 16655 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:24.189513 16543 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:24.205314 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:24.196020 16765 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:24.197690 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:24.206365 16767 log.cc:927] Time spent T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:22:24.211664 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:24.218334 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:24.221690 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 153799us
I20260709 12:22:24.204463 16710 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:24.225361 10974 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:24.218791 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:24.204851 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:24.206779 16639 raft_consensus.cc:740] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:22:24.247642 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.291738 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:24.292101 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 57422.1us
I20260709 12:22:24.296906 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:24.230000 10974 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:24.302867 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 66996.6us
I20260709 12:22:24.220130 16765 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:24.306339 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 76409.6us
I20260709 12:22:24.220335 16659 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:24.309559 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:24.310388 11005 raft_consensus.cc:2393] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 16: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:24.291092 16568 consensus_queue.cc:260] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:24.313726 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:24.313962 16568 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:24.314811 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:24.317405 16543 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:24.317863 16543 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:24.318259 16543 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:24.324527 16533 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:24.326349 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 2588) took 1037 ms. Trace:
I20260709 12:22:24.326766 10928 rpcz_store.cc:276] 0709 12:22:23.289479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.291844 (+  2365us) service_pool.cc:224] Handling call
0709 12:22:24.326122 (+1034278us) spinlock_profiling.cc:243] Waited 95.4 ms on lock 0x7b54001e5ad4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:24.326272 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219368320}
I20260709 12:22:24.309222 16765 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:24.219308 16531 consensus_queue.cc:1059] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.090s
W20260709 12:22:24.309466 16778 log.cc:927] Time spent T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:22:24.208865 16651 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:24.331211 16651 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:24.304688 16665 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:24.292312 16655 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:24.333796 16655 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:24.334193 16655 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:24.309918 16659 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:24.337200 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:24.335079 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:24.337826 10927 raft_consensus.cc:2376] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17. Re-sending same reply.
I20260709 12:22:24.338045 10929 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:24.338934 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:24.339613 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:24.340711 10974 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:24.340773 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:24.341666 10928 raft_consensus.cc:2376] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12. Re-sending same reply.
I20260709 12:22:24.342567 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:24.343627 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:24.344851 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:24.346235 10928 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:22:24.347195 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:24.348507 11011 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:22:24.350366 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:24.356695 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:24.362197 10929 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:22:24.360565 10928 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
W20260709 12:22:24.362811 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 163590us
I20260709 12:22:24.366609 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:24.363566 11051 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:24.349006 16745 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:24.331578 16709 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:24.349390 16659 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:24.378465 10927 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:22:24.412990 16627 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:24.415294 16627 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:24.366897 10928 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:22:24.355576 16662 raft_consensus.cc:3055] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:24.356345 16665 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:24.435534 10931 raft_consensus.cc:2368] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17.
I20260709 12:22:24.308714 11650 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:22:24.368290 10929 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:24.395987 11051 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:24.461997 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 66127.4us
I20260709 12:22:24.397027 10934 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:24.462203 11004 raft_consensus.cc:2368] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 17. Current term is 18.
I20260709 12:22:24.462765 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:24.462992 11051 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:24.419698 10901 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:24.422883 11005 raft_consensus.cc:2393] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 14: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:24.395565 10933 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
W20260709 12:22:24.463896 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 44232.7us
I20260709 12:22:24.425595 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:24.465292 11082 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:24.438675 16554 consensus_meta.cc:287] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.000s
W20260709 12:22:24.440416 16780 log.cc:927] Time spent T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
W20260709 12:22:24.441856 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.412997 16753 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:24.446913 16745 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:24.478581 16655 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:24.480163 16753 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:24.209885 16352 raft_consensus.cc:2955] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 LEADER]: Committing config change with OpId 11.10: config changed from index 6 to 10, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:22:24.351171 16621 consensus_queue.cc:237] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:24.424445 16287 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:24.452630 16773 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:24.453123 16543 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:24.454125 16618 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:24.455296 16765 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:24.374306 16785 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 12:22:24.390492 16639 consensus_queue.cc:260] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:24.459697 16659 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:24.460244 16665 raft_consensus.cc:697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:24.463305 11077 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:24.422129 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:24.418422 16695 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:24.468945 16525 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:24.468865 16709 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:24.428175 16662 raft_consensus.cc:740] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:24.469167 16554 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:24.472278 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:24.472795 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
W20260709 12:22:24.461871 16638 consensus_meta.cc:287] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.591s	user 0.010s	sys 0.000s
I20260709 12:22:24.607074 11082 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:24.550648 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:24.548547 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 182410us
I20260709 12:22:24.568264 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:24.776620 10975 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:24.984114 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:24.983631 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 520663us
I20260709 12:22:24.989111 11051 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:24.994233 11657 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:24.994885 11079 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:24.998011 10931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 2615) took 1165 ms. Trace:
I20260709 12:22:24.998456 10931 rpcz_store.cc:276] 0709 12:22:23.832429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.832561 (+   132us) service_pool.cc:224] Handling call
0709 12:22:24.997813 (+1165252us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b540024c054. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:24.997948 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1321068288}
W20260709 12:22:24.543076 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 47084.2us
W20260709 12:22:24.999789 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.562529 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41098 (request call id 479) took 1184 ms. Trace:
I20260709 12:22:25.002148 11009 rpcz_store.cc:276] 0709 12:22:23.378182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.378343 (+   161us) service_pool.cc:224] Handling call
0709 12:22:23.378660 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:23.486634 (+107974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.562279 (+1075645us) spinlock_profiling.cc:243] Waited 99.5 ms on lock 0x7b540032d2d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:24.562466 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228849408}
I20260709 12:22:24.994171 11050 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:24.481206 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:25.011070 11011 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:22:25.013787 16676 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:25.015847 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.017429 11051 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:25.020335 11006 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
W20260709 12:22:24.491818 16696 consensus_meta.cc:287] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.536s	user 0.002s	sys 0.010s
I20260709 12:22:24.468521 16716 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:25.033731 16739 log.cc:927] Time spent T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 1.326s	user 0.008s	sys 0.045s
I20260709 12:22:24.469856 16617 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:24.554473 16749 log.cc:927] Time spent T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.849s	user 0.003s	sys 0.000s
W20260709 12:22:24.552078 16742 log.cc:927] Time spent T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.848s	user 0.003s	sys 0.000s
I20260709 12:22:24.478041 16553 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:25.006708 16287 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:25.036626 11008 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:25.005581 16638 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:25.039168 11003 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:24.990778 16695 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:25.006258 16525 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:24.879746 16627 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.035712 16716 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.536039 16531 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:25.047336 16617 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:24.471633 16702 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.571s
I20260709 12:22:24.543347 16568 consensus_queue.cc:1059] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.504s
I20260709 12:22:25.026149 16676 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.019672 16786 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:25.058162 16287 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:25.080206 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3441) took 1098 ms. Trace:
I20260709 12:22:25.086830 11007 rpcz_store.cc:276] 0709 12:22:23.981819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.081404 (+ 99585us) service_pool.cc:224] Handling call
0709 12:22:24.081654 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:24.086381 (+  4727us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:24.086504 (+   123us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:24.086563 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:24.086792 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.079950 (+993158us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b54002d9954. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:25.079999 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.080150 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10446208}
I20260709 12:22:25.046737 16639 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:24.571316 16711 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.068197 16525 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:25.046130 16696 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:25.099751 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2723) took 1015 ms. Trace:
I20260709 12:22:25.114388 11007 rpcz_store.cc:276] 0709 12:22:24.084747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.098839 (+1014092us) service_pool.cc:224] Handling call
0709 12:22:25.099218 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.099417 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:25.099442 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:25.099486 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:25.099522 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.099575 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.099689 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.116596 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2724) took 1031 ms. Trace:
I20260709 12:22:25.117059 11007 rpcz_store.cc:276] 0709 12:22:24.084983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.115650 (+1030667us) service_pool.cc:224] Handling call
0709 12:22:25.116081 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.116263 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:25.116290 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:25.116333 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:25.116364 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.116417 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.116545 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.118780 11007 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:25.119390 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2725) took 1034 ms. Trace:
I20260709 12:22:25.119740 11007 rpcz_store.cc:276] 0709 12:22:24.085203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.118115 (+1032912us) service_pool.cc:224] Handling call
0709 12:22:25.118463 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.119139 (+   676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.119341 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.133293 16711 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:25.133963 16711 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:25.134473 16711 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.135620 16543 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:25.136494 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 617) took 1799 ms. Trace:
I20260709 12:22:25.136863 11084 rpcz_store.cc:276] 0709 12:22:23.337304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.338038 (+   734us) service_pool.cc:224] Handling call
0709 12:22:23.338359 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:23.857195 (+518836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.136254 (+1279059us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b540011cbd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:25.136437 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1154139520}
I20260709 12:22:25.137763 16554 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:25.138123 10936 raft_consensus.cc:2393] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 14: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:25.139333 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 3072) took 1148 ms. Trace:
I20260709 12:22:25.140897 16659 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:25.078541 16617 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:25.139644 10936 rpcz_store.cc:276] 0709 12:22:23.990606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.087270 (+ 96664us) service_pool.cc:224] Handling call
0709 12:22:25.139149 (+1051879us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000609d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:25.139280 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2413926272}
I20260709 12:22:25.079533 16531 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:25.166148 10935 raft_consensus.cc:2368] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 13. Current term is 14.
I20260709 12:22:25.168082 11077 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
W20260709 12:22:25.170058 10928 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.015s	sys 0.032s
I20260709 12:22:25.077715 16716 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:25.173573 10928 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.015s	sys 0.033s
I20260709 12:22:25.074694 16627 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:25.136646 16765 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:25.089680 16676 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:25.072106 16662 consensus_queue.cc:260] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.113405 16665 consensus_queue.cc:237] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.176317 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53346 (request call id 536) took 1106 ms. Trace:
W20260709 12:22:25.174930 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 186039us
I20260709 12:22:25.272492 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3338) took 1106 ms. Trace:
I20260709 12:22:25.232609 11081 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3328) took 1126 ms. Trace:
I20260709 12:22:25.241520 10932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3066) took 2638 ms. Trace:
I20260709 12:22:25.294286 11657 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:25.134212 16583 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:25.292984 11085 rpcz_store.cc:276] 0709 12:22:24.166030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.166382 (+   352us) service_pool.cc:224] Handling call
0709 12:22:24.183012 (+ 16630us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:24.196619 (+ 13607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:24.196639 (+    20us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:24.196946 (+   307us) log.cc:844] Serialized 26 byte log entry
0709 12:22:24.462507 (+265561us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:24.462545 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.462604 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:25.272241 (+809637us) raft_consensus.cc:1685] finished
0709 12:22:25.272260 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.272418 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":265322,"threads_started":1,"wal-append.queue_time_us":982956}
I20260709 12:22:25.293373 11081 rpcz_store.cc:276] 0709 12:22:24.105813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.145341 (+ 39528us) service_pool.cc:224] Handling call
0709 12:22:24.145633 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:24.200479 (+ 54846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.232318 (+1031839us) spinlock_profiling.cc:243] Waited 8.42 ms on lock 0x7b54000e0954. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:25.232533 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19355520}
I20260709 12:22:25.157677 16709 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:25.292112 10928 rpcz_store.cc:276] 0709 12:22:24.069556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.418685 (+349129us) service_pool.cc:224] Handling call
0709 12:22:24.418953 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:24.419138 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:22:24.419386 (+   248us) log.cc:844] Serialized 14 byte log entry
0709 12:22:25.175950 (+756564us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:25.176012 (+    62us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:22:25.176059 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.176127 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.176256 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":103,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"thread_start_us":746085,"threads_started":1}
I20260709 12:22:25.167120 16617 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:25.270176 16711 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:25.293470 16659 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:25.272917 16618 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:25.270079 16785 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:25.297927 10932 rpcz_store.cc:276] 0709 12:22:22.602800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.671431 (+ 68631us) service_pool.cc:224] Handling call
0709 12:22:22.671826 (+   395us) raft_consensus.cc:1471] Updating replica for 5 ops
0709 12:22:23.045002 (+373176us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:23.245641 (+200639us) log.cc:844] Serialized 14 byte log entry
0709 12:22:23.492506 (+246865us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 12:22:23.493352 (+   846us) log.cc:844] Serialized 104 byte log entry
0709 12:22:23.493517 (+   165us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:23.495391 (+  1874us) log.cc:844] Serialized 14 byte log entry
0709 12:22:23.495777 (+   386us) log.cc:844] Serialized 14 byte log entry
0709 12:22:23.528144 (+ 32367us) log.cc:844] Serialized 14 byte log entry
0709 12:22:23.528412 (+   268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:23.528495 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:23.958914 (+430419us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b1800352de0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:22:24.407994 (+449080us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b4800002958. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb5e89aa1 00007f9bb5e80b37 00007f9bb5e809ca 00007f9bb5f7826f 00007f9bb5f77f37 00007f9bb5f8c55c 00007f9bb5f8c508 00007f9bb5f8c488 00007f9bb5f8c443 00007f9bb5f8b6ec 00007f9bb4eb5a96
0709 12:22:24.413422 (+  5428us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b1800352de0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:22:24.551455 (+138033us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:22:24.559096 (+  7641us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b1800352de0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade412a6 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1
0709 12:22:24.559876 (+   780us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b1800352de0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:22:25.241227 (+681351us) raft_consensus.cc:1685] finished
0709 12:22:25.241250 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.241424 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70747,"prepare.queue_time_us":2343545,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":132,"raft.queue_time_us":162598,"raft.run_cpu_time_us":3563,"raft.run_wall_time_us":898027,"spinlock_wait_cycles":188593152,"thread_start_us":613518,"threads_started":3,"wal-append.queue_time_us":361850}
W20260709 12:22:25.324255 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 306891us
I20260709 12:22:25.325094 11051 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:25.332065 16793 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.332648 16793 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.334287 11051 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:25.334834 16793 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:25.321317 16662 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:25.335623 16793 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:25.324111 16696 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:25.347587 11051 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:25.322860 16773 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:22:25.324362 16659 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.340080 16716 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:25.324929 16785 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:25.334574 16287 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.348393 16696 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.319356 16709 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.350391 16786 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:25.350080 16531 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:25.340374 16655 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:25.354054 16702 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:25.378711 16721 raft_consensus.cc:3055] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:25.345453 16793 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:25.386179 16721 raft_consensus.cc:740] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:25.425601  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:22:25.444676 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 667951us
I20260709 12:22:25.444864 11006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2718) took 1361 ms. Trace:
I20260709 12:22:25.350257 16639 consensus_queue.cc:1059] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:22:25.485782 16621 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.487116 16621 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:25.447789 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.453361 11051 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:25.456815 16352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:55644 (request call id 13) took 14635 ms. Trace:
I20260709 12:22:25.381899 16695 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.383711 16702 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:25.385140 16676 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:25.376394 16696 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.452328 11006 rpcz_store.cc:276] 0709 12:22:24.083550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.021876 (+938326us) service_pool.cc:224] Handling call
0709 12:22:25.039126 (+ 17250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:25.047571 (+  8445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:25.047598 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:25.052235 (+  4637us) log.cc:844] Serialized 26 byte log entry
0709 12:22:25.268076 (+215841us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:25.268121 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.268195 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:25.444202 (+176007us) raft_consensus.cc:1685] finished
0709 12:22:25.444273 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.444625 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8067,"raft.queue_time_us":36731,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":3225,"thread_start_us":210208,"threads_started":1,"wal-append.queue_time_us":323097}
I20260709 12:22:25.527061 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3436) took 1548 ms. Trace:
W20260709 12:22:25.529042 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 72215.3us
I20260709 12:22:25.557119 11003 rpcz_store.cc:276] 0709 12:22:23.978528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.978644 (+   116us) service_pool.cc:224] Handling call
0709 12:22:23.978923 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.061766 (+1082843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.526527 (+464761us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000dd9d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:25.526866 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2437883776}
W20260709 12:22:25.532469 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 80801.3us
I20260709 12:22:25.529565 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3430) took 1581 ms. Trace:
I20260709 12:22:25.529652 11011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2719) took 1445 ms. Trace:
I20260709 12:22:25.525077 10930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2587) took 2258 ms. Trace:
W20260709 12:22:25.528462 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 179092us
I20260709 12:22:25.501464 16797 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:25.566704 16797 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.567225 10974 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:25.515547 16659 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:25.567477 16797 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.568105 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:25.570895 16797 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:25.571022 11051 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:25.559440 16630 raft_consensus.cc:3055] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:25.572331 16630 raft_consensus.cc:740] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:25.573501 11051 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:25.535374 16627 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:25.576646 10974 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:25.577862 16583 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:22:25.528297 11004 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2736) took 1426 ms (client timeout 1601 ms). Trace:
W20260709 12:22:25.507748 16791 log.cc:927] Time spent T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:22:25.582347 16651 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:25.517697 16793 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:25.509577 16287 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:25.561039 11011 rpcz_store.cc:276] 0709 12:22:24.083796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.021900 (+938104us) service_pool.cc:224] Handling call
0709 12:22:25.022175 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.022365 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:22:25.231892 (+209527us) log.cc:844] Serialized 14 byte log entry
0709 12:22:25.528797 (+296905us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:25.528909 (+   112us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:25.529023 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.529156 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.529429 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60139,"prepare.queue_time_us":333035,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":87326,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":292,"thread_start_us":408332,"threads_started":2,"wal-append.queue_time_us":169111}
I20260709 12:22:25.521402 16709 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:25.560779 11008 rpcz_store.cc:276] 0709 12:22:23.948029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.948188 (+   159us) service_pool.cc:224] Handling call
0709 12:22:23.960017 (+ 11829us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.053083 (+1093066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.529025 (+475942us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400160654. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:25.529379 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2475542912}
W20260709 12:22:25.578979 11004 rpcz_store.cc:269] 0709 12:22:24.101316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.115262 (+ 13946us) service_pool.cc:224] Handling call
0709 12:22:25.527741 (+1412479us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b54002d8554. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:25.528063 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":625724672}
I20260709 12:22:25.513439 16785 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:25.531689 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:25.510381 16695 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:25.525840 16802 raft_consensus.cc:3055] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:22:25.592110 16802 raft_consensus.cc:740] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:25.593410 16702 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:25.593510 16802 consensus_queue.cc:260] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.595470 16802 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:25.595698 11077 raft_consensus.cc:1275] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:25.596498 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:25.597330 16773 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:25.598263 11004 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:22:25.598112 16773 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:25.598912 11004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2730) took 1508 ms. Trace:
I20260709 12:22:25.599499 11656 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:22:25.539264 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:25.498953 16352 rpcz_store.cc:276] 0709 12:22:10.821419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.821756 (+   337us) service_pool.cc:224] Handling call
0709 12:22:10.938511 (+116755us) log.cc:844] Serialized 494 byte log entry
0709 12:22:25.456493 (+14517982us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1442,"raft.run_cpu_time_us":1135,"raft.run_wall_time_us":1134}
I20260709 12:22:25.601357 11010 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:25.602016 11010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2731) took 1510 ms. Trace:
I20260709 12:22:25.602627 10974 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:25.602874 10819 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9b6c427f0a234dbab806dced4d3ba0fb with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 10)
I20260709 12:22:25.599295 11004 rpcz_store.cc:276] 0709 12:22:24.090112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.597184 (+1507072us) service_pool.cc:224] Handling call
0709 12:22:25.597766 (+   582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.598630 (+   864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.598834 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.604481 16494 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.582844 16583 raft_consensus.cc:697] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:25.544669 16639 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:25.615788 16745 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:25.619639 16627 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:25.620060 16676 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:25.620806 16627 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:25.626868 16627 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:25.627404 11005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2720) took 1543 ms. Trace:
I20260709 12:22:25.627626 16627 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.628508 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:25.628681 16627 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.629434 11006 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:25.630607 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:25.631295 11006 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:25.599319 11654 raft_consensus.cc:1240] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:25.632277 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:25.633044 10900 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:25.633801 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:25.634210 16808 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:25.634826 16808 raft_consensus.cc:697] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:25.607836 11004 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:25.603838 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:25.635720 11650 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:25.636027 16808 consensus_queue.cc:237] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:25.608878 16769 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:25.614845 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2715) took 1532 ms. Trace:
I20260709 12:22:25.634512 16639 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.602378 11010 rpcz_store.cc:276] 0709 12:22:24.091643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.600461 (+1508818us) service_pool.cc:224] Handling call
0709 12:22:25.600899 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.601766 (+   867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.601967 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.584666 16651 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.604399 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:25.648968 11004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2732) took 1542 ms. Trace:
I20260709 12:22:25.649410 11004 rpcz_store.cc:276] 0709 12:22:24.100239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.604700 (+1504461us) service_pool.cc:224] Handling call
0709 12:22:25.607499 (+  2799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.642296 (+ 34797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.642507 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.649600 16651 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:25.653767 16639 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:25.654340 16676 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:25.644622 16769 raft_consensus.cc:697] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:25.655108 16676 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:25.656472 16769 consensus_queue.cc:237] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.659107 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:25.659359 16583 consensus_queue.cc:237] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.660704 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:25.655203 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:25.605603 16797 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:25.661593 11010 raft_consensus.cc:2410] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 17 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:22:25.663004 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:25.634119 16627 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:25.662949 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:25.668545 11004 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:22:25.669188 11004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41098 (request call id 484) took 1311 ms. Trace:
I20260709 12:22:25.669546 11004 rpcz_store.cc:276] 0709 12:22:24.358217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.667827 (+1309610us) service_pool.cc:224] Handling call
0709 12:22:25.668176 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.668950 (+   774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.669137 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.573884 16630 consensus_queue.cc:260] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.673151 11004 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:25.673729 11004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2738) took 1307 ms. Trace:
I20260709 12:22:25.674052 11004 rpcz_store.cc:276] 0709 12:22:24.365888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.672462 (+1306574us) service_pool.cc:224] Handling call
0709 12:22:25.672834 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.673501 (+   667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.673680 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.675959 10900 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:25.639225 11009 rpcz_store.cc:276] 0709 12:22:24.082243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.024847 (+942604us) service_pool.cc:224] Handling call
0709 12:22:25.025191 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.025423 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:22:25.320504 (+295081us) log.cc:844] Serialized 14 byte log entry
0709 12:22:25.612139 (+291635us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:25.612252 (+   113us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:25.612392 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.612492 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.614606 (+  2114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35764,"prepare.queue_time_us":330245,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":911,"raft.queue_time_us":26174,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":148,"thread_start_us":495277,"threads_started":2,"wal-append.queue_time_us":271126}
I20260709 12:22:25.676090 11004 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:25.679311 11004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3444) took 1273 ms. Trace:
I20260709 12:22:25.679710 11009 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:25.680437 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3445) took 1215 ms. Trace:
I20260709 12:22:25.680716 11009 rpcz_store.cc:276] 0709 12:22:24.465149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.678929 (+1213780us) service_pool.cc:224] Handling call
0709 12:22:25.679386 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.680208 (+   822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.680388 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:25.681587 16525 consensus_meta.cc:287] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.551s	user 0.013s	sys 0.004s
I20260709 12:22:25.682334 11009 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:25.682080 16525 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.627929 11005 rpcz_store.cc:276] 0709 12:22:24.084061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.035494 (+951433us) service_pool.cc:224] Handling call
0709 12:22:25.035883 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:25.340418 (+304535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:25.340451 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:25.341317 (+   866us) log.cc:844] Serialized 26 byte log entry
0709 12:22:25.563589 (+222272us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:25.583532 (+ 19943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.588651 (+  5119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:25.588708 (+    57us) raft_consensus.cc:1685] finished
0709 12:22:25.588718 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.627222 (+ 38504us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31376,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":7347,"thread_start_us":331731,"threads_started":2,"wal-append.queue_time_us":135910}
I20260709 12:22:25.679754 11004 rpcz_store.cc:276] 0709 12:22:24.405699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.675449 (+1269750us) service_pool.cc:224] Handling call
0709 12:22:25.675797 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.678981 (+  3184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.679218 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.683403 11083 raft_consensus.cc:2393] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 14: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:25.671607 16773 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:25.690918 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41098 (request call id 485) took 1206 ms. Trace:
I20260709 12:22:25.691399 11009 rpcz_store.cc:276] 0709 12:22:24.482502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.681528 (+1199026us) service_pool.cc:224] Handling call
0709 12:22:25.681923 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.682689 (+   766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.688605 (+  5916us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:25.693928 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 181304us
W20260709 12:22:25.711987 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.535609 16721 consensus_queue.cc:260] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.707162 16494 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:25.666507 16531 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:25.743927 16525 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:25.748003 16720 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.748749 16720 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.751014 16720 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:25.751916 16494 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:25.751976 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2727) took 1604 ms. Trace:
I20260709 12:22:25.753372 11007 rpcz_store.cc:276] 0709 12:22:24.085667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.120501 (+1034834us) service_pool.cc:224] Handling call
0709 12:22:25.120766 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.120971 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:22:25.453054 (+332083us) log.cc:844] Serialized 14 byte log entry
0709 12:22:25.562478 (+109424us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:25.581290 (+ 18812us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:22:25.639022 (+ 57732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.648974 (+  9952us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.689550 (+ 40576us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56778,"prepare.queue_time_us":249868,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":57306,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":27058,"thread_start_us":323935,"threads_started":2,"wal-append.queue_time_us":125136}
I20260709 12:22:25.755512 16721 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:25.760923 11650 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:25.725041 16695 consensus_queue.cc:1059] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:22:25.763515 16695 raft_consensus.cc:3055] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:25.764016 16695 raft_consensus.cc:740] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:25.765189 16695 consensus_queue.cc:260] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:25.768211 10900 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:25.737672 16709 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:25.769533 16709 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:25.769945 16809 consensus_queue.cc:1059] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:22:25.770830 16621 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:25.771194 16809 consensus_queue.cc:1059] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:25.771669 11084 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:25.769950 16709 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:25.561136 10930 rpcz_store.cc:276] 0709 12:22:23.266793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.269381 (+  2588us) service_pool.cc:224] Handling call
0709 12:22:23.269726 (+   345us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:22:23.297904 (+ 28178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:23.297934 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:22:23.350281 (+ 52347us) log.cc:844] Serialized 78 byte log entry
0709 12:22:23.569183 (+218902us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:23.614218 (+ 45035us) log.cc:844] Serialized 14 byte log entry
0709 12:22:23.614593 (+   375us) log.cc:844] Serialized 14 byte log entry
0709 12:22:23.619712 (+  5119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.524172 (+1904460us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b5400202bd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:25.524259 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:25.524451 (+   192us) raft_consensus.cc:1685] finished
0709 12:22:25.524467 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.524800 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37254,"prepare.queue_time_us":46318,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":37360,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":12478,"spinlock_wait_cycles":63872896,"thread_start_us":176977,"threads_started":1,"wal-append.queue_time_us":268002,"wal-append.run_cpu_time_us":3390,"wal-append.run_wall_time_us":1212002}
I20260709 12:22:25.775301 16703 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.776273 16793 raft_consensus.cc:3055] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:25.776130 16703 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.777349 16800 consensus_queue.cc:1059] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:25.778592 16703 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:25.779234 16568 raft_consensus.cc:3055] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:25.776804 16793 raft_consensus.cc:740] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:25.780794 16793 consensus_queue.cc:260] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.742059 10977 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:25.779567 16695 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:25.771559 16621 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:25.781687 16568 raft_consensus.cc:740] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:25.781708 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:25.796068 11006 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:25.781486 16711 raft_consensus.cc:3055] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:25.795094 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:25.797024 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:25.801296 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 225619us
I20260709 12:22:25.791339 11011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2737) took 1687 ms. Trace:
I20260709 12:22:25.804914 11011 rpcz_store.cc:276] 0709 12:22:24.101570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.665085 (+1563515us) service_pool.cc:224] Handling call
0709 12:22:25.665486 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.665851 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:22:25.666686 (+   835us) log.cc:844] Serialized 14 byte log entry
0709 12:22:25.788894 (+122208us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:25.788944 (+    50us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:25.788985 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.789046 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.789153 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":261,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":3366,"thread_start_us":117865,"threads_started":1}
I20260709 12:22:25.806577 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:25.807664 11009 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:25.808153 16630 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:22:25.808635 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 121520us
I20260709 12:22:25.810586 10977 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:25.799125 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:25.804288 11008 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:22:25.818856 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:25.825081 16617 consensus_meta.cc:287] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.007s
I20260709 12:22:25.827780 11010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2733) took 1717 ms. Trace:
I20260709 12:22:25.832304 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:25.772251 16803 consensus_queue.cc:1059] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:22:25.843211 16803 raft_consensus.cc:3055] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:25.843742 16803 raft_consensus.cc:740] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:25.844955 16803 consensus_queue.cc:260] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.847100 16803 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:25.851440 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.838654 16769 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:25.855907 16696 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:25.857106 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:25.858060 11002 raft_consensus.cc:2393] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 16: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:22:25.858361 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.839027 11084 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:25.812778 16621 raft_consensus.cc:697] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:25.860589 16621 consensus_queue.cc:237] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:25.861940 16702 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.865581 16676 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:25.865711 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:25.866537 11011 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:25.856321 16769 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.872337 16769 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:25.872907 10901 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:25.874775 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:25.875550 11079 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:25.840970 10935 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53346 (request call id 527) took 1954 ms (client timeout 1526 ms). Trace:
W20260709 12:22:25.875998 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 65552.2us
W20260709 12:22:25.876384 10935 rpcz_store.cc:269] 0709 12:22:23.886267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.886518 (+   251us) service_pool.cc:224] Handling call
0709 12:22:25.840504 (+1953986us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540024ca54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:25.840757 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2875690752}
I20260709 12:22:25.877295 10977 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:25.803879 16711 raft_consensus.cc:740] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:25.838049 16765 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:25.917425 16711 consensus_queue.cc:260] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.918979 16711 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:25.852514 16793 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:25.854049 16809 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:25.854671 16710 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.924329 16809 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.840570 16568 consensus_queue.cc:260] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.925725 16568 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:25.926864 16809 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:25.880458 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:25.877962 16745 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:25.881500 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:25.928217 11082 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:25.928427 11078 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:25.929754 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 52621.1us
I20260709 12:22:25.930831 16745 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:25.931263 16745 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:25.882283 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:25.882467 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:25.936347 11080 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:25.931744 16745 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:25.883471 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:25.832718 11010 rpcz_store.cc:276] 0709 12:22:24.100533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.664153 (+1563620us) service_pool.cc:224] Handling call
0709 12:22:25.664655 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:25.670651 (+  5996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:25.670682 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:25.671285 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 12:22:25.785385 (+114100us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:25.785427 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.785492 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:25.812375 (+ 26883us) raft_consensus.cc:1685] finished
0709 12:22:25.812395 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.818164 (+  5769us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5418,"raft.queue_time_us":6766,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":163,"thread_start_us":113672,"threads_started":1,"wal-append.queue_time_us":138804}
I20260709 12:22:25.943059 16651 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.891728 11051 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:25.892019 11083 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 3343) took 1471 ms (client timeout 1507 ms). Trace:
I20260709 12:22:25.893646 16716 raft_consensus.cc:3055] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:25.947680 16716 raft_consensus.cc:740] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:25.947980 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:25.948781 16802 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:25.949041 16716 consensus_queue.cc:260] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.900269 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:25.902930 16617 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:25.949725 16802 raft_consensus.cc:697] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:25.950165 11084 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:25.950465 11004 raft_consensus.cc:1240] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:25.951740 16617 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:25.904279 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:25.906502 16696 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:25.953934 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:25.907071 16800 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:25.954818 16800 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.955185 16800 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:25.956033 11085 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:25.954635 16696 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:25.958297 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:25.959005 16696 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:25.954627 11650 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:25.895372 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:25.960295 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.960424 11081 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:22:25.960767 11078 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:25.912035 16627 consensus_queue.cc:1048] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:25.888440 11077 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:25.965557 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.966388 16802 consensus_queue.cc:237] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.968653 16716 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:25.916126 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 44301.6us
I20260709 12:22:25.916496 16720 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.924494 16710 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:25.927671 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.986685 11084 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:25.888310 16676 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:25.880016 10834 catalog_manager.cc:5697] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 13 to 14, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 14 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:25.949457 11076 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:22:25.969424 11085 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: []
W20260709 12:22:25.948410 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 56776.9us
I20260709 12:22:25.915314 16798 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:25.960047 11080 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:22:25.989845 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:25.906787 16769 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:25.976341 11082 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:22:25.977296 11079 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
W20260709 12:22:25.971717 11083 rpcz_store.cc:269] 0709 12:22:24.420762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.421887 (+  1125us) service_pool.cc:224] Handling call
0709 12:22:25.891759 (+1469872us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b540031e054. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:25.891940 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1606362368}
I20260709 12:22:26.000712 11077 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:25.980927 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:25.993168 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:25.993541 11051 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:25.994037 16721 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:22:26.029103 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.029381 10974 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:26.031697 16793 consensus_queue.cc:1059] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:25.997283 10834 catalog_manager.cc:5697] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:25.995082 16710 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:25.871397 16709 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:25.998172 16627 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:26.054726 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 72318us
I20260709 12:22:26.037648 16769 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:26.026587 16696 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:26.038017 16809 raft_consensus.cc:3055] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:26.066239 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2734) took 1965 ms. Trace:
I20260709 12:22:26.066854 11003 rpcz_store.cc:276] 0709 12:22:24.100785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.664225 (+1563440us) service_pool.cc:224] Handling call
0709 12:22:25.909182 (+244957us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b5800223598. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f39fc0 00007f9bb5f24929 00007f9bb5f243d2 00007f9baf49bbd4
0709 12:22:25.909452 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.909731 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:22:25.910055 (+   324us) log.cc:844] Serialized 14 byte log entry
0709 12:22:26.065885 (+155830us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:26.065941 (+    56us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:26.065992 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.066060 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:26.066174 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5535,"prepare.queue_time_us":160,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"spinlock_wait_cycles":51703040,"thread_start_us":140777,"threads_started":1}
I20260709 12:22:26.071558 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:26.075156 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:26.071089 10900 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:26.045256 16676 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:26.062109 16630 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:26.070220 16651 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:26.089214 11010 raft_consensus.cc:2410] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:22:26.091475 10974 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:26.072263 16710 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.070114 16809 raft_consensus.cc:740] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:26.065434 11650 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
W20260709 12:22:26.094527 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 101063us
I20260709 12:22:26.099852 10974 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:26.077318 16702 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:26.058678 16720 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:26.101552 11654 raft_consensus.cc:1240] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:26.084110 16765 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:26.101783 10834 catalog_manager.cc:5697] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 5 to 12, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 12 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:26.089316 16630 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.089598 16659 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:22:26.121491 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 190927us
I20260709 12:22:26.127962 16835 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.128759 16835 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:26.130091 16655 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:26.130898 16568 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:26.131556 16638 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:22:26.132193 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 52968.1us
W20260709 12:22:26.133076 16819 log.cc:927] Time spent T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:22:26.141543 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 72329.2us
I20260709 12:22:26.144026 11010 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:22:26.124074 10834 catalog_manager.cc:5697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 7 to 10, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 10 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:26.123353 16630 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:26.130219 16665 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:26.122803 16651 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:26.172569 16651 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:26.173077 16651 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:26.148526 16665 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:26.175618 16665 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:26.183614 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.140383 16808 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:26.192059 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.191644 16808 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:26.196408 16773 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:26.196879 16720 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:26.197089 16352 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:26.197757 16803 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:26.194608 16808 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:26.157249 16563 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:22:26.157083 16809 consensus_queue.cc:260] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:26.200287 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:26.161599 16676 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:26.146207 16710 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:26.201510 16745 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:26.202679 11007 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:26.202842 16710 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:26.163458 10834 catalog_manager.cc:5697] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:26.144593 16659 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:26.208742 10834 catalog_manager.cc:5697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 11 to 12, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 12 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:26.200618 16809 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:26.168673 11051 leader_election.cc:400] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17.
I20260709 12:22:26.211376 11051 leader_election.cc:403] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:26.211930 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:26.122165 16531 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 12:22:26.212240 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 81372us
I20260709 12:22:26.132128 16638 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.212940 16638 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:26.213652 16745 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:26.215086 16835 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:26.215233 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:26.171181 16709 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:26.101442 16627 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:26.122534 16696 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:26.216794 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:26.217439 11007 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:26.217892 16696 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:26.213562 16531 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:22:26.219825 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:26.214959 10834 catalog_manager.cc:5697] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 10 to 13, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 13 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:22:26.221498 10834 catalog_manager.cc:5697] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 10 to 13, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 13 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:26.222536 16627 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:26.209666 16659 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:26.220151 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:26.224184 11085 raft_consensus.cc:2410] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 15 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:22:26.225841 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:26.226076 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:26.226812 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:26.226116 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:26.227533 11079 raft_consensus.cc:2393] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 17: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:26.228323 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:26.229506 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:26.230350 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:26.231441 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:26.232201 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:26.233148 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:26.233770 11082 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 10.
I20260709 12:22:26.234236 16651 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:26.234601 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:26.235459 11082 raft_consensus.cc:2410] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:22:26.236685 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:26.236745 16651 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:26.238138 11082 raft_consensus.cc:2410] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:22:26.155957 10975 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:26.203954 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:26.204957 11002 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 20. Current term is 21. Ops: []
I20260709 12:22:26.162551 16800 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:26.205879 16676 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.169565 11050 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:26.212313 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:26.259002 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 103209us
I20260709 12:22:26.208606 11010 raft_consensus.cc:1240] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:22:26.216109 11003 raft_consensus.cc:2410] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:22:26.145419 10974 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:26.240973 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.223196 10834 catalog_manager.cc:5697] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:26.232100 11077 raft_consensus.cc:2410] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:22:26.262019 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:26.245545 11078 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:26.167294 16630 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:26.279681 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 152506us
I20260709 12:22:26.280277 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:26.268937 16651 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:26.283888 10901 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:26.282132 11007 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:26.286005 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:26.287335 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:26.289160 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:26.286808 10974 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:26.295970 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:26.299479 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:26.290810 10834 catalog_manager.cc:5697] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 9 to 11, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 11 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:26.301658 11083 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:22:26.302227 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:26.305222 11077 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:22:26.306432 11077 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17. Ops: [16.7-16.7]
I20260709 12:22:26.309442 11654 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:22:26.213593 16665 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:26.312644 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:26.314095 16837 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.314661 16837 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:26.316800 16837 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:26.311465 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:26.320099 10974 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:26.290998 16651 raft_consensus.cc:697] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:26.307500 16627 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:26.274369 16676 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:26.294730 16838 consensus_queue.cc:1059] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:22:26.341027 11010 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:26.548156 11080 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:26.404815 10834 catalog_manager.cc:5697] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 15 to 16, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 16 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:26.351042 10901 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:26.559296 11083 raft_consensus.cc:1240] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 12:22:26.433297 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.506803 11081 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 12:22:26.506304 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 181333us
I20260709 12:22:26.406215 10974 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:26.364454 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:26.383500 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:26.560712 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 391031us
I20260709 12:22:26.565845 16702 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:22:26.405557 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:26.567241 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.566022 11050 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:26.568837 11082 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 12:22:26.307899 16710 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:26.545387 16847 log.cc:927] Time spent T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:22:26.572708 11085 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
W20260709 12:22:26.574584 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 223595us
I20260709 12:22:26.568274 16702 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:26.340531 16583 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:22:26.548949 16585 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:26.435117 16621 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.549120 16846 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.578118 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:26.402853 16563 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:26.576122 10901 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:26.581431 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 240922us
I20260709 12:22:26.580756 11656 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:22:26.453428 16630 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:26.578117 10834 catalog_manager.cc:5697] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 8 to 9, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 9 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:26.548846 16717 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:26.568987 16711 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.585517 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:26.586088 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:26.587771 11004 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:26.588352 10974 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:26.586937 16837 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:26.589922 16837 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:26.589773 10834 catalog_manager.cc:5697] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 15 to 16, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 16 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:26.591234 16802 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:26.587180 16716 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:26.592235 16716 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.591600 10834 catalog_manager.cc:5697] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 11 to 14, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 14 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:26.592617 16716 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:26.592923 16676 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:26.593658 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:26.593900 16711 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:26.594491 11080 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 18: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:26.593634 10834 catalog_manager.cc:5697] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 11 to 13, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 13 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:26.595745 16794 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:26.596678 10935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:22:26.596487 16794 raft_consensus.cc:697] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:26.597613 10935 raft_consensus.cc:606] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:26.598136 10935 raft_consensus.cc:614] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:26.598848 10834 catalog_manager.cc:5697] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 12 to 17, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 17 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:26.598151 16794 consensus_queue.cc:237] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:26.364945 16696 consensus_queue.cc:1059] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.216s
I20260709 12:22:26.601977 16802 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:26.603327 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:26.364169 16773 consensus_queue.cc:1059] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.232s
I20260709 12:22:26.604456 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:26.605710 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:26.606032 16665 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:26.606707 16800 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:26.606846 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:26.608561 10977 leader_election.cc:336] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.513s (SENT)
I20260709 12:22:26.610052 16846 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:26.610831 10977 leader_election.cc:336] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.587s (SENT)
I20260709 12:22:26.611286 10977 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:26.612489 16621 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:26.613128 16617 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:26.614099 16808 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:26.572506 16651 consensus_queue.cc:237] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:26.615962 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:26.616819 10974 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:26.617136 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:26.617856 10974 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:26.618240 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:26.618665 16654 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:26.619231 16654 raft_consensus.cc:697] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:26.620211 16654 consensus_queue.cc:237] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:26.621187 11085 raft_consensus.cc:1240] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:26.622193 16638 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:26.623661 16745 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:26.624209 16659 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:26.625083 16659 raft_consensus.cc:697] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:26.623487 11005 raft_consensus.cc:2393] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 18: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:26.625982 16659 consensus_queue.cc:237] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:26.624311 16745 raft_consensus.cc:697] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:26.623457 16665 consensus_queue.cc:1059] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:26.628547 16745 consensus_queue.cc:237] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:26.629256 16665 raft_consensus.cc:3055] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:26.629745 16665 raft_consensus.cc:740] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:26.630612 16665 consensus_queue.cc:260] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:26.631798 16665 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:26.587139 16717 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.633863 16717 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:26.636598 11083 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:26.637897 16621 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:26.638671 16531 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17.
I20260709 12:22:26.639531 11079 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:26.642159 16709 raft_consensus.cc:3055] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:26.642568 16709 raft_consensus.cc:740] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:26.582952 16769 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:26.644438 16769 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:26.646528 16769 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:26.648255 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:26.649596 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:26.579362 16702 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.649708 10935 raft_consensus.cc:2410] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:22:26.657311 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:26.652691 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:26.658658 11077 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:26.650249 10930 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:26.579741 16627 raft_consensus.cc:697] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:26.656726 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:26.657488 16352 consensus_queue.cc:1059] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:22:26.643435 16709 consensus_queue.cc:260] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:26.658164 11007 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 12:22:26.829492 11625 leader_election.cc:336] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.935s (SENT)
I20260709 12:22:26.604756 16773 raft_consensus.cc:3055] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:22:26.697350 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 50098.5us
W20260709 12:22:26.753657 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 47901us
I20260709 12:22:26.668210 10933 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:26.751761 10927 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: []
W20260709 12:22:26.667079 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 49352.6us
I20260709 12:22:26.749895 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:27.005219 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:26.777581 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.583890 16563 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:26.981760 10931 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:26.612591 16846 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:26.984404 16352 raft_consensus.cc:3055] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:26.662593 11080 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:26.657815 16702 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:26.655047 16696 raft_consensus.cc:3055] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:22:27.009460 16563 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:26.668284 16583 raft_consensus.cc:697] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:26.829802 16531 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.031138 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:26.656561 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:27.007157 16837 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:26.660784 11004 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:22:27.005375 10935 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:22:26.946521 16638 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:27.013264 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.027639 10928 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:22:27.010829 11050 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:27.012481 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:22:27.005853 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 394989us
I20260709 12:22:26.654501 16838 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:27.012440 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:27.001442 16773 raft_consensus.cc:740] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:27.013654 16352 raft_consensus.cc:740] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:26.748108 16710 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:27.032541 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:27.014959 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:27.045027 10933 raft_consensus.cc:2410] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 12:22:27.035650 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:26.654628 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:27.047273 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.752110 16803 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.278s
I20260709 12:22:27.019654 16696 raft_consensus.cc:740] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:27.009931 16720 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:22:27.032768 10932 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:27.046464 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:27.054093 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.051206 10930 raft_consensus.cc:2410] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:22:27.046870 16709 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:27.052289 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:27.052891 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:27.019825 16798 consensus_queue.cc:1059] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:22:27.058460 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:27.052110 10934 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:27.056753 10901 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:27.062541 10927 raft_consensus.cc:2376] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12. Re-sending same reply.
W20260709 12:22:27.065536 10977 leader_election.cc:336] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.611s (SENT)
W20260709 12:22:27.068174 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 238714us
I20260709 12:22:27.070173 10928 raft_consensus.cc:2410] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 12:22:27.050328 16585 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:27.071118 10935 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:27.067646 16773 consensus_queue.cc:260] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:27.075639 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:27.076388 16773 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:27.076200 16583 consensus_queue.cc:237] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:27.051772 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:27.033479 16531 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:27.079246 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:27.056049 16837 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.076337 10927 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:27.081768 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:27.074796 10930 raft_consensus.cc:2376] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18. Re-sending same reply.
I20260709 12:22:27.083935 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:27.064113 16676 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:27.072495 16846 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:22:27.086951 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.073824 16711 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:27.074281 16585 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.087821 16627 consensus_queue.cc:237] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:27.061285 16838 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:27.091655 16848 log.cc:927] Time spent T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 12:22:27.069682 16835 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.023s
W20260709 12:22:27.101243 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:27.105782 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 88269.5us
I20260709 12:22:27.109166 16655 raft_consensus.cc:3055] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:27.109869 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:27.114835 10928 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 12:22:27.111321 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3367) took 1052 ms. Trace:
W20260709 12:22:27.099959 16716 consensus_meta.cc:287] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.507s	user 0.003s	sys 0.009s
I20260709 12:22:27.114574 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:27.123947 11085 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:27.116583 11084 rpcz_store.cc:276] 0709 12:22:26.058634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.059513 (+   879us) service_pool.cc:224] Handling call
0709 12:22:26.076622 (+ 17109us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:26.086398 (+  9776us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:26.168005 (+ 81607us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b180007eca0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9baddedc0a 00007f9bb752d219 00007f9bb4e3458f 00007f9bade73571 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd
0709 12:22:26.296542 (+128537us) log.cc:844] Serialized 14 byte log entry
0709 12:22:26.501186 (+204644us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:26.507225 (+  6039us) log.cc:844] Serialized 26 byte log entry
0709 12:22:26.507389 (+   164us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:26.507424 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.507498 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:27.110990 (+603492us) raft_consensus.cc:1685] finished
0709 12:22:27.111105 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:27.111240 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12692,"prepare.queue_time_us":33128,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":27,"raft.queue_time_us":25355,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":7407,"spinlock_wait_cycles":10824448,"thread_start_us":346848,"threads_started":2,"wal-append.queue_time_us":279543}
I20260709 12:22:27.119423 10934 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:27.104897 16585 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:27.101938 16846 raft_consensus.cc:697] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:27.086195 16837 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:27.160246 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:27.155108 10927 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:27.155522 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:27.159111 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.151103 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:27.162171 11081 raft_consensus.cc:1813] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Handling vote request from an unknown peer 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:27.166494 11081 raft_consensus.cc:2410] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 14 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:22:27.168439 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:27.168604 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:27.169076 11079 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:27.154304 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:27.169970 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:27.113873 16655 raft_consensus.cc:740] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:27.173043 11078 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:22:27.167704 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:27.178843 11076 raft_consensus.cc:2393] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 14: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:27.170145 10930 raft_consensus.cc:2376] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12. Re-sending same reply.
I20260709 12:22:27.101091 16676 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:27.184842 11084 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:22:27.083089 16352 consensus_queue.cc:260] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:27.191293 10932 raft_consensus.cc:2393] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 15: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:22:27.193109 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 182365us
W20260709 12:22:27.187994 10977 leader_election.cc:336] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.726s (SENT)
I20260709 12:22:27.149343 16716 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:27.208604 10977 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:27.211469 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:27.212255 11004 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:27.207569 11050 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:27.214795 11078 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:27.217135 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:27.218130 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.222751 16655 consensus_queue.cc:260] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:27.223909 16655 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:27.228032 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:27.229007 11007 raft_consensus.cc:2393] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 14: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:22:27.231514 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.233309 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:27.233358 16676 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:27.234977 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:27.236408 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:27.236585 16531 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:27.237360 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:27.234412 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:27.241698 11007 raft_consensus.cc:2393] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 13: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:27.242990 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:27.246677 10927 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
W20260709 12:22:27.291781 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.248018 11085 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:27.251466 11008 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:22:27.251935 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:27.252118 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:27.253402 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:27.253728 16837 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:27.255081 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:27.257360 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:27.299131 11004 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:27.258605 11050 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:27.260749 16665 consensus_meta.cc:287] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.628s	user 0.010s	sys 0.000s
I20260709 12:22:27.302374 10935 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
W20260709 12:22:27.264495 16857 log.cc:927] Time spent T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:22:27.264817 16630 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:27.269183 16716 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:27.273200 10933 raft_consensus.cc:2368] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18.
I20260709 12:22:27.274886 16846 consensus_queue.cc:237] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:27.277611 16709 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.279458 16710 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:27.284895 16838 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:27.285369 11625 leader_election.cc:336] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 2.041s (SENT)
I20260709 12:22:27.326231 11625 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:27.327314 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:27.286083 10934 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:27.289551 10928 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:27.298152 11003 raft_consensus.cc:2393] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 17: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:27.300050 10936 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:27.184185 16696 consensus_queue.cc:260] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:27.302320 11050 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:27.303565 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:27.334362 11079 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:27.334751 10935 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:27.304579 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:27.308411 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:27.318267 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:27.336230 11082 raft_consensus.cc:2393] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 15: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:27.312103 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:27.336767 10932 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:27.310226 11005 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:27.259375 16702 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:27.298182 16711 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:27.327932 11625 leader_election.cc:336] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 2.176s (SENT)
I20260709 12:22:27.342873 11625 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:27.339648 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:27.301770 16798 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:22:27.356339 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 54114.4us
I20260709 12:22:27.285666 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:27.333155 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:27.338466 11083 raft_consensus.cc:1240] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:27.310575 16630 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:27.330593 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:27.345088 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 163634us
I20260709 12:22:27.344800 16711 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:27.345561 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:27.362713 11003 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:27.347093 16696 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:27.350842 11011 raft_consensus.cc:2410] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:22:27.353304 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:27.354058 10929 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:22:27.317303 16676 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:27.357126 11050 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:27.363076 11080 raft_consensus.cc:1275] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:27.366945 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:27.325531 16837 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.336601 16779 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:22:27.355983 16717 consensus_meta.cc:287] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.708s	user 0.006s	sys 0.005s
W20260709 12:22:27.321098 16745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.016s	sys 0.010s
I20260709 12:22:27.361440 11010 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:27.390177 10927 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:27.356899 16352 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:27.410270 10932 raft_consensus.cc:1275] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:27.411576 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:27.362182 16630 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:27.325831 16709 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:27.427268 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:27.364938 16866 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:27.408860 16745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.016s	sys 0.010s
I20260709 12:22:27.428074 11008 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:27.448696 10935 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
W20260709 12:22:27.455580 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 128916us
I20260709 12:22:27.450279 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:27.375821 11650 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
W20260709 12:22:27.455039 10977 leader_election.cc:336] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.839s (SENT)
I20260709 12:22:27.406932 16531 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:27.457585 10974 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:27.462369 11082 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:22:27.463737 10977 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:27.437785 16676 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.364385 16563 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:27.471149 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.404393 16837 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:27.451812 16779 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:27.474957 11008 raft_consensus.cc:1240] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:22:27.475581 10974 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:27.410174 16862 consensus_queue.cc:1059] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:22:27.407750 16717 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:27.479620 16866 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:22:27.481155 10977 leader_election.cc:336] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.954s (SENT)
I20260709 12:22:27.489315 10977 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:27.490442 10900 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:27.484249 11622 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:27.439026 16585 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:27.495530 11010 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:27.456465 16638 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:22:27.476521 16654 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:27.510771 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.472783 16659 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:27.532279 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:27.537220 10931 raft_consensus.cc:2368] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18.
I20260709 12:22:27.506572 10974 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
W20260709 12:22:27.521140 16852 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.365s	user 0.004s	sys 0.000s
W20260709 12:22:27.542752 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 58586.7us
I20260709 12:22:27.476258 16665 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 12:22:27.544459 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.507733 16861 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:27.472322 16676 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:27.474221 16745 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:22:27.550195 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:27.535184 16621 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:27.567692 10935 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:27.569839 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:27.570586 10935 raft_consensus.cc:2393] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 14: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:27.541720 16862 raft_consensus.cc:3055] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:27.573988 10933 raft_consensus.cc:2393] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 16: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:22:27.574222 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 67775.6us
I20260709 12:22:27.572520 16702 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:27.581331 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 100203us
I20260709 12:22:27.542793 16779 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:27.590744 10929 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
W20260709 12:22:27.593617 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:27.618492 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.616683 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:27.622592 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:27.623351 10929 raft_consensus.cc:2393] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 19: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:27.624255 11003 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:27.624822 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:27.624548 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:27.625739 10935 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:27.625687 10929 raft_consensus.cc:2393] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 17: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:27.633159 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:27.633783 10929 raft_consensus.cc:2376] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15. Re-sending same reply.
I20260709 12:22:27.634663 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:27.635372 10929 raft_consensus.cc:2393] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 14: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:27.569111 16621 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.492849 16866 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:27.645613 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:27.616303 16847 log.cc:927] Time spent T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:22:27.646977 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:27.651790 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:27.652539 10933 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:22:27.652067 10929 raft_consensus.cc:2376] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14. Re-sending same reply.
W20260709 12:22:27.654515 10977 leader_election.cc:336] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.985s (SENT)
I20260709 12:22:27.655027 10977 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:27.586119 16862 raft_consensus.cc:740] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:27.599121 16583 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:27.641973 16651 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:27.649326 16621 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:27.656903 16877 log.cc:927] Time spent T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:22:27.665861 10935 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:27.645480 16881 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:22:27.680104 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.692771 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:27.697131 10929 raft_consensus.cc:2393] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 14: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:27.693966 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:27.654763 16702 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.656826 16802 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.702708 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:27.657964 16794 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 12:22:27.716310 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 127847us
I20260709 12:22:27.717810 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41098 (request call id 492) took 1439 ms. Trace:
I20260709 12:22:27.684721 16583 raft_consensus.cc:697] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:27.684801 16711 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:27.693903 16765 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:22:27.718205 11002 rpcz_store.cc:276] 0709 12:22:26.278852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.279007 (+   155us) service_pool.cc:224] Handling call
0709 12:22:26.298602 (+ 19595us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:26.559712 (+261110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:26.559745 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:26.582133 (+ 22388us) log.cc:844] Serialized 52 byte log entry
0709 12:22:27.032498 (+450365us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:27.032542 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.032607 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:27.481382 (+448775us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:22:27.703809 (+222427us) raft_consensus.cc:1685] finished
0709 12:22:27.703872 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:27.717743 (+ 13871us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24184,"raft.queue_time_us":227724,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":7339,"spinlock_wait_cycles":23932160,"thread_start_us":441470,"threads_started":1,"wal-append.queue_time_us":497555}
W20260709 12:22:27.734601 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 406700us
I20260709 12:22:27.735109 10935 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:22:27.754406 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:27.756716 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.726156 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:27.761165 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 106700us
I20260709 12:22:27.732506 16883 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.761056 11050 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:27.748966 16865 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 12:22:27.766127 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:27.770015 11083 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:22:27.774051 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:27.775775 10935 raft_consensus.cc:2376] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14. Re-sending same reply.
I20260709 12:22:27.778739 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:27.780819 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:27.781451 10929 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:22:27.720058 16702 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:27.706382 16881 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:27.790469 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:27.790939 11051 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:27.792752 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:27.793438 10929 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:27.793471 10935 raft_consensus.cc:2393] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 15: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:27.812698 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:27.782753 16563 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:27.779515 16837 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:27.740981 16802 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:27.819613 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.781580 16717 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:27.836046 10933 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:27.766516 16861 raft_consensus.cc:697] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:27.786231 16585 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:27.840837 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 49973.1us
I20260709 12:22:27.842839 11082 raft_consensus.cc:2955] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 6 to 10, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:22:27.848798 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:27.774566 16883 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:27.864195 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:27.871942 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:27.874701 10977 leader_election.cc:336] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 2.022s (SENT)
W20260709 12:22:27.856832 16880 log.cc:927] Time spent T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
W20260709 12:22:27.880393 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 130242us
I20260709 12:22:27.781347 16892 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
W20260709 12:22:27.861306 16873 log.cc:927] Time spent T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
W20260709 12:22:27.860177 16855 log.cc:927] Time spent T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.698s	user 0.003s	sys 0.003s
W20260709 12:22:27.882532 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.883728 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:27.862188 16676 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:27.884999 11081 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:27.886917 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:27.884104 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:27.896953 10935 raft_consensus.cc:1813] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Handling vote request from an unknown peer 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:27.905829 10935 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 14: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:27.783254 16862 consensus_queue.cc:260] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:27.872766 16583 consensus_queue.cc:237] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:27.889952 16585 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:27.954618 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:27.962188 10935 raft_consensus.cc:2393] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 14: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:22:27.933218 10977 leader_election.cc:336] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 2.052s (SENT)
I20260709 12:22:27.931180 16866 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:27.922117 16676 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:22:28.003386 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:27.980890 16874 log.cc:927] Time spent T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
W20260709 12:22:28.002629 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 130080us
I20260709 12:22:28.010804 11084 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:22:28.012209 10977 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:28.024236 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:27.929770 16745 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:22:28.028659 10935 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:28.044730 16702 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:27.978403 16585 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:28.084246 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.063898 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:28.140415 11625 leader_election.cc:336] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.553s (SENT)
I20260709 12:22:28.140928 11625 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:28.142832 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 224421us
W20260709 12:22:28.076788 16879 log.cc:927] Time spent T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 12:22:27.984992 16861 consensus_queue.cc:237] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:28.158306 10974 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:28.188066 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:28.066437 16676 raft_consensus.cc:697] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:28.074640 16897 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:28.196580 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:28.197716 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:28.199939 16909 log.cc:927] Time spent T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:22:28.186667 16765 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 12:22:28.292532 10933 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:28.185328 16862 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:28.237860 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2641) took 1046 ms. Trace:
W20260709 12:22:28.235025 11008 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.031s	sys 0.035s
W20260709 12:22:28.241215 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:28.290808 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 357657us
I20260709 12:22:28.182482 16617 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:28.185166 16883 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:28.633213 10935 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
W20260709 12:22:28.356061 16891 log.cc:927] Time spent T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.363s	user 0.001s	sys 0.001s
W20260709 12:22:28.243335 16903 log.cc:927] Time spent T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.203s	user 0.002s	sys 0.006s
W20260709 12:22:28.711542 11008 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.136s	user 0.071s	sys 0.054s
W20260709 12:22:28.245893 16654 consensus_meta.cc:287] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.709s	user 0.006s	sys 0.003s
W20260709 12:22:28.248312 16890 log.cc:927] Time spent T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 12:22:28.729714 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:28.380187 11050 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.001s	sys 0.004s
I20260709 12:22:28.189018 16638 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:22:28.635741 10927 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.011s	sys 0.012s
W20260709 12:22:28.247962 16882 log.cc:927] Time spent T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
W20260709 12:22:28.347954 16630 consensus_meta.cc:287] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.907s	user 0.005s	sys 0.007s
W20260709 12:22:28.248389 16878 log.cc:927] Time spent T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 12:22:28.355235 16887 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:28.580250 16920 log.cc:927] Time spent T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
W20260709 12:22:28.311051 16893 log.cc:927] Time spent T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.240s	user 0.000s	sys 0.000s
W20260709 12:22:28.355962 16870 log.cc:927] Time spent T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca: Append to log took a long time: real 0.649s	user 0.003s	sys 0.000s
I20260709 12:22:28.733070 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:28.248193 16885 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:22:28.674186 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.634505 16702 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:28.738308 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.738790 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:28.187820 16896 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:22:28.362496 16902 log.cc:927] Time spent T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
W20260709 12:22:28.633674 16696 consensus_meta.cc:287] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 1.218s	user 0.013s	sys 0.000s
I20260709 12:22:28.248458 16907 consensus_queue.cc:1059] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.795s
W20260709 12:22:28.364162 16913 log.cc:927] Time spent T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
W20260709 12:22:28.363308 16904 log.cc:927] Time spent T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
W20260709 12:22:28.745221 11050 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.007s	sys 0.009s
W20260709 12:22:28.772714 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 1.01501e+06us
I20260709 12:22:28.730005 16906 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.290900 16892 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:22:28.641120 11079 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.007s	sys 0.007s
W20260709 12:22:28.778201 11079 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.017s	sys 0.021s
I20260709 12:22:28.778896 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3391) took 1008 ms. Trace:
I20260709 12:22:28.310168 16912 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:28.729840 16905 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:28.563890 16910 log.cc:927] Time spent T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.340s	user 0.001s	sys 0.000s
W20260709 12:22:28.750001 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.729878 10934 rpcz_store.cc:276] 0709 12:22:27.191001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.341891 (+150890us) service_pool.cc:224] Handling call
0709 12:22:27.345033 (+  3142us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:27.345494 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:27.345529 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:27.346165 (+   636us) log.cc:844] Serialized 52 byte log entry
0709 12:22:27.450847 (+104682us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:27.705688 (+254841us) log.cc:844] Serialized 14 byte log entry
0709 12:22:27.733492 (+ 27804us) log.cc:844] Serialized 14 byte log entry
0709 12:22:27.733925 (+   433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.733994 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:28.237624 (+503630us) raft_consensus.cc:1685] finished
0709 12:22:28.237645 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.237795 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53970,"prepare.queue_time_us":153737,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":9130,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":17328,"spinlock_wait_cycles":10640384,"thread_start_us":303439,"threads_started":2,"wal-append.queue_time_us":192185}
W20260709 12:22:28.745752 10977 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 2.205s (SENT) [suppressed 51 similar messages]
I20260709 12:22:28.203413 16802 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:28.785655 10931 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 3104) took 1970 ms (client timeout 1726 ms). Trace:
I20260709 12:22:28.749418 10933 raft_consensus.cc:2393] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 14: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:28.747428 16630 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:28.788879 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2755) took 1546 ms. Trace:
W20260709 12:22:28.783679 16773 consensus_meta.cc:287] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 1.707s	user 0.012s	sys 0.003s
W20260709 12:22:28.764608 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.766305 16887 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:28.736289 16654 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:28.768528 16885 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:28.751618 16638 raft_consensus.cc:697] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:28.776000 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:28.773430 11050 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:28.799209 11050 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:28.779207 11079 rpcz_store.cc:276] 0709 12:22:27.770191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.770650 (+   459us) service_pool.cc:224] Handling call
0709 12:22:27.770948 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:27.771170 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:22:27.771510 (+   340us) log.cc:844] Serialized 14 byte log entry
0709 12:22:28.778562 (+1007052us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:28.778615 (+    53us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:28.778657 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.778718 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.778836 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39425,"prepare.queue_time_us":1415,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":100687,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":3902,"thread_start_us":1005318,"threads_started":2,"wal-append.queue_time_us":154668}
I20260709 12:22:28.769095 16896 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.767740 16901 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:28.555148 16676 consensus_queue.cc:237] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:28.639938 16897 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:28.789346 11009 rpcz_store.cc:276] 0709 12:22:27.242174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.242612 (+   438us) service_pool.cc:224] Handling call
0709 12:22:27.258313 (+ 15701us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:27.301268 (+ 42955us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:27.301303 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:27.329370 (+ 28067us) log.cc:844] Serialized 26 byte log entry
0709 12:22:27.478484 (+149114us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:27.478566 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.478690 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:28.788659 (+1309969us) raft_consensus.cc:1685] finished
0709 12:22:28.788679 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.788822 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42519,"raft.queue_time_us":47854,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":18103,"thread_start_us":121602,"threads_started":1,"wal-append.queue_time_us":299803}
W20260709 12:22:28.353606 16894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.003s	sys 0.002s
W20260709 12:22:28.787302 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.780153 16585 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:28.199844 16881 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:28.788312 10931 rpcz_store.cc:269] 0709 12:22:26.815630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.017895 (+202265us) service_pool.cc:224] Handling call
0709 12:22:28.785441 (+1767546us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b540017b1d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:28.785587 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1126982528}
W20260709 12:22:28.739660 10927 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.011s	sys 0.022s
W20260709 12:22:28.905421 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 106282us
I20260709 12:22:28.930994 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:28.934207 10934 raft_consensus.cc:2393] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 12: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:28.779026 16702 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:28.939538 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53346 (request call id 541) took 1102 ms. Trace:
I20260709 12:22:28.940033 10934 rpcz_store.cc:276] 0709 12:22:27.837180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.798318 (+961138us) service_pool.cc:224] Handling call
0709 12:22:28.939464 (+141146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:28.937034 11050 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:28.942346 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:28.943080 10933 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
W20260709 12:22:28.927028 16894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.113s	user 0.006s	sys 0.008s
I20260709 12:22:28.786612 16907 raft_consensus.cc:3055] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:28.918175 10901 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:28.951905 10899 connection.cc:256] RPC call timeout handler was delayed by -2.5595214250001845s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
W20260709 12:22:28.968451 10899 connection.cc:256] RPC call timeout handler was delayed by -2.5145214250001118s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
I20260709 12:22:28.927125 16696 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.972350 16696 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:28.974824 16696 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:28.976765 10930 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:22:28.927122 16901 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:28.981792 16630 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:28.982355 16901 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:28.964600 16907 raft_consensus.cc:740] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:28.926853 16925 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:28.778564 16906 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:28.944690 16893 log.cc:927] Time spent T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:22:28.951886 11651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59384 (request call id 702) took 1855 ms. Trace:
I20260709 12:22:28.952071 16917 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:22:28.952411 16929 log.cc:927] Time spent T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 12:22:29.099179 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 630) took 1257 ms. Trace:
I20260709 12:22:28.954135 16885 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:28.786193 16912 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:28.788101 16905 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:28.956053 16887 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:28.956617 16911 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.879s	user 0.011s	sys 0.003s
W20260709 12:22:28.964116 16352 consensus_meta.cc:287] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 1.534s	user 0.009s	sys 0.004s
I20260709 12:22:28.929059 16802 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:28.977286 16897 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:28.952432 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:28.979754 16886 log.cc:927] Time spent T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 1.222s	user 0.003s	sys 0.012s
I20260709 12:22:28.950683 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:29.009155 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:29.130538 10934 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
W20260709 12:22:28.916249 11625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.005s	sys 0.034s
W20260709 12:22:29.131430 11625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.005s	sys 0.035s
W20260709 12:22:29.132052 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 991594us
I20260709 12:22:28.865063 16896 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:28.948174 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2757) took 1697 ms. Trace:
W20260709 12:22:29.022512 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 276818us
I20260709 12:22:29.056710 11004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2761) took 1802 ms. Trace:
I20260709 12:22:29.135993 11004 rpcz_store.cc:276] 0709 12:22:27.254264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.493348 (+239084us) service_pool.cc:224] Handling call
0709 12:22:27.533806 (+ 40458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:27.617278 (+ 83472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:27.617309 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:27.617349 (+    40us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:22:27.617384 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.056442 (+1439058us) spinlock_profiling.cc:243] Waited 40.3 ms on lock 0x7b54004010d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:29.056493 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.056642 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92786944}
I20260709 12:22:28.975648 16696 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:22:29.067586 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.063462 11050 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:29.099236 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:22:28.953171 16924 log.cc:927] Time spent T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
W20260709 12:22:29.100299 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.101142 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53346 (request call id 542) took 1225 ms. Trace:
I20260709 12:22:29.108532 16917 raft_consensus.cc:697] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:29.061751 11651 rpcz_store.cc:276] 0709 12:22:27.094092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.094356 (+   264us) service_pool.cc:224] Handling call
0709 12:22:27.094719 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:27.113742 (+ 19023us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:22:27.402977 (+289235us) log.cc:844] Serialized 14 byte log entry
0709 12:22:27.766838 (+363861us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:27.797370 (+ 30532us) log.cc:844] Serialized 26 byte log entry
0709 12:22:27.814009 (+ 16639us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:22:27.814056 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.814121 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:28.949341 (+1135220us) raft_consensus.cc:1685] finished
0709 12:22:28.949360 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.949482 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":368559,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":807,"raft.queue_time_us":96038,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":15763,"thread_start_us":533212,"threads_started":3,"wal-append.queue_time_us":355462}
I20260709 12:22:28.947984 16585 consensus_queue.cc:1059] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.162s
W20260709 12:22:29.101917 16861 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.002s	sys 0.013s
I20260709 12:22:28.983538 16907 consensus_queue.cc:260] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:29.144622 10932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2646) took 1770 ms. Trace:
I20260709 12:22:29.145120 10931 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:22:29.147307 10935 rpcz_store.cc:276] 0709 12:22:27.879377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.773374 (+893997us) service_pool.cc:224] Handling call
0709 12:22:29.101084 (+327710us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:29.100049 11082 rpcz_store.cc:276] 0709 12:22:27.841879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.842019 (+   140us) service_pool.cc:224] Handling call
0709 12:22:27.842356 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:27.842636 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:22:27.862433 (+ 19797us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.037841 (+1175408us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.098816 (+ 60975us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.098870 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:29.098921 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.098990 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.099116 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":245534,"prepare.queue_time_us":282728,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":671642,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":26275,"spinlock_wait_cycles":96323328,"thread_start_us":493864,"threads_started":2,"wal-append.queue_time_us":364250}
I20260709 12:22:29.161873 10931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 2657) took 1575 ms. Trace:
I20260709 12:22:29.132726 11007 rpcz_store.cc:276] 0709 12:22:27.251055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.254267 (+  3212us) service_pool.cc:224] Handling call
0709 12:22:27.254572 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:27.300895 (+ 46323us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:27.458226 (+157331us) log.cc:844] Serialized 14 byte log entry
0709 12:22:27.953050 (+494824us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:27.981519 (+ 28469us) log.cc:844] Serialized 26 byte log entry
0709 12:22:27.985405 (+  3886us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:27.985445 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.985511 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:28.947905 (+962394us) raft_consensus.cc:1685] finished
0709 12:22:28.947928 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.948102 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66368,"prepare.queue_time_us":44984,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":133653,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":15812,"thread_start_us":598705,"threads_started":3,"wal-append.queue_time_us":553667}
W20260709 12:22:29.154089 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 90706.9us
I20260709 12:22:29.162261 10931 rpcz_store.cc:276] 0709 12:22:27.586433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.937935 (+1351502us) service_pool.cc:224] Handling call
0709 12:22:29.161816 (+223881us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:29.157248 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:29.021663 16925 consensus_queue.cc:1059] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.105s
I20260709 12:22:29.127790 16802 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.167011 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:29.167222 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:29.167909 10934 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:29.169552 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2645) took 1828 ms. Trace:
I20260709 12:22:29.170316 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:22:29.171634 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 253530us
W20260709 12:22:29.157675 16621 consensus_meta.cc:287] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 1.454s	user 0.006s	sys 0.007s
I20260709 12:22:29.142195 16696 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.152449 16617 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.158999 16630 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:29.170020 10927 rpcz_store.cc:276] 0709 12:22:27.340975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.410908 (+ 69933us) service_pool.cc:224] Handling call
0709 12:22:27.411254 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:27.446506 (+ 35252us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:22:27.977398 (+530892us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.169222 (+1191824us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.169272 (+    50us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:29.169315 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.169378 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.169493 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":114851,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":57,"raft.queue_time_us":42380,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":1633743,"threads_started":3,"wal-append.queue_time_us":766892}
W20260709 12:22:29.174485 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.174341 10901 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:29.160355 16861 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.002s	sys 0.013s
I20260709 12:22:29.192328 16851 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.178341 10933 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:29.161193 10932 rpcz_store.cc:276] 0709 12:22:27.356654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.454194 (+ 97540us) service_pool.cc:224] Handling call
0709 12:22:27.467400 (+ 13206us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:27.473637 (+  6237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:27.473665 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:27.479506 (+  5841us) log.cc:844] Serialized 52 byte log entry
0709 12:22:27.695475 (+215969us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:27.726716 (+ 31241us) log.cc:844] Serialized 14 byte log entry
0709 12:22:27.733116 (+  6400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.733207 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:29.126775 (+1393568us) raft_consensus.cc:1685] finished
0709 12:22:29.126799 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.126960 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":170,"prepare.queue_time_us":36308,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":17370,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":8202,"thread_start_us":126145,"threads_started":1,"wal-append.queue_time_us":481093}
I20260709 12:22:29.152156 16352 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.181190 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:29.171916 16802 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:29.186384 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:29.113726 16638 consensus_queue.cc:237] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:29.156775 16897 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:22:29.206091 10977 connection.cc:256] RPC call timeout handler was delayed by -2.5081122030001097s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25470000000000004s for a response
W20260709 12:22:29.207321 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.200670 10935 raft_consensus.cc:2410] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:22:29.192971 16851 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:29.209718 10930 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 3116) took 2110 ms (client timeout 2181 ms). Trace:
W20260709 12:22:29.210145 10930 rpcz_store.cc:269] 0709 12:22:27.099609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.327003 (+227394us) service_pool.cc:224] Handling call
0709 12:22:29.209562 (+1882559us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5400370ad4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:29.209666 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3306097024}
I20260709 12:22:29.216140 16835 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:29.216652 16835 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.217025 16835 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:29.209623 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2648) took 1803 ms. Trace:
I20260709 12:22:29.221001 10935 rpcz_store.cc:276] 0709 12:22:27.406192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.208778 (+1802586us) service_pool.cc:224] Handling call
0709 12:22:29.209104 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.209295 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:29.209322 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.209363 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:29.209393 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.209444 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.209548 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:29.223234 16884 log.cc:927] Time spent T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 1.463s	user 0.012s	sys 0.012s
I20260709 12:22:29.225216 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2642) took 2011 ms. Trace:
I20260709 12:22:29.225694 10936 rpcz_store.cc:276] 0709 12:22:27.213676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.356284 (+142608us) service_pool.cc:224] Handling call
0709 12:22:27.356622 (+   338us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:27.410722 (+ 54100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:27.410752 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:27.430811 (+ 20059us) log.cc:844] Serialized 52 byte log entry
0709 12:22:27.586912 (+156101us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:27.622392 (+ 35480us) log.cc:844] Serialized 14 byte log entry
0709 12:22:27.622590 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.622659 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:28.362953 (+740294us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b180039bb00. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:22:29.222580 (+859627us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:22:29.224906 (+  2326us) raft_consensus.cc:1685] finished
0709 12:22:29.224936 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.225133 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36186,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":3618,"raft.queue_time_us":27134,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":15301,"spinlock_wait_cycles":11701504,"thread_start_us":108837,"threads_started":1,"wal-append.queue_time_us":251046}
I20260709 12:22:29.228742 16702 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:29.199692 16933 consensus_queue.cc:1175] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2201bad9e18849b09cf82de29dd032d3" responder_term: 16 status { last_received { term: 16 index: 13 } last_committed_idx: 11 last_received_current_leader { term: 16 index: 13 } }
I20260709 12:22:29.223284 10935 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: [16.10-18.11]
I20260709 12:22:29.232860 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2650) took 1778 ms. Trace:
I20260709 12:22:29.233245 10935 rpcz_store.cc:276] 0709 12:22:27.454039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.222481 (+1768442us) service_pool.cc:224] Handling call
0709 12:22:29.222973 (+   492us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:29.232480 (+  9507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.232760 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:29.234527 16863 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:29.235118 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:29.235131 16863 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:29.236079 11009 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:29.239923 11051 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:29.241676 11051 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:29.182287 16621 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:29.242668 16900 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:29.243053 16866 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:22:29.244890 16882 log.cc:927] Time spent T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.460s	user 0.012s	sys 0.005s
I20260709 12:22:29.245471 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:29.246006 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2644) took 1914 ms. Trace:
I20260709 12:22:29.247123 16863 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:29.246379 10928 rpcz_store.cc:276] 0709 12:22:27.331312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.403758 (+ 72446us) service_pool.cc:224] Handling call
0709 12:22:27.426754 (+ 22996us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:27.436026 (+  9272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:27.436066 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:27.436776 (+   710us) log.cc:844] Serialized 52 byte log entry
0709 12:22:27.473282 (+ 36506us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:27.659409 (+186127us) log.cc:844] Serialized 14 byte log entry
0709 12:22:27.660716 (+  1307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.660802 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:29.243774 (+1582972us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b240013af78. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badcf99c4 00007f9badcf7acb 00007f9badeb2dc9 00007f9badeb2a55 00007f9badeb209d 00007f9bb0ae410e 00007f9bb0afb88c 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221
0709 12:22:29.245704 (+  1930us) raft_consensus.cc:1685] finished
0709 12:22:29.245796 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.245947 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68070,"prepare.queue_time_us":105333,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":9664,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":20971,"spinlock_wait_cycles":7371136,"thread_start_us":138290,"threads_started":2,"wal-append.queue_time_us":227393}
I20260709 12:22:29.249138 11002 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:29.184046 16696 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:29.251746 11009 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:29.253643 10935 raft_consensus.cc:1240] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:29.254464 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2652) took 1773 ms. Trace:
I20260709 12:22:29.254899 10935 rpcz_store.cc:276] 0709 12:22:27.481536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.234058 (+1752522us) service_pool.cc:224] Handling call
0709 12:22:29.253418 (+ 19360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.254169 (+   751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.254394 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:29.256263 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3400) took 1387 ms. Trace:
I20260709 12:22:29.194782 16617 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:29.256826 16835 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:29.256307 10935 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:29.256695 11078 rpcz_store.cc:276] 0709 12:22:27.868874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.869504 (+   630us) service_pool.cc:224] Handling call
0709 12:22:27.870320 (+   816us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:27.870524 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:27.870548 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:27.871060 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 12:22:27.876226 (+  5166us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:27.876266 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.876335 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:28.769812 (+893477us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:22:29.255994 (+486182us) raft_consensus.cc:1685] finished
0709 12:22:29.256012 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.256205 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61083008,"thread_start_us":4794,"threads_started":1,"wal-append.queue_time_us":114767}
I20260709 12:22:29.257063 16925 consensus_queue.cc:1059] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:22:29.194351 16887 raft_consensus.cc:3055] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:29.260886 16887 raft_consensus.cc:740] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:29.260085 16779 raft_consensus.cc:2955] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 6 to 10, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:22:29.261591 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:29.261806 16887 consensus_queue.cc:260] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:29.262730 16887 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:29.263681 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:29.264225 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:29.264910 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:29.247834 11051 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:29.265460 16917 consensus_queue.cc:237] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:29.268711 16906 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:29.260483 16925 raft_consensus.cc:3055] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:29.269838 16352 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:29.270946 10931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 2659) took 1567 ms. Trace:
I20260709 12:22:29.258528 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2654) took 1759 ms. Trace:
W20260709 12:22:29.273016 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:29.280465 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 311443us
I20260709 12:22:29.249249 16912 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:29.258765 16617 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:29.207751 10977 connection.cc:256] RPC call timeout handler was delayed by -2.3871484930000406s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1592s for a response
I20260709 12:22:29.273582 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:29.273097 11051 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:29.280652 10934 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:22:29.288772 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 2664) took 1385 ms. Trace:
W20260709 12:22:29.272140 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.280881 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:29.281495 10931 rpcz_store.cc:276] 0709 12:22:27.703442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.169786 (+1466344us) service_pool.cc:224] Handling call
0709 12:22:29.270883 (+101097us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:29.281914 10935 rpcz_store.cc:276] 0709 12:22:27.498985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.255781 (+1756796us) service_pool.cc:224] Handling call
0709 12:22:29.256147 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.258235 (+  2088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.258442 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:29.194880 16907 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:29.254531 16932 log.cc:927] Time spent T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:22:29.288983 10928 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:29.289920 10927 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:22:29.290206 10935 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:22:29.290503 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:29.291800 11003 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:29.289139 10934 rpcz_store.cc:276] 0709 12:22:27.903026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.148634 (+1245608us) service_pool.cc:224] Handling call
0709 12:22:29.288698 (+140064us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:29.295317 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:29.417021 16912 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:29.377734 10977 leader_election.cc:336] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 2.172s (SENT)
I20260709 12:22:29.390566 11050 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:29.451040 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 60571.9us
I20260709 12:22:29.451112 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:29.236265 16583 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:29.337859 10929 raft_consensus.cc:2368] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 13. Current term is 14.
W20260709 12:22:29.346311 16862 consensus_meta.cc:287] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.612s	user 0.005s	sys 0.005s
I20260709 12:22:29.281052 16926 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:29.286379 16906 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:22:29.423211 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.417251 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3390) took 1647 ms. Trace:
I20260709 12:22:29.481881 10934 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:22:29.401381 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:29.400863 16709 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:29.390280 16630 consensus_queue.cc:1059] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:29.415074 16851 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:29.382750 11082 raft_consensus.cc:1240] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 16. Current term is 17. Ops: [16.13-16.13]
W20260709 12:22:29.485245 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.339715 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:29.339701 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:29.270613 16925 raft_consensus.cc:740] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:29.423573 16938 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:29.336566 16883 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:29.400595 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:29.424288 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:29.498065 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.387262 11004 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
W20260709 12:22:29.425009 16916 log.cc:927] Time spent T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 1.177s	user 0.007s	sys 0.014s
I20260709 12:22:29.426535 16352 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:29.426687 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3478) took 2102 ms. Trace:
W20260709 12:22:29.427927 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.430377 16896 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:29.421077 16621 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:29.434087 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:29.397686 10931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3132) took 1813 ms. Trace:
I20260709 12:22:29.421825 11650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59384 (request call id 704) took 1804 ms. Trace:
I20260709 12:22:29.280397 16897 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:29.384224 10933 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:22:29.514173 10933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 3135) took 1929 ms. Trace:
I20260709 12:22:29.446075 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:29.515633 10936 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 11. Current term is 12. Ops: [9.7-11.8]
I20260709 12:22:29.204155 16676 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.264860 16905 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:29.447921 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 273617us
I20260709 12:22:29.475775 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3133) took 1864 ms. Trace:
I20260709 12:22:29.520635 10935 rpcz_store.cc:276] 0709 12:22:27.584562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.289686 (+1705124us) service_pool.cc:224] Handling call
0709 12:22:29.290000 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:29.448234 (+158234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.448498 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:29.450418 10977 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:29.478072 11625 leader_election.cc:336] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.654s (SENT)
I20260709 12:22:29.482753 11084 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
W20260709 12:22:29.396476 10899 connection.cc:256] RPC call timeout handler was delayed by -2.3021214250002231s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
I20260709 12:22:29.482968 10934 pending_rounds.cc:85] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 7
I20260709 12:22:29.521903 11084 pending_rounds.cc:85] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 11
I20260709 12:22:29.522579 10901 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:29.502118 11008 rpcz_store.cc:276] 0709 12:22:27.324078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.516275 (+192197us) service_pool.cc:224] Handling call
0709 12:22:27.543302 (+ 27027us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:28.730758 (+1187456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.730792 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:28.739378 (+  8586us) log.cc:844] Serialized 52 byte log entry
0709 12:22:28.931501 (+192123us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:29.092339 (+160838us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.092548 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.092637 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:29.253841 (+161204us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:22:29.426322 (+172481us) raft_consensus.cc:1685] finished
0709 12:22:29.426442 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.426616 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37369,"prepare.queue_time_us":166737,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":63985,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":36687,"spinlock_wait_cycles":42011904,"thread_start_us":1305803,"threads_started":2,"wal-append.queue_time_us":365674}
I20260709 12:22:29.488777 11656 raft_consensus.cc:2393] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 13: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:29.482084 11077 rpcz_store.cc:276] 0709 12:22:27.769906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.770033 (+   127us) service_pool.cc:224] Handling call
0709 12:22:27.770361 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:27.902411 (+132050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:27.902443 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:27.929653 (+ 27210us) log.cc:844] Serialized 26 byte log entry
0709 12:22:28.632892 (+703239us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:28.632931 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.416858 (+783927us) spinlock_profiling.cc:243] Waited 90.2 ms on lock 0x7b5400218754. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:29.416914 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:29.416964 (+    50us) raft_consensus.cc:1685] finished
0709 12:22:29.416979 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.417189 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85845,"raft.queue_time_us":149528,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":24068,"spinlock_wait_cycles":209158144,"thread_start_us":226552,"threads_started":1,"wal-append.queue_time_us":806028}
I20260709 12:22:29.491469 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:29.514552 10933 rpcz_store.cc:276] 0709 12:22:27.585082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.166680 (+1581598us) service_pool.cc:224] Handling call
0709 12:22:29.514099 (+347419us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:29.489262 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:29.524533 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:29.505348 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:29.524933 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:29.526103 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:29.475891 16894 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:29.521901 11625 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:29.504398 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:29.508404 11005 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
W20260709 12:22:29.527693 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 49660.9us
I20260709 12:22:29.508476 10931 rpcz_store.cc:276] 0709 12:22:27.584280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.289675 (+1705395us) service_pool.cc:224] Handling call
0709 12:22:29.368940 (+ 79265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.397243 (+ 28303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:29.397280 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.397327 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:29.397408 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.397480 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.397620 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9009,"raft.queue_time_us":29790,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110}
W20260709 12:22:29.522778 10899 connection.cc:256] RPC call timeout handler was delayed by -2.2472214250001343s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2137s for a response
W20260709 12:22:29.529012 10899 connection.cc:256] RPC call timeout handler was delayed by -2.1464214249999714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22490000000000002s for a response
W20260709 12:22:29.529382 10899 connection.cc:256] RPC call timeout handler was delayed by -2.143721424999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22519999999999998s for a response
W20260709 12:22:29.529645 10899 connection.cc:256] RPC call timeout handler was delayed by -1.7648214250002638s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26730000000000004s for a response
W20260709 12:22:29.529907 10899 connection.cc:256] RPC call timeout handler was delayed by -1.7396214250002231s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2701s for a response
W20260709 12:22:29.530166 10899 connection.cc:256] RPC call timeout handler was delayed by -1.6469214250000732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2804s for a response
I20260709 12:22:29.502990 16883 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:22:29.530439 10899 connection.cc:256] RPC call timeout handler was delayed by -1.4678214250002384s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3003s for a response
I20260709 12:22:29.480505 16583 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:29.481151 16906 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:29.533283 10899 connection.cc:256] RPC call timeout handler was delayed by -1.4462214250002035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3027s for a response
I20260709 12:22:29.522109 10934 pending_rounds.cc:107] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:22:29.522524 11084 pending_rounds.cc:107] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 12:22:29.536389 10934 raft_consensus.cc:2889] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:29.534461 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:29.483444 16912 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:29.536461 11084 raft_consensus.cc:2889] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:29.535068 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:29.537277 11080 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
W20260709 12:22:29.537437 10899 connection.cc:256] RPC call timeout handler was delayed by -1.4237214250001671s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3052s for a response
W20260709 12:22:29.538870 10899 connection.cc:256] RPC call timeout handler was delayed by -1.3877214250001089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30920000000000003s for a response
I20260709 12:22:29.532380 16352 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:29.538991 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:29.545199 10899 connection.cc:256] RPC call timeout handler was delayed by -1.2103265040000224s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
I20260709 12:22:29.537220 10933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53346 (request call id 537) took 1768 ms. Trace:
I20260709 12:22:29.536283 16883 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:29.535148 16894 raft_consensus.cc:697] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:22:29.546291 10899 connection.cc:256] RPC call timeout handler was delayed by -1.1869265039999846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
I20260709 12:22:29.546495 11080 raft_consensus.cc:2410] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:22:29.547308 10899 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:29.548005 10933 rpcz_store.cc:276] 0709 12:22:27.768643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.524528 (+1755885us) service_pool.cc:224] Handling call
0709 12:22:29.524796 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.536816 (+ 12020us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:29.536850 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.536905 (+    55us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:29.536942 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.537006 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.537143 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:29.512042 11650 rpcz_store.cc:276] 0709 12:22:27.617032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.622074 (+  5042us) service_pool.cc:224] Handling call
0709 12:22:27.698569 (+ 76495us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:27.820777 (+122208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:27.823518 (+  2741us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:27.852094 (+ 28576us) log.cc:844] Serialized 26 byte log entry
0709 12:22:27.879641 (+ 27547us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:27.888277 (+  8636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.892815 (+  4538us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:29.419136 (+1526321us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b2400338468. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badcf99c4 00007f9badcf7acb 00007f9badeb2dc9 00007f9badeb2a55 00007f9badeb1fb0 00007f9bb0b28488 00007f9bb0b28be8 00007f9bb0b00398 00007f9bb0afb76a 00007f9bb0afabb6
0709 12:22:29.421469 (+  2333us) raft_consensus.cc:1685] finished
0709 12:22:29.421492 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.421752 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113060,"spinlock_wait_cycles":267747968,"thread_start_us":34692,"threads_started":2,"wal-append.queue_time_us":97940}
I20260709 12:22:29.550844 10930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2649) took 2126 ms. Trace:
I20260709 12:22:29.551017 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3137) took 1949 ms. Trace:
I20260709 12:22:29.551986 16908 raft_consensus.cc:3055] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:29.551304 10930 rpcz_store.cc:276] 0709 12:22:27.424502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.210790 (+1786288us) service_pool.cc:224] Handling call
0709 12:22:29.211018 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.211323 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:22:29.377928 (+166605us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.550485 (+172557us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.550540 (+    55us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:22:29.550586 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.550657 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.550778 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3350,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":11124,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":222566,"threads_started":2}
I20260709 12:22:29.554118 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3123) took 2072 ms. Trace:
I20260709 12:22:29.503111 16938 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:29.554502 10928 rpcz_store.cc:276] 0709 12:22:27.481703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.248223 (+1766520us) service_pool.cc:224] Handling call
0709 12:22:29.288703 (+ 40480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.453381 (+164678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.553925 (+100544us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b54001a81d0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:29.554064 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92274560}
I20260709 12:22:29.551483 10934 rpcz_store.cc:276] 0709 12:22:27.601298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.477273 (+1875975us) service_pool.cc:224] Handling call
0709 12:22:29.477612 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.550769 (+ 73157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.550963 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:29.556623 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.557004 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:29.557489 11079 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
W20260709 12:22:29.562906 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.530391 16531 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:29.563203 11085 raft_consensus.cc:2410] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:22:29.565061 11082 raft_consensus.cc:2393] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 17: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:29.565232 11007 raft_consensus.cc:2410] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:22:29.571918 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:29.573746 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.574106 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:29.575241 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:29.576980 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53346 (request call id 545) took 1615 ms. Trace:
I20260709 12:22:29.577481 10934 rpcz_store.cc:276] 0709 12:22:27.961196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.556370 (+1595174us) service_pool.cc:224] Handling call
0709 12:22:29.569311 (+ 12941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.576578 (+  7267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:29.576612 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.576664 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:29.576708 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.576773 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.576914 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:29.579537 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:29.580511 11079 raft_consensus.cc:2410] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:22:29.585274 11002 raft_consensus.cc:2393] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:29.558496 16908 raft_consensus.cc:740] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:29.562062 16709 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:29.558537 16654 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:29.530722 16676 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:29.588670 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:29.567886 10931 raft_consensus.cc:2955] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 6 to 10, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:22:29.564606 16835 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:29.591634 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:29.592497 11005 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:22:29.596155 16941 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:29.596206 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3393) took 1778 ms. Trace:
W20260709 12:22:29.597077 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 225495us
I20260709 12:22:29.598469 11009 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:29.602182 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53346 (request call id 546) took 1618 ms. Trace:
W20260709 12:22:29.601935 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 54758.6us
I20260709 12:22:29.606523 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3139) took 1946 ms. Trace:
I20260709 12:22:29.602563 10934 rpcz_store.cc:276] 0709 12:22:27.983558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.578458 (+1594900us) service_pool.cc:224] Handling call
0709 12:22:29.593139 (+ 14681us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.601869 (+  8730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:29.601899 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.601941 (+    42us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:22:29.601970 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.602023 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.602128 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:29.606940 10927 rpcz_store.cc:276] 0709 12:22:27.660365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.453076 (+1792711us) service_pool.cc:224] Handling call
0709 12:22:29.490789 (+ 37713us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:29.521152 (+ 30363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:29.521186 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:29.531423 (+ 10237us) log.cc:844] Serialized 26 byte log entry
0709 12:22:29.591290 (+ 59867us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:29.591328 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.591390 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:29.606303 (+ 14913us) raft_consensus.cc:1685] finished
0709 12:22:29.606326 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.606461 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9844,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":5473,"thread_start_us":22323,"threads_started":1,"wal-append.queue_time_us":48207}
I20260709 12:22:29.547380 16894 consensus_queue.cc:237] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:29.609258 10977 connection.cc:256] RPC call timeout handler was delayed by -2.3079484929999126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
W20260709 12:22:29.612216 10977 connection.cc:256] RPC call timeout handler was delayed by -2.25791220300016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28250000000000003s for a response
W20260709 12:22:29.612552 10977 connection.cc:256] RPC call timeout handler was delayed by -2.2179484930002218s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
I20260709 12:22:29.612757 11079 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:22:29.573196 16531 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:29.602731 11083 rpcz_store.cc:276] 0709 12:22:27.817538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.820426 (+  2888us) service_pool.cc:224] Handling call
0709 12:22:27.858358 (+ 37932us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:27.923345 (+ 64987us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:27.923378 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:27.923976 (+   598us) log.cc:844] Serialized 26 byte log entry
0709 12:22:29.593820 (+1669844us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b1800423a00. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bb0b084bc 00007f9bade5648b 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b 00007f9bb0affd23 00007f9bb0b000d1
0709 12:22:29.593983 (+   163us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:29.594018 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.594085 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:29.594130 (+    45us) raft_consensus.cc:1685] finished
0709 12:22:29.594140 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.596148 (+  2008us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39140,"raft.queue_time_us":120742,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":16648,"spinlock_wait_cycles":28757760,"thread_start_us":105204,"threads_started":2,"wal-append.queue_time_us":255052}
W20260709 12:22:29.612850 10977 connection.cc:256] RPC call timeout handler was delayed by -2.0419453539998358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
W20260709 12:22:29.615804 10977 connection.cc:256] RPC call timeout handler was delayed by -2.0190484929999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2001s for a response
W20260709 12:22:29.616137 10977 connection.cc:256] RPC call timeout handler was delayed by -1.9654453540001668s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17250000000000001s for a response
W20260709 12:22:29.616436 10977 connection.cc:256] RPC call timeout handler was delayed by -1.8786484930001279s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2157s for a response
W20260709 12:22:29.616811 10977 connection.cc:256] RPC call timeout handler was delayed by -1.857048493000093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21810000000000002s for a response
W20260709 12:22:29.617077 10977 connection.cc:256] RPC call timeout handler was delayed by -1.8439453539999704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18600000000000003s for a response
W20260709 12:22:29.617328 10977 connection.cc:256] RPC call timeout handler was delayed by -1.7764122030002909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.336s for a response
W20260709 12:22:29.617568 10977 connection.cc:256] RPC call timeout handler was delayed by -1.499856316000205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
W20260709 12:22:29.617733 10977 connection.cc:256] RPC call timeout handler was delayed by -1.4854563160001817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
W20260709 12:22:29.617877 10977 connection.cc:256] RPC call timeout handler was delayed by -1.2817718680003054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260709 12:22:29.618017 10977 connection.cc:256] RPC call timeout handler was delayed by -1.2268718680002166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
W20260709 12:22:29.618153 10977 connection.cc:256] RPC call timeout handler was delayed by -1.2070718680001846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
W20260709 12:22:29.618304 10977 connection.cc:256] RPC call timeout handler was delayed by -1.1917718680001599s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
W20260709 12:22:29.618446 10977 connection.cc:256] RPC call timeout handler was delayed by -1.1700094450002325s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
W20260709 12:22:29.618580 10977 connection.cc:256] RPC call timeout handler was delayed by -1.0900718680004502s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20579999999999998s for a response
W20260709 12:22:29.618719 10977 connection.cc:256] RPC call timeout handler was delayed by -1.0828718680004386s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2066s for a response
W20260709 12:22:29.618857 10977 connection.cc:256] RPC call timeout handler was delayed by -1.0215094449999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
I20260709 12:22:29.614497 10934 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:22:29.622421 16943 log.cc:927] Time spent T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:22:29.624100 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53346 (request call id 543) took 1730 ms. Trace:
I20260709 12:22:29.655706 10928 rpcz_store.cc:276] 0709 12:22:27.893445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.555386 (+1661941us) service_pool.cc:224] Handling call
0709 12:22:29.555599 (+   213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.584309 (+ 28710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:29.584339 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.584380 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:29.584416 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.623793 (+ 39377us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b54002044d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:29.623881 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.624031 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65497984}
I20260709 12:22:29.645943 16583 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:29.647716 10899 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:22:29.688262 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.652155 10977 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:29.656656 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2671) took 1299 ms. Trace:
I20260709 12:22:29.693400 10934 rpcz_store.cc:276] 0709 12:22:28.357509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.608697 (+1251188us) service_pool.cc:224] Handling call
0709 12:22:29.609047 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.656386 (+ 47339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.656598 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:29.655803 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.656203 16941 raft_consensus.cc:697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:22:29.717862 16948 log.cc:927] Time spent T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:22:29.691454 16352 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:29.686978 16907 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.722442 16779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:55644 (request call id 14) took 6092 ms. Trace:
W20260709 12:22:29.719645 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 72058us
I20260709 12:22:29.627722 16696 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:29.714847 16659 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:22:29.754704 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.778904 10930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2663) took 1912 ms. Trace:
I20260709 12:22:29.721511 16352 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:29.800659 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:29.839948 10930 rpcz_store.cc:276] 0709 12:22:27.866700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.553511 (+1686811us) service_pool.cc:224] Handling call
0709 12:22:29.553838 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.554058 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:22:29.554381 (+   323us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.718704 (+164323us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.718766 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:29.769110 (+ 50344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.769199 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.778812 (+  9613us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26321,"prepare.queue_time_us":4471,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":57494,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":30036,"thread_start_us":108187,"threads_started":1}
I20260709 12:22:29.699308 16802 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:29.829241 16958 log.cc:927] Time spent T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 12:22:29.852908 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 200859us
I20260709 12:22:29.621997 16925 consensus_queue.cc:260] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:29.855461 11657 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 12:22:29.856364 11657 pending_rounds.cc:85] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: Aborting all ops after (but not including) 11
I20260709 12:22:29.856617 11657 pending_rounds.cc:107] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 12:22:29.856848 11657 raft_consensus.cc:2889] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:29.723439 16835 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:29.720480 16917 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:29.845572 16890 log.cc:927] Time spent T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:22:29.722914 16907 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:29.863750 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2651) took 2396 ms. Trace:
I20260709 12:22:29.864329 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:29.808339 16630 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.864223 10936 rpcz_store.cc:276] 0709 12:22:27.467597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.227632 (+1760035us) service_pool.cc:224] Handling call
0709 12:22:29.515346 (+287714us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:29.516126 (+   780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.863544 (+347418us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54000613d0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:29.863687 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660512128}
I20260709 12:22:29.866274 10899 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:29.865088 11082 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:29.868813 11081 raft_consensus.cc:2393] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:22:29.873198 16939 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.023s	sys 0.024s
I20260709 12:22:29.874729 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:29.873694 16939 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.023s	sys 0.025s
I20260709 12:22:29.830847 16941 consensus_queue.cc:237] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:29.881057 10933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2662) took 2066 ms. Trace:
I20260709 12:22:29.881562 10933 rpcz_store.cc:276] 0709 12:22:27.814373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.549027 (+1734654us) service_pool.cc:224] Handling call
0709 12:22:29.549725 (+   698us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:29.559426 (+  9701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:29.559459 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:29.568901 (+  9442us) log.cc:844] Serialized 26 byte log entry
0709 12:22:29.706005 (+137104us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:29.706054 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.706132 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:29.880794 (+174662us) raft_consensus.cc:1685] finished
0709 12:22:29.880818 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.880986 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":14337,"thread_start_us":102909,"threads_started":1,"wal-append.queue_time_us":225182}
W20260709 12:22:29.888702 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.888510 10977 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:29.844799 16659 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:29.899766 16659 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:29.889971 16931 log.cc:927] Time spent T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.742s	user 0.005s	sys 0.000s
I20260709 12:22:29.881189 16352 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:29.899264 16835 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:29.871285 16630 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:29.900246 16861 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:29.912360 16861 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:29.912838 16861 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:29.914772 16862 raft_consensus.cc:3055] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:29.915230 16862 raft_consensus.cc:740] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:29.907495 10931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53346 (request call id 538) took 2127 ms. Trace:
I20260709 12:22:29.865582 16917 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:29.917361 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 66325.5us
I20260709 12:22:29.873870 16654 consensus_queue.cc:1059] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:22:29.916723 10931 rpcz_store.cc:276] 0709 12:22:27.779912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.528844 (+1748932us) service_pool.cc:224] Handling call
0709 12:22:29.540563 (+ 11719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.567701 (+ 27138us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:22:29.721553 (+153852us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.906862 (+185309us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.907098 (+   236us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.907155 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:29.907213 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.907291 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.907427 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12369,"raft.queue_time_us":196,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":5608,"spinlock_wait_cycles":13656064,"thread_start_us":168890,"threads_started":1}
W20260709 12:22:29.923632 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 51236.3us
I20260709 12:22:29.933418 10977 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:29.932716 16696 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:29.935042 16950 log.cc:927] Time spent T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:22:29.938795 10899 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:29.948522 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:29.944729 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:29.950604 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:29.950959 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:29.951218 11004 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:29.951589 11080 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
W20260709 12:22:29.948735 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:29.952999 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:29.953284 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.722957 16779 rpcz_store.cc:276] 0709 12:22:23.629769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.629944 (+   175us) service_pool.cc:224] Handling call
0709 12:22:23.702706 (+ 72762us) log.cc:844] Serialized 494 byte log entry
0709 12:22:24.477631 (+774925us) spinlock_profiling.cc:243] Waited 9.17 ms on lock 0x7b54007df3a0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0ed9142 00007f9bb0eb9eaa 00007f9bb0ec0d53 00007f9bb0ec0cd9 00007f9bb0ec0c69 00007f9bb0ec0c31 00007f9bb0ebfdfd 0000000000388634 0000000000388479 00007f9bade73475
0709 12:22:29.722218 (+5244587us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6440,"raft.queue_time_us":23301,"raft.run_cpu_time_us":21349,"raft.run_wall_time_us":1216788,"spinlock_wait_cycles":21083008,"thread_start_us":88779,"threads_started":1,"wal-append.queue_time_us":134387,"wal-append.run_cpu_time_us":2535,"wal-append.run_wall_time_us":1194299}
W20260709 12:22:29.955000 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.936197 16798 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:29.957316 10901 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:29.954885 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:29.958086 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:29.958544 11085 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:22:29.959122 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:29.955488 16654 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.960188 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:29.969516 16938 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:29.966077 16709 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:29.968369 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:29.968955 11004 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:29.974220 16638 consensus_queue.cc:1059] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:29.975199 16912 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:29.977471 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:29.978091 11085 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 19: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:29.971841 10819 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c1b75831227444d382e9c0fc5b367564 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:29.978935 16955 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:29.979560 16955 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:29.962812 16798 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:29.989822 16798 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:29.966127 16923 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.972407 16963 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:22:29.957275 16696 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:29.984812 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:29.970482 16897 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:29.970134 16709 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.966619 16908 consensus_queue.cc:260] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.012559 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:30.020430 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:30.012735 10901 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:30.023162 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 86262.1us
I20260709 12:22:30.023510 11085 raft_consensus.cc:2393] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 17: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:30.024760 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:30.025075 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:30.025569 10933 raft_consensus.cc:2393] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 17: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:30.025377 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:30.026386 10930 raft_consensus.cc:2410] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 18 because replica has last-logged OpId of term: 16 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 6.
I20260709 12:22:30.025071 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:30.026515 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.027446 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:30.027673 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:30.028276 10936 raft_consensus.cc:2393] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 14: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:30.028517 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:30.029250 11085 raft_consensus.cc:2410] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:22:30.030265 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:30.030634 16959 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:30.031615 16959 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.032698 10933 raft_consensus.cc:1240] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:30.035379 16959 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:30.031222 10934 raft_consensus.cc:2410] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:22:30.045017 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:30.047725 10931 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
W20260709 12:22:30.049440 16944 log.cc:927] Time spent T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.440s	user 0.001s	sys 0.001s
I20260709 12:22:30.050734 16802 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:30.047240 10936 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:30.046018 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:30.052670 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3140) took 2359 ms. Trace:
W20260709 12:22:30.055378 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.022925 16709 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:30.013567 16907 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:30.058017 10930 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:22:29.985174 16654 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:30.062791 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 107629us
I20260709 12:22:30.059718 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:30.044212 16897 raft_consensus.cc:3055] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:22:30.060472 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:30.059074 10899 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:30.063825 10933 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:22:30.046144 16971 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:30.065264 11085 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:30.065532 10974 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:30.060734 11051 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:30.061769 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:30.068401 10928 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
W20260709 12:22:30.069042 16883 consensus_meta.cc:287] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.000s
I20260709 12:22:30.069501 16883 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.070293 11080 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:22:30.076257 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:30.046772 16955 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:30.078193 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:30.078853 10933 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:30.053879 16959 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:30.082883 11083 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:30.071556 16883 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:30.086398 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:30.087280 10936 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 19: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:30.090687 16885 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:30.091032 16863 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:30.075133 10974 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:30.092432 11002 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:30.059150 16802 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:30.012092 16923 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.093925 11051 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:30.117174 11085 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:30.091688 16885 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:30.077751 16696 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:30.064739 16897 raft_consensus.cc:740] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:30.118340 10933 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:30.077185 16908 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:30.093001 16971 raft_consensus.cc:697] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:30.084838 16630 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:30.122021 11051 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:30.118114 16933 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.071578 16798 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.120558 16883 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:30.120697 16885 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:30.093169 16959 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.136629 16798 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:30.111610 16802 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.128890 16630 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:30.130493 16967 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:30.130828 16917 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:30.132699 16883 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.150274 16923 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:30.168339 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 115421us
I20260709 12:22:30.171115 16897 consensus_queue.cc:260] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.173329 16654 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:30.173559 16897 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:30.173832 16531 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:30.180274 16971 consensus_queue.cc:237] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.170161 16883 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:30.183691 11051 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:30.185367 11051 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:30.186476 11051 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:30.133278 16933 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:30.192051 16959 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:30.193471 16968 log.cc:927] Time spent T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:22:30.198872 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.166455 16967 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.200532 16967 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:30.203299 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:30.206099 16933 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:30.208264 16802 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:30.208580 11002 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:22:30.194833 16659 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:30.206192 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.213536 16696 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.214041 16696 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:30.214972 16676 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:30.220165 10929 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53346 (request call id 539) took 2433 ms (client timeout 1553 ms). Trace:
W20260709 12:22:30.220669 10929 rpcz_store.cc:269] 0709 12:22:27.787248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.794408 (+  7160us) service_pool.cc:224] Handling call
0709 12:22:30.219942 (+2425534us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b5400310954. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:30.220063 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3481155968}
I20260709 12:22:30.220985 10899 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:30.222492 10899 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:30.199136 16861 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.225011 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:30.211673 16883 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:30.240504 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 136736us
I20260709 12:22:30.228210 16630 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:30.237013 16531 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:30.228431 16976 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:22:30.241814 16963 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:30.240813 16959 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:30.279496 11051 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:30.280555 11051 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:30.284200 11081 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 19. Current term is 20. Ops: []
I20260709 12:22:30.285629 11084 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:22:30.255937 16696 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:30.300873 11051 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:30.264711 16963 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:22:30.302719 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 80338us
I20260709 12:22:30.273355 16531 raft_consensus.cc:697] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:30.272354 16959 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:30.304853 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:30.249212 16975 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
W20260709 12:22:30.311437 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 188437us
I20260709 12:22:30.281594 16938 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:30.316210 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 73162us
I20260709 12:22:30.303313 11051 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:30.312579 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:30.317054 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.263461 16914 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:22:30.317268 10900 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:30.303737 16676 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:30.306335 16963 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:30.339114 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:30.342957 11084 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 19: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:30.313803 16959 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:30.289062 16709 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.312534 16585 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:30.305879 16926 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:30.354429 11084 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:22:30.355417 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:30.340791 16696 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:30.308097 16885 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:30.361295 11051 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:30.364946 10934 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:30.367022 11051 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:30.368938 16709 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:30.370087 16862 consensus_queue.cc:260] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.370428 16866 consensus_queue.cc:1059] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:30.371398 16862 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:30.353332 16976 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.371843 16630 raft_consensus.cc:3055] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:30.372401 16630 raft_consensus.cc:740] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:30.372221 16976 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.373399 16630 consensus_queue.cc:260] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:30.374449 16976 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:30.374986 16866 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:30.375474 16866 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:30.358429 11657 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 12.
I20260709 12:22:30.376317 11051 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:30.377348 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 59552.5us
I20260709 12:22:30.378031 11051 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:30.350570 16906 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:30.380051 10900 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:30.319304 16938 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.377110 10977 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:30.384066 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3399) took 2511 ms. Trace:
I20260709 12:22:30.381709 11051 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:30.388116 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:30.388806 11084 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 13.
I20260709 12:22:30.389679 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:30.391589 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:30.358218 16988 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:30.376266 16861 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:30.424640 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.358522 16981 consensus_queue.cc:1048] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:22:30.375933 16866 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:30.353718 16665 consensus_queue.cc:1059] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:22:30.374473 16630 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:30.425809 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:30.425155 10933 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:30.375667 16659 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:30.349828 16651 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:22:30.386302 11076 rpcz_store.cc:276] 0709 12:22:27.868531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.868640 (+   109us) service_pool.cc:224] Handling call
0709 12:22:27.884475 (+ 15835us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:27.896581 (+ 12106us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:27.896610 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:29.226693 (+1330083us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b4800210cd8. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb5e89aa1 00007f9bb5e80b37 00007f9bb5e809ca 00007f9bb5f7826f 00007f9bb5f77f37 00007f9bb5f8c55c 00007f9bb5f8c508 00007f9bb5f8c488 00007f9bb5f8c443 00007f9bb5f8b6ec 00007f9bb4eb5a96
0709 12:22:29.407458 (+180765us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b2c000040c8. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9baf859a11 00007f9baf869372 00007f9bb0f9ba01 00007f9bb0f6043a 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2
0709 12:22:29.408055 (+   597us) log.cc:844] Serialized 26 byte log entry
0709 12:22:29.488426 (+ 80371us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:29.488460 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.379404 (+890944us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b5400217d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:30.379454 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:30.379499 (+    45us) raft_consensus.cc:1685] finished
0709 12:22:30.379511 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:30.379658 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7073,"raft.queue_time_us":153565,"raft.run_cpu_time_us":28468,"raft.run_wall_time_us":1180725,"spinlock_wait_cycles":51411328,"thread_start_us":79976,"threads_started":1,"wal-append.queue_time_us":153756}
I20260709 12:22:30.381047 16917 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:30.383771 16802 consensus_queue.cc:1059] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 12:22:30.383402 16990 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:30.455899 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:30.385640 16897 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 12:22:30.503571 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:30.504244 11008 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:30.053306 10935 rpcz_store.cc:276] 0709 12:22:27.693047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.521441 (+1828394us) service_pool.cc:224] Handling call
0709 12:22:29.950583 (+429142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.956849 (+  6266us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:29.966456 (+  9607us) log.cc:844] Serialized 14 byte log entry
0709 12:22:30.052338 (+ 85882us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:30.052390 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:30.052440 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.052511 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:30.052622 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":295,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":45,"raft.queue_time_us":668,"spinlock_wait_cycles":40704,"thread_start_us":85470,"threads_started":1}
I20260709 12:22:30.391816 16912 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:30.464120 16970 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:30.464250 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:30.469064 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:30.507817 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:30.508600 10932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2647) took 3139 ms. Trace:
I20260709 12:22:30.456066 16883 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:30.477372 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:30.477146 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.486284 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:30.516649 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:30.484259 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.492131 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:30.518502 11082 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 17.
I20260709 12:22:30.492707 11622 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:30.493772 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:30.495041 10927 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:30.524221 10931 raft_consensus.cc:2376] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17. Re-sending same reply.
W20260709 12:22:30.463366 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 98980us
I20260709 12:22:30.485620 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:30.526762 11051 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:30.532094 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.486195 16696 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:30.533917 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:30.535712 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:30.462121 11081 raft_consensus.cc:2955] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 6 to 10, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:22:30.505367 16917 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.507980 16990 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.539480 11010 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:30.476001 16676 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:30.481184 16938 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:30.532089 11622 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:30.486459 16906 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:30.513337 16585 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:30.548316 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.462406 16967 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.532882 16898 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:30.482466 16885 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:30.534116 11049 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:30.470804 16896 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:30.533468 16696 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.560169 16696 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:30.545018 16986 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:30.552116 16898 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.568995 16898 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:30.569248 16907 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.569792 16907 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:30.573458 10977 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:30.575114 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:30.576714 16651 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:30.577641 16563 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:30.578125 16563 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:30.578476 16563 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:30.583837 16925 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:30.463959 16531 consensus_queue.cc:237] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.587958 16981 raft_consensus.cc:3055] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:22:30.588359 16981 raft_consensus.cc:740] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:30.589126 16981 consensus_queue.cc:260] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.590140 16981 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:30.534539 16912 raft_consensus.cc:697] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:30.543256 16990 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:30.555837 16676 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:30.540357 16917 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:30.594311 11008 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:30.552845 11050 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:30.546299 16702 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:30.612049 16702 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.612563 16702 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:30.613768 16912 consensus_queue.cc:237] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.602471 11082 raft_consensus.cc:1240] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:30.587599 16651 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:30.617278 16583 raft_consensus.cc:3055] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:30.617709 16583 raft_consensus.cc:740] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:30.618467 16583 consensus_queue.cc:260] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.618942 16970 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:30.550153 16906 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:30.609565 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:30.549459 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:30.552608 16779 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:30.646055 11650 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:22:30.567390 16959 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:30.627079 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:30.632403 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 79659.8us
W20260709 12:22:30.650395 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.637671 16802 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:30.654423 11050 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:30.619848 16917 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.620903 10977 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:30.620338 16866 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.641134 16906 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:30.625623 16967 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:30.592763 16907 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:30.619709 16583 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:30.624388 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 3202) took 1113 ms. Trace:
I20260709 12:22:30.662035 10977 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:30.662317 11050 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:30.642369 11076 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 13.
I20260709 12:22:30.509207 10932 rpcz_store.cc:276] 0709 12:22:27.368897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.207091 (+1838194us) service_pool.cc:224] Handling call
0709 12:22:29.286095 (+ 79004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.286302 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:22:29.293845 (+  7543us) log.cc:844] Serialized 14 byte log entry
0709 12:22:30.379017 (+1085172us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b180017b780. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b 00007f9bb0affd23 00007f9bb0b0023a 00007f9bb0f6aa2a
0709 12:22:30.508116 (+129099us) log.cc:844] Serialized 14 byte log entry
0709 12:22:30.508274 (+   158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:30.508313 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:30.508360 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.508424 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:30.508542 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":512,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":2358,"raft.queue_time_us":730,"spinlock_wait_cycles":26518272,"thread_start_us":119319,"threads_started":1}
I20260709 12:22:30.648272 16779 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.688027 11079 rpcz_store.cc:276] 0709 12:22:29.510786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.587281 (+ 76495us) service_pool.cc:224] Handling call
0709 12:22:29.600131 (+ 12850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.613234 (+ 13103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.624089 (+1010855us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b540031ea54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:30.624309 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28149120}
I20260709 12:22:30.689859 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:22:30.696612 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 176754us
I20260709 12:22:30.697307 10977 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:30.698726 11050 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:30.700929 16802 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:30.701275 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:30.699802 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:30.702929 10929 raft_consensus.cc:2393] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 21: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:30.703791 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:30.704424 10932 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:22:30.706009 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:30.706688 10927 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:30.714006 10927 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
W20260709 12:22:30.717711 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.722556 11051 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:30.722676 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:30.723449 16802 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:30.723887 16802 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:30.724285 16802 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:30.672605 16941 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.674319 16651 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:22:30.735236 10977 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:30.740640 11049 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:30.674650 16885 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:30.740182 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3405) took 1019 ms. Trace:
I20260709 12:22:30.742375 11083 rpcz_store.cc:276] 0709 12:22:29.721054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.909111 (+188057us) service_pool.cc:224] Handling call
0709 12:22:29.918903 (+  9792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:30.083574 (+164671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.739926 (+656352us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54000df554. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:30.740120 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357150976}
I20260709 12:22:30.695340 16779 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:30.695899 16908 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:22:30.752132 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.752274 10977 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:30.752667 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 283681us
I20260709 12:22:30.768272 10899 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:30.770234 10899 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:30.675608 16897 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 12:22:30.751924 16862 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:22:30.773974 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.774235 16862 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:30.774682 16862 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:30.778587 16866 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:30.766661 16885 raft_consensus.cc:697] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:30.780949 16885 consensus_queue.cc:237] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.729604 16980 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:30.742561 16967 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:22:30.758430 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.798691 10901 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:30.817488 11002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:22:30.730103 16898 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:30.818166 11002 raft_consensus.cc:606] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:30.819591 16898 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:30.822363 16862 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:30.824119 11650 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:30.824605 16802 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.804580 16859 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:30.830615 16967 raft_consensus.cc:697] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:30.831581 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:30.844930 11085 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:30.832527 11051 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:30.766563 16975 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:30.805116 10901 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:30.787549 16971 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:30.744328 16941 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:30.871469 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 101292us
I20260709 12:22:30.831270 16696 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:30.824050 16938 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:30.804448 17003 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:22:30.867197 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 62153.6us
I20260709 12:22:30.840153 16959 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:30.884287 10901 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:30.867128 11051 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:30.893874 11085 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 14.
I20260709 12:22:30.893568 11622 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:30.861033 16975 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:30.873538 16716 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:30.818190 16990 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.881214 16938 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.898558 11051 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:30.873737 16896 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:30.901644 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:30.901873 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:30.903772 10933 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:30.903875 10928 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:30.906914 10935 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:22:30.911012 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:30.911195 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.893281 16531 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:30.901449 16975 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:30.928076 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:30.892468 17001 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:30.903095 16898 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:30.912586 16716 raft_consensus.cc:697] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:30.906960 16917 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:30.907438 16896 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.946978 10935 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:30.947369 10899 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:30.917240 16894 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:30.898427 17005 consensus_queue.cc:1059] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:22:30.911953 16938 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:30.920924 16862 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:30.952670 10928 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
W20260709 12:22:30.966282 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 130192us
I20260709 12:22:30.966800 10933 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
W20260709 12:22:30.955617 16963 consensus_meta.cc:287] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.002s
I20260709 12:22:30.962455 11624 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:30.963464 11051 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:30.973709 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:30.974932 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:30.949679 16898 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:30.977946 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.958909 16896 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:30.933525 16702 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:30.956996 17001 raft_consensus.cc:697] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:22:30.988512 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.960340 16531 raft_consensus.cc:697] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:31.021746 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:30.991529 10932 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:22:30.991815 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 184847us
I20260709 12:22:30.950491 16630 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:22:30.995308 11084 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: [12.12-13.13]
I20260709 12:22:30.962479 17003 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:31.002404 11004 raft_consensus.cc:1240] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:22:31.004813 10935 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:30.994794 17005 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:31.006690 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:31.024986 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:31.026129 11007 raft_consensus.cc:1240] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:30.991462 16898 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:31.031908 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:31.032099 11658 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:31.032819 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:22:31.038257 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.035068 11003 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:31.058552 11010 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 19: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:31.049592 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:31.055205 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60046 (request call id 3197) took 1603 ms. Trace:
I20260709 12:22:31.033440 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:31.059791 11077 rpcz_store.cc:276] 0709 12:22:29.451729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.534844 (+ 83115us) service_pool.cc:224] Handling call
0709 12:22:31.054999 (+1520155us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54000c26d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:31.055145 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3133419904}
I20260709 12:22:31.050710 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:30.991685 16894 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:31.034453 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:31.061474 11006 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:31.032897 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:31.032577 11005 raft_consensus.cc:2955] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 6 to 10, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:22:30.950101 16967 consensus_queue.cc:237] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:31.070709 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:31.071527 11009 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:22:31.073669 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:31.074331 11003 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:22:31.074631 11084 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
W20260709 12:22:31.074934 17004 log.cc:927] Time spent T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.141s	user 0.003s	sys 0.003s
W20260709 12:22:31.072753 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:31.031971 17008 log.cc:927] Time spent T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:22:31.035108 16583 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.077744 11080 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 20. Current term is 21. Ops: []
I20260709 12:22:30.979223 16963 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:31.040900 16802 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:31.077664 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.094282 11006 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:31.079710 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:31.085018 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:31.085978 10899 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:31.071588 16908 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.101414 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:31.102392 11009 raft_consensus.cc:2410] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:22:31.103670 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:31.075996 16835 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:31.104872 16835 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:31.106571 11004 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:22:31.107182 17014 log.cc:927] Time spent T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:22:31.078636 16894 raft_consensus.cc:697] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:31.114097 11624 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:31.113656 10977 leader_election.cc:336] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.513s (SENT)
W20260709 12:22:31.132812 10977 leader_election.cc:336] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.581s (SENT)
I20260709 12:22:31.132601 16894 consensus_queue.cc:237] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:31.133736 10977 leader_election.cc:336] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.618s (SENT)
W20260709 12:22:31.134636 10977 leader_election.cc:336] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.625s (SENT)
I20260709 12:22:31.088080 16583 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:31.136670 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2686) took 1077 ms. Trace:
W20260709 12:22:31.137400 17015 log.cc:927] Time spent T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:22:31.138803 16933 raft_consensus.cc:3055] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:31.139204 16933 raft_consensus.cc:740] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:31.140261 16990 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:31.114403 16696 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:31.115679 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:31.105859 16975 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:31.116163 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:31.114215 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:31.117808 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:31.118232 16531 consensus_queue.cc:237] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:31.127907 16941 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:31.128587 17001 consensus_queue.cc:237] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:31.135767 10977 leader_election.cc:336] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.729s (SENT)
I20260709 12:22:31.169433 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:31.169651 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:31.170053 10930 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:31.170934 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:31.171787 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:22:31.128619 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.137086 10934 rpcz_store.cc:276] 0709 12:22:30.059761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.059928 (+   167us) service_pool.cc:224] Handling call
0709 12:22:30.072521 (+ 12593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:30.365381 (+292860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.136428 (+771047us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b5400060754. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:31.136608 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672118144}
I20260709 12:22:31.174659 11081 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:31.146617 11006 raft_consensus.cc:1240] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:31.149555 11007 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 16.
I20260709 12:22:31.156708 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:22:31.165503 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 268245us
I20260709 12:22:31.028777 16716 consensus_queue.cc:237] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:31.178479 11622 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:31.168632 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:31.167073 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:22:31.195487 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 109612us
I20260709 12:22:31.195611 10936 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:31.172441 11009 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:31.184047 16933 consensus_queue.cc:260] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:31.185969 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:31.192091 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:22:31.192776 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 57033.2us
W20260709 12:22:31.204589 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.208494 11004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:22:31.173969 16696 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:31.145076 16908 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:31.212810 11006 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:22:31.223824 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 78257.1us
I20260709 12:22:31.193482 16990 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.225925 11051 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:31.238692 11051 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:31.233817 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:31.213590 16933 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:31.233075 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:31.263080 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:31.268078 11009 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
W20260709 12:22:31.298650 16906 consensus_meta.cc:287] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.611s	user 0.011s	sys 0.000s
I20260709 12:22:31.317139 10899 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:31.319010 10977 leader_election.cc:336] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.873s (SENT)
I20260709 12:22:31.319447 10977 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:31.223989 16917 consensus_queue.cc:1059] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:22:31.243242 16885 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:31.224545 16925 consensus_queue.cc:1059] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
W20260709 12:22:31.317978 16983 log.cc:927] Time spent T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:22:31.262085 16905 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:31.355624 10930 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:22:31.358302 10936 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:31.359684 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:31.368089 10932 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:22:31.368294 10929 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:31.244717 16990 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:31.287358 16630 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 12:22:31.322494 16709 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:31.341475 16895 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:31.299237 16906 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:31.361125 16907 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:31.380427 16885 raft_consensus.cc:697] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:31.390736 16981 consensus_queue.cc:1059] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:22:31.400946 16885 consensus_queue.cc:237] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:31.404305 16980 raft_consensus.cc:3055] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:31.404763 16980 raft_consensus.cc:740] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:22:31.406018 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.407377 10927 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:22:31.388195 16905 raft_consensus.cc:697] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:31.409868 16905 consensus_queue.cc:237] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:31.405532 16980 consensus_queue.cc:260] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:31.412681 10899 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:31.413544 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 94562.8us
W20260709 12:22:31.380944 16779 consensus_meta.cc:287] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.000s
W20260709 12:22:31.417649 10977 leader_election.cc:336] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.920s (SENT)
I20260709 12:22:31.418076 10977 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:31.419243 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:31.419914 11650 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:31.382541 16862 raft_consensus.cc:3055] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:31.420858 16862 raft_consensus.cc:740] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:31.421718 16862 consensus_queue.cc:260] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:31.422915 16862 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:31.386227 16917 raft_consensus.cc:3055] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:31.385731 16969 consensus_queue.cc:1059] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:22:31.424201 16917 raft_consensus.cc:740] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:22:31.425267 16563 consensus_meta.cc:287] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.846s	user 0.009s	sys 0.003s
I20260709 12:22:31.425058 16917 consensus_queue.cc:260] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:31.428764 11081 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: []
W20260709 12:22:31.432691 10977 leader_election.cc:336] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.951s (SENT)
I20260709 12:22:31.427912 16779 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:31.433693 10977 leader_election.cc:336] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.984s (SENT)
I20260709 12:22:31.434192 11657 raft_consensus.cc:2368] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18.
I20260709 12:22:31.436136 16779 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:31.436362 16969 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:31.440403 16969 raft_consensus.cc:3055] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:22:31.435595 10977 leader_election.cc:336] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 2.141s (SENT)
I20260709 12:22:31.440685 10927 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:22:31.386425 17020 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:31.441831 10977 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:31.444303 10899 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:31.444670 10929 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:31.449226 10899 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:31.451164 10899 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:31.440623 16971 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:31.441944 16969 raft_consensus.cc:740] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:31.425696 16563 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:31.452689 16709 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:31.458402 16941 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:31.457792 16696 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:31.437013 16859 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:22:31.454522 17020 raft_consensus.cc:697] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:31.477398 11010 raft_consensus.cc:1240] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:31.481060 16563 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:31.481885 17017 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:22:31.462486 16898 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:31.494445 16938 consensus_meta.cc:287] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.000s
I20260709 12:22:31.490415 16970 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:31.504634 10899 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:22:31.504890 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 303434us
I20260709 12:22:31.513746 11050 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:31.479741 16969 consensus_queue.cc:260] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:31.516721 16969 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:31.517156 11650 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:22:31.518013 16926 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:22:31.506569 16938 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:31.520534 16938 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:31.525434 11050 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:31.528055 16835 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:31.531198 16926 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:22:31.531764 16898 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:31.532486 17020 consensus_queue.cc:237] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:31.536193 10899 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:31.536620 17021 log.cc:927] Time spent T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.237s	user 0.000s	sys 0.003s
I20260709 12:22:31.540334 16963 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:31.545707 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.542366 11050 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:31.548280 16941 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:31.550357 16926 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:31.536410 16990 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:31.554699 11050 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:31.556905 10900 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:31.566085 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.570356 10899 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:31.578154 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 399719us
I20260709 12:22:31.577916 11050 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:31.584504 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:31.586961 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:31.587687 11003 raft_consensus.cc:2393] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 13: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:31.587687 11050 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:31.588608 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:31.543707 16908 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:31.593560 11004 raft_consensus.cc:606] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:31.566045 16969 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:31.581840 16835 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:31.596215 10899 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:31.565114 16971 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:31.581243 16926 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:31.601130 10900 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:31.554730 16896 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:31.593082 16630 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:22:31.610589 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.594770 16866 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:22:31.586660 16990 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:22:31.599380 16938 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:31.602694 16926 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:31.597772 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:31.623692 10899 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:31.599622 16908 consensus_queue.cc:1059] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:22:31.609745 16894 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:31.626062 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 217939us
I20260709 12:22:31.602596 16969 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:31.627132 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 250990us
I20260709 12:22:31.629346 10899 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:31.595316 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 481254us
I20260709 12:22:31.633948 10899 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:31.623222 16926 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:31.644531 16563 consensus_queue.cc:1059] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:31.609496 16802 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:22:31.637315 16970 consensus_queue.cc:1059] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:31.638782 10975 leader_election.cc:400] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18.
I20260709 12:22:31.640733 16967 consensus_queue.cc:1059] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 12:22:31.648851 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.650740 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:31.654006 11010 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:22:31.624325 16709 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:31.656066 11624 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:31.651304 10899 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:31.652423 10975 leader_election.cc:403] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:31.632874 16938 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:31.631971 16971 raft_consensus.cc:697] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:31.635917 16941 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:31.667908 10900 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:31.672351 10899 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:31.674542 11085 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 12:22:31.652770 16976 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:31.651243 17001 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:31.631026 16894 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:31.658980 16709 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:31.660838 16898 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:22:31.684435 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.686626 11010 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 18.
I20260709 12:22:31.688354 11624 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:31.690075 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 47688.8us
I20260709 12:22:31.677192 16963 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:31.682788 16938 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:31.692588 16970 raft_consensus.cc:3055] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:22:31.685542 16941 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:31.685712 16709 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:31.703100 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 64486.3us
I20260709 12:22:31.688023 17035 raft_consensus.cc:3055] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:22:31.715466 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.705756 16895 consensus_queue.cc:1059] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:22:31.706709 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:31.749464 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.750689 11010 raft_consensus.cc:1240] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 12. Current term is 13. Ops: []
W20260709 12:22:31.751160 17029 log.cc:927] Time spent T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 12:22:31.752243 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 84469.9us
I20260709 12:22:31.706214 10899 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:31.713759 17035 raft_consensus.cc:740] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:22:31.756467 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 50325.4us
W20260709 12:22:31.746222 17030 log.cc:927] Time spent T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:22:31.692183 16967 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18.
I20260709 12:22:31.686455 17020 consensus_queue.cc:1059] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:22:31.708954 16970 raft_consensus.cc:740] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:22:31.736169 17034 log.cc:927] Time spent T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:22:31.703833 16907 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:31.700415 17037 raft_consensus.cc:3055] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:31.757968 10899 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:31.760015 16963 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:31.738517 16971 consensus_queue.cc:237] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:31.776687 16967 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.777236 16967 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:31.768143 17033 log.cc:927] Time spent T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:22:31.768679 16975 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:31.779382 16967 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:31.773241 16970 consensus_queue.cc:260] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:31.780678 16894 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:31.775767 16989 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:31.752573 16959 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:31.781776 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.754550 16896 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:31.797669 11005 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:31.798286 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:31.798995 11008 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:31.802265 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:31.802491 11009 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:22:31.802930 11002 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:22:31.780613 16970 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:22:31.807801 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 49913.7us
I20260709 12:22:31.808602 10899 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:31.809221 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.809664 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:31.826735 10899 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:31.829089 10899 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:31.771018 16906 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:31.775192 17037 raft_consensus.cc:740] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:31.801879 16907 raft_consensus.cc:697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
W20260709 12:22:31.848639 17043 log.cc:927] Time spent T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:22:31.849602 17037 consensus_queue.cc:260] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:31.852229 16702 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:31.856110 16969 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:31.855871 16907 consensus_queue.cc:237] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:31.858218 16926 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:31.833130 17048 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:22:31.860853 16917 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:31.861708 16941 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:31.804647 16989 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:31.864426 16989 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:31.828966 16963 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:31.868770 10899 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:31.831327 17047 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:31.807082 16959 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:31.899034 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:31.899814 10929 raft_consensus.cc:2368] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18.
W20260709 12:22:31.900637 17042 log.cc:927] Time spent T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:22:31.902143 17038 log.cc:927] Time spent T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:22:31.905958 17041 log.cc:927] Time spent T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.071s	user 0.002s	sys 0.000s
I20260709 12:22:31.906944 16941 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:31.908039 16963 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.908545 16963 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:31.910543 16963 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:31.911212 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:31.912459 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:31.913209 10934 raft_consensus.cc:2393] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 14: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:31.913770 16938 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:31.913939 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:31.833343 17035 consensus_queue.cc:260] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:31.914670 10931 raft_consensus.cc:2393] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 14: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:31.915367 17001 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:22:31.922971 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:31.942000 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:31.889050 16936 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:22:31.944906 16926 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:31.947209 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:31.946153 17035 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:31.948161 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:31.948557 16583 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:31.949214 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:31.950603 16630 raft_consensus.cc:3055] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:31.951054 16630 raft_consensus.cc:740] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:31.951907 16835 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:31.920410 17031 consensus_queue.cc:1059] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:22:31.953361 16907 raft_consensus.cc:3055] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:31.953713 16907 raft_consensus.cc:740] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:31.954548 16907 consensus_queue.cc:260] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:31.955246 16709 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:31.956126 16907 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:31.957408 16709 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:31.958391 11650 raft_consensus.cc:1240] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:22:31.961745 17037 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:31.962850 11085 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:31.948882 10935 raft_consensus.cc:2368] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18.
I20260709 12:22:31.966092 16859 raft_consensus.cc:993] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:22:31.966761 16583 consensus_queue.cc:1059] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:31.967674 17050 raft_consensus.cc:3055] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:31.967924 16859 raft_consensus.cc:1081] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:22:31.968101 17050 raft_consensus.cc:740] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:31.968914 17050 consensus_queue.cc:260] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:31.951929 16630 consensus_queue.cc:260] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:31.970088 17050 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:31.970391 16630 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:31.972304 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:31.974159 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:31.974254 11083 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:22:31.977325 16980 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:31.977773 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:31.984071 17049 raft_consensus.cc:3055] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:31.984548 17049 raft_consensus.cc:740] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:31.985414 17049 consensus_queue.cc:260] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:31.986454 17049 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:31.987085 17057 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:22:31.982714 17028 raft_consensus.cc:3055] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:22:31.991801 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.995733 11007 raft_consensus.cc:1240] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:31.996748 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:32.001515 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:32.002238 11007 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:32.012749 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:32.013288 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:32.013949 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:32.015587 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:32.015785 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:32.016857 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:32.017441 11078 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:32.018602 11008 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:22:32.026046 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:32.026734 11078 raft_consensus.cc:1240] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:32.028383 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:32.029008 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:32.029327 11078 raft_consensus.cc:2410] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:22:32.031572 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:32.032263 10930 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:32.032639 11082 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:32.034281 10927 raft_consensus.cc:1240] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:32.035307 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:32.036083 11080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:22:32.036180 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:32.036378 17044 log.cc:927] Time spent T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.201s	user 0.002s	sys 0.000s
I20260709 12:22:32.036542 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:32.036917 10929 raft_consensus.cc:2376] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13. Re-sending same reply.
I20260709 12:22:32.038726 11076 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:22:32.038770 11080 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:32.039400 11080 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:32.041424 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:32.042122 11004 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:32.043028 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:32.043609 10934 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:31.988850 17028 raft_consensus.cc:740] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
W20260709 12:22:32.043968 17036 log.cc:927] Time spent T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.375s	user 0.003s	sys 0.003s
I20260709 12:22:32.045367 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:32.051230 16970 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:32.051906 10932 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:32.052408 11080 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:32.046695 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:32.052804 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:32.053362 10935 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:32.047995 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:32.016673 17031 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:32.048606 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:32.054601 17031 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:32.048650 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:32.055804 10933 raft_consensus.cc:2368] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 18. Current term is 19.
I20260709 12:22:32.056852 10933 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:22:32.057783 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:32.058451 10933 raft_consensus.cc:2393] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 21: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:32.059193 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:32.050961 10931 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:32.055187 10929 raft_consensus.cc:2368] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16.
I20260709 12:22:32.056852 10927 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:22:32.054203 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:32.062068 10935 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:32.064841 16926 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.065419 16926 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:32.054662 10928 raft_consensus.cc:2368] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 19. Current term is 20.
I20260709 12:22:32.067489 16926 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:32.073590 10930 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:22:32.046811 11002 raft_consensus.cc:2410] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:22:32.053933 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:31.966675 16917 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:32.075404 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:32.086445 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.087105 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:32.087764 10933 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:32.075724 10936 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:32.088690 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:32.076447 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:32.089385 10928 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
W20260709 12:22:32.089706 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.090262 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:32.091217 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:31.977231 16959 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:32.077198 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:32.093578 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:32.095745 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:32.096125 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:32.097865 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:32.098611 10931 raft_consensus.cc:2376] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21. Re-sending same reply.
I20260709 12:22:32.099498 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:32.084039 10974 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:32.084265 11625 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:32.077378 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:32.084808 11009 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:22:32.091372 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:32.106492 11078 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:32.085593 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:32.092020 11084 raft_consensus.cc:2393] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:32.091904 11081 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:22:32.107472 11081 pending_rounds.cc:85] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 7
I20260709 12:22:32.050856 17035 consensus_queue.cc:1059] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:32.056802 17031 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:32.094002 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:32.127802 11078 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:32.128291 10927 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:32.128834 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:32.129200 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:32.129916 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:32.130262 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:32.097925 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:32.130931 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:32.131523 11078 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
W20260709 12:22:32.132372 10834 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35608 (request call id 263) took 35913 ms (client timeout 15000 ms). Trace:
I20260709 12:22:32.132761 17032 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:32.133352 17032 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:32.102463 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:32.140245 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.140590 11077 raft_consensus.cc:2410] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:22:32.102851 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:32.104038 10931 raft_consensus.cc:2368] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 19. Current term is 20.
I20260709 12:22:32.142163 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:32.143409 10931 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:32.117610 17035 consensus_queue.cc:1243] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 1abf4b385a2b493ab83f593a1f8c9cd1 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:22:32.148133 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:32.103452 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:32.153640 11085 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 19: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:32.154492 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:32.155046 11085 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:32.107721 11081 pending_rounds.cc:107] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:22:32.156098 11081 raft_consensus.cc:2889] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:32.157404 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:32.158002 11081 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 14.
I20260709 12:22:32.158752 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:32.159250 11081 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:32.092621 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:32.161079 10936 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:32.162161 10936 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:32.082614 10934 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:32.165011 10934 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:22:32.165452 10936 raft_consensus.cc:1275] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:32.165894 11010 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
W20260709 12:22:32.132746 10834 rpcz_store.cc:269] 0709 12:21:56.219382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.236206 (+ 16824us) service_pool.cc:224] Handling call
0709 12:22:32.132261 (+35896055us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:27.191770 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:27.204871 (+ 13101us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:27.204928 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:22:27.204983 (+    55us) tablet.cc:662] Decoding operations
0709 12:22:27.218766 (+ 13783us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:27.218869 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:27.218896 (+    27us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:22:27.220249 (+  1353us) tablet.cc:701] Row locks acquired
0709 12:22:27.220313 (+    64us) write_op.cc:260] PREPARE: finished
0709 12:22:27.220508 (+   195us) write_op.cc:270] Start()
0709 12:22:27.220680 (+   172us) write_op.cc:276] Timestamp: P: 1783599747220435 usec, L: 0
0709 12:22:27.220704 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:22:27.221609 (+   905us) log.cc:844] Serialized 6314 byte log entry
0709 12:22:29.193128 (+1971519us) op_driver.cc:464] REPLICATION: finished
0709 12:22:29.655120 (+461992us) spinlock_profiling.cc:243] Waited 7.63 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bade560ac 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb4996ef0
0709 12:22:29.876331 (+221211us) write_op.cc:301] APPLY: starting
0709 12:22:29.876467 (+   136us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:30.133778 (+257311us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:30.141065 (+  7287us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:30.369741 (+228676us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:30.370093 (+   352us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=0,mrs_lookups=0
0709 12:22:30.370144 (+    51us) write_op.cc:312] APPLY: finished
0709 12:22:30.370584 (+   440us) log.cc:844] Serialized 148 byte log entry
0709 12:22:30.506959 (+136375us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:30.507152 (+   193us) write_op.cc:454] Released schema lock
0709 12:22:30.513956 (+  6804us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:30.580099 (+ 66143us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:30.580138 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":213524,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":672718,"apply.run_cpu_time_us":37142,"apply.run_wall_time_us":672599,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70911,"num_ops":16,"prepare.queue_time_us":532844,"prepare.run_cpu_time_us":32855,"prepare.run_wall_time_us":299176,"raft.queue_time_us":213270,"raft.run_cpu_time_us":49094,"raft.run_wall_time_us":683091,"replication_time_us":1972215,"spinlock_wait_cycles":17551104,"thread_start_us":1664179,"threads_started":5,"wal-append.queue_time_us":457593,"wal-append.run_cpu_time_us":36804,"wal-append.run_wall_time_us":3730406}]]}
I20260709 12:22:32.116065 16583 consensus_queue.cc:1059] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:32.173144 16583 consensus_queue.cc:1243] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 1abf4b385a2b493ab83f593a1f8c9cd1 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:22:32.116588 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:32.093675 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 84202.2us
I20260709 12:22:32.141198 11076 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:32.107973 11080 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:32.110599 11650 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:32.117767 16981 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:32.119580 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:32.052062 17028 consensus_queue.cc:260] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:32.125422 10829 catalog_manager.cc:5697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 14 to 20. New cstate: current_term: 20 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.108001 16779 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:32.118546 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:32.134989 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:32.177704 10829 catalog_manager.cc:5697] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.175730 10900 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:32.135516 10929 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:32.102154 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:32.148528 10928 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:32.149411 17032 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:32.150549 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:32.151239 11007 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:22:32.130954 10927 raft_consensus.cc:2368] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13.
I20260709 12:22:32.093695 16917 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:32.150465 11051 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:32.108268 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 43727.1us
I20260709 12:22:32.107059 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:32.174969 10936 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:32.176296 11084 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 15: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:32.177567 16583 raft_consensus.cc:3055] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:22:32.176983 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.135327 10933 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:22:32.182391 10935 raft_consensus.cc:2393] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 14: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:32.194952 10928 raft_consensus.cc:1240] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:32.186789 10977 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:32.187381 11076 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:22:32.195827 11076 pending_rounds.cc:85] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 9
I20260709 12:22:32.196097 11076 pending_rounds.cc:107] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:22:32.196321 11076 raft_consensus.cc:2889] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:32.189704 10930 raft_consensus.cc:1240] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:22:32.166118 10934 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:32.190217 11051 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:32.198626 11081 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:32.177086 11085 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 14.
I20260709 12:22:32.199610 11078 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:32.199877 10929 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:32.176179 16936 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.175705 16981 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.203925 11084 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:22:32.202380 10932 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:32.193850 10829 catalog_manager.cc:5697] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:22:32.181829 17001 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:32.208647 11050 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:32.209561 11079 raft_consensus.cc:1813] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Handling vote request from an unknown peer 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:32.206900 11076 raft_consensus.cc:1240] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:32.210019 11079 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:32.193501 16583 raft_consensus.cc:740] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:32.214988 16583 consensus_queue.cc:260] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:32.208195 16967 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:32.216035 16967 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.216521 16967 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:32.220585 16802 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:32.212448 16989 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:22:32.224505 16709 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:32.225062 16862 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:32.200565 17032 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:32.226850 16917 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:32.203094 16925 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:22:32.230101 17028 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:32.207221 10829 catalog_manager.cc:5697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 13 to 14, leader changed from 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 14 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:32.235353 10977 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:32.235666 11050 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:32.211946 11051 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:32.258806 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:32.238874 11081 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:22:32.205178 16630 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:32.264132 16563 consensus_queue.cc:1059] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:32.265056 16651 raft_consensus.cc:3055] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:32.265553 16651 raft_consensus.cc:740] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:32.266368 16651 consensus_queue.cc:260] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:32.267547 16651 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:32.216218 16583 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:32.239523 16702 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:22:32.250113 17032 raft_consensus.cc:697] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:32.209060 16936 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:32.244674 16709 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:32.301466 16709 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:32.184204 17050 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:22:32.240259 17001 raft_consensus.cc:697] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:32.192770 16970 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:22:32.245394 16980 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:22:32.210817 16981 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:32.260003 10977 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:32.264307 17037 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:22:32.272475 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 60647.5us
I20260709 12:22:32.278030 11079 raft_consensus.cc:2410] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:22:32.286983 11076 raft_consensus.cc:1217] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Deduplicated request from leader. Original: 10.6->[11.7-11.7]   Dedup: 11.7->[]
I20260709 12:22:32.314888 11076 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:22:32.241528 16862 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.287775 16896 consensus_queue.cc:1059] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:32.289027 16894 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:22:32.328003 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 68092.2us
I20260709 12:22:32.285769 16989 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:32.328820 10977 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:32.329056 11010 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:22:32.285089 16917 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:32.303059 16936 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:32.305445 10931 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:32.308147 11007 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:22:32.315747 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:32.334475 11009 raft_consensus.cc:2393] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 13: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:32.323072 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:32.335170 10977 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:32.326711 11085 raft_consensus.cc:1240] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:32.294180 11078 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 18.
I20260709 12:22:32.294653 11003 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:22:32.336879 11003 pending_rounds.cc:85] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 10
I20260709 12:22:32.337129 11003 pending_rounds.cc:107] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:22:32.277904 16906 consensus_queue.cc:1059] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:22:32.335950 11002 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:32.337399 11003 raft_consensus.cc:2889] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:32.338289 10977 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:32.337878 10829 catalog_manager.cc:5697] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 12 to 15, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 15 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:32.322938 16862 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:32.356940 10829 catalog_manager.cc:5697] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:22:32.339367 17001 consensus_queue.cc:237] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:32.332129 16917 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.363550 10829 catalog_manager.cc:5697] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 12 to 14, leader changed from 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 14 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:32.361385 16702 raft_consensus.cc:3055] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:32.366560 16917 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:32.366798 16702 raft_consensus.cc:740] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:32.367818 16702 consensus_queue.cc:260] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:32.369038 16702 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:32.370021 17032 consensus_queue.cc:237] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:32.373993 16696 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:32.374410 10977 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:32.375631 16709 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:32.377151 17053 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:32.379011 10901 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:32.379789 16936 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:32.380327 17035 raft_consensus.cc:3055] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:32.380688 17035 raft_consensus.cc:740] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:32.381579 16936 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:32.381446 17035 consensus_queue.cc:260] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:32.381973 16936 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.382328 16936 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:32.382632 17035 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:32.383929 16802 consensus_queue.cc:1175] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9e8170bbe8244e40a2b2e5011e69b697" responder_term: 16 status { last_received { term: 16 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 16 index: 10 } }
I20260709 12:22:32.385288 10977 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:32.385999 16895 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:32.386699 16895 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:32.387339 11085 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:32.339318 17050 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:32.387532 10977 leader_election.cc:400] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 19. Current term is 20.
I20260709 12:22:32.340880 16970 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:32.389652 10977 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:32.390158 17046 consensus_queue.cc:1059] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:32.390941 10977 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:32.375998 10829 catalog_manager.cc:5697] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 8 to 13, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 13 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.393599 10829 catalog_manager.cc:5697] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.411067 10977 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:32.331125 16563 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:32.413792 10977 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:32.414932 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 86091.8us
I20260709 12:22:32.414364 17037 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:32.420532 10829 catalog_manager.cc:5697] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 8 to 15, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 15 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:22:32.428814 10977 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:32.391851 17046 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:22:32.392891 16989 raft_consensus.cc:697] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:32.427646 11051 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:32.433362 10977 leader_election.cc:400] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13.
I20260709 12:22:32.413823 16895 raft_consensus.cc:3055] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:32.436380 16895 raft_consensus.cc:740] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:32.431612 16563 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:32.440126 10829 catalog_manager.cc:5697] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 6 to 10, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 10 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:32.441893 17060 log.cc:927] Time spent T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:22:32.442732 16862 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:32.445724 16862 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:32.449926 11651 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:32.451980 16696 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:32.456624 16917 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:32.420899 17050 consensus_queue.cc:1059] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:22:32.441885 10829 catalog_manager.cc:5697] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 17 to 18, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 18 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:22:32.463133 17050 raft_consensus.cc:3055] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:32.463482 10829 catalog_manager.cc:5697] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:22:32.464941 10829 catalog_manager.cc:5697] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 11 to 17, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 17 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:22:32.414858 16975 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:32.469360 16967 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:32.473542 10977 leader_election.cc:403] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:22:32.476686 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:32.463539 17050 raft_consensus.cc:740] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:32.484093 10977 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:32.489984 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:32.490634 10934 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:32.414809 16859 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 12:22:32.471730 16967 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:32.496738 11083 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:32.472533 16970 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:32.429857 16630 raft_consensus.cc:697] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:32.466902 10829 catalog_manager.cc:5697] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 11 to 16, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 16 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:32.497440 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 222984us
I20260709 12:22:32.512843 11050 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:32.500965 16563 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.479223 16651 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13.
I20260709 12:22:32.529120 10934 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:32.499758 17052 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:32.536615 17075 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:32.500763 17046 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.500679 17037 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:32.539788 10829 catalog_manager.cc:5697] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 11 to 12, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 12 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:32.545289 10829 catalog_manager.cc:5697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 11 to 15, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 15 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:32.541378 17046 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:32.551321 17046 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:32.553544 16936 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:32.547029 17052 raft_consensus.cc:697] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:32.558827 10829 catalog_manager.cc:5697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:32.559904 11008 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:22:32.562779 11008 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:22:32.571146 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:32.572109 10934 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:22:32.575222 11010 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 13. (term mismatch)
I20260709 12:22:32.575637 11010 pending_rounds.cc:85] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 12
I20260709 12:22:32.575883 11010 pending_rounds.cc:107] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 12:22:32.576110 11010 raft_consensus.cc:2889] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:32.544409 17037 raft_consensus.cc:697] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:32.534495 16563 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:32.546991 16906 consensus_queue.cc:1243] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:22:32.572566 10829 catalog_manager.cc:5697] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 13 to 16, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 16 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.543409 17075 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:32.594624 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:32.595271 11009 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:32.581290 16907 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:22:32.600390 10829 catalog_manager.cc:5697] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 11 to 13, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 13 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:22:32.616035 11009 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:32.617671 10901 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:32.560787 17050 consensus_queue.cc:260] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:32.546437 16989 consensus_queue.cc:237] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:32.563764 17052 consensus_queue.cc:237] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:32.633955 17062 log.cc:927] Time spent T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.194s	user 0.003s	sys 0.000s
I20260709 12:22:32.647150 17048 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:32.647727 17048 raft_consensus.cc:697] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:32.648584 17048 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:32.615689 16917 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:32.590495 16630 consensus_queue.cc:237] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:32.659957 17028 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:32.641448 16936 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:32.692157 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:32.706784 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 89207.8us
I20260709 12:22:32.626333 17037 consensus_queue.cc:237] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:32.743643 16980 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.779067 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:32.779970 10934 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:32.776368 16980 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:32.793969 16980 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:32.795923 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:32.846916 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:22:32.860828 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.830646 17075 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:32.833725 16563 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:32.879631 16936 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:22:32.941943 17084 log.cc:927] Time spent T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:22:32.925709 16936 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:32.957861 16981 consensus_meta.cc:287] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.635s	user 0.002s	sys 0.007s
I20260709 12:22:32.958698 16981 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:32.992229 11008 raft_consensus.cc:606] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:32.994340 11003 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:32.996229 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:32.998473 16936 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:33.016410 16696 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:33.017557 16696 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:33.019730 16696 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:33.020387 16936 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.020983 16936 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:33.023734 16936 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:33.024362 16936 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:33.024471 16967 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.025157 16967 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:33.026424 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:33.027189 16967 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:33.027410 11008 raft_consensus.cc:2410] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 12:22:33.029642 11657 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:33.030743 11008 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:22:33.031422 11008 raft_consensus.cc:606] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:33.032068 11008 raft_consensus.cc:614] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:33.032346 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:33.032771 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:33.033435 10936 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:33.036576 17037 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:33.040828 11011 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:22:33.041793 11011 raft_consensus.cc:606] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:33.042274 11011 raft_consensus.cc:614] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:33.060949 17092 consensus_queue.cc:1059] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:33.062070 17092 raft_consensus.cc:3055] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:33.062433 17092 raft_consensus.cc:740] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:22:33.067595 17068 log.cc:927] Time spent T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.627s	user 0.014s	sys 0.031s
I20260709 12:22:33.072872 16959 raft_consensus.cc:3055] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:33.073498 16959 raft_consensus.cc:740] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:33.074390 16959 consensus_queue.cc:260] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:33.077543 17066 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.078223 17066 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:33.082204 17050 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:33.089916 17032 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.090597 17032 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:33.052704  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 12:22:33.094187 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 581394us
W20260709 12:22:33.078228 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.097995 11004 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:33.105063 11050 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:33.106046 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 678413us
I20260709 12:22:33.106948 11051 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:33.109606  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:33.024904 16936 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:33.049850 17037 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.142735 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:33.131824 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 3232) took 1013 ms. Trace:
I20260709 12:22:33.063328 17092 consensus_queue.cc:260] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:33.125100 17069 log.cc:927] Time spent T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:22:33.143599 11077 rpcz_store.cc:276] 0709 12:22:32.117941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.182367 (+ 64426us) service_pool.cc:224] Handling call
0709 12:22:32.184357 (+  1990us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:32.192840 (+  8483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:32.192871 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:32.193359 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 12:22:32.337080 (+143721us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:32.412602 (+ 75522us) log.cc:844] Serialized 14 byte log entry
0709 12:22:32.633386 (+220784us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:22:33.070209 (+436823us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b18002542c0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9baddedc0a 00007f9bb752d219 00007f9bade75a40 00007f9bade704e4 00007f9bade70455 00007f9bb0f58060 00007f9bb0f6a716 00007f9bb0f7b287 00007f9bb0f7b208
0709 12:22:33.131475 (+ 61266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:33.131556 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:33.131602 (+    46us) raft_consensus.cc:1685] finished
0709 12:22:33.131615 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:33.131756 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63776,"prepare.queue_time_us":77715,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":663527,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":15646,"spinlock_wait_cycles":116299264,"thread_start_us":183492,"threads_started":2,"wal-append.queue_time_us":205927}
I20260709 12:22:33.114547 17049 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.147233 11051 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:33.149415 16862 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:22:33.146473 11050 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:33.151763 17064 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:33.127455 17073 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:33.159333 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 47597.8us
W20260709 12:22:33.162477 16970 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.009s	sys 0.029s
W20260709 12:22:33.163007 16970 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.009s	sys 0.030s
I20260709 12:22:33.163362 16970 raft_consensus.cc:697] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:33.164467 16970 consensus_queue.cc:237] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:33.143738 17070 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:33.141017 17048 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:22:33.172335 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:33.172515 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:33.172017 11004 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 12:22:33.130820 17037 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:33.172878 16630 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:33.173141 11009 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:22:33.195055 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:33.195760 17032 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:33.196182 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:33.157055 17049 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:33.196779 11009 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:33.173458 16862 raft_consensus.cc:697] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:33.161762 17092 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:33.205770 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:33.206491 11076 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 11.
I20260709 12:22:33.176951 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:33.253034 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:22:33.253587 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.181099 11002 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:33.192235 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:33.175220 11011 raft_consensus.cc:1275] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:33.199220 16862 consensus_queue.cc:237] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:33.250973 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:33.256851 11076 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:33.174075 11004 pending_rounds.cc:85] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 11
W20260709 12:22:33.967517 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 286994us
W20260709 12:22:36.109125 10899 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.67:40209 timed out after 1.578s (SENT) [suppressed 10 similar messages]
I20260709 12:22:35.071568 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3196) took 2414 ms. Trace:
I20260709 12:22:36.113253 10928 rpcz_store.cc:276] 0709 12:22:32.656940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.658421 (+  1481us) service_pool.cc:224] Handling call
0709 12:22:32.658720 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:32.975342 (+316622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:32.975376 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:32.976309 (+   933us) log.cc:844] Serialized 26 byte log entry
0709 12:22:33.041351 (+ 65042us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:22:33.053444 (+ 12093us) log.cc:844] Serialized 14 byte log entry
0709 12:22:33.053878 (+   434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:33.053951 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:33.079028 (+ 25077us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b4800002958. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb5e89aa1 00007f9bb5e80b37 00007f9bb5e809ca 00007f9bb5f7826f 00007f9bb5f77f37 00007f9bb5f8c55c 00007f9bb5f8c508 00007f9bb5f8c488 00007f9bb5f8c443 00007f9bb5f8b6ec 00007f9bb4eb5a96
0709 12:22:33.588645 (+509617us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b18002d9280. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:22:35.071325 (+1482680us) raft_consensus.cc:1685] finished
0709 12:22:35.071349 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:35.071512 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13071,"prepare.queue_time_us":11921,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":9821,"raft.queue_time_us":86169,"raft.run_cpu_time_us":20511,"raft.run_wall_time_us":382906,"spinlock_wait_cycles":34233472,"thread_start_us":355560,"threads_started":2,"wal-append.queue_time_us":117297,"wal-append.run_cpu_time_us":1868,"wal-append.run_wall_time_us":1004805}
W20260709 12:22:35.106196 10975 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.008s	sys 0.012s
W20260709 12:22:36.122525 10975 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.738s	user 0.008s	sys 0.012s
W20260709 12:22:35.022603 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.576296 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:36.175742 10935 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
W20260709 12:22:36.176651 10935 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 3202) took 2644 ms (client timeout 1770 ms). Trace:
W20260709 12:22:36.177093 10935 rpcz_store.cc:269] 0709 12:22:33.532501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.575937 (+1043436us) service_pool.cc:224] Handling call
0709 12:22:36.176468 (+1600531us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:35.830363 11004 pending_rounds.cc:107] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 19.12
W20260709 12:22:34.995246 11009 consensus_meta.cc:287] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 1.798s	user 0.017s	sys 0.018s
I20260709 12:22:36.178853 11004 raft_consensus.cc:2889] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:36.179075 11009 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
W20260709 12:22:36.179994 11009 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2845) took 3004 ms (client timeout 1683 ms). Trace:
W20260709 12:22:35.064833 11049 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.815s	user 0.034s	sys 0.052s
I20260709 12:22:34.031994 11008 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:33.589422 11002 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:22:34.800714 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.199460 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2850) took 3022 ms. Trace:
I20260709 12:22:34.801749 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:36.208160 11002 rpcz_store.cc:276] 0709 12:22:33.176585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:33.588909 (+412324us) service_pool.cc:224] Handling call
0709 12:22:33.589208 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:36.198868 (+2609660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.199293 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:36.209203 11079 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:22:34.933718 11077 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 3463) took 1742 ms (client timeout 2189 ms). Trace:
I20260709 12:22:36.211318 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3540) took 2220 ms. Trace:
W20260709 12:22:35.013414 11082 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.858s	user 0.063s	sys 0.030s
W20260709 12:22:36.217538 11082 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.062s	user 0.065s	sys 0.030s
I20260709 12:22:34.799309 11081 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:36.220415 11081 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3474) took 1421 ms. Trace:
I20260709 12:22:36.220832 11081 rpcz_store.cc:276] 0709 12:22:34.798565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.798737 (+   172us) service_pool.cc:224] Handling call
0709 12:22:34.799106 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:36.219768 (+1420662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.220169 (+   401us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:34.798650 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:35.067956 11106 debug-util.cc:398] Leaking SignalData structure 0x7b08003656a0 after lost signal to thread 9744
W20260709 12:22:33.460342 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 211829us
W20260709 12:22:34.807989 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:35.883378 10902 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.384s	user 0.010s	sys 0.021s
W20260709 12:22:36.242238 10902 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.743s	user 0.010s	sys 0.022s
I20260709 12:22:35.906780 10936 raft_consensus.cc:2410] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:22:34.810638 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:33.540349 16630 raft_consensus.cc:697] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:33.254594 16702 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.273620 16702 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.274124 16630 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:34.069383 16862 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.013s	sys 0.000s
I20260709 12:22:33.190084 16895 consensus_queue.cc:260] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.283644 16895 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:22:36.280617 16862 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.723s	user 0.013s	sys 0.003s
I20260709 12:22:33.379962 16907 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:36.289140 16907 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:33.177522 16936 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:33.526443 16938 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:36.295253 16938 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:34.050904 16963 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.992751 16967 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:35.062268 16969 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.879758 16970 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:33.180347 16981 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:33.524928 17001 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:36.332055 16981 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.332870 16981 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.332984 17001 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:33.555774 17047 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:33.534272 17048 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:33.198329 17049 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:33.989792 17050 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.342260 17050 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:33.314185 17063 log.cc:927] Time spent T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.870s	user 0.009s	sys 0.013s
W20260709 12:22:36.359751 10829 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35614 (request call id 247) took 13514 ms (client timeout 15000 ms). Trace:
W20260709 12:22:35.082805 17064 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.747s	user 0.009s	sys 0.009s
I20260709 12:22:33.255183 17066 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:33.170883 17070 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:35.059337 17077 log.cc:927] Time spent T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 2.462s	user 0.031s	sys 0.014s
I20260709 12:22:36.370913 10932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3190) took 3884 ms. Trace:
I20260709 12:22:34.939075 17075 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:35.069519 17078 log.cc:927] Time spent T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 2.473s	user 0.039s	sys 0.036s
I20260709 12:22:36.377295 10929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3192) took 3889 ms. Trace:
I20260709 12:22:33.556023 17092 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.377795 10929 rpcz_store.cc:276] 0709 12:22:32.487733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.487882 (+   149us) service_pool.cc:224] Handling call
0709 12:22:32.488273 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:32.494323 (+  6050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:32.494353 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:32.494851 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 12:22:32.589334 (+ 94483us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:32.652760 (+ 63426us) log.cc:844] Serialized 14 byte log entry
0709 12:22:32.665919 (+ 13159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.666000 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:34.959712 (+2293712us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b180005f1a0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade73522 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:22:35.068943 (+109231us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:22:36.376695 (+1307752us) raft_consensus.cc:1685] finished
0709 12:22:36.376750 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.377052 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18910,"prepare.queue_time_us":135278,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":95259,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":34361,"spinlock_wait_cycles":12716288,"thread_start_us":108800,"threads_started":3,"wal-append.queue_time_us":64884}
I20260709 12:22:36.379485 17092 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.371378 10932 rpcz_store.cc:276] 0709 12:22:32.486298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.486458 (+   160us) service_pool.cc:224] Handling call
0709 12:22:32.515629 (+ 29171us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:32.515911 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:32.515940 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:32.531942 (+ 16002us) log.cc:844] Serialized 26 byte log entry
0709 12:22:32.586736 (+ 54794us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:32.741462 (+154726us) log.cc:844] Serialized 14 byte log entry
0709 12:22:32.763363 (+ 21901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.763444 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:33.066174 (+302730us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b180030c4c0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:22:35.058675 (+1992501us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:22:36.370387 (+1311712us) raft_consensus.cc:1685] finished
0709 12:22:36.370426 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.370684 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21587,"prepare.queue_time_us":133810,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":1500,"raft.queue_time_us":29871,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":125,"spinlock_wait_cycles":16582656,"thread_start_us":168514,"threads_started":2,"wal-append.queue_time_us":53951}
W20260709 12:22:33.302920 17099 log.cc:927] Time spent T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.173s	user 0.006s	sys 0.000s
W20260709 12:22:33.307682 17098 log.cc:927] Time spent T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.192s	user 0.000s	sys 0.006s
I20260709 12:22:33.990531 17105 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:36.386963 17105 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:33.308317 17102 log.cc:927] Time spent T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.115s	user 0.000s	sys 0.009s
W20260709 12:22:33.393517 17110 log.cc:927] Time spent T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:22:33.549129 17116 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 12:22:33.566766 17117 log.cc:927] Time spent T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:22:34.985172 17130 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:33.974109 17131 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:33.971081 17134 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:33.974004 17136 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:36.397178 17134 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.398263 17136 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:34.809813 17137 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:36.400570 17131 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.401285 17137 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.404089 17137 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:36.405323 11005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3538) took 3221 ms. Trace:
I20260709 12:22:36.405766 11005 rpcz_store.cc:276] 0709 12:22:33.184054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.904316 (+2720262us) service_pool.cc:224] Handling call
0709 12:22:35.904612 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:36.402667 (+498055us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:36.402721 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:36.402763 (+    42us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:22:36.402795 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.404842 (+  2047us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b5400473e54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:36.404893 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.405099 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1144634112}
I20260709 12:22:36.407388 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:34.811079 17138 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.373450 17075 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.409619 17138 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:34.804440 17141 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.412417 17141 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.414935 17141 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:34.813033 17142 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.416258 17142 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:34.817739 17144 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:36.419358 17144 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:34.936781 17145 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:35.022817 17146 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.422166 17145 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.422428 17146 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.425136 17146 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:35.956140 10974 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.151s	user 0.009s	sys 0.013s
W20260709 12:22:36.425932 10974 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.622s	user 0.010s	sys 0.013s
I20260709 12:22:35.958946 17149 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:22:35.962463 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 2.81492e+06us
W20260709 12:22:35.982728 11007 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.781s	user 0.026s	sys 0.030s
I20260709 12:22:36.003814 17150 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.426838 17149 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.427513 17150 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.004747 17083 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.005348 17151 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.003695 17090 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:36.017969 11010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41098 (request call id 512) took 2809 ms. Trace:
I20260709 12:22:36.054379 11011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2842) took 2879 ms. Trace:
I20260709 12:22:36.055140 17140 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.065208 16959 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:36.086694 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 2.896e+06us
W20260709 12:22:36.094431 11032 debug-util.cc:398] Leaking SignalData structure 0x7b0800329d00 after lost signal to thread 9744
I20260709 12:22:36.098639 11006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3539) took 2105 ms. Trace:
I20260709 12:22:33.178246  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:36.130975 17153 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:36.132839 16802 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:36.141004 16894 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:36.152500 10899 leader_election.cc:336] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Timed out: RequestConsensusVote RPC to 127.9.131.67:40209 timed out after 1.607s (SENT)
I20260709 12:22:36.180204 11004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2838) took 3010 ms. Trace:
W20260709 12:22:36.180742 11009 rpcz_store.cc:269] 0709 12:22:33.175277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:33.195974 (+ 20697us) service_pool.cc:224] Handling call
0709 12:22:36.179828 (+2983854us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:36.183441 17157 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:36.183740 17156 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:36.187479 11049 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.938s	user 0.037s	sys 0.052s
I20260709 12:22:36.195379 17032 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:36.200001 11076 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:34.802896 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:34.939105 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.509290 17149 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:36.509580 11083 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 3465) took 3317 ms (client timeout 1525 ms). Trace:
I20260709 12:22:36.213050 11002 rpcz_store.cc:276] 0709 12:22:33.991256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.209915 (+2218659us) service_pool.cc:224] Handling call
0709 12:22:36.210553 (+   638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:36.210930 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:36.210961 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:36.211023 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:36.211067 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.211116 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.211235 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:36.510967 17136 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.509990 11006 rpcz_store.cc:276] 0709 12:22:33.990975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.044932 (+2053957us) service_pool.cc:224] Handling call
0709 12:22:36.045491 (+   559us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:36.046115 (+   624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:36.046142 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:36.047005 (+   863us) log.cc:844] Serialized 26 byte log entry
0709 12:22:36.096012 (+ 49007us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:36.096051 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.096136 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:36.096198 (+    62us) raft_consensus.cc:1685] finished
0709 12:22:36.096208 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.096346 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1660,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":165,"thread_start_us":48516,"threads_started":1,"wal-append.queue_time_us":45909}
I20260709 12:22:36.222478 17147 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:36.212707 11077 rpcz_store.cc:269] 0709 12:22:33.191083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:33.191954 (+   871us) service_pool.cc:224] Handling call
0709 12:22:34.933649 (+1741695us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:36.229694 11084 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:36.229012 10832 catalog_manager.cc:5697] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 14 to 16, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 16 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.512451 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:36.512966 11084 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 3473) took 1714 ms (client timeout 1799 ms). Trace:
I20260709 12:22:36.513291 17137 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:36.234493 11106 debug-util.cc:398] Leaking SignalData structure 0x7b080025a3c0 after lost signal to thread 10868
I20260709 12:22:36.238385 11008 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:22:36.245398 11079 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:22:36.248289 16941 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:36.514576 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.253404 17111 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.513234 11006 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
W20260709 12:22:36.515265 11008 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2846) took 3339 ms (client timeout 1683 ms). Trace:
W20260709 12:22:36.252800 10936 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 3201) took 3110 ms (client timeout 3355 ms). Trace:
I20260709 12:22:36.260221 16696 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.254074 16709 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:22:36.515700 11008 rpcz_store.cc:269] 0709 12:22:33.175547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:33.252760 (+ 77213us) service_pool.cc:224] Handling call
0709 12:22:36.515170 (+3262410us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:36.280565 17160 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.299889 11650 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:22:36.300990 16963 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.303000 16907 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.303999 16938 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.516347 16709 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:36.517462 11650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59398 (request call id 562) took 1949 ms (client timeout 1833 ms). Trace:
I20260709 12:22:36.516727 17160 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.516148 16696 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:36.518567 11106 debug-util.cc:398] Leaking SignalData structure 0x7b08002dc480 after lost signal to thread 10960
I20260709 12:22:36.518828 16709 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.308373 17158 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:36.295632 16702 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:36.519654 17158 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.514431 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 3477) took 1713 ms. Trace:
I20260709 12:22:36.312186 16970 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.325795 17161 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:36.521813 17158 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.324653 17164 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.522403 17158 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:36.522285 17161 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.522590 17164 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.523252 17158 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.518724 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:33.364974 17037 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:36.307448 16969 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.336870 17001 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.366000 17070 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:36.372352 17050 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.521800 16963 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.527596 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:36.528973 11008 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:36.530004 16969 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:36.515954 17146 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:36.530864 11106 debug-util.cc:398] Leaking SignalData structure 0x7b08002dc260 after lost signal to thread 11035
W20260709 12:22:36.531208 11106 debug-util.cc:398] Leaking SignalData structure 0x7b08002dc1a0 after lost signal to thread 11036
I20260709 12:22:36.510569 17075 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:36.363708 17064 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.028s	user 0.011s	sys 0.011s
I20260709 12:22:36.512202 16981 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.532251 17064 raft_consensus.cc:697] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:36.385731 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 3233) took 4251 ms. Trace:
I20260709 12:22:36.393925 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:22:36.532683 11106 debug-util.cc:398] Leaking SignalData structure 0x7b080035cde0 after lost signal to thread 11109
W20260709 12:22:36.533125 11106 debug-util.cc:398] Leaking SignalData structure 0x7b08003c5880 after lost signal to thread 11110
I20260709 12:22:36.533371 11654 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
W20260709 12:22:36.534693 11106 debug-util.cc:398] Leaking SignalData structure 0x7b080033ffc0 after lost signal to thread 11683
I20260709 12:22:36.395478 17130 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.535308 11004 rpcz_store.cc:276] 0709 12:22:33.170344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:33.171327 (+   983us) service_pool.cc:224] Handling call
0709 12:22:33.171661 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:36.179825 (+3008164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.180146 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:36.512295 17147 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.535022 17064 consensus_queue.cc:237] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.537878 17153 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.538786 17147 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:36.527617 17037 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.539472 17130 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.541128 17160 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.533010 11082 rpcz_store.cc:276] 0709 12:22:32.134160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.190111 (+ 55951us) service_pool.cc:224] Handling call
0709 12:22:32.207833 (+ 17722us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:32.224049 (+ 16216us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:22:32.252533 (+ 28484us) log.cc:844] Serialized 14 byte log entry
0709 12:22:33.154182 (+901649us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:33.154858 (+   676us) log.cc:844] Serialized 26 byte log entry
0709 12:22:33.155004 (+   146us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:22:33.196437 (+ 41433us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:22:36.218094 (+3021657us) log.cc:844] Serialized 14 byte log entry
0709 12:22:36.218525 (+   431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.218646 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:36.385396 (+166750us) raft_consensus.cc:1685] finished
0709 12:22:36.385419 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.385614 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":656345,"prepare.queue_time_us":33713,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":64,"raft.queue_time_us":666580,"raft.run_cpu_time_us":394,"raft.run_wall_time_us":20350,"spinlock_wait_cycles":71497472,"thread_start_us":3306835,"threads_started":3,"wal-append.queue_time_us":191377}
I20260709 12:22:36.507413 17105 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:36.453974 11005 raft_consensus.cc:2393] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 17: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:22:36.466313 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 186231us
I20260709 12:22:36.511425 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:36.516578 16941 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.542654 11002 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:36.545032 16941 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:36.513983 11084 rpcz_store.cc:269] 0709 12:22:34.798188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.798353 (+   165us) service_pool.cc:224] Handling call
0709 12:22:36.512842 (+1714489us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:36.514719 17049 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:36.540261 17153 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.305095 16967 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.546056 16802 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.546581 16802 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:36.547832 16967 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:36.517863 11650 rpcz_store.cc:269] 0709 12:22:34.568466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.810223 (+241757us) service_pool.cc:224] Handling call
0709 12:22:36.517248 (+1707025us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b54004df8d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:36.517372 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84084992}
I20260709 12:22:36.549469 17037 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.550233 17151 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.525080 17164 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.552595 17160 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.553440 17160 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.545974 17049 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.556264 17156 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.558638 17156 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:36.559114 17049 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:36.560341 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:36.562673 11076 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 3476) took 1762 ms (client timeout 1597 ms). Trace:
I20260709 12:22:36.563257 16702 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.563488 17147 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.524878 17161 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:36.525127 11006 raft_consensus.cc:1813] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Handling vote request from an unknown peer 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:36.573642 11006 raft_consensus.cc:2410] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:22:36.573441 17157 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.525288 11079 rpcz_store.cc:276] 0709 12:22:34.801416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.801533 (+   117us) service_pool.cc:224] Handling call
0709 12:22:36.514337 (+1712804us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:36.525578 17158 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:36.516857 10936 rpcz_store.cc:269] 0709 12:22:33.142360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:33.142494 (+   134us) service_pool.cc:224] Handling call
0709 12:22:36.252339 (+3109845us) spinlock_profiling.cc:243] Waited 2.76 s on lock 0x7b54001621d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:36.252608 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6354496768}
I20260709 12:22:36.451608 17092 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:36.513804 10832 catalog_manager.cc:5697] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 6 to 10, term changed from 11 to 14, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New cstate: current_term: 14 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.576268 17090 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.578038 10832 catalog_manager.cc:5697] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.515630 17111 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:36.542167 11007 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.341s	user 0.030s	sys 0.030s
I20260709 12:22:36.575919 17150 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.571777 16894 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:33.303117 17097 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.151s	user 0.000s	sys 0.006s
I20260709 12:22:36.530869 17146 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.583000 16894 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:36.583690 17146 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.522020 16970 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.335902 17047 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:36.584185 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 431796us
W20260709 12:22:36.584990 10899 leader_election.cc:336] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Timed out: RequestConsensusVote RPC to 127.9.131.67:40209 timed out after 1.688s (SENT)
I20260709 12:22:36.585376 10899 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:36.586057 17047 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.586735 17047 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:22:36.510023 11083 rpcz_store.cc:269] 0709 12:22:33.200706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:33.252104 (+ 51398us) service_pool.cc:224] Handling call
0709 12:22:36.509341 (+3257237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:36.520201 16696 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.223665 17107 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:36.542680 11622 connection.cc:256] RPC call timeout handler was delayed by -2.4465141509999739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
I20260709 12:22:36.589257 17107 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.510066 11010 rpcz_store.cc:276] 0709 12:22:33.208740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.006755 (+2798015us) service_pool.cc:224] Handling call
0709 12:22:36.007545 (+   790us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:36.008154 (+   609us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:22:36.008704 (+   550us) log.cc:844] Serialized 14 byte log entry
0709 12:22:36.017299 (+  8595us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:36.017370 (+    71us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:22:36.017444 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.017514 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.017731 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":81411,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":7623,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":270,"thread_start_us":7904,"threads_started":2,"wal-append.queue_time_us":1220}
W20260709 12:22:36.509774 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08002c16e0 after lost signal to thread 10868
W20260709 12:22:36.563063 11076 rpcz_store.cc:269] 0709 12:22:34.800389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.800495 (+   106us) service_pool.cc:224] Handling call
0709 12:22:36.562572 (+1762077us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:36.564571 16702 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.567796 16989 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:36.568315 16862 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.568061 17083 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.568222 16630 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:36.569471 16896 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:36.605811 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 93673.8us
I20260709 12:22:36.564360 17147 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.570135 17065 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.513994 17137 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.572094 17120 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.572288 17140 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.572110 17032 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.619741 16896 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.621035 17070 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.621444 17032 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:36.621811 16896 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:36.578776 17090 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:36.580858 17111 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.526592 16895 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.623180 17070 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:36.510227 10931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3197) took 3852 ms. Trace:
I20260709 12:22:36.623736 17083 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:36.612223 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41098 (request call id 510) took 3941 ms. Trace:
I20260709 12:22:36.623416 16895 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.625102 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3541) took 2633 ms. Trace:
I20260709 12:22:36.625394 17145 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:36.594987 17160 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:36.507802 17144 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:36.626693 16895 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.505628 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:36.627585 11009 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:36.635496 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:36.636395 11004 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:36.636606 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:36.636847 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:36.637320 11009 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
W20260709 12:22:36.534993 11106 debug-util.cc:398] Leaking SignalData structure 0x7b08003e0da0 after lost signal to thread 11684
W20260709 12:22:36.564633 11050 connection.cc:256] RPC call timeout handler was delayed by -1.8759409610001967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
I20260709 12:22:36.625463 11008 rpcz_store.cc:276] 0709 12:22:33.991478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.530148 (+2538670us) service_pool.cc:224] Handling call
0709 12:22:36.530488 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:36.596319 (+ 65831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:36.596350 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:36.606159 (+  9809us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:36.606215 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.624856 (+ 18641us) spinlock_profiling.cc:243] Waited 62.3 ms on lock 0x7b54000dded4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:36.624903 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.625022 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143396608}
I20260709 12:22:36.638252 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:36.637601 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:36.639165 11010 raft_consensus.cc:2410] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 16 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:22:36.640486 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:36.641185 11008 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:22:36.642102 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:36.642421 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:36.642719 11004 raft_consensus.cc:2393] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 15: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:22:36.603982 11032 debug-util.cc:398] Leaking SignalData structure 0x7b080023f4a0 after lost signal to thread 10960
I20260709 12:22:36.643162 11008 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:36.429859 17131 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:36.608354 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.644959 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:36.649053 11004 raft_consensus.cc:2410] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:22:36.552508 17151 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.563158 17037 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.506469 17142 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.609674 10975 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:36.613390 16862 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:36.360327 10829 rpcz_store.cc:269] 0709 12:22:22.844789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.845024 (+   235us) service_pool.cc:224] Handling call
0709 12:22:36.359495 (+13514471us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:32.783298 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:32.783869 (+   571us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:32.785046 (+  1177us) write_op.cc:435] Acquired schema lock
0709 12:22:32.787042 (+  1996us) tablet.cc:662] Decoding operations
0709 12:22:32.960229 (+173187us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:32.960289 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:32.960317 (+    28us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:22:33.029530 (+ 69213us) tablet.cc:701] Row locks acquired
0709 12:22:33.029554 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:22:33.029718 (+   164us) write_op.cc:270] Start()
0709 12:22:33.029856 (+   138us) write_op.cc:276] Timestamp: P: 1783599753029665 usec, L: 0
0709 12:22:33.029881 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:22:33.030666 (+   785us) log.cc:844] Serialized 7831 byte log entry
0709 12:22:33.404282 (+373616us) op_driver.cc:464] REPLICATION: finished
0709 12:22:33.555543 (+151261us) write_op.cc:301] APPLY: starting
0709 12:22:33.557215 (+  1672us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:33.578340 (+ 21125us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:33.578917 (+   577us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:33.593825 (+ 14908us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:33.594165 (+   340us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=0,mrs_lookups=0
0709 12:22:33.594213 (+    48us) write_op.cc:312] APPLY: finished
0709 12:22:33.594645 (+   432us) log.cc:844] Serialized 180 byte log entry
0709 12:22:33.594825 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:33.595014 (+   189us) write_op.cc:454] Released schema lock
0709 12:22:33.595076 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:33.595507 (+   431us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:33.595526 (+    19us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":541251,"reported_tablets":54,"spinlock_wait_cycles":1408,"child_traces":[["op",{"apply.queue_time_us":148038,"apply.run_cpu_time_us":26270,"apply.run_wall_time_us":39988,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87607,"num_ops":20,"prepare.queue_time_us":128388,"prepare.run_cpu_time_us":68955,"prepare.run_wall_time_us":349989,"raft.queue_time_us":151407,"raft.run_cpu_time_us":10170,"raft.run_wall_time_us":200753,"replication_time_us":324220,"thread_start_us":325856,"threads_started":4,"wal-append.queue_time_us":131864,"wal-append.run_cpu_time_us":11968,"wal-append.run_wall_time_us":1432830}]]}
I20260709 12:22:36.614838 17108 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:36.652336 16862 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:36.614267 16989 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.654706 16989 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:36.615656 17120 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.657147 17120 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:36.616696 17118 consensus_queue.cc:1048] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:36.486933 11003 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:36.608002 16630 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.615152 17065 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.623709 10931 rpcz_store.cc:276] 0709 12:22:32.657247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.659213 (+  1966us) service_pool.cc:224] Handling call
0709 12:22:32.659517 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:32.883963 (+224446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:32.883997 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:32.885588 (+  1591us) log.cc:844] Serialized 26 byte log entry
0709 12:22:33.008296 (+122708us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:33.010371 (+  2075us) log.cc:844] Serialized 14 byte log entry
0709 12:22:33.010791 (+   420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:33.010866 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:36.509811 (+3498945us) raft_consensus.cc:1685] finished
0709 12:22:36.509850 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.510064 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1914,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":97645,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":8377,"thread_start_us":307034,"threads_started":2,"wal-append.queue_time_us":146437}
I20260709 12:22:36.629976 11007 rpcz_store.cc:276] 0709 12:22:32.671044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.671170 (+   126us) service_pool.cc:224] Handling call
0709 12:22:32.744206 (+ 73036us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:32.745525 (+  1319us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:22:32.745559 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:32.756225 (+ 10666us) log.cc:844] Serialized 26 byte log entry
0709 12:22:33.201452 (+445227us) spinlock_profiling.cc:243] Waited 9.79 ms on lock 0x7b180032dc40. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b 00007f9bb0affd23 00007f9bb0b000d1 00007f9bb0f1ba0f
0709 12:22:36.579693 (+3378241us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:36.579753 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.579839 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:36.596193 (+ 16354us) raft_consensus.cc:1685] finished
0709 12:22:36.596208 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.612150 (+ 15942us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":875,"raft.queue_time_us":6422,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":4846,"spinlock_wait_cycles":22508288,"thread_start_us":3377933,"threads_started":1,"wal-append.queue_time_us":599383}
I20260709 12:22:36.631352 17140 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.631539 17157 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.505766 17138 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:36.624327 11078 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 3478) took 1821 ms (client timeout 1770 ms). Trace:
I20260709 12:22:36.637480 11006 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:36.643234 11010 raft_consensus.cc:2368] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20.
W20260709 12:22:36.643932 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08003104c0 after lost signal to thread 10961
W20260709 12:22:36.637900 11050 connection.cc:256] RPC call timeout handler was delayed by -1.8759409610001967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
W20260709 12:22:36.679020 11050 connection.cc:256] RPC call timeout handler was delayed by -1.6104409610002222s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
W20260709 12:22:36.679380 11050 connection.cc:256] RPC call timeout handler was delayed by -1.5906409610001901s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
W20260709 12:22:36.679679 11050 connection.cc:256] RPC call timeout handler was delayed by -1.5402409610005634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
W20260709 12:22:36.649281 10899 connection.cc:256] RPC call timeout handler was delayed by -2.2984210969998458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1917s for a response
I20260709 12:22:36.651467 17142 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:22:36.618760 17107 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:36.617393 16702 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:36.564770 11011 rpcz_store.cc:276] 0709 12:22:33.174474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:33.174605 (+   131us) service_pool.cc:224] Handling call
0709 12:22:33.174911 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:36.053721 (+2878810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.054181 (+   460us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:36.645022 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:36.399664 17134 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.669591 10901 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:36.671238 11003 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37594 (request call id 2840) took 3500 ms (client timeout 2056 ms). Trace:
I20260709 12:22:36.680996 11050 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:36.678177 11078 rpcz_store.cc:269] 0709 12:22:34.802418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.802629 (+   211us) service_pool.cc:224] Handling call
0709 12:22:36.624117 (+1821488us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:36.685770 10899 connection.cc:256] RPC call timeout handler was delayed by -2.2825179299998126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.215s for a response
W20260709 12:22:36.687580 11032 debug-util.cc:398] Leaking SignalData structure 0x7b080034cbe0 after lost signal to thread 11035
I20260709 12:22:36.693063 17160 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:36.693876 17065 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:36.695576 17144 consensus_queue.cc:1059] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:36.698020 11009 raft_consensus.cc:2410] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:22:36.700316 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08002f3280 after lost signal to thread 11036
W20260709 12:22:36.701072 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4320 after lost signal to thread 11050
I20260709 12:22:36.673486 10832 catalog_manager.cc:5697] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:36.699203 11003 rpcz_store.cc:269] 0709 12:22:33.171079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:33.172264 (+  1185us) service_pool.cc:224] Handling call
0709 12:22:36.671011 (+3498747us) spinlock_profiling.cc:243] Waited 3.27 s on lock 0x7b5400160654. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:36.671168 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7514683648}
W20260709 12:22:36.706224 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9e40 after lost signal to thread 11109
W20260709 12:22:36.706588 11032 debug-util.cc:398] Leaking SignalData structure 0x7b0800300920 after lost signal to thread 11110
W20260709 12:22:36.706912 11032 debug-util.cc:398] Leaking SignalData structure 0x7b080038e020 after lost signal to thread 11622
I20260709 12:22:36.708590 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:36.709399 11658 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:36.708832 10901 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:36.711284 17083 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:36.713703 17138 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:36.714138 17138 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:36.714546 17138 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:36.685139 17142 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.715426 17142 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:36.716109 17137 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.717048 16702 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:36.718641 16630 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:36.711601 10901 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:36.720782 10901 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:36.720680 17151 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:36.714048 17144 raft_consensus.cc:3055] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:36.721702 17151 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:36.721534 17090 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:36.722314 17151 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:36.711668 17083 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:36.723026 17073 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.723384 17083 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:36.723529 17073 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.721964 17144 raft_consensus.cc:740] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:36.723978 10832 catalog_manager.cc:5697] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 12 to 13, leader changed from 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 13 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:22:36.725335 10899 connection.cc:256] RPC call timeout handler was delayed by -2.0689210969999294s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21720000000000003s for a response
I20260709 12:22:36.725590 17144 consensus_queue.cc:260] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:36.719259 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08002e08a0 after lost signal to thread 11683
W20260709 12:22:36.726805 11032 debug-util.cc:398] Leaking SignalData structure 0x7b0800176540 after lost signal to thread 11684
I20260709 12:22:36.726028 16941 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:36.727375 17090 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:36.698338 17147 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:36.728066 16941 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.728751 16802 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.721643 10901 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:36.732522 17131 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:36.733067 17131 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:36.733549 17131 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:36.727806 17090 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:22:36.727154 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08003bc740 after lost signal to thread 16630
W20260709 12:22:36.726428 10899 connection.cc:256] RPC call timeout handler was delayed by -1.9738179299997682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2493s for a response
W20260709 12:22:36.736356 10899 connection.cc:256] RPC call timeout handler was delayed by -1.9216451050001524s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260709 12:22:36.736141 11032 debug-util.cc:398] Leaking SignalData structure 0x7b080035e000 after lost signal to thread 16702
W20260709 12:22:36.737049 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08003b7e80 after lost signal to thread 16802
W20260709 12:22:36.737373 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08003350e0 after lost signal to thread 16895
W20260709 12:22:36.737597 11032 debug-util.cc:398] Leaking SignalData structure 0x7b0800398f80 after lost signal to thread 16906
W20260709 12:22:36.737833 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08001d8640 after lost signal to thread 16907
W20260709 12:22:36.738044 11032 debug-util.cc:398] Leaking SignalData structure 0x7b080022cb40 after lost signal to thread 16917
W20260709 12:22:36.738256 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08003233e0 after lost signal to thread 16926
W20260709 12:22:36.738457 11032 debug-util.cc:398] Leaking SignalData structure 0x7b0800321c20 after lost signal to thread 16936
W20260709 12:22:36.738649 11032 debug-util.cc:398] Leaking SignalData structure 0x7b080014ea60 after lost signal to thread 16938
W20260709 12:22:36.738941 11032 debug-util.cc:398] Leaking SignalData structure 0x7b0800274680 after lost signal to thread 16981
W20260709 12:22:36.739171 11032 debug-util.cc:398] Leaking SignalData structure 0x7b0800331da0 after lost signal to thread 17001
W20260709 12:22:36.739382 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08002bf6e0 after lost signal to thread 17032
W20260709 12:22:36.739575 11032 debug-util.cc:398] Leaking SignalData structure 0x7b080033fa80 after lost signal to thread 17037
W20260709 12:22:36.736721 10899 connection.cc:256] RPC call timeout handler was delayed by -1.8505451050000374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21680000000000002s for a response
W20260709 12:22:36.739781 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08003a30a0 after lost signal to thread 17047
W20260709 12:22:36.740298 10899 connection.cc:256] RPC call timeout handler was delayed by -1.752417929999865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2739s for a response
W20260709 12:22:36.740600 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08001fa1c0 after lost signal to thread 17048
I20260709 12:22:36.719259 16630 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
W20260709 12:22:36.740943 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08003389c0 after lost signal to thread 17049
W20260709 12:22:36.741279 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08003cd280 after lost signal to thread 17063
I20260709 12:22:36.741501 17134 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:36.742154 17134 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.742568 16696 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:36.743238 16696 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.744390 17134 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.739982 16802 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:36.741580 11032 debug-util.cc:398] Leaking SignalData structure 0x7b080035b100 after lost signal to thread 17065
W20260709 12:22:36.745688 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08003a0660 after lost signal to thread 17066
W20260709 12:22:36.745960 11032 debug-util.cc:398] Leaking SignalData structure 0x7b0800399760 after lost signal to thread 17070
W20260709 12:22:36.741200 10899 connection.cc:256] RPC call timeout handler was delayed by -1.515717929999937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3002s for a response
I20260709 12:22:36.725804 10832 catalog_manager.cc:5697] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 9 to 11, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 11 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.747535 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:36.733027 10901 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:36.749010 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08003ae160 after lost signal to thread 17092
W20260709 12:22:36.749789 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe9e0 after lost signal to thread 17097
W20260709 12:22:36.750039 11032 debug-util.cc:398] Leaking SignalData structure 0x7b0800308220 after lost signal to thread 17098
W20260709 12:22:36.750243 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08002e3080 after lost signal to thread 17099
I20260709 12:22:36.726907 17144 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:36.756031 17137 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:36.757833 17137 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.758963 17151 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.760556 17137 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:36.762221 17083 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.732975 16941 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.764670 16630 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:36.765558 16802 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.765954 17147 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:36.766150 16802 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.766656 17147 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.756134 16696 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.768574 17090 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.762838 17151 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.770725 16959 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:36.771027 17090 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.765339 16630 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.769019 17147 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:36.771615 16959 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.774340 17150 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.775440 17130 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.775790 17150 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.775960 17130 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.776691 16630 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:36.776718 16959 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:36.777943 17130 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.768944 16802 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:36.778530 17130 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:36.779088 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 46123.4us
I20260709 12:22:36.772430 17092 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:22:36.774266 11051 connection.cc:256] RPC call timeout handler was delayed by -1.0475589350003247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:22:36.777989 17150 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:36.779719 16696 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:22:36.772642 10899 connection.cc:256] RPC call timeout handler was delayed by -1.1385465119997207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
I20260709 12:22:36.780010 17065 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.743257 17138 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.803632 17092 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.804179 11049 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:36.804641 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.805255 11076 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:22:36.805547 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:36.805734 11079 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 12:22:36.806084 11079 pending_rounds.cc:85] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 10
I20260709 12:22:36.774360 17047 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.806505 11079 pending_rounds.cc:107] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:22:36.806579 10901 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:36.807085 11078 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:22:36.807276 16802 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:36.807677 16802 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.807590 10901 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:36.792907 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:36.808521 11084 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:36.807931 17090 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:36.796787 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:36.809582 17090 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.810003 17090 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:36.809849 17142 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.773644 17134 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.795840 17083 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.806166 11657 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:22:36.810730 16802 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:36.811275 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:36.779304 17130 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.795212 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:36.809068 10901 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:36.811841 17065 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.837718 11650 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:36.838178 10901 leader_election.cc:400] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20.
I20260709 12:22:36.838485 10901 leader_election.cc:403] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:36.838977 11049 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:36.839224 17065 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:36.840025 17083 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:36.840442 17083 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.840773 17083 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:36.841524 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.842137 11080 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:36.842983 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.811991 16696 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.807106 11079 raft_consensus.cc:2889] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:36.771821 10832 catalog_manager.cc:5697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.807808 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.844947 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:36.845564 11650 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:22:36.846649 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.846719 11049 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:36.847611 17064 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:22:36.848033 17064 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.848289 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:36.849534 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:36.849861 16802 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.850873 10931 raft_consensus.cc:1275] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:36.850461 10832 catalog_manager.cc:5697] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 13 to 14, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 14 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.821593 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.851889 16696 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:36.809124 17111 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:36.852507 17111 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:36.852937 17111 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:36.822873 17144 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:36.854581 17144 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.845722 17150 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:22:36.856762 17144 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.825358 17147 consensus_queue.cc:1059] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:36.857249 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:36.857517 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:36.857893 10932 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:36.858124 10929 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:36.858596 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:36.859179 11006 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:36.860219 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:36.848203 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:36.861814 11084 raft_consensus.cc:2376] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17. Re-sending same reply.
I20260709 12:22:36.840912 11085 raft_consensus.cc:3055] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:36.862674 11085 raft_consensus.cc:740] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:36.864522 11007 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:36.865307 10932 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:36.865572 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.812664 17137 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.866708 17137 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.867983 17165 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:36.868568 17165 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.812536 17138 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.869201 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.869807 11083 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:36.830421 16630 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:22:36.870757 17165 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.830725 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.863358 11085 consensus_queue.cc:260] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.871804 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:36.872588 17142 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:36.872373 11085 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:36.873078 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:36.873833 11009 raft_consensus.cc:2393] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:36.839761 17065 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:36.849457 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.881206 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.881470 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:36.882081 10929 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:36.883628 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:36.884217 11658 raft_consensus.cc:1813] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Handling vote request from an unknown peer 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:36.884682 11658 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 15: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:36.885776 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:36.886102 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:36.886564 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:36.887367 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:36.887941 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:36.857654 17147 raft_consensus.cc:3055] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:36.889053 17147 raft_consensus.cc:740] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:36.890465 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:36.891603 10934 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:36.892175 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:36.892918 10933 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:36.893011 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:36.893127 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.893556 11656 raft_consensus.cc:1813] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Handling vote request from an unknown peer 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:36.888514 11655 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:22:36.894225 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.893810 17090 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.894908 11079 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:36.895462 10930 raft_consensus.cc:2393] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 18: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:36.896095 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:36.810820 17047 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.897215 17073 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:36.894439 10936 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15. Ops: [13.9-14.10]
I20260709 12:22:36.898154 17047 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.848418 17064 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:36.900372 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.901830 10931 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:36.825655 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.904748 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.905894 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.872619 11011 raft_consensus.cc:2393] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 17: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:36.906616 11076 raft_consensus.cc:1240] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:36.907505 11656 raft_consensus.cc:2410] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:22:36.907760 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:36.888655 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:36.908347 11651 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:36.906426 11082 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:36.827044 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.909597 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.910660 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.908205 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.911203 11082 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:36.890110 17147 consensus_queue.cc:260] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.912341 17147 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:36.912817 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.891978 17065 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.912358 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:36.909825 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.908867 10929 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:36.806329 17092 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:36.868877 17137 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.895737 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.917382 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:36.917621 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:36.918560 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.924023 11002 raft_consensus.cc:2410] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:22:36.919420 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:36.920017 17065 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:36.822284 17131 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.920328 11651 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:36.922194 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:36.929662 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:36.836661 17134 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.924564 11010 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:36.930208 11009 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:36.928113 11655 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:22:36.928193 11007 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:36.927383 11006 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:36.933728 11657 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:36.936571 11049 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:36.936652 11085 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 12:22:36.937282 11085 pending_rounds.cc:85] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 8
I20260709 12:22:36.937877 11085 pending_rounds.cc:107] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 12:22:36.938123 11085 raft_consensus.cc:2889] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:36.906810 16802 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:36.940846 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.940778 11049 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:36.944541 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.946779 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.947402 11083 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:36.948500 11078 raft_consensus.cc:2393] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 19: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:36.940637 17073 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:36.951695 10929 raft_consensus.cc:1240] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:36.955104 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.956238 17073 raft_consensus.cc:697] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:36.957234 17073 consensus_queue.cc:237] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.960346 17090 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.961241 17131 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.962865 17064 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:36.964138 11081 raft_consensus.cc:2393] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 22: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:36.965543 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.966575 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.967162 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.967900 11076 raft_consensus.cc:2393] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 19: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:36.968233 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.880087 17083 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.973624 11079 raft_consensus.cc:1813] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Handling vote request from an unknown peer 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:36.973052 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.974175 11079 raft_consensus.cc:2410] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:22:36.971319 17130 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:36.975317 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.972261 16630 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:22:36.976032 11083 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:22:36.976958 17092 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.977481 17092 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.979044 16696 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:36.951045 16702 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:37.004619 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.005188 10929 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:22:36.980110 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.980279 11650 raft_consensus.cc:1240] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:36.980732 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:37.006167 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:36.979831 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.006179 11076 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:36.981745 17083 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.983409 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:36.984126 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:36.985977 10933 raft_consensus.cc:1240] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:36.986980 10930 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:22:37.011296 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:37.011626 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:36.979846 17092 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.988343 17134 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:36.988567 10934 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:22:36.990413 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:37.015259 11079 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
W20260709 12:22:36.983584 10974 connection.cc:256] RPC call timeout handler was delayed by -2.0294498670004941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
I20260709 12:22:36.991047 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:22:37.016083 10974 connection.cc:256] RPC call timeout handler was delayed by -2.0117781080002715s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
I20260709 12:22:36.995990 11010 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:22:37.005647 11003 raft_consensus.cc:2410] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 20 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 12:22:37.016992 10900 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:36.982425 10977 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.031s	sys 0.036s
W20260709 12:22:37.018488 10977 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.033s	sys 0.037s
I20260709 12:22:37.014766 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.008244 11081 raft_consensus.cc:2393] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:37.008590 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:37.012132 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:37.012202 11008 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:37.020022 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:37.013285 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:37.021298 11011 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:37.021476 11077 raft_consensus.cc:1813] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Handling vote request from an unknown peer 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:37.019706 11655 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:22:37.022176 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:37.025110 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:37.026044 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.023361 11076 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:36.978989 17111 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:37.043085 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.043666 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:37.051373 11085 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
W20260709 12:22:37.052388 10977 connection.cc:256] RPC call timeout handler was delayed by -1.0802989900003013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
I20260709 12:22:37.048745 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:37.032774 17150 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20.
I20260709 12:22:37.057224 11079 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:37.058914 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:37.056344 10975 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:37.062337 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.018489 16702 raft_consensus.cc:697] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:37.063623 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.064626 11004 raft_consensus.cc:2410] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 21 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:22:37.064397 16702 consensus_queue.cc:237] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:37.067926 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:37.071787 11076 raft_consensus.cc:2368] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20.
I20260709 12:22:37.072338 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:37.073143 11079 raft_consensus.cc:2393] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 15: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:22:37.073925 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.074048 17111 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:37.074721 17166 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:22:37.075263 17166 raft_consensus.cc:697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:22:37.077080 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 59290.5us
I20260709 12:22:37.081327 11006 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:37.083894 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:37.085574 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:37.086783 11085 raft_consensus.cc:1813] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Handling vote request from an unknown peer 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:37.087411 11085 raft_consensus.cc:2410] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:22:37.088402 11009 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:37.090942 11008 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:22:37.035190 17134 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:22:37.093400 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 72076.1us
I20260709 12:22:37.114955 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:37.108975 10900 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:37.137475 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:37.136933 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:37.143059 11082 raft_consensus.cc:2410] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 12:22:37.265550 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 157076us
W20260709 12:22:37.267426 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 124924us
I20260709 12:22:37.139005 17131 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:37.202955 17166 consensus_queue.cc:237] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:37.116359 17092 consensus_queue.cc:1059] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.138s
I20260709 12:22:37.273345 17065 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:37.100809 16630 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:37.281337 10935 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:22:37.285212 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:37.296337 11085 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:37.298120 11080 raft_consensus.cc:2368] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15.
I20260709 12:22:37.300419 10901 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:37.308023 17092 raft_consensus.cc:3055] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:37.308507 17092 raft_consensus.cc:740] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:37.309433 17092 consensus_queue.cc:260] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:37.310693 17092 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:37.285971 17131 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:37.312882 10974 connection.cc:256] RPC call timeout handler was delayed by -1.6607781080001587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
I20260709 12:22:37.278682 17134 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.318569 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:37.319180 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.320389 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.320395 17083 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:37.319736 10901 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:37.312552 17131 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:37.328051 11002 raft_consensus.cc:1240] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:37.324720 11085 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:22:37.324887 11009 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:37.335336 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:37.338466 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:37.337141 10901 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:37.339315 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:37.339784 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:37.340070 11655 raft_consensus.cc:2393] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 22: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:37.340688 11082 raft_consensus.cc:2393] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:37.341768 11002 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 12:22:37.342967 17090 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:37.328171 17083 raft_consensus.cc:697] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:37.342171 11002 pending_rounds.cc:85] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 10
I20260709 12:22:37.344900 11002 pending_rounds.cc:107] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:22:37.326779 17064 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:37.345196 11002 raft_consensus.cc:2889] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:37.346469 11008 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:37.346964 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:37.348416 17083 consensus_queue.cc:237] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:37.356495 11008 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 12:22:37.340435 17111 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:22:37.362394 17178 log.cc:927] Time spent T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 12:22:37.362939 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:37.356940 11008 pending_rounds.cc:85] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 10
I20260709 12:22:37.370708 11008 pending_rounds.cc:107] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:22:37.371019 11008 raft_consensus.cc:2889] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:37.377072 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.361032 16696 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:37.383598 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:37.388343 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.343950 16630 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:37.392746 11082 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:22:37.392948 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.360015 17134 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:37.395488 10977 connection.cc:256] RPC call timeout handler was delayed by -1.2415920309999819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33690000000000003s for a response
I20260709 12:22:37.398886 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:37.399876 10931 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 12.
I20260709 12:22:37.400275 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:37.401026 17134 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:37.401328 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:37.403110 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:37.403398 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.403398 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:37.404947 11080 raft_consensus.cc:2376] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 18. Re-sending same reply.
I20260709 12:22:37.376995 17111 raft_consensus.cc:697] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:37.411533 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:37.411830 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:37.412247 11651 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:37.412587 11085 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:37.418057 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.416837 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:37.409765 17177 log.cc:927] Time spent T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:22:37.420426 11004 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:22:37.419924 17047 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:22:37.423619 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:37.426115 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:37.426838 11085 raft_consensus.cc:2368] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 21. Current term is 22.
I20260709 12:22:37.407745 17065 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:37.428208 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.431440 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:37.432188 11080 raft_consensus.cc:2368] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 14. Current term is 15.
I20260709 12:22:37.436576 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.436707 11651 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:37.437281 11008 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:37.438385 11049 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:37.440604 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.445606 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:37.416527 17134 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:22:37.455729 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:37.457203 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.458447 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:37.459285 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 113195us
I20260709 12:22:37.463445 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.448026 17065 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:37.468936 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.469489 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:37.469656 10901 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:37.473805 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.476629 10901 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:37.479913 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:37.480734 11008 raft_consensus.cc:2393] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 19: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:37.482934 10901 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:37.483044 11080 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 17.
I20260709 12:22:37.484910 17047 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:37.485476 17047 raft_consensus.cc:697] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:37.486567 17130 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:37.486375 17047 consensus_queue.cc:237] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:37.487483 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.486972 10901 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:37.487061 17130 raft_consensus.cc:697] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:37.491189 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:37.491896 11082 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 14.
I20260709 12:22:37.475592 17065 raft_consensus.cc:697] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:37.481915 17090 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:37.503532 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.461666 17111 consensus_queue.cc:237] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:37.510707 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.512455 11011 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:37.502007 16696 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:37.521581 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.522337 11004 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:37.515676 17151 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:37.529769 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.531162 11002 raft_consensus.cc:2410] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 12:22:37.532124 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.545646 11081 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:37.533591 17151 raft_consensus.cc:697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:37.557173 11002 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:37.528075 16696 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:37.561798 16696 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:37.562093 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.562754 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:37.563349 11005 raft_consensus.cc:2376] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20. Re-sending same reply.
I20260709 12:22:37.565910 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.565920 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:37.567319 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.572424 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:37.573112 11009 raft_consensus.cc:2376] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18. Re-sending same reply.
I20260709 12:22:37.572424 11008 raft_consensus.cc:2376] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15. Re-sending same reply.
I20260709 12:22:37.581144 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.524860 17130 consensus_queue.cc:237] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:37.613080 11625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.619176 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.565508 17131 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:37.638772 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 167994us
I20260709 12:22:37.642980 11003 raft_consensus.cc:1240] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:37.645907 10928 raft_consensus.cc:2393] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 14: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:37.645787 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:37.589233 17065 consensus_queue.cc:237] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:37.656670 10901 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:37.680603 17187 log.cc:927] Time spent T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:22:37.695147 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:37.782639 11003 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:37.645010 17151 consensus_queue.cc:237] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:37.780043 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.784819 11005 raft_consensus.cc:2410] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 14 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:22:37.780249 17144 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:37.780982 17083 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:22:37.783226 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.787048 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.788528 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:37.780046 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 123461us
I20260709 12:22:37.828233 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:37.828943 10932 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:22:37.781620 17090 raft_consensus.cc:697] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:37.835214 11011 raft_consensus.cc:1240] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:37.836146 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:37.838146 11011 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:37.838522 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:37.841964 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.844909 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:37.845564 10935 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:37.839294 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:37.838135 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:37.824694 17083 raft_consensus.cc:697] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:37.822782 16630 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:37.846879 10934 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
W20260709 12:22:37.848759 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 200417us
I20260709 12:22:37.858515 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.868665 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:37.869416 10927 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:37.870393 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:37.871196 10927 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:22:37.850395 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:37.873656 11622 leader_election.cc:400] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 pre-election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 21. Current term is 22.
I20260709 12:22:37.873984 11622 leader_election.cc:403] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:37.850364 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:37.872123 17194 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:37.875381 10936 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
W20260709 12:22:37.848112 17185 log.cc:927] Time spent T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.184s	user 0.000s	sys 0.010s
I20260709 12:22:37.877853 10932 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:37.887110 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:37.887758 10934 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:37.881080 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:37.888466 10935 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
W20260709 12:22:37.891625 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 60364.8us
I20260709 12:22:37.891991 11051 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:37.893344 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:37.895723 11003 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
W20260709 12:22:37.901137 17189 log.cc:927] Time spent T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:22:37.902103 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:37.903380 10936 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:37.917570 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:37.923848 10935 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:37.922847 11625 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:37.932368 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:37.936285 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.939822 17083 consensus_queue.cc:237] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:37.940481 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:37.941090 11651 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:37.941843 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:37.942433 10932 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:22:37.943338 11006 raft_consensus.cc:1275] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:37.943389 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:37.944368 10932 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:37.945196 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:37.945739 10932 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:37.953933 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:37.954733 10935 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:37.927129 17144 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 21. Current term is 22.
W20260709 12:22:37.960989 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.962172 10901 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:37.963568 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:37.964409 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:37.896785 17194 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:37.960443 17092 consensus_meta.cc:287] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.649s	user 0.015s	sys 0.004s
I20260709 12:22:37.939025 17131 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:37.976418 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:37.981303 11651 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:37.982571 10931 raft_consensus.cc:2410] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:22:37.983385 10933 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:22:37.983784 10900 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:37.988188 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:37.988762 10935 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
W20260709 12:22:37.990053 17195 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:22:37.990484 10930 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:37.992249 10936 raft_consensus.cc:1240] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:37.997611 10932 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:37.999986 11624 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:38.002043 11624 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:38.005821 17196 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:22:38.008090 17186 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:22:38.009414 17198 log.cc:927] Time spent T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 12:22:38.015893 10934 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:38.017063 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:38.017720 10934 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:38.018718 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:37.974347 17205 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:22:38.021970 17150 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:38.022576 17150 raft_consensus.cc:697] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:38.023429 17150 consensus_queue.cc:237] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:38.018653 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:38.025723 10932 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 19: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:38.024693 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:38.053180 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:38.053963 10935 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:22:38.055008 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:38.068602 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:37.986614 16630 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:38.070374 10932 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:38.070642 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:38.071445 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:38.074410 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:38.077503 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.968863 17090 consensus_queue.cc:237] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:38.080243 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:38.079663 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:38.069602 17186 raft_consensus.cc:697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:38.083240 10934 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:22:38.070755 16630 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:38.085472 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:38.090824 10932 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:22:38.092479 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:38.074119 17209 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:38.093238 10934 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:38.094937 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:38.094271 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 125835us
W20260709 12:22:38.097536 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 95561.2us
I20260709 12:22:38.074252 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:38.074998 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 207159us
I20260709 12:22:38.099843 11622 leader_election.cc:400] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 14. Current term is 15.
I20260709 12:22:38.100749 11622 leader_election.cc:403] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:22:38.088899 16630 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:38.100457 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:38.106276 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:38.107492 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:38.107779 10899 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:38.108337 17151 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:38.095319 17144 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:38.110224 17151 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:38.110544 17144 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:38.111824 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:38.112931 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:38.113524 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:38.114151 10899 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:38.116504 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:38.117127 10934 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:38.124598 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:38.125262 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:38.125952 10932 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:38.095139 17209 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:38.133004 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:38.133548 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:38.127578 10974 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:38.134217 10935 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 12.
I20260709 12:22:38.136610 11622 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:38.170173 17190 log.cc:927] Time spent T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:22:38.135557 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:38.136996 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 254908us
I20260709 12:22:38.110859 17151 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:22:38.174063 11622 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:38.150585 11651 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:22:38.175236 10934 raft_consensus.cc:2376] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15. Re-sending same reply.
W20260709 12:22:38.156983 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:38.176316 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.176258 11051 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:38.177671 11622 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:38.189467 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 59942.6us
I20260709 12:22:38.172646 17213 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 14. Current term is 15.
I20260709 12:22:38.128634 17092 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:38.203469 17215 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:38.161791 17194 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:38.134814 17209 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:38.207988 10928 raft_consensus.cc:1240] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:38.207667 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:38.191009 17165 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:38.219806 11008 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 12:22:38.213763 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 96321.6us
I20260709 12:22:38.222769 17204 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.223433 17204 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:38.225422 16630 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:38.211336 17224 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:22:38.228789 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
W20260709 12:22:38.232117 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 55943.7us
I20260709 12:22:38.233085 11051 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:38.234383 11051 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:38.235217 16702 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:38.235807 16702 raft_consensus.cc:697] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:38.236945 16702 consensus_queue.cc:237] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:38.240087 17214 consensus_queue.cc:1059] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:38.241168 17214 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:38.241523 17214 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.241866 17214 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:38.244233 17205 raft_consensus.cc:3055] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:38.244714 17205 raft_consensus.cc:740] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:38.245596 17205 consensus_queue.cc:260] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:38.246956 17205 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:38.247207 17147 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.225807 17204 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:38.202740 17206 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:22:38.252123 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 56682.8us
I20260709 12:22:38.202509 17092 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:22:38.249548 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:38.252732 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 45145.2us
I20260709 12:22:38.253603 10899 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:38.205055 17221 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:38.254755 10899 leader_election.cc:400] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20.
I20260709 12:22:38.256786 10899 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:38.211149 17220 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:38.259687 17111 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:38.219038 17165 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:38.255646 17151 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:38.261395 17165 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:38.261618 17151 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:38.262084 17151 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:38.248003 17147 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:38.263643 10974 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:38.265642 17158 raft_consensus.cc:2764] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:22:38.252485 17144 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.135485 17186 consensus_queue.cc:237] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:38.251518 16630 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:38.255939 17192 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:38.254261 17092 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:38.266855 17144 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:38.260586 17220 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:38.268392 17220 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:38.255934 17221 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:38.306608 17221 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:38.271108 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:38.312235 11651 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 11.
I20260709 12:22:38.214673 17166 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.044s
I20260709 12:22:38.265563 17147 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:38.314771 11049 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:38.260497 10899 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:22:38.316066 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 55650.5us
I20260709 12:22:38.315881 17209 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:38.317034 11657 raft_consensus.cc:1240] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:38.317641 10899 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:38.318786 10899 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:38.319072 17166 consensus_queue.cc:1059] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:38.283888 17144 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:38.285274 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:38.290323 17151 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:38.281463 17092 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:38.268049 10974 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:38.304399 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 51031.8us
I20260709 12:22:38.319347 17192 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:38.295621 11008 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:22:38.323261 11051 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:38.324769 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 58149.9us
I20260709 12:22:38.322362 17151 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:38.320024 17166 raft_consensus.cc:3055] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:38.320092 17147 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:38.331621 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:38.333444 17225 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:38.333652 16959 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:38.334172 16959 raft_consensus.cc:697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:38.337713 10974 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:38.332149 17199 raft_consensus.cc:2764] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 12:22:38.328490 17047 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:38.334555 17147 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.333117 17166 raft_consensus.cc:740] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:38.344844 10974 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:38.347165 17147 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:38.354846 17209 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:38.356182 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:38.346215 17204 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:38.357069 17204 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.357426 17204 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:38.356155 17220 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:38.360983 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:38.361753 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:38.362469 11004 raft_consensus.cc:2393] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 17: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:38.361080 17092 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:38.328474 16630 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
W20260709 12:22:38.363315 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 44601.9us
I20260709 12:22:38.364851 10899 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:38.367877 17200 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:38.368399 17200 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.372059 10899 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:38.335389 17065 consensus_queue.cc:1059] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:22:38.375356 10974 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:38.368718 17200 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:38.362936 17214 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:38.392839 17092 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:38.393404 17092 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:38.393810 17092 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:38.400225 16959 consensus_queue.cc:237] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:38.403064 17221 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:38.393942 17214 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:38.384303 17047 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:22:38.412684 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.385131 17169 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:38.413604 17169 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.413990 17169 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:38.343569 17224 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:22:38.408943 17166 consensus_queue.cc:260] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:38.364039 17150 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:22:38.410008 17220 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:38.410560 11657 raft_consensus.cc:1240] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:38.420104 10899 leader_election.cc:400] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15.
I20260709 12:22:38.418747 16630 raft_consensus.cc:3055] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:38.424963 10899 leader_election.cc:403] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 12:22:38.431362 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 97150.5us
I20260709 12:22:38.440332 10974 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:38.449659 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.428745 16630 raft_consensus.cc:740] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:22:38.479494 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 100721us
I20260709 12:22:38.480386 10899 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:38.441809 17151 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15.
I20260709 12:22:38.431313 17199 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:22:38.494060 10899 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:38.498167 10899 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:38.489557 11051 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:38.478396 17166 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:38.501273 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 122297us
I20260709 12:22:38.504330 10899 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
W20260709 12:22:38.505637 11050 leader_election.cc:336] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.683s (SENT)
W20260709 12:22:38.508868 11050 leader_election.cc:336] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 1.683s (SENT)
I20260709 12:22:38.511818 11051 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:38.514874 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 74595.6us
I20260709 12:22:38.515146 11625 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:38.485464 17221 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:38.499913 17191 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:38.502055 16696 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:38.502162 17225 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:38.488492 17065 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:22:38.486214 16702 consensus_queue.cc:1059] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:22:38.492681 17205 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:22:38.516567 17214 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:22:38.554154 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.516573 17199 consensus_queue.cc:1243] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 1abf4b385a2b493ab83f593a1f8c9cd1 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:22:38.518798 17193 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:38.571476 10974 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:38.525767 11051 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:38.522269 17220 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:38.575598 11625 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:38.524355 17191 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:38.527035 17221 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:38.580461 17193 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:38.521236 17165 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:38.526503 17233 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:38.518646 17147 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:38.603327 10927 raft_consensus.cc:1240] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:38.591615 17191 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:38.595445 17193 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:38.605540 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:38.605926 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:38.608888 10928 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:38.606570 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:38.609885 10933 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:38.607548 10977 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:38.617110 11655 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:38.594409 17209 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:38.594861 17221 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:38.622661 17240 consensus_queue.cc:1059] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:22:38.626942 17243 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:22:38.634075 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 157698us
I20260709 12:22:38.580905 16630 consensus_queue.cc:260] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:38.618464 17233 raft_consensus.cc:697] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:38.630555 17221 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:22:38.642349 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 70965.3us
I20260709 12:22:38.639384 17236 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:38.654117 17092 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:38.633980 17065 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:38.646814 10974 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:38.650200 17236 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.629354 17220 consensus_queue.cc:1059] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
W20260709 12:22:38.672444 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 146742us
W20260709 12:22:38.675269 17235 log.cc:927] Time spent T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:22:38.676316 17231 log.cc:927] Time spent T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:22:38.656852 17064 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.684267 17064 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:38.685199 17147 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:38.685902 17230 log.cc:927] Time spent T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:22:38.686866 17064 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:38.689661 11655 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:22:38.674496 11051 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:38.695312 11051 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:38.697877 11051 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:38.666720 17065 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.698863 11051 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:38.707285 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.706881 17147 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:38.708576 17147 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.708948 17147 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:38.705027 17065 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:38.670733 17236 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:38.705814 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:38.719614 11655 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:38.703176 16630 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:38.730405 17251 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:38.730896 17251 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:38.731313 17251 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:38.706872 17245 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:38.732132 17245 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:38.725360 11051 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:38.707729 17204 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:38.704893 17246 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:38.762938 11655 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:22:38.740097 10928 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 13.
W20260709 12:22:38.814393 10899 leader_election.cc:336] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Timed out: RequestConsensusVote RPC to 127.9.131.67:40209 timed out after 1.984s (SENT)
W20260709 12:22:38.756558 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 109844us
I20260709 12:22:38.819233 11625 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:38.821328 17193 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:38.824441 17193 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:38.782473 17169 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:38.826571 17144 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:38.827437 17144 raft_consensus.cc:697] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:38.827955 17169 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:38.828506 17144 consensus_queue.cc:237] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:38.830246 17204 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:38.756194 17233 consensus_queue.cc:237] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:38.807098 17239 log.cc:927] Time spent T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:22:38.833245 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:38.833902 17147 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:38.756390 17092 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:38.836344 17147 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:38.761289 16702 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:38.837343 16702 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:38.837754 16702 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:38.752928 17245 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:38.845563 17214 raft_consensus.cc:3055] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:38.846055 17214 raft_consensus.cc:740] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:38.847010 17214 consensus_queue.cc:260] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:38.866465 11051 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:38.868808 11050 leader_election.cc:336] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 2.056s (SENT)
I20260709 12:22:38.869246 10974 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:38.734364 17250 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:22:38.817094 17246 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:38.867928 11051 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:38.880897 17214 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:38.869436 17147 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:38.807907 17166 consensus_queue.cc:1059] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.087s
I20260709 12:22:38.906746 11051 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:38.954602 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 44592.6us
W20260709 12:22:38.952395 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:38.916422 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 47266.3us
I20260709 12:22:38.962735 11049 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:38.964838 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:38.966663 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:38.967008 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:38.968170 11050 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:38.957722 17200 consensus_meta.cc:287] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.000s
I20260709 12:22:38.971729 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:38.973371 11080 raft_consensus.cc:2393] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 22: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:38.916226 17147 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:38.978221 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:38.971897 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 364367us
I20260709 12:22:38.976990 11082 raft_consensus.cc:2368] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12.
W20260709 12:22:38.963776 17232 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:22:38.979552 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:38.909950 17244 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:38.978902 11077 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:38.960865 17158 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:38.898240 17250 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:38.906637 17246 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:38.989189 17250 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:38.910734 16630 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:22:38.995712 10977 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:38.981271 17147 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:22:38.996591 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 89940.9us
I20260709 12:22:38.985558 17244 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.987653 17215 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:38.999079 17257 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:39.004417 17214 consensus_queue.cc:1059] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:38.969240 16959 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:22:39.009382 10977 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:38.976779 17200 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:38.997268 17166 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:39.012948 17254 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:39.016458 17254 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.016820 17254 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:39.005544 17064 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:39.006446 17244 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:39.029350 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:39.035935 17237 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.036425 17237 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:39.037024 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:39.038224 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:39.038573 17237 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:39.041455 10928 raft_consensus.cc:1240] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:39.035612 10934 raft_consensus.cc:1240] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:39.043097 17251 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:39.044446 11651 raft_consensus.cc:1240] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:39.046962 11080 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:39.046383 10977 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:39.048221 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:39.052394 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:39.056309 17214 consensus_queue.cc:1243] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:22:39.056233 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:39.056363 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 57407.8us
I20260709 12:22:39.057411 17214 consensus_queue.cc:1059] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:39.058146 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:39.058800 17214 raft_consensus.cc:3055] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:39.059253 17214 raft_consensus.cc:740] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:39.060133 17214 consensus_queue.cc:260] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:39.061348 10928 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:22:39.062806 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:39.063367 10931 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:39.064404 10934 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:39.065428 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:39.062773 17214 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:39.068543 10927 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:22:39.069787 10927 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:22:39.071830 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:39.072551 10935 raft_consensus.cc:2393] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 15: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:39.058964 11083 raft_consensus.cc:2393] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:39.075533 10931 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:39.078024 10934 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:39.087805 10931 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:22:39.088078 10928 raft_consensus.cc:1240] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:39.089172 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:39.089793 10935 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:39.093082 11004 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:22:39.055419 10974 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:39.101886 11083 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:22:39.112742 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:39.113549 11007 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 10.
I20260709 12:22:39.101616 11011 raft_consensus.cc:2393] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 18: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:39.114576 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:39.115427 11006 raft_consensus.cc:2393] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 19: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:39.116379 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:39.117050 11009 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:39.118880 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:39.122665 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:39.124138 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:39.125002 11010 raft_consensus.cc:2393] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 14: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:39.126518 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:39.127386 11005 raft_consensus.cc:2393] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 18: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:39.129314 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:39.131608 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 85287.7us
I20260709 12:22:39.132414 10977 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:39.134881 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 75103.5us
I20260709 12:22:39.138473 17266 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.139037 17266 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:39.141638 17260 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.142207 17260 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:39.144462 11657 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:39.146186 11651 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:39.147004 17260 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:39.148543 17260 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:39.149749 17266 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:39.150466 17266 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:39.025050 17064 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:39.156847 11002 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:39.160936 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:39.158650 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:39.158881 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 150086us
I20260709 12:22:39.159281 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:39.162175 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:39.164211 11008 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:22:39.166229 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:39.166913 11004 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:22:39.167618 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:39.169879 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:39.167512 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:39.173405 11002 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:22:39.025782 16702 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:39.180013 17256 log.cc:927] Time spent T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 12:22:39.191021 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:39.155614 17166 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:39.180677 17251 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:39.181878 17138 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:39.183388 17092 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.178398 11050 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:39.190375 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:39.201761 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:39.220552 11003 raft_consensus.cc:2393] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 18: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:39.206187 11010 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:39.206895 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:39.092183 17144 consensus_queue.cc:1059] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.075s
I20260709 12:22:39.112491 17191 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:39.167171 17064 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:39.094587 17229 consensus_queue.cc:1059] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.082s
I20260709 12:22:39.211387 11008 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:22:39.193938 11005 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:22:39.207505 10935 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:39.223932 17251 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:39.224383 17169 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:39.226979 11077 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16. Ops: []
W20260709 12:22:39.275204 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 87081.8us
I20260709 12:22:39.191488 17237 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:22:39.225661 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 47361.9us
W20260709 12:22:39.334002 10899 leader_election.cc:336] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Timed out: RequestConsensusVote RPC to 127.9.131.67:40209 timed out after 1.601s (SENT)
I20260709 12:22:39.334412 10899 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:39.334697 11050 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:39.335364 17266 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:39.335978 11050 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:39.336732 17266 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:39.337256 17259 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:22:39.282089 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 226731us
I20260709 12:22:39.338235 10974 leader_election.cc:400] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12.
I20260709 12:22:39.338529 10974 leader_election.cc:403] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:39.339743 11050 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:39.340591 17264 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:22:39.329099 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 200736us
I20260709 12:22:39.187660 17236 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:39.332989 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 196973us
I20260709 12:22:39.332139 11005 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:22:39.342996 11655 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:39.350186 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:39.325042 10936 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 19. Current term is 20. Ops: []
I20260709 12:22:39.343667 11050 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:39.345229 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:39.213192 17260 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 12:22:39.234648 17205 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:39.284883 17251 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.368745 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:39.371328 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 238972us
I20260709 12:22:39.372123 10977 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:39.374594 11009 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:22:39.227520 17092 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:39.370600 10975 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:39.380270 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:39.280763 17166 consensus_queue.cc:1059] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 12:22:39.383646 11008 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17. Ops: []
W20260709 12:22:39.386036 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 52068.6us
I20260709 12:22:39.355603 17193 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:39.387224 11079 raft_consensus.cc:2393] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:39.391597 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:39.274906 17250 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:39.370522 17266 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:39.373312 17200 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:39.357625 16959 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:22:39.372048 17158 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:39.374169 17251 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:39.408299 11050 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:39.419633 11078 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 21. Current term is 22. Ops: []
I20260709 12:22:39.431823 11079 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:22:39.393489 17259 consensus_queue.cc:1048] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:22:39.449488 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:39.451511 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 79469.8us
I20260709 12:22:39.390832 17254 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:39.460279 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 52046.7us
I20260709 12:22:39.453601 10977 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:39.461558 11050 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:39.428426 17252 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.034s
I20260709 12:22:39.444046 17266 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:22:39.439332 17204 consensus_queue.cc:1059] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
W20260709 12:22:39.499521 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 45974.5us
I20260709 12:22:39.502836 10977 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:39.463673 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:39.443816 17257 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:39.505336 11079 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:39.469092 11050 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:39.460894 17065 consensus_meta.cc:287] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.748s	user 0.006s	sys 0.006s
I20260709 12:22:39.514981 11080 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:39.519730 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:39.521066 10977 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:39.502426 16959 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:22:39.458019 17282 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:22:39.475203 16702 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:39.540314 11004 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 12.
I20260709 12:22:39.538596 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:39.541467 10977 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:39.529435 11079 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 18.
I20260709 12:22:39.471307 17281 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:39.549674 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:39.553285 17169 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:22:39.553735 17221 consensus_meta.cc:287] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.884s	user 0.009s	sys 0.000s
I20260709 12:22:39.554162 17221 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:39.555218 17147 consensus_meta.cc:287] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.001s
I20260709 12:22:39.556408 17092 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:39.558580 17254 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:39.505733 17279 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:39.560168 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:39.519085 17065 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:39.566493 11084 raft_consensus.cc:2393] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 14: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:39.567023 17064 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:39.568864 11081 raft_consensus.cc:1240] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:39.569473 17165 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:39.570245 17257 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:39.570631 17257 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.570956 17257 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:39.555642 17147 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:39.573630 11082 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 19. Current term is 20. Ops: []
I20260709 12:22:39.572533 17244 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:39.525905 17285 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:39.576749 17242 raft_consensus.cc:3055] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:39.577199 17242 raft_consensus.cc:740] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:39.577805 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:39.548032 17281 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.578032 17242 consensus_queue.cc:260] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:39.578804 17281 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:39.579445 17242 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:39.544070 17237 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 11. Current term is 12.
I20260709 12:22:39.591414 17257 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:39.593727 17281 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:39.597568 17281 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:39.600481 17286 log.cc:927] Time spent T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 12:22:39.568804 17263 log.cc:927] Time spent T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:22:39.602653 17250 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:39.605682 17236 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:39.548553 17191 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:39.578261 17269 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:22:39.540525 17240 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:39.549237 17204 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:39.624095 17204 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:22:39.616834 17214 consensus_meta.cc:287] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.551s	user 0.004s	sys 0.008s
I20260709 12:22:39.636658 17204 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:39.639719 17221 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:39.647518 17204 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:39.622032 17245 consensus_meta.cc:287] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.778s	user 0.004s	sys 0.004s
I20260709 12:22:39.677016 17245 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:39.631261 17262 log.cc:927] Time spent T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.613s	user 0.002s	sys 0.000s
I20260709 12:22:39.660441 17241 raft_consensus.cc:3055] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:39.679752 17241 raft_consensus.cc:740] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:39.680202 17092 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.680657 17241 consensus_queue.cc:260] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:39.680697 17092 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:39.684528 17092 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:39.684752 17251 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:39.685341 11076 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: []
W20260709 12:22:39.686596 10899 leader_election.cc:336] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Timed out: RequestConsensusVote RPC to 127.9.131.67:40209 timed out after 1.823s (SENT)
I20260709 12:22:39.686920 11003 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:22:39.687071 10899 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:39.688706 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:39.689291 17255 log.cc:927] Time spent T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.671s	user 0.001s	sys 0.001s
I20260709 12:22:39.689505 11076 raft_consensus.cc:2393] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:39.690442 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:39.691009 11076 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:39.693491 17245 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:39.681926 17241 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:39.694530 17064 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:39.698297 11079 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:39.699642 11652 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:39.662089 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:39.700822 11084 raft_consensus.cc:2393] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 15: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:39.701951 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:39.676111 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:39.709568 17244 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:39.709890 17191 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:22:39.610106 17246 consensus_meta.cc:287] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.621s	user 0.006s	sys 0.003s
I20260709 12:22:39.712342 17257 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:39.712126 17246 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:39.713548 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:39.714139 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:39.715348 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:39.715669 17246 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:39.716235 17191 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:39.716842 17065 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:39.718089 17209 raft_consensus.cc:3055] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:39.718523 17209 raft_consensus.cc:740] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:39.719417 17209 consensus_queue.cc:260] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:39.720683 10974 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:39.709631 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:39.722239 11085 raft_consensus.cc:2368] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14.
I20260709 12:22:39.723114 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:39.723901 10899 leader_election.cc:336] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Timed out: RequestConsensusVote RPC to 127.9.131.67:40209 timed out after 1.917s (SENT)
W20260709 12:22:39.735646 10899 leader_election.cc:336] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Timed out: RequestConsensusVote RPC to 127.9.131.67:40209 timed out after 1.919s (SENT)
W20260709 12:22:39.738624 10899 leader_election.cc:336] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Timed out: RequestConsensusVote RPC to 127.9.131.67:40209 timed out after 1.933s (SENT)
I20260709 12:22:39.739136 10899 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:39.740909 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 271872us
I20260709 12:22:39.742019 11050 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:39.742725 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3237) took 1137 ms. Trace:
I20260709 12:22:39.742885 17294 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:39.743173 10936 rpcz_store.cc:276] 0709 12:22:38.604905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.605012 (+   107us) service_pool.cc:224] Handling call
0709 12:22:38.605754 (+   742us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:39.358112 (+752358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.742451 (+384339us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b5400451354. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:39.742640 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1561386368}
I20260709 12:22:39.741357 17092 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:22:39.744917 17243 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:39.745496 17243 raft_consensus.cc:697] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:39.746409 17294 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:39.746596 17200 consensus_queue.cc:1059] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:22:39.747439 17200 consensus_queue.cc:1059] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:39.748162 17200 consensus_queue.cc:1059] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:39.748755 10934 raft_consensus.cc:1240] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:39.748977 17200 raft_consensus.cc:3055] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:39.749500 17200 raft_consensus.cc:740] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:39.749650 11050 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:39.750510 17294 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:39.734249 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:39.752736 11078 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:39.753073 17294 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:39.741189 17260 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:39.754953 17229 raft_consensus.cc:3055] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:39.755390 17229 raft_consensus.cc:740] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:39.750053 17248 raft_consensus.cc:3055] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:22:39.756263 17248 raft_consensus.cc:740] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:39.757117 17248 consensus_queue.cc:260] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:39.758502 17248 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:39.720970 17209 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:39.764012 10934 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:22:39.764546 10934 pending_rounds.cc:85] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 11
I20260709 12:22:39.764663 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:39.766001 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:39.766564 11082 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:39.764129 10929 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:39.764789 10934 pending_rounds.cc:107] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:22:39.768183 10934 raft_consensus.cc:2889] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:39.746451 17243 consensus_queue.cc:237] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:39.770973 17271 log.cc:927] Time spent T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.414s	user 0.001s	sys 0.000s
I20260709 12:22:39.756287 17229 consensus_queue.cc:260] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:39.773108 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:39.773392 17229 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:39.773936 11081 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 16: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:39.774024 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:39.774693 11085 raft_consensus.cc:2376] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18. Re-sending same reply.
I20260709 12:22:39.775527 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:39.724860 17147 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:39.780108 11085 raft_consensus.cc:2393] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 15: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:39.780974 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:39.782099 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:39.782711 11085 raft_consensus.cc:2368] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18.
I20260709 12:22:39.783500 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:39.785581 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:39.776913 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:39.788221 17273 log.cc:927] Time spent T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.501s	user 0.002s	sys 0.000s
I20260709 12:22:39.788527 11080 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:39.789920 11011 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 20. Current term is 21. Ops: []
I20260709 12:22:39.792042 17251 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:39.774839 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:39.793103 11081 raft_consensus.cc:2393] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 19: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:39.793946 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:39.794648 11081 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 19: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:22:39.795531 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:39.794574 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:39.801177 11077 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 15: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:39.804399 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:39.804401 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:39.806140 11003 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:22:39.811923 11622 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:39.802193 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:39.813601 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:39.814790 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:39.815943 17233 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:39.818724 17233 consensus_queue.cc:1059] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:39.820156 17064 raft_consensus.cc:3055] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:39.820663 17064 raft_consensus.cc:740] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:22:39.786662 10832 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 116) took 13644 ms (client timeout 15000 ms). Trace:
I20260709 12:22:39.776475 17200 consensus_queue.cc:260] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:39.821610 17064 consensus_queue.cc:260] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:39.787712 17240 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:22:39.825774 17240 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.826164 17240 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:39.826602 17200 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:39.798524 17215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.004s	sys 0.011s
I20260709 12:22:39.776306 10936 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:22:39.787422 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 246022us
I20260709 12:22:39.824839 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:39.825201 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:39.828531 17215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.004s	sys 0.012s
I20260709 12:22:39.828923 17215 raft_consensus.cc:697] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:39.829517 10977 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:39.830422 17246 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:39.830837 17246 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.829896 17215 consensus_queue.cc:237] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:39.831197 17246 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:39.699364 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:39.718402 11076 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:39.835208 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:39.832194 10832 rpcz_store.cc:269] 0709 12:22:26.149057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.152116 (+  3059us) service_pool.cc:224] Handling call
0709 12:22:39.786592 (+13634476us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:37.309241 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:37.309876 (+   635us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:37.309931 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:22:37.309945 (+    14us) tablet.cc:662] Decoding operations
0709 12:22:37.310808 (+   863us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:37.310901 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:37.310928 (+    27us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:22:37.311660 (+   732us) tablet.cc:701] Row locks acquired
0709 12:22:37.311721 (+    61us) write_op.cc:260] PREPARE: finished
0709 12:22:37.311894 (+   173us) write_op.cc:270] Start()
0709 12:22:37.312045 (+   151us) write_op.cc:276] Timestamp: P: 1783599757311811 usec, L: 0
0709 12:22:37.312076 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:22:37.371644 (+ 59568us) log.cc:844] Serialized 3190 byte log entry
0709 12:22:38.087368 (+715724us) op_driver.cc:464] REPLICATION: finished
0709 12:22:38.322553 (+235185us) write_op.cc:301] APPLY: starting
0709 12:22:38.333032 (+ 10479us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:38.399841 (+ 66809us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:38.413678 (+ 13837us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:38.737812 (+324134us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:38.738117 (+   305us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 12:22:38.738184 (+    67us) write_op.cc:312] APPLY: finished
0709 12:22:38.738524 (+   340us) log.cc:844] Serialized 81 byte log entry
0709 12:22:38.806877 (+ 68353us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:38.815538 (+  8661us) write_op.cc:454] Released schema lock
0709 12:22:38.875257 (+ 59719us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:38.970061 (+ 94804us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:38.971588 (+  1527us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":65601,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":213557,"apply.run_cpu_time_us":15681,"apply.run_wall_time_us":651096,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37519,"num_ops":8,"prepare.queue_time_us":319900,"prepare.run_cpu_time_us":26251,"prepare.run_wall_time_us":297922,"raft.queue_time_us":114531,"raft.run_cpu_time_us":54633,"raft.run_wall_time_us":181983,"replication_time_us":764315,"thread_start_us":476034,"threads_started":4,"wal-append.queue_time_us":272280,"wal-append.run_cpu_time_us":19172,"wal-append.run_wall_time_us":2075730}]]}
I20260709 12:22:39.834436 11079 raft_consensus.cc:2368] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18.
I20260709 12:22:39.836550 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:39.837013 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:39.837308 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:39.837707 10932 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:39.837918 10935 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:39.724622 17204 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:39.795485 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:39.749079 17241 raft_consensus.cc:3055] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:39.841228 17241 raft_consensus.cc:740] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:39.841735 17251 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:39.842554 17251 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:39.842820 17241 consensus_queue.cc:260] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:39.845645 17241 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:39.845963 10977 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:39.848182 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:39.848676 17251 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:39.850790 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:39.841274 11080 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:22:39.853144 17233 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:39.854367 11051 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:39.889106 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:39.888321 10932 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:39.854488 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:39.890261 11083 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:39.854903 17306 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:39.836889 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:39.890735 11005 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:39.837888 11076 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:22:39.860755 17221 consensus_queue.cc:1059] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:39.862057 17138 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:39.899840 11080 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:22:39.862339 17193 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:39.862759 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:39.862344 17204 consensus_queue.cc:1059] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:39.865850 17209 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:39.866786 17064 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:39.869372 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:39.871035 17246 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:39.851028 17240 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:39.872689 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:39.876209 10935 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:22:39.877832 11011 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:22:39.880368 10977 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:39.779387 11078 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:39.885848 11082 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:22:39.888310 10936 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:39.888535 11077 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
W20260709 12:22:39.893219 17134 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.000s	sys 0.012s
W20260709 12:22:39.894261 10899 leader_election.cc:336] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Timed out: RequestConsensusVote RPC to 127.9.131.67:40209 timed out after 2.089s (SENT)
I20260709 12:22:39.897511 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:22:39.897785 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 43504.5us
I20260709 12:22:39.821561 17229 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:39.740950  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:39.946143 11005 raft_consensus.cc:2393] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 14: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:39.900863 17243 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:39.947171 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:39.947590 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:39.947813 11005 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:39.948197 17134 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.000s	sys 0.014s
I20260709 12:22:39.948823 11082 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:39.944654 11003 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 20: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:39.952268 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:39.952757 11051 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:39.953402 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:39.954934 17298 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:39.955295 17244 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:39.915486 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:39.957223 10936 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:39.939005 17294 consensus_queue.cc:1059] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:22:39.958464 17229 raft_consensus.cc:697] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:39.925576 10927 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:22:39.959717 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:39.959645 17229 consensus_queue.cc:237] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:39.958752 10899 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:39.933100 11006 raft_consensus.cc:3055] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:39.937990 11002 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:22:39.910256 11076 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 20. Current term is 21. Ops: []
I20260709 12:22:39.963699 11078 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:22:39.963912 11006 raft_consensus.cc:740] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:39.955549 17298 raft_consensus.cc:697] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:39.904328 17259 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:39.961174 11007 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 12:22:39.935706 17246 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:39.966778 11077 raft_consensus.cc:1275] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:22:39.969161 11005 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:39.935755 10974 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:40.002349 11005 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: []
W20260709 12:22:39.994448 11651 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.019s	sys 0.028s
W20260709 12:22:40.003873 11651 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.019s	sys 0.028s
I20260709 12:22:39.973376 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:39.958462 17233 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:40.003043 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 103185us
I20260709 12:22:40.003293 11076 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:22:39.993557 11007 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:22:40.006454 11005 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: []
W20260709 12:22:39.973879 17309 log.cc:927] Time spent T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:22:39.906031 17191 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.097s
W20260709 12:22:40.008963 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 128675us
I20260709 12:22:39.937683 17240 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:40.012701 10977 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:40.010622 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 74953.7us
I20260709 12:22:40.009833 11007 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 12:22:40.013994 10974 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:40.006548 11006 consensus_queue.cc:260] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:40.015445 11006 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:40.016845 11076 raft_consensus.cc:1240] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:40.017138 11077 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:22:40.022253 11078 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:22:40.023901 10977 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:40.028837 10974 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:40.029421 10977 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:40.032528 11076 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:40.010963 17233 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:40.035486 17233 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:40.036965 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 138699us
I20260709 12:22:40.008381 17300 raft_consensus.cc:3055] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:40.044502 10977 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:40.044953 10927 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:40.045709 10977 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:40.047917 11078 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 12:22:40.042513 11007 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:22:40.043363 11081 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:40.010842 17204 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:40.017517 17252 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:22:40.055526 10977 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:40.069559 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:40.036608 17246 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:40.036161 17237 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:40.043697 17166 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:40.080016 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:40.055642 17249 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:40.089031 10977 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:40.062301 17243 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:40.044104 17300 raft_consensus.cc:740] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:40.067901 17221 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:40.070027 17240 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:40.111428 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:40.112147 11007 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:40.113148 10977 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:40.091370 17166 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:40.122157 11004 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:40.123075 11003 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
W20260709 12:22:40.129361 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.118747 17166 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:40.118196 17252 raft_consensus.cc:697] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:40.124274 17240 raft_consensus.cc:2764] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 12:22:40.127064 11006 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:22:40.136595 11006 pending_rounds.cc:85] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 11
I20260709 12:22:40.136907 11006 pending_rounds.cc:107] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:22:40.137192 11006 raft_consensus.cc:2889] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:40.139627 17221 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.146847 17221 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:40.149716 17221 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:40.126546 17249 raft_consensus.cc:697] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:40.156783 17249 consensus_queue.cc:237] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:40.169142 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.167690 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:40.174165 11006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3622) took 1037 ms. Trace:
I20260709 12:22:40.174670 11006 rpcz_store.cc:276] 0709 12:22:39.136273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.326059 (+189786us) service_pool.cc:224] Handling call
0709 12:22:39.358730 (+ 32671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:39.932981 (+574251us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b540038f2a0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0ed7dc0 00007f9bb0f621c0 00007f9bb0f63231 00007f9bb0f5fd8f 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c
0709 12:22:40.173909 (+240928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.174093 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1297218816}
I20260709 12:22:40.108157 17298 consensus_queue.cc:237] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:40.181249 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.195358 17252 consensus_queue.cc:237] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:40.138273 17237 consensus_queue.cc:1059] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:22:40.188577 17240 consensus_queue.cc:1059] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
W20260709 12:22:40.204613 17158 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:22:40.181520 17279 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:40.206331 17279 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:40.206797 17279 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:40.135448 17300 consensus_queue.cc:260] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:40.211290 17300 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:40.199880 17237 consensus_queue.cc:1243] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 1abf4b385a2b493ab83f593a1f8c9cd1 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:22:40.222529 17092 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:22:40.222978 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 228617us
I20260709 12:22:40.223989 11051 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:40.224498 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 330277us
W20260709 12:22:40.225308 10899 leader_election.cc:336] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Timed out: RequestConsensusVote RPC to 127.9.131.67:40209 timed out after 2.147s (SENT)
I20260709 12:22:40.225674 17215 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:40.226243 17215 raft_consensus.cc:697] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:40.226627 11051 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:40.227530 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 189266us
W20260709 12:22:40.227252 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.225713 10899 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:40.229450 11051 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:40.232193 11083 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:22:40.237468 11082 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:40.227087 17215 consensus_queue.cc:237] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:40.226969 17193 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:40.235731 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 172095us
I20260709 12:22:40.220232 17251 raft_consensus.cc:3055] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:22:40.241291 10974 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:40.239787 11010 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
W20260709 12:22:40.289280 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 59908.7us
I20260709 12:22:40.293681 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:22:40.295823 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 53517.2us
I20260709 12:22:40.296550 11050 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:40.297762 11008 raft_consensus.cc:1240] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:40.301339 11622 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:40.303205 11004 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 15.
I20260709 12:22:40.304476 11624 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:40.234722 17294 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 12:22:40.247980 17204 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:22:40.308190 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.244071 17251 raft_consensus.cc:740] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:40.310436 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:40.261600 17240 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:22:40.311295 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.317364 11081 raft_consensus.cc:1240] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:40.242615 17259 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 12:22:40.322866 11009 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:40.331877 17248 raft_consensus.cc:3055] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:40.335927 17204 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:22:40.343349 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 118057us
W20260709 12:22:40.351155 10899 leader_election.cc:336] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Timed out: RequestConsensusVote RPC to 127.9.131.67:40209 timed out after 2.150s (SENT)
I20260709 12:22:40.351611 10899 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:40.261335 17214 consensus_queue.cc:1059] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
W20260709 12:22:40.311367 17322 log.cc:927] Time spent T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 12:22:40.347754 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 51287.4us
I20260709 12:22:40.286950 17092 consensus_queue.cc:1059] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:22:40.316428 17191 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:40.387686 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 77704.6us
I20260709 12:22:40.285431 17319 consensus_queue.cc:1059] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 12:22:40.353809 16630 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.348261 17258 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:40.346083 17248 raft_consensus.cc:740] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:40.316212 17229 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:22:40.410009 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 54222.4us
I20260709 12:22:40.310968 17296 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:40.356410 17204 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:40.404088 17295 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:40.415678 17245 raft_consensus.cc:3055] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:40.421033 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:40.421897 11082 raft_consensus.cc:2393] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 15: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:40.422515 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:40.387604 17240 raft_consensus.cc:697] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:40.424690 17240 consensus_queue.cc:237] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:40.354166 17266 consensus_queue.cc:1059] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
W20260709 12:22:40.419567 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 68458.6us
W20260709 12:22:40.427973 10899 leader_election.cc:336] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Timed out: RequestConsensusVote RPC to 127.9.131.67:40209 timed out after 2.168s (SENT)
I20260709 12:22:40.428366 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:40.428921 10899 leader_election.cc:336] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Timed out: RequestConsensusVote RPC to 127.9.131.67:40209 timed out after 2.172s (SENT)
I20260709 12:22:40.429440 10899 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:40.355134 17279 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:40.436544 11083 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:22:40.451939 11655 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:40.456387 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:40.456374 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:40.458083 11078 raft_consensus.cc:2376] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20. Re-sending same reply.
I20260709 12:22:40.395849 17209 consensus_queue.cc:1059] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 12:22:40.460523 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:40.464046 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 107938us
I20260709 12:22:40.466184 11081 raft_consensus.cc:2393] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 20: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:40.466876 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:40.467563 11079 raft_consensus.cc:2376] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19. Re-sending same reply.
W20260709 12:22:40.451472 17335 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:22:40.420971 17245 raft_consensus.cc:740] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:40.405063 16630 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:40.443383 17064 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:40.478170 17340 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:22:40.484475 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 55581.8us
I20260709 12:22:40.431416 17251 consensus_queue.cc:260] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:40.471691 17319 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:22:40.475538 17258 consensus_queue.cc:1059] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:22:40.451408 17330 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.501030 17264 raft_consensus.cc:3055] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:22:40.501516 17264 raft_consensus.cc:740] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:40.502381 17264 consensus_queue.cc:260] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:40.504604 17334 log.cc:927] Time spent T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:22:40.443573 17297 consensus_queue.cc:1059] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:22:40.503652 17264 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:40.506521 17330 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:40.523350 17330 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:40.523936 17279 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:40.511305 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 116295us
I20260709 12:22:40.492506 17131 raft_consensus.cc:3055] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:40.501058 17346 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:40.497233 17295 raft_consensus.cc:697] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:22:40.549273 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:40.560482 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.472106 17343 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.060s
W20260709 12:22:40.562527 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 95657.7us
I20260709 12:22:40.475756 17248 consensus_queue.cc:260] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:40.528468 17131 raft_consensus.cc:740] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:22:40.571480 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 153873us
W20260709 12:22:40.570084 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 341210us
W20260709 12:22:40.579505 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 94399.6us
W20260709 12:22:40.581604 10899 leader_election.cc:336] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Timed out: RequestConsensusVote RPC to 127.9.131.67:40209 timed out after 2.493s (SENT)
I20260709 12:22:40.561430 17229 raft_consensus.cc:697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:40.584731 10901 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:40.571378 17266 raft_consensus.cc:3055] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:22:40.511600 11009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "015a67e38c364985be24b18358579506"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:22:40.589886 11009 raft_consensus.cc:606] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:40.590399 11009 raft_consensus.cc:614] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:40.594660 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:40.598066 11081 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 12:22:40.599942 17147 consensus_queue.cc:1059] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:40.600342 11079 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:22:40.588613 17193 consensus_queue.cc:1059] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
W20260709 12:22:40.602069 17331 log.cc:927] Time spent T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:22:40.601891 17221 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:40.604046 17131 consensus_queue.cc:260] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:40.605301 17131 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:40.609630 17339 raft_consensus.cc:3055] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:40.610105 17339 raft_consensus.cc:740] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:40.585538 17248 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:40.612236 10831 catalog_manager.cc:5697] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:40.614945 10831 catalog_manager.cc:5697] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 9 to 14, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 14 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:22:40.616418 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:40.617758 17349 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:40.618191 17349 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.618521 17349 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:40.633258 17166 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:40.597750 17244 raft_consensus.cc:3055] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:40.636090 11011 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:40.636409 17244 raft_consensus.cc:740] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:40.588497 17266 raft_consensus.cc:740] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:40.637702 17266 consensus_queue.cc:260] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:40.638833 17266 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:40.639496 17193 raft_consensus.cc:3055] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:22:40.639951 17193 raft_consensus.cc:740] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:40.592497 17295 consensus_queue.cc:237] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:40.640795 17193 consensus_queue.cc:260] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:40.641059 17245 consensus_queue.cc:260] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:40.642031 17193 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:40.642196 17245 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:40.645016 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:40.646512 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 49740.8us
W20260709 12:22:40.596771 17326 log.cc:927] Time spent T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 12:22:40.648811 10831 catalog_manager.cc:5697] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:40.656149 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:40.659360 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.662307 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:40.647656 11050 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:40.638302 17330 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:22:40.667310 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 85578.4us
W20260709 12:22:40.671242 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.671583 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:40.671828 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:40.664052 10831 catalog_manager.cc:5697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:40.677337 10932 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:40.683795 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:40.684479 10932 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:40.677599 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:40.678789 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.680383 10936 raft_consensus.cc:2393] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:40.679966 10927 raft_consensus.cc:2393] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 14: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:40.692512 10934 raft_consensus.cc:2393] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:40.649384 17166 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:40.676854 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:40.694931 10935 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:40.697110 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:40.697870 10931 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:40.700268 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:40.701187 10928 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:40.705194 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 104305us
I20260709 12:22:40.708500 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:40.716424 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:40.717008 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:40.717500 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.718076 11051 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:40.725041 10933 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 21. Current term is 22. Ops: []
I20260709 12:22:40.740792 11011 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:22:40.739599 11051 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:40.742534 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 318962us
I20260709 12:22:40.679021 17316 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:22:40.769521 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:40.770823 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:40.771363 10936 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:40.727525 17343 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:22:40.679620 17330 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:40.755678 17354 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:40.673099 17356 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 12:22:40.789003 17354 raft_consensus.cc:697] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:22:40.754778 17348 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:22:40.776880 10977 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:40.813644 10977 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:40.777654 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 130073us
I20260709 12:22:40.778855 11051 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:40.786584 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:40.817245 10927 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:40.786767 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:40.787319 17297 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:22:40.787618 17339 consensus_queue.cc:260] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:40.788316 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:40.774653 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:40.782099 10899 leader_election.cc:336] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Timed out: RequestConsensusVote RPC to 127.9.131.67:40209 timed out after 2.739s (SENT)
I20260709 12:22:40.752561 17134 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.840545 10935 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:40.831454 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 52668.7us
I20260709 12:22:40.833163 11050 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:40.837877 10977 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:40.789314 16702 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:40.853374 17252 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:40.853295 16702 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.854765 16702 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:40.855134 17330 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:40.856061 17260 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:40.856622 17260 raft_consensus.cc:697] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:40.857612 17260 consensus_queue.cc:237] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:40.853307 17134 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:40.854171 11077 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:22:40.854290 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:40.853330 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 71277.4us
I20260709 12:22:40.864544 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:40.854682 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:40.782106 10928 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:40.872946 10931 raft_consensus.cc:2410] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:22:40.734918 10932 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:22:40.694051 17229 consensus_queue.cc:237] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:40.875038 11079 raft_consensus.cc:2393] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 19: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:40.875566 10929 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:22:40.878440 10936 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:40.882061 10935 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:40.878623 10977 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:40.909596 10899 leader_election.cc:400] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18.
I20260709 12:22:40.909986 10899 leader_election.cc:403] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:22:40.909912 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:40.743494 17296 consensus_queue.cc:1059] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.102s
I20260709 12:22:40.915623 10899 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:40.916584 17316 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18.
I20260709 12:22:40.917307 17316 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:40.917594 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:40.918506 10899 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:40.919535 17316 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:40.921164 17204 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:40.921955 10899 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:40.922744 17316 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:40.923237 17316 raft_consensus.cc:697] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:40.910310 17346 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.844937 17240 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:40.845835 17279 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:22:40.925244 10899 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:40.936067 10927 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:22:40.773699 17352 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.134s
I20260709 12:22:40.875824 17306 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:40.910333 17221 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:40.876042 17297 raft_consensus.cc:697] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:40.910689 17248 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:22:40.952762 10899 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:40.949257 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:40.954259 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.955294 10931 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20. Ops: [16.8-19.10]
I20260709 12:22:40.956816 10931 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 21. Current term is 22. Ops: [20.11-21.12]
I20260709 12:22:40.854113 17252 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:40.941217 17339 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:40.949705 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:40.946885 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:40.912575 17131 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:40.960664 10935 raft_consensus.cc:2393] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 20: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:40.950610 10936 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:22:40.991503 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:41.002683 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:40.947973 17353 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.948038 17296 raft_consensus.cc:3055] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:40.949199 17064 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.998235 17359 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:40.953568 17221 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.015444 10831 catalog_manager.cc:5697] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 13 to 14, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 14 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:41.044533 10930 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:40.992095 17241 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.998237 17357 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:22:41.068168 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.133948 10935 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14. Ops: []
W20260709 12:22:41.011266 17362 log.cc:927] Time spent T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:22:41.139241 10831 catalog_manager.cc:5697] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 14 to 16, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 16 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
W20260709 12:22:41.097661 17264 consensus_meta.cc:287] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.000s
I20260709 12:22:41.012126 17296 raft_consensus.cc:740] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:41.007368 17306 raft_consensus.cc:697] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:40.924080 17346 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:41.086478 17221 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:41.157179 10831 catalog_manager.cc:5697] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 11 to 12, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 12 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:41.049283 17353 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:41.096541 17249 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.082666 17064 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:41.196815 10927 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:41.144975 17359 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:22:41.138873 17241 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:41.194212 17349 consensus_meta.cc:287] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.573s	user 0.008s	sys 0.004s
I20260709 12:22:41.216609 10831 catalog_manager.cc:5697] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:41.221470 10831 catalog_manager.cc:5697] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 9 to 12, leader changed from 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 12 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:41.233570 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 186764us
I20260709 12:22:41.209618 17330 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:41.193204 17249 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:41.212975 17370 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:22:41.241076 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:41.269642 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.950434 17316 consensus_queue.cc:237] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:41.197163 17297 consensus_queue.cc:237] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:41.244611 17266 consensus_meta.cc:287] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.601s	user 0.005s	sys 0.005s
W20260709 12:22:41.006338 17092 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.016s	sys 0.019s
I20260709 12:22:41.251888 17240 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.225919 17349 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:41.278127 17131 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 12:22:41.238029 17306 consensus_queue.cc:237] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:41.317421 17092 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.020s	sys 0.019s
I20260709 12:22:41.219413 17296 consensus_queue.cc:260] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:41.289289 17368 log.cc:927] Time spent T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 12:22:41.290316 17374 log.cc:927] Time spent T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:22:41.292315 17365 log.cc:927] Time spent T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:22:41.293265 17353 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:41.293485 17193 consensus_meta.cc:287] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.636s	user 0.009s	sys 0.000s
I20260709 12:22:41.250211 16702 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:41.294697 17249 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:41.358912 17373 log.cc:927] Time spent T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:22:41.300134 17252 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:41.300892 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:41.361028 11077 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 15.
I20260709 12:22:41.301726 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:41.304476 17221 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:41.305513 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:41.358265 17381 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:22:41.308319 17382 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:41.309203 17248 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:41.368249 17064 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:41.368134 17248 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:41.368791 17064 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:41.370355 17248 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:41.309646 17359 consensus_queue.cc:1048] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:41.007190 17354 consensus_queue.cc:237] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:41.312564 17134 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:41.356746 17364 log.cc:927] Time spent T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
W20260709 12:22:41.314520 17245 consensus_meta.cc:287] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.666s	user 0.010s	sys 0.001s
I20260709 12:22:41.304409 17241 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:41.249971 17330 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:41.355439 10932 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:22:41.356917 17378 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:22:41.357864 17369 log.cc:927] Time spent T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:22:41.358230 16702 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:41.364871 17349 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:41.373176 11622 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:41.313171 17257 raft_consensus.cc:3055] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:41.377413 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:22:41.358263 17371 log.cc:927] Time spent T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:22:41.385591 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 106450us
I20260709 12:22:41.386741 10934 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:22:41.325570 17240 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:41.252198 17370 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:41.396427 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:41.392076 10899 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:41.398000 11051 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:41.399513 17319 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:41.399842 10899 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:41.402812 10899 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:41.383800 17257 raft_consensus.cc:740] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:41.379272 17353 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 12:22:41.404951 11051 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:41.370263 17244 consensus_queue.cc:260] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:41.396297 16702 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.411827 11051 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:41.380899 17064 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:41.414973 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.402684 17298 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:41.405643 17319 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:41.405839 17245 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:41.428342 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.391111 17349 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:22:41.395129 17134 consensus_queue.cc:1059] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:22:41.410470 17381 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:22:41.428985 10928 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.018s	sys 0.008s
I20260709 12:22:41.415829 17260 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:41.424899 17258 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:22:41.425220 17244 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:41.425472 17248 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.428762 17382 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:41.452696 10899 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:41.457163 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 45120.3us
W20260709 12:22:41.455922 10928 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.019s	sys 0.009s
I20260709 12:22:41.418776 16702 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:41.453380 17339 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:41.428614 17266 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:22:41.432468 17245 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:41.464895 17134 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:22:41.456683 17248 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:41.491482 17367 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.498394 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:41.498690 17064 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:41.455675 17381 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:41.464725 17382 raft_consensus.cc:697] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:22:41.491482 17376 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:22:41.548864 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:41.469985 17339 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:41.522332 17241 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:41.491617 17363 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:41.652535 11078 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:41.547775 17249 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:41.653301 17260 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:41.540529 17252 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:41.450932 17257 consensus_queue.cc:260] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:41.552906 17349 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:22:41.707029 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 245727us
W20260709 12:22:41.696861 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 228490us
I20260709 12:22:41.691282 17353 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.706350 17370 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:41.780313 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.781985 11078 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:22:41.733673 10899 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:41.709889 17330 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:41.786814 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 51500.6us
I20260709 12:22:41.706641 17241 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:41.702072 17383 log.cc:927] Time spent T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.315s	user 0.007s	sys 0.021s
I20260709 12:22:41.741289 17257 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:41.798497 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:41.711898 17363 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.690609 17367 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:41.710008 17249 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:41.715131 17252 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:41.785300 17064 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.786842 17297 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:41.712697 17260 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:41.791153 17193 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:41.735203 17349 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:41.803267 17240 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:41.816118 17233 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:41.815402 17363 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:41.821805 17229 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:41.814138 17353 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:41.872328 17397 log.cc:927] Time spent T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 12:22:41.874646 17399 log.cc:927] Time spent T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:22:41.791357 17382 consensus_queue.cc:237] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:41.879385 17394 log.cc:927] Time spent T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 12:22:41.882061 17241 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:41.882781 17241 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:41.885357 17367 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:41.890362 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 92056.2us
W20260709 12:22:41.855372 17386 log.cc:927] Time spent T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.372s	user 0.000s	sys 0.001s
I20260709 12:22:41.840794 17240 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.883296 17241 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:41.856681 16702 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:41.829563 17064 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:41.887594 17353 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:41.916064 17391 log.cc:927] Time spent T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.368s	user 0.000s	sys 0.001s
I20260709 12:22:41.915845 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:41.918323 17252 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:41.832329 17297 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:41.916460 17367 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.961241 10930 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 15.
I20260709 12:22:41.957831 10927 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:22:41.968502 11006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3635) took 1248 ms. Trace:
I20260709 12:22:41.969848 11006 rpcz_store.cc:276] 0709 12:22:40.673383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.675705 (+  2322us) service_pool.cc:224] Handling call
0709 12:22:40.705995 (+ 30290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.706225 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:22:40.732500 (+ 26275us) log.cc:844] Serialized 14 byte log entry
0709 12:22:41.406668 (+674168us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b18001ef340. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b 00007f9bb0affd23 00007f9bb0b0023a 00007f9bb0f6aa2a
0709 12:22:41.642520 (+235852us) log.cc:844] Serialized 14 byte log entry
0709 12:22:41.921226 (+278706us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:41.921277 (+    51us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:41.921326 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.921392 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:41.921500 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":304594,"prepare.run_cpu_time_us":134,"prepare.run_wall_time_us":5601,"raft.queue_time_us":209386,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":36859,"spinlock_wait_cycles":6831360,"thread_start_us":497817,"threads_started":3,"wal-append.queue_time_us":974094}
I20260709 12:22:41.970297 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:41.957479 17241 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:41.984162 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:41.851079 17233 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:41.986409 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 93063.3us
W20260709 12:22:41.920910 17390 log.cc:927] Time spent T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
W20260709 12:22:41.990970 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 192997us
I20260709 12:22:41.959322 17204 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:41.959084 17349 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:41.959306 17248 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:41.958199 16630 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:42.000669 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:41.969798 16702 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.004789 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.005590 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:42.008538 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.017345 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.018790 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.019275 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:42.019541 11082 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:41.995052 17339 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:42.012461 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:42.021587 11084 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 15: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:41.858654 17229 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:42.018664 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:42.025499 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:42.022307 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.020193 11003 raft_consensus.cc:2393] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 17: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:42.026721 11009 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:22:42.023849 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.025581 11005 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:42.023255 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.021857 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:41.920033 17240 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.031967 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:42.032624 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.035471 11081 raft_consensus.cc:2393] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 14: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:42.036164 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:42.036839 11006 raft_consensus.cc:1813] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Handling vote request from an unknown peer 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:42.037339 11006 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 12: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:42.010756 17354 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:42.041366 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.986021 17367 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:41.996884 17353 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:22:42.012717 17241 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:42.050091 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:42.051458 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:42.052171 11006 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:42.052331 11003 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:22:42.020905 17405 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.060173 11085 raft_consensus.cc:1240] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:22:42.026471 17381 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.028807 17260 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:42.065415 11081 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:22:42.024293 16702 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.081362 11005 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:22:42.051574 17354 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:42.063977 17241 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.114259 17347 raft_consensus.cc:3055] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:42.114687 17428 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:42.091022 17249 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:42.115821 17319 consensus_meta.cc:287] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.666s	user 0.008s	sys 0.002s
W20260709 12:22:42.116205 17375 log.cc:927] Time spent T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.885s	user 0.004s	sys 0.004s
I20260709 12:22:42.071110 17405 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:42.135573 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 100538us
I20260709 12:22:42.147483 11010 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:42.148204 10899 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:42.143379 11079 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 16.
I20260709 12:22:42.149358 10899 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:42.155503 10927 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:22:42.156858 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.158236 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.159260 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:42.161288 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.166129 10899 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:42.168073 10899 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:42.168514 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.176112 10899 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:42.187101 10899 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:42.144752 17319 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:42.143363 17347 raft_consensus.cc:740] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:42.111053 17363 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:42.189476 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.195479 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.197589 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.173174 17382 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:42.212168 10899 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:42.177755 17064 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:42.179642 17248 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:42.180811 17297 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:42.213596 10930 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:22:42.200899 17381 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:42.202497 17233 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:42.213549 17349 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:42.216784 17414 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:42.228217 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:42.164994 17428 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:42.230067 17418 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:42.216919 17417 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:42.247294 17414 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:42.247876 17338 raft_consensus.cc:3055] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:42.244699 17134 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:42.248732 17363 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.249105 17354 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:42.249265 17421 log.cc:927] Time spent T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 12:22:42.250258 17244 consensus_meta.cc:287] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.794s	user 0.011s	sys 0.000s
I20260709 12:22:42.253468 17405 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.224326 17249 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.221498 17240 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.261768 17414 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:42.303222 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 44674.9us
I20260709 12:22:42.328306 10933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3251) took 1597 ms. Trace:
W20260709 12:22:42.303259 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 73843.3us
W20260709 12:22:42.321311 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 82173.8us
I20260709 12:22:42.338845 17427 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:42.339505 17427 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:42.303299 17353 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:22:42.321810 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 80982.6us
I20260709 12:22:42.219558 17248 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.345372 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.260915 17338 raft_consensus.cc:740] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:22:42.260819 17422 log.cc:927] Time spent T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca: Append to log took a long time: real 0.151s	user 0.000s	sys 0.002s
I20260709 12:22:42.225674 17229 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:42.327764 17411 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:42.261523 17251 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:42.329531 17249 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.305317 17215 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 12:22:42.343616 17257 consensus_meta.cc:287] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.000s
I20260709 12:22:42.325722 16702 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:42.330341 10933 rpcz_store.cc:276] 0709 12:22:40.731012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.741386 (+ 10374us) service_pool.cc:224] Handling call
0709 12:22:40.775815 (+ 34429us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:40.797772 (+ 21957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:40.797812 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:40.837963 (+ 40151us) log.cc:844] Serialized 52 byte log entry
0709 12:22:41.044629 (+206666us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:41.044677 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.044747 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:42.115461 (+1070714us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:22:42.325668 (+210207us) raft_consensus.cc:1685] finished
0709 12:22:42.325690 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:42.328239 (+  2549us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1944,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":20221,"spinlock_wait_cycles":4640000,"thread_start_us":169409,"threads_started":1,"wal-append.queue_time_us":336328}
I20260709 12:22:42.347846 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:42.346758 10901 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:42.343386 17428 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.340189 17244 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.370361 10901 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:42.378197 10901 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:42.379753 17248 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.369024 17411 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:42.245695 17347 consensus_queue.cc:260] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:42.381341 17347 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:42.382314 17411 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.351099 17349 consensus_queue.cc:1059] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:22:42.369814 11083 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:42.385548 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:42.400504 17432 log.cc:927] Time spent T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:22:42.384555 17382 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:42.402403 17382 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:42.402792 17382 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:42.405355 17249 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.374481 17241 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.349714 17193 consensus_queue.cc:1059] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:22:42.393357 17417 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:42.407297 17417 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:42.407686 17417 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:42.422564 17378 raft_consensus.cc:3055] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:42.425587 17378 raft_consensus.cc:740] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:42.426399 17378 consensus_queue.cc:260] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.393931 17244 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.430181 17244 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:42.431166 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.394444 17349 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:22:42.432354 17349 raft_consensus.cc:697] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:42.432780 10933 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:22:42.433349 17349 consensus_queue.cc:237] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.427623 17378 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:42.437186 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.443478 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:42.444221 11003 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:42.445858 10901 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:42.446931 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.458074 17424 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 12:22:42.450820 17244 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:42.460120 17244 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.349983 17353 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:42.450034 17193 consensus_queue.cc:1243] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 19.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:22:42.456790 17134 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:42.477408 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.498196 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.498994 10933 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:22:42.500038 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.500804 17381 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:42.497068 17417 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.482353 11083 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 16.
I20260709 12:22:42.483173 17425 consensus_queue.cc:1059] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:22:42.464320 17330 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:42.466645 17418 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:42.507766 17215 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.508140 17297 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.515115 17330 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.542268 17417 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.532649 17330 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:42.554615 17427 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:42.558861 11085 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:22:42.562072 17330 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.564584 17330 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.572193 17353 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.516366 17414 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.532905 17297 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.535458 17415 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:42.589385 17249 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.586678 17241 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.591393 17249 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.591797 17241 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.526425 17215 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.596388 10974 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:42.594107 17248 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.593994 17249 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.587368 17251 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:42.591341 17240 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:42.595172 17241 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.598734 17416 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.616292 17414 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.621511 17215 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:42.627781 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.599807 17248 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.633033 17418 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:42.634155 17248 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.634394 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:22:42.634768 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 189004us
I20260709 12:22:42.637562 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:42.641564 11005 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:42.611701 17240 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.645061 17240 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.651298 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:42.652032 11003 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:42.654614 11005 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:22:42.661926 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:42.664215 11005 raft_consensus.cc:2393] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 17: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:42.611792 17251 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.669404 11003 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:42.636163 17241 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:42.636018 17416 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:42.676836 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 80558us
W20260709 12:22:42.676227 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 325655us
I20260709 12:22:42.679768 11003 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:22:42.682099 17417 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.672494 17359 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.689973 11004 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:22:42.692884 11655 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:22:42.695175 17245 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:42.685703 17367 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.689918 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:42.690305 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:42.707906 11007 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 12.
I20260709 12:22:42.682662 17417 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.706228 11004 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:22:42.706367 11005 raft_consensus.cc:1240] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:42.627733 17382 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.717973 11003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:22:42.725694 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.726845 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:42.727085 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.727545 10936 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:42.725114 11003 raft_consensus.cc:606] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:42.729962 11003 raft_consensus.cc:614] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:42.735929 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.718775 17158 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:42.736989 17158 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.737344 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.738610 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.739204 10933 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:22:42.739426 17158 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.719188 17240 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:42.740249 17353 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:42.740312 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:42.741456 11004 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:42.742942 11011 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:22:42.744676 11002 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:22:42.745911 11007 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: [18.9-18.9]
W20260709 12:22:42.765432 10977 connection.cc:256] RPC call timeout handler was delayed by -1.1477036870001029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
I20260709 12:22:42.747418 17221 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.727442 17241 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.727612 17454 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:42.749155 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.772317 10927 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:42.772192 17454 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.773375 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.773983 10927 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:42.774369 17454 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.753201 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2828) took 1670 ms. Trace:
I20260709 12:22:42.691653 17359 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.777495 17359 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.774853 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.780834 17251 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.771486 17241 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:42.782110 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.779278 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.783202 17241 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:42.784554 17257 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:42.785173 11085 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:22:42.785079 17257 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.786610 10935 rpcz_store.cc:276] 0709 12:22:41.083257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.083965 (+   708us) service_pool.cc:224] Handling call
0709 12:22:41.084340 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:41.134498 (+ 50158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:42.752918 (+1618420us) spinlock_profiling.cc:243] Waited 49.4 ms on lock 0x7b54000613d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:42.753120 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113523456}
I20260709 12:22:42.787070 17257 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:42.787250 11078 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:22:42.787611 17257 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.762403 10936 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 16.
I20260709 12:22:42.763983 17240 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.766835 10977 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:42.767416 17353 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:42.768885 17417 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.767431 17405 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:22:42.769511 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.769538 11625 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:42.769922 17453 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.770478 17297 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:42.770941 17408 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.865017 17257 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.874246 17408 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.814409 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.812719 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:42.877532 11655 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
W20260709 12:22:42.759785 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 45577.7us
I20260709 12:22:42.878897 10901 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:42.815737 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.816213 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.811873 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.880941 10975 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:42.817126 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.786418 17416 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.817795 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:42.818126 17382 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.812493 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.821219 17338 consensus_queue.cc:260] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:42.825294 17398 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 1.133s	user 0.002s	sys 0.000s
W20260709 12:22:42.826735 17389 log.cc:927] Time spent T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 1.129s	user 0.000s	sys 0.002s
I20260709 12:22:42.830193 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.836453 10932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2820) took 1886 ms. Trace:
W20260709 12:22:42.840826 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 272613us
W20260709 12:22:42.844110 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 56253.2us
W20260709 12:22:42.847970 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.786494 11080 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:22:42.893899 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:42.895164 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.810359 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:42.810860 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:42.866778 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 100039us
I20260709 12:22:42.891314 10932 rpcz_store.cc:276] 0709 12:22:40.950188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.950685 (+   497us) service_pool.cc:224] Handling call
0709 12:22:40.950944 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:41.381001 (+430057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:42.836172 (+1455171us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54001793d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:42.836380 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":929717120}
W20260709 12:22:42.869412 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 99961.5us
I20260709 12:22:42.882133 11079 raft_consensus.cc:2410] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:22:42.885855 10935 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:42.886106 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.887564 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.887465 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:42.897279 10977 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:42.900125 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.900935 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.901163 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.888679 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.892447 11051 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:42.902207 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.885380 10901 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:42.871202 17221 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:22:42.891052 10930 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:22:42.910598 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.911298 10930 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:42.902315 11082 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:42.904017 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.907145 10977 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:42.909135 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.914670 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.915271 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.917225 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:42.907379 10901 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:42.887420 17134 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:22:42.918712 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.919080 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.919742 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.923560 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.924074 11082 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:22:42.925195 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.916360 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.920985 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.925973 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.887669 17417 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.887665 17158 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:42.934830 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.935102 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.937534 11078 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:22:42.929157 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.907944 17338 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:42.942569 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.903887 17257 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:42.912290 17382 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:42.927794 10977 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:42.943545 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:42.929083 17430 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.918314 17416 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:42.961264 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.962072 11082 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:22:42.963153 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.871876 17413 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:42.949681 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:42.933703 17158 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.951768 10977 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:42.882608 17453 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:42.914465 17064 consensus_queue.cc:1059] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 12:22:42.938014 17349 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:42.952770 11083 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:42.917750 17408 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:42.904279 17297 consensus_queue.cc:1059] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:22:42.936758 17417 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.922336 17419 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:22:42.938740 17134 raft_consensus.cc:697] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:42.918179 17424 consensus_queue.cc:1059] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:22:42.938503 17221 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:42.963997 11080 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:42.937949 17306 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:42.978003 10932 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 19. Current term is 20. Ops: []
I20260709 12:22:42.978715 10977 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:42.983701 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.960654 17248 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:42.987334 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:42.944509 17342 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:22:42.988337 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:42.996894 11006 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:42.989943 10974 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:42.968582 17382 raft_consensus.cc:697] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:42.973853 17158 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:42.993229 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:42.995882 11011 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:22:42.951542 17427 consensus_queue.cc:1059] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:22:42.973721 17349 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:22:43.003299 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.982820 17416 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:22:43.012063 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.017189 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:43.017910 11010 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:42.968865 17430 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:42.979970 17251 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:22:42.977701 17241 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:22:42.990715 17306 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.034854 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53346 (request call id 572) took 2171 ms. Trace:
I20260709 12:22:43.007231 17349 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:43.007831 17360 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.992571 17215 consensus_queue.cc:1059] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:22:43.005810 17221 raft_consensus.cc:697] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:43.041879 10928 rpcz_store.cc:276] 0709 12:22:40.863184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.871007 (+  7823us) service_pool.cc:224] Handling call
0709 12:22:40.871435 (+   428us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:40.871848 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:40.871896 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:40.872499 (+   603us) log.cc:844] Serialized 52 byte log entry
0709 12:22:41.459291 (+586792us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:41.468266 (+  8975us) log.cc:844] Serialized 14 byte log entry
0709 12:22:41.693613 (+225347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.693701 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:42.826141 (+1132440us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:22:43.023153 (+197012us) raft_consensus.cc:1685] finished
0709 12:22:43.034654 (+ 11501us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:43.034796 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37602,"prepare.queue_time_us":11212,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":18073,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":6851,"spinlock_wait_cycles":6015616,"thread_start_us":759539,"threads_started":2,"wal-append.queue_time_us":553179}
I20260709 12:22:43.029574 17260 raft_consensus.cc:3055] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:42.994812 17408 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 12:22:43.034833 17366 log.cc:927] Time spent T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 1.945s	user 0.003s	sys 0.002s
I20260709 12:22:43.088778 17260 raft_consensus.cc:740] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:43.084573 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:43.087458 11079 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:22:43.024130 17297 raft_consensus.cc:3055] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:43.019244 17418 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:22:43.044570 17306 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:43.090142 17408 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:43.034556 17416 raft_consensus.cc:697] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:43.098340 17221 consensus_queue.cc:237] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:43.098939 17453 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:43.093483 17297 raft_consensus.cc:740] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:43.086287 17240 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:43.089697 17260 consensus_queue.cc:260] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:43.103052 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:43.110312 17382 consensus_queue.cc:237] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:43.111200 17134 consensus_queue.cc:237] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:43.112373 10882 auto_rebalancer.cc:629] Failed to schedule move for tablet 2f281b53af584a8bab9bb1d343d005f8: Illegal state: Replica 9e8170bbe8244e40a2b2e5011e69b697 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
W20260709 12:22:43.112866 17457 log.cc:927] Time spent T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 12:22:43.116114 17430 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:43.048101 17360 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:43.043686 17454 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:43.092181 11010 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:22:43.101050 17417 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:43.204067 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:43.205575 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 212413us
I20260709 12:22:43.215873 10977 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:22:43.206960 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 217092us
I20260709 12:22:43.203751 17353 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:43.217724 10974 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:43.221539 10974 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:43.223105 17416 consensus_queue.cc:237] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:43.223892 10974 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:43.209941 17352 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:43.232228 17352 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:43.233819 17251 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:43.234519 17352 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:43.209805 17248 raft_consensus.cc:697] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:43.240512 10929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3258) took 2470 ms. Trace:
I20260709 12:22:43.241252 17360 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:43.240942 10929 rpcz_store.cc:276] 0709 12:22:40.769943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.847047 (+ 77104us) service_pool.cc:224] Handling call
0709 12:22:40.847350 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.876006 (+ 28656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.240146 (+2364140us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b5400060754. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:43.240449 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64158976}
I20260709 12:22:43.213944 17260 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:43.226475 10974 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:43.225286 10977 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:43.228293 17460 log.cc:927] Time spent T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:22:43.229216 17346 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:43.231096 16702 raft_consensus.cc:3055] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:22:43.219944 17240 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:22:43.224066 17241 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:43.226976 17453 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:43.248605 17417 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.254108 17467 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:43.253391 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:43.261483 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.226847 17408 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:22:43.254496 16702 raft_consensus.cc:740] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:43.273586 11009 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:22:43.254920 17454 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:43.257125 17453 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.278590 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:43.255069 17241 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.220351 17297 consensus_queue.cc:260] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:43.281661 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:43.283664 11009 raft_consensus.cc:2393] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 15: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:43.285842 10977 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:43.264319 17240 raft_consensus.cc:697] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:43.284518 17469 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.289273 10977 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:43.290530 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:43.293501 10977 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:43.294517 11010 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:43.286216 17453 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:43.320573 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.282512 17342 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.301616 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:43.292374 17468 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:22:43.304322 17380 log.cc:927] Time spent T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 1.873s	user 0.005s	sys 0.004s
I20260709 12:22:43.304667 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:43.296172 10977 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:43.307139 17297 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:43.287565 17251 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:43.309060 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:43.292598 17356 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.309984 11007 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:22:43.296741 17467 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:43.302416 17470 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:43.309055 16702 consensus_queue.cc:260] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:43.314615 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:43.315528 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:43.317039 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:43.317317 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:43.317732 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:43.318415 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:43.319329 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:43.266474 17417 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:43.287951 17241 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:43.327543 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:43.328725 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:43.331633 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.344899 10931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2823) took 2386 ms. Trace:
I20260709 12:22:43.345432 10931 rpcz_store.cc:276] 0709 12:22:40.958546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.994741 (+ 36195us) service_pool.cc:224] Handling call
0709 12:22:40.995106 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:40.995453 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:40.995484 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:40.996187 (+   703us) log.cc:844] Serialized 26 byte log entry
0709 12:22:41.314079 (+317892us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:41.314123 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.314195 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:43.278285 (+1964090us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:22:43.344582 (+ 66297us) raft_consensus.cc:1685] finished
0709 12:22:43.344605 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:43.344831 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48073,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":37626,"spinlock_wait_cycles":7810560,"thread_start_us":264929,"threads_started":1,"wal-append.queue_time_us":345207}
I20260709 12:22:43.348758 17244 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:43.332353 10977 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:43.333323 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:43.344995 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:43.333743 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.338105 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:43.334708 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:43.335461 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:43.355508 11007 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:43.356491 11006 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:22:43.356981 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:43.357450 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:43.367980 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:43.334457 17454 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:43.354421 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:43.381247 11011 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:22:43.382880 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:43.368638 11622 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:43.384903 11622 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:43.386579 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:43.388020 11011 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:22:43.389043 11011 raft_consensus.cc:1240] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:43.364777 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:43.384050 10927 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 13.
I20260709 12:22:43.333065 17470 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.402200 10930 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:22:43.392930 10927 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:22:43.378881 11049 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:43.403004 11006 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:43.327133 17468 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:43.399133 17306 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:43.383208 17316 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 12:22:43.400398 17417 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:43.379038 16702 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:43.404975 10932 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:43.391309 10899 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:43.295454 17469 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:43.411826 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:43.415596 10935 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:22:43.423897 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:43.433043 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:43.401461 10934 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 3250) took 2694 ms (client timeout 1862 ms). Trace:
I20260709 12:22:43.329028 17342 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:43.480922 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 148644us
I20260709 12:22:43.293802 17248 consensus_queue.cc:237] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:43.491451 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 104836us
I20260709 12:22:43.404177 17413 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:43.484196 11656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59384 (request call id 784) took 1468 ms. Trace:
I20260709 12:22:43.335875 17356 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:43.504041 17338 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:43.506095 17356 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:43.482777 11006 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:43.507781 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:43.509385 11006 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:22:43.510707 11006 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:22:43.506340 10899 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:43.479944 17250 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:22:43.485770 10934 rpcz_store.cc:269] 0709 12:22:40.707940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.708244 (+   304us) service_pool.cc:224] Handling call
0709 12:22:43.401269 (+2693025us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b54002035d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:43.401390 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1494217600}
I20260709 12:22:43.489316 10932 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:43.513693 17360 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:43.485265 10928 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:22:43.514262 17360 raft_consensus.cc:697] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:43.490000 10977 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:43.495354 11011 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:22:43.479758 17408 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:43.515339 17454 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:43.515179 17360 consensus_queue.cc:237] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:43.411841 17353 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:43.499482 17357 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:43.500236 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:43.503719 10974 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:43.497813 17469 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:43.517750 11624 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:43.474260 17468 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:43.412539 17470 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:43.518332 17352 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:22:43.524425 17353 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:43.527819 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:43.533586 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:43.528429 10974 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:43.534246 10927 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:22:43.535293 10974 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:43.516429 11656 rpcz_store.cc:276] 0709 12:22:42.010677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.010874 (+   197us) service_pool.cc:224] Handling call
0709 12:22:42.011154 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:42.050606 (+ 39452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:42.050634 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:42.050679 (+    45us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:42.050707 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.478681 (+1427974us) spinlock_profiling.cc:243] Waited 39.2 ms on lock 0x7b54007ddf54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:43.478741 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:43.478921 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90270464}
I20260709 12:22:43.532004 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:43.532687 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:43.518890 17306 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:43.529129 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:43.546686 17427 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:22:43.539075 11050 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:43.542124 11011 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:22:43.542223 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:43.544302 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:43.542752 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:43.523818 17241 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:43.472910 17240 consensus_queue.cc:237] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:43.571370 10977 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.862s (SENT) [suppressed 55 similar messages]
I20260709 12:22:43.593497 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:43.604836 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:43.605433 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 66349.7us
I20260709 12:22:43.606285 11050 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:43.586742 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:43.594763 10935 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:43.547469 17416 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:43.544253 17408 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:43.526330 17454 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:43.614792 17408 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.614916 17454 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.615448 17454 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:43.595839 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:43.616681 10928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "660a349ad34749648cae6a025708c84d"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:22:43.617268 10928 raft_consensus.cc:606] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:43.541611 17353 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:43.589298 17349 consensus_meta.cc:287] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.000s
I20260709 12:22:43.591769 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:43.592368 17306 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:43.607623 11050 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:43.624797 11050 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:43.605638 10932 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:43.626310 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:43.627360 10932 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:43.609661 11009 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 20: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:43.610685 17241 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:43.611774 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:43.628705 11084 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:22:43.591519 17158 consensus_meta.cc:287] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.587s	user 0.009s	sys 0.000s
I20260709 12:22:43.622448 10936 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:43.615268 17408 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:43.631537 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:43.634667 11050 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:43.634776 10936 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:22:43.618264 17412 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:43.618088 17356 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:43.638101 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:43.639755 10936 raft_consensus.cc:2410] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 12:22:43.641229 11050 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:43.649312 11050 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:43.651371 11050 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:43.652745 11050 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:43.654037 11050 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:43.633280 17258 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:43.661926 11050 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:43.638401 17250 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:22:43.664759 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.672495 10932 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:22:43.645757 17147 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:43.639169 17158 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:43.685648 17453 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:43.687763 17158 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:43.690660 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:43.649683 17352 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:43.691636 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:43.692960 11652 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:43.695633 17356 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:43.696157 17356 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.696486 17356 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:43.635612 17306 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:43.651065 17343 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:22:43.700502 11652 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:22:43.712831 11050 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:43.623567 17349 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:43.658646 17469 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:43.657465 17264 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:43.658989 17424 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:43.724771 11084 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:22:43.727632 10975 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:43.739005 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:43.668335 17260 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:43.760144 17349 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:43.758332 17424 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:43.760803 17158 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:43.761480 11083 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:43.761576 17158 raft_consensus.cc:697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:43.762583 17158 consensus_queue.cc:237] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:43.763559 10935 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:43.699148 17468 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:43.769381 11007 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:22:43.769374 11082 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:22:43.703907 17356 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:43.705478 17296 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:43.783390 11051 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:43.784366 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 266686us
I20260709 12:22:43.786695 11083 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:43.748039 17453 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:43.761178 17424 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:43.706496 17297 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 12:22:43.747069 17469 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:43.749912 17388 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:43.706709 17470 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:43.732113 17258 consensus_queue.cc:1059] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:22:43.789367 17260 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 12:22:43.796940 11051 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:43.788692 17214 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:43.777777 17343 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
W20260709 12:22:43.851435 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.780648 17244 consensus_queue.cc:1059] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:22:43.829233 11082 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:22:43.800158 17412 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:43.872562 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:43.872259 11624 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:43.873245 16702 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.904022 11005 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:43.886444 17469 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:43.795260 17245 consensus_queue.cc:1059] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.102s
I20260709 12:22:43.795073 17250 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 12:22:43.811920 17468 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:43.890893 17413 raft_consensus.cc:697] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
W20260709 12:22:43.968827 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 397451us
I20260709 12:22:43.811252 17147 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.157s
I20260709 12:22:43.830256 17298 consensus_queue.cc:1059] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.153s
I20260709 12:22:43.981123 10901 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:43.982851 11049 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:43.904913 17412 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.911224 17134 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.911706 17388 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:43.965140 17258 raft_consensus.cc:3055] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:43.898038 17214 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:44.010449 10901 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:44.023578 10901 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:43.966743 16702 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.056932 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:44.057682 10936 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:44.062597 17214 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:44.004467 17450 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:22:44.063371 17476 log.cc:927] Time spent T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 12:22:44.064051 17356 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:44.066381 10936 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:44.007834 17258 raft_consensus.cc:740] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:44.068634 17258 consensus_queue.cc:260] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.069556 10928 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 20. Current term is 21. Ops: []
I20260709 12:22:44.009333 17427 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 12:22:44.070502 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:43.988854 17412 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:43.984802 17294 raft_consensus.cc:3055] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:22:44.027920 17131 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:22:44.002920 17388 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:44.034332 17480 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:44.050881 17413 consensus_queue.cc:237] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:44.052228 17414 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:44.055384 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:44.009351 17245 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:43.988250 16959 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:44.026731 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:44.074810 10928 raft_consensus.cc:1275] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:22:44.067761 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.028303 10995 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b6c427f0a234dbab806dced4d3ba0fb with delete_type TABLET_DATA_TOMBSTONED (TS 2201bad9e18849b09cf82de29dd032d3 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:50260
I20260709 12:22:44.069855 17258 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:44.086480 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:44.063441 17450 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:44.025075 17260 raft_consensus.cc:3055] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:44.100463 10977 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:44.100803 11625 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:44.108170 17450 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:44.111940 17260 raft_consensus.cc:740] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:44.112720 16959 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.113063 17260 consensus_queue.cc:260] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.114200 17260 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:44.115181 16959 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:44.057809 16702 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:44.047399 17408 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.155099 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:44.164685 10935 raft_consensus.cc:2376] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21. Re-sending same reply.
I20260709 12:22:44.074131 17294 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:44.120803 10977 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:44.077756 17416 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.156447 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:44.111941 17342 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:44.104053 11625 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:44.081470 17131 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:44.008406 17134 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.163499 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:44.178768 11655 raft_consensus.cc:2368] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20.
I20260709 12:22:44.163597 10974 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:44.084672 17388 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:44.204870 10931 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 12:22:44.209954 10931 pending_rounds.cc:85] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 9
I20260709 12:22:44.210165 10931 pending_rounds.cc:107] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 12:22:44.210386 10931 raft_consensus.cc:2889] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:44.208611 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 45089.7us
W20260709 12:22:44.170357 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:44.175531 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 71579.2us
I20260709 12:22:44.088660 17306 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:44.155171 17468 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:44.175836 17416 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.177938 17131 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:22:44.156198 17414 raft_consensus.cc:697] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:44.214852 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:44.218866 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 421968us
I20260709 12:22:44.224824 11083 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:44.225134 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:44.225950 11051 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:44.216332 11082 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 20. Current term is 21. Ops: []
I20260709 12:22:44.116490 17481 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:44.162645 17221 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:44.201472 17408 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:44.086020 17353 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:44.130695 17454 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.185695 17134 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:44.182686 17244 consensus_queue.cc:1059] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:22:44.237430 11083 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:44.196084 17330 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:22:44.182178 17482 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:22:44.188915 17470 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:44.200016 17488 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:44.217047 17453 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:44.232370 17346 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:44.239457 17306 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:44.233282 11051 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:44.259552 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 387379us
I20260709 12:22:44.237979 17469 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.244803 17221 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.277760 17454 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:44.279021 17469 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:44.279672 11077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 676) took 2789 ms. Trace:
I20260709 12:22:44.280087 11077 rpcz_store.cc:276] 0709 12:22:41.490522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.525893 (+ 35371us) service_pool.cc:224] Handling call
0709 12:22:41.538870 (+ 12977us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:41.691266 (+152396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:41.691298 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:43.483454 (+1792156us) spinlock_profiling.cc:243] Waited 988 us on lock 0x7b180040f180. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade412a6 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9baf859a11 00007f9baf869372 00007f9bb0f9ba01 00007f9bb0f6043a
0709 12:22:43.554162 (+ 70708us) spinlock_profiling.cc:243] Waited 9.14 ms on lock 0x7b2c000040c8. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9baf859a11 00007f9baf869372 00007f9bb0f9ba01 00007f9bb0f6043a 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2
0709 12:22:43.554695 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 12:22:43.788514 (+233819us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:43.788559 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.788647 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:44.279430 (+490783us) raft_consensus.cc:1685] finished
0709 12:22:44.279452 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.279589 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":121152,"raft.queue_time_us":150861,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":5718,"spinlock_wait_cycles":23297536,"thread_start_us":233375,"threads_started":1,"wal-append.queue_time_us":425902}
I20260709 12:22:44.260456 17330 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:44.263922 17215 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:44.262620 11624 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:44.181221 17424 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:44.264317 17453 raft_consensus.cc:697] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:44.261833 17346 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.309685 11051 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:44.311455 11051 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:44.291556 17480 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:44.260839 17294 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.286550 17450 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.288589 17414 consensus_queue.cc:237] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.314491 17469 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:44.317011 17353 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:44.321410 17416 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:44.337172 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.340739 10932 raft_consensus.cc:1240] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15. Ops: []
W20260709 12:22:44.343521 17489 log.cc:927] Time spent T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:22:44.343765 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:44.344362 17330 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:44.347263 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:44.331846 17469 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:44.352487 11009 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:22:44.350660 11051 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:44.334118 17494 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:22:44.357949 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:44.358675 11006 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
W20260709 12:22:44.351722 17296 consensus_meta.cc:287] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.563s	user 0.006s	sys 0.006s
I20260709 12:22:44.362957 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:44.364786 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:44.365921 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:44.366478 11009 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:44.366503 10974 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:44.367483 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:44.372673 11011 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:44.373818 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:44.374465 11011 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:44.375250 11650 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
W20260709 12:22:44.370389 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 249668us
I20260709 12:22:44.376565 10977 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:44.354521 17469 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:44.352005 17294 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:44.379487 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:44.380445 11006 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:44.379710 10977 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:44.356297 17494 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:22:44.385308 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.383396 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:44.361653 17498 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:22:44.391671 11080 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:44.392297 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:44.392930 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:44.351799 17412 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.402462 11083 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 12:22:44.402932 11083 pending_rounds.cc:85] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 13
I20260709 12:22:44.403156 11083 pending_rounds.cc:107] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 12:22:44.403396 11083 raft_consensus.cc:2889] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:44.404554 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:44.405191 11083 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:44.405980 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:44.406634 11083 raft_consensus.cc:2393] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 20: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:44.338268 17453 consensus_queue.cc:237] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.398518 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:44.381224 10974 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:44.377524 17411 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.377633 17416 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:44.362938 17244 consensus_queue.cc:1059] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 12:22:44.384944 17468 consensus_queue.cc:1059] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:22:44.410709 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:44.410055 11009 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:22:44.382543 17454 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:22:44.479761 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:44.415381 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:44.459545 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:44.438380 10930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3261) took 1707 ms. Trace:
I20260709 12:22:44.386837 10977 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:44.390388 17408 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:44.481418 11009 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:44.437552 10901 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:44.415674 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:44.465539 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 84381.9us
I20260709 12:22:44.484005 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:44.482158 10930 rpcz_store.cc:276] 0709 12:22:42.730973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.960898 (+229925us) service_pool.cc:224] Handling call
0709 12:22:43.401876 (+440978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:43.402597 (+   721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.438159 (+1035562us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b54002035d0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:44.438320 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1013330176}
I20260709 12:22:44.391806 17494 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:44.521941 11006 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:44.486748 11084 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:44.422003 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:44.429643 10899 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:44.485507 11080 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 12:22:44.408588 17424 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:44.539122 11077 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:44.439667 17450 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:44.544618 11011 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:22:44.483150 17502 tablet_replica.cc:333] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:22:44.426707 17131 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.540220 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:44.564211 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:44.538630 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 101175us
I20260709 12:22:44.410269 17346 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:44.426578 16959 raft_consensus.cc:3055] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:22:44.572167 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:44.573112 11006 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:22:44.574040 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:44.542716 17134 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:44.429919 17451 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.139s
I20260709 12:22:44.416145 17306 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.561501 11655 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:22:44.478106 17498 raft_consensus.cc:697] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:44.481320 17221 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:44.565688 10901 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:44.480783 17454 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:44.515134 17468 consensus_queue.cc:1243] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 1abf4b385a2b493ab83f593a1f8c9cd1 log is divergent from this leader: its last log entry 19.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:22:44.483369 17470 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:44.560768 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:44.568861 11005 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20. Ops: []
I20260709 12:22:44.478111 17496 consensus_queue.cc:1059] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.205s
I20260709 12:22:44.566928 17462 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.480835 17411 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:44.635121 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 96814.3us
I20260709 12:22:44.559230 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:44.660580 11011 raft_consensus.cc:2393] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 19: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:44.638458 11077 raft_consensus.cc:2468] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 17.
I20260709 12:22:44.664484 11080 raft_consensus.cc:1240] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:22:44.664969 11050 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:44.639725 11009 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:44.619063 17346 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:44.572702 16959 raft_consensus.cc:740] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:22:44.652624 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 87037.6us
I20260709 12:22:44.624590 17453 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:44.670977 11006 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:44.673614 17404 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.675951 17382 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.676836 17134 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.678532 11004 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20. Ops: []
W20260709 12:22:44.702433 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 315640us
I20260709 12:22:44.694530 10901 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:44.721379 10977 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:44.721489 11004 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:22:44.640460 17416 raft_consensus.cc:697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:44.666361 11622 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:44.724391 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:44.734951 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 68690.2us
I20260709 12:22:44.654157 17454 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:22:44.727478 10927 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:44.732147 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:44.737432 11077 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:44.656246 17414 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:44.689114 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:44.734910 10930 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:44.690061 11050 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:44.725216 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:44.741155 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 51182us
I20260709 12:22:44.741340 10934 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:22:44.730998 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:44.679188 17346 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:44.669081 17215 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.726423 10932 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:22:44.650970 17306 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.732055 10928 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 22. Current term is 23. Ops: []
I20260709 12:22:44.743660 10977 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:44.776429 11051 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:44.777312 11004 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:44.788507 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:44.740676 11081 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:22:44.741834 11050 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:44.662843 17470 raft_consensus.cc:697] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:44.793042 17470 consensus_queue.cc:237] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.718189 17257 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:22:44.821964 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 78370.6us
I20260709 12:22:44.801716 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:44.820216 11083 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:22:44.823459 10977 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:44.824149 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:44.775998 17244 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:44.822505 17257 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:44.833199 17257 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:22:44.836581 17510 log.cc:927] Time spent T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:22:44.668948 17462 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.693070 17506 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:44.858786 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 117027us
I20260709 12:22:44.789388 17346 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:44.722425 17138 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.104s
I20260709 12:22:44.886351 11050 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:44.777261 17353 raft_consensus.cc:2804] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:22:44.888661 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 65288.8us
I20260709 12:22:44.981096 10977 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:44.826689 17388 consensus_meta.cc:287] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.000s
W20260709 12:22:44.960362 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 208862us
W20260709 12:22:44.987030 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.994765 10977 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:44.734876 17134 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:44.777076 17424 consensus_queue.cc:1059] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.195s
I20260709 12:22:44.722931 17382 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.723027 17404 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.889819 17412 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:45.003114 17353 raft_consensus.cc:697] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:44.822050 17515 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:44.807430 17215 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.948235 10927 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:45.020159 11077 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:22:44.947618 17508 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:44.843505 17221 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.160s
W20260709 12:22:44.997802 17500 log.cc:927] Time spent T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.458s	user 0.001s	sys 0.000s
I20260709 12:22:44.998394 17388 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.883059 17518 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:22:45.040985 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 154723us
W20260709 12:22:45.042076 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 47435.8us
I20260709 12:22:45.058416 10977 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:45.054595 17519 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:22:45.053175 11077 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20. Ops: []
I20260709 12:22:45.057655 11050 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:45.054484 17504 log.cc:927] Time spent T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.432s	user 0.000s	sys 0.001s
I20260709 12:22:44.789299 17498 consensus_queue.cc:237] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:44.946386 17506 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.046859 17131 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:45.161530 17388 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:45.105764 17478 log.cc:927] Time spent T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:22:44.996551 16959 consensus_queue.cc:260] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.106185 17412 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:45.007272 17416 consensus_queue.cc:237] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.118111 17518 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:22:45.165850 17526 log.cc:927] Time spent T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 12:22:45.195039 10927 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:45.148165 17508 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:45.173632 17306 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:45.186180 17469 consensus_meta.cc:287] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.795s	user 0.010s	sys 0.000s
I20260709 12:22:45.212584 17382 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:45.212916 17404 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:45.214022 17134 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:45.214494 17221 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:45.215835 17494 consensus_meta.cc:287] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.000s
I20260709 12:22:45.217278 17215 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:45.177654 17352 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:45.219626 17345 raft_consensus.cc:3055] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:45.220212 17521 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:45.220391 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3577) took 1516 ms. Trace:
I20260709 12:22:45.192533 17353 consensus_queue.cc:237] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:45.220836 17518 consensus_queue.cc:1059] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:45.222235 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2988) took 1063 ms. Trace:
I20260709 12:22:45.211195 17147 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:45.166241 17524 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:22:45.225838 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 129968us
I20260709 12:22:45.231443 10930 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:22:45.238058 11077 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:22:45.240984 11079 rpcz_store.cc:276] 0709 12:22:43.704311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.704468 (+   157us) service_pool.cc:224] Handling call
0709 12:22:43.704821 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:43.738622 (+ 33801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:43.738657 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:43.738714 (+    57us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:22:43.738746 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.220148 (+1481402us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b540044c5d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:45.220197 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:45.220330 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77274368}
W20260709 12:22:45.236337 10976 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.006s	sys 0.009s
I20260709 12:22:45.225544 17508 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:22:45.251245 10976 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.007s	sys 0.009s
I20260709 12:22:45.252344 17496 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.244097 17306 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:45.254917 17524 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.232674 17241 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:22:45.255504 17521 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.241319 17352 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:45.275107 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:45.256093 17158 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.241083 17345 raft_consensus.cc:740] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
W20260709 12:22:45.257596 17532 log.cc:927] Time spent T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:22:45.257977 17462 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:45.230320 17412 raft_consensus.cc:697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:45.247325 11007 rpcz_store.cc:276] 0709 12:22:44.159201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.159325 (+   124us) service_pool.cc:224] Handling call
0709 12:22:44.159641 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:44.160045 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:44.160072 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:44.160556 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:22:44.374234 (+213678us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:44.374282 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.374353 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:45.221999 (+847646us) raft_consensus.cc:1685] finished
0709 12:22:45.222019 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:45.222177 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2523,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":1650,"thread_start_us":185954,"threads_started":1,"wal-append.queue_time_us":361709}
I20260709 12:22:45.258901 10977 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:45.235489 17536 raft_consensus.cc:3055] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:22:45.252197 17437 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 1.171s	user 0.005s	sys 0.000s
I20260709 12:22:45.296419 17412 consensus_queue.cc:237] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:45.297024 17545 consensus_queue.cc:1059] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:45.298107 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 3339) took 3292 ms. Trace:
I20260709 12:22:45.298491 11076 rpcz_store.cc:276] 0709 12:22:42.005209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.006084 (+   875us) service_pool.cc:224] Handling call
0709 12:22:42.006431 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:42.103022 (+ 96591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:42.103055 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:42.103527 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 12:22:42.201611 (+ 98084us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:22:42.262931 (+ 61320us) log.cc:844] Serialized 14 byte log entry
0709 12:22:42.303314 (+ 40383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:42.828822 (+525508us) spinlock_profiling.cc:243] Waited 85.5 ms on lock 0x7b54000dff54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:42.828890 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:44.003648 (+1174758us) spinlock_profiling.cc:243] Waited 926 us on lock 0x7b18003f42a0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:22:45.196524 (+1192876us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:22:45.297847 (+101323us) raft_consensus.cc:1685] finished
0709 12:22:45.297873 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:45.298019 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":545,"prepare.queue_time_us":315766,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":26022,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":9705,"spinlock_wait_cycles":208293376,"thread_start_us":127922,"threads_started":2,"wal-append.queue_time_us":213850}
W20260709 12:22:45.244745 17516 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.422s	user 0.000s	sys 0.001s
W20260709 12:22:45.248039 17511 log.cc:927] Time spent T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.399s	user 0.001s	sys 0.000s
W20260709 12:22:45.268379 17260 consensus_meta.cc:287] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 1.154s	user 0.010s	sys 0.005s
I20260709 12:22:45.245420 17221 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.303689 11076 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:22:45.304378 11005 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:22:45.245584 17494 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.306629 17494 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:45.264187 17306 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:45.307348 17306 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:45.307091 17481 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:22:45.258828 17508 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:45.290674 17517 log.cc:927] Time spent T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 12:22:45.274390 17503 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.265762 17524 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:22:45.283171 17382 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:45.280014 17131 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:45.265569 17147 raft_consensus.cc:697] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:45.280474 17158 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:45.286461 17507 log.cc:927] Time spent T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.398s	user 0.000s	sys 0.002s
I20260709 12:22:45.309736 17241 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:22:45.233901 17469 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.259099 17414 raft_consensus.cc:2764] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:22:45.282943 17214 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.293218 17536 raft_consensus.cc:740] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:45.273010 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:45.347534 11011 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 17: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:45.284052 17506 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:45.303751 17221 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:45.330065 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 272120us
I20260709 12:22:45.286698 17345 consensus_queue.cc:260] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:45.281635 17454 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.358532 17506 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:45.359056 17454 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:45.267524 17496 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:45.361709 17496 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:45.315912 11079 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:45.289721 17521 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.363986 17521 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:45.365041 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:45.365864 11079 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 20.
I20260709 12:22:45.367367 17411 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:45.368059 11622 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:45.369632 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:45.370441 11079 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 14.
I20260709 12:22:45.359125 17506 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.374104 17408 raft_consensus.cc:3055] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:22:45.374521 17408 raft_consensus.cc:740] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:45.375567 17506 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:45.376483 17543 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:45.377030 17411 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:45.377859 11011 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:22:45.377949 17411 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.353327 11050 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:45.379040 17411 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:45.380725 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3692) took 1001 ms. Trace:
I20260709 12:22:45.381193 17158 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:45.376770 11622 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:45.381110 11009 rpcz_store.cc:276] 0709 12:22:44.379276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.670978 (+291702us) service_pool.cc:224] Handling call
0709 12:22:44.671307 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:44.719055 (+ 47748us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:22:44.743111 (+ 24056us) log.cc:844] Serialized 14 byte log entry
0709 12:22:44.889998 (+146887us) log.cc:844] Serialized 14 byte log entry
0709 12:22:44.890181 (+   183us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:44.890231 (+    50us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:44.890286 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.369721 (+479435us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b180024de40. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:22:45.380491 (+ 10770us) spinlock_profiling.cc:243] Waited 47.5 ms on lock 0x7b5400243454. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:45.380546 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:45.380663 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69647,"prepare.queue_time_us":134681,"prepare.run_cpu_time_us":123,"prepare.run_wall_time_us":25187,"raft.queue_time_us":377184,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":35364,"spinlock_wait_cycles":116242048,"thread_start_us":76833,"threads_started":1,"wal-append.queue_time_us":88775}
I20260709 12:22:45.357033 17345 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:45.378568 11011 raft_consensus.cc:606] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:45.348546 17537 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.422808 11009 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 15. Current term is 16. Ops: [15.14-15.14]
W20260709 12:22:45.428417 10899 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.019s	sys 0.024s
W20260709 12:22:45.431001 10899 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.019s	sys 0.024s
W20260709 12:22:45.433672 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 1.00403e+06us
I20260709 12:22:45.443950 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:45.451459 10899 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:45.390174 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 211670us
I20260709 12:22:45.329746 17382 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:45.330708 17131 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.329965 17257 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:45.382654 17496 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:45.438172 17528 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:45.539036 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3573) took 2214 ms. Trace:
I20260709 12:22:45.539549 11078 rpcz_store.cc:276] 0709 12:22:43.324322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.324439 (+   117us) service_pool.cc:224] Handling call
0709 12:22:43.331424 (+  6985us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:43.536189 (+204765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:43.536223 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:43.536751 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 12:22:43.565912 (+ 29161us) spinlock_profiling.cc:243] Waited 6.3 ms on lock 0x7b4800210cd8. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb5e89aa1 00007f9bb5e80b37 00007f9bb5e809ca 00007f9bb5f7826f 00007f9bb5f77f37 00007f9bb5f8c55c 00007f9bb5f8c508 00007f9bb5f8c488 00007f9bb5f8c443 00007f9bb5f8b6ec 00007f9bb4eb5a96
0709 12:22:43.969797 (+403885us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:43.969843 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.538713 (+1568870us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b5400216454. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:45.538771 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:45.538812 (+    41us) raft_consensus.cc:1685] finished
0709 12:22:45.538823 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:45.538976 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18833,"raft.queue_time_us":25063,"raft.run_cpu_time_us":2046,"raft.run_wall_time_us":28773,"spinlock_wait_cycles":429312768,"thread_start_us":373242,"threads_started":1,"wal-append.queue_time_us":577093,"wal-append.run_cpu_time_us":1656,"wal-append.run_wall_time_us":1004604}
I20260709 12:22:45.437999 17297 raft_consensus.cc:3055] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:45.493211 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:45.543306 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 50873.3us
I20260709 12:22:45.549829 17523 raft_consensus.cc:993] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:22:45.550367 17523 raft_consensus.cc:1081] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:22:45.551702 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:45.350529 17214 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.544834 11049 leader_election.cc:400] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20.
I20260709 12:22:45.554881 11081 raft_consensus.cc:1240] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:45.554704 11049 leader_election.cc:403] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:22:45.494457 17507 log.cc:927] Time spent T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:22:45.328967 17503 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.474936 17414 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:22:45.375450 17408 consensus_queue.cc:260] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.544399 17496 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.575481 10931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3289) took 1521 ms. Trace:
I20260709 12:22:45.575942 10931 rpcz_store.cc:276] 0709 12:22:44.054108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.067997 (+ 13889us) service_pool.cc:224] Handling call
0709 12:22:44.068309 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:44.210770 (+142461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.575215 (+1364445us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b5400335254. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:45.575420 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312972032}
I20260709 12:22:45.571277 17544 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20.
I20260709 12:22:45.377009 17543 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:45.547303 17297 raft_consensus.cc:740] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:45.492983 17370 consensus_queue.cc:1059] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 12:22:45.599040 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:45.552273 17138 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:22:45.599951 10902 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.015s	sys 0.020s
W20260709 12:22:45.603058 10902 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.016s	sys 0.020s
I20260709 12:22:45.461786 17537 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:45.600457 17496 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:45.611425 11009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9432c125c17431e881ba1329e02a201"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:22:45.573994 17260 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.569342 17515 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:45.614493 11009 raft_consensus.cc:606] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:45.615183 11009 raft_consensus.cc:614] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:22:45.605438 17244 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.011s	sys 0.022s
I20260709 12:22:45.598802 17523 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:45.541712 17147 consensus_queue.cc:237] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.493274 17530 consensus_queue.cc:1059] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.118s
I20260709 12:22:45.623047 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:45.606066 17506 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:45.599084 17404 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:45.620476 11011 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 15.
I20260709 12:22:45.618393 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2990) took 1455 ms. Trace:
W20260709 12:22:45.618722 17244 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.012s	sys 0.023s
I20260709 12:22:45.604490 17250 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:45.608059 17408 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:45.546358 17528 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:45.382210 17536 consensus_queue.cc:260] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.599298 17481 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:45.607517 17158 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:45.604750 17138 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.631561 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:45.630789 11008 rpcz_store.cc:276] 0709 12:22:44.162788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.162926 (+   138us) service_pool.cc:224] Handling call
0709 12:22:44.163251 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:44.163580 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:44.163607 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:44.168466 (+  4859us) log.cc:844] Serialized 26 byte log entry
0709 12:22:44.537446 (+368980us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:44.561876 (+ 24430us) log.cc:844] Serialized 14 byte log entry
0709 12:22:44.643243 (+ 81367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.643418 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:45.285852 (+642434us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:22:45.609706 (+323854us) raft_consensus.cc:1685] finished
0709 12:22:45.618174 (+  8468us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:45.618333 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23032,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":102777,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":26766,"spinlock_wait_cycles":71351552,"thread_start_us":394907,"threads_started":2,"wal-append.queue_time_us":509579}
W20260709 12:22:45.621986 17343 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.003s	user 0.011s	sys 0.046s
I20260709 12:22:45.640172 17539 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.641983 17214 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:45.652576 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:45.652772 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:45.653492 10927 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:45.642134 17528 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:45.643741 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:45.645627 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60046 (request call id 3391) took 1231 ms. Trace:
I20260709 12:22:45.650110 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:45.601190 17549 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 12:22:45.655826 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:45.660831 10931 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 17: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:45.620997 17260 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.655305 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:45.663475 10932 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:22:45.674751 10930 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:45.662039 11083 rpcz_store.cc:276] 0709 12:22:44.414471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.483705 (+ 69234us) service_pool.cc:224] Handling call
0709 12:22:45.645455 (+1161750us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54000e1354. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:45.645568 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":648886656}
I20260709 12:22:45.664573 17541 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.669798 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3571) took 2348 ms. Trace:
I20260709 12:22:45.671217 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:45.676533 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:45.677558 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:45.678499 10931 raft_consensus.cc:2393] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 23: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:45.673834 11008 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:22:45.664052 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:45.632688 17244 raft_consensus.cc:697] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:45.678241 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:22:45.652904 17343 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.037s	user 0.011s	sys 0.049s
I20260709 12:22:45.687995 10928 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:22:45.688755 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:45.641822 17537 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:45.699636 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:45.704743 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.675678 11085 rpcz_store.cc:276] 0709 12:22:43.321526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.322744 (+  1218us) service_pool.cc:224] Handling call
0709 12:22:43.323146 (+   402us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:43.529841 (+206695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:43.529875 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:43.544653 (+ 14778us) log.cc:844] Serialized 52 byte log entry
0709 12:22:43.971191 (+426538us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:43.971235 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.665937 (+1694702us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b540031e054. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:45.665987 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:45.666031 (+    44us) raft_consensus.cc:1685] finished
0709 12:22:45.666042 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:45.669739 (+  3697us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26531,"raft.queue_time_us":27505,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":7097,"spinlock_wait_cycles":413271424,"thread_start_us":375017,"threads_started":1,"wal-append.queue_time_us":512339,"wal-append.run_cpu_time_us":1888,"wal-append.run_wall_time_us":1001901}
I20260709 12:22:45.714450 11078 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:45.700989 10977 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:45.717170 17260 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:45.622673 17523 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:45.722121 17523 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:45.723477 17415 raft_consensus.cc:3055] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:22:45.724009 17415 raft_consensus.cc:740] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:45.733515 11083 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:22:45.734845 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:45.735160 10930 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:22:45.736546 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:45.737450 10928 raft_consensus.cc:2410] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:22:45.724165 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:45.739140 10933 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:45.740211 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:45.740329 11083 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:22:45.740926 10933 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:45.710929 11008 raft_consensus.cc:606] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:45.635730 17404 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.632102 17506 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.747555 11008 raft_consensus.cc:614] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:45.654435 17158 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:45.734357 11085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "660a349ad34749648cae6a025708c84d"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60046
I20260709 12:22:45.618958 17515 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.697327 17416 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.757386 11083 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 12:22:45.742836 17346 consensus_meta.cc:287] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.761s	user 0.008s	sys 0.004s
I20260709 12:22:45.742624 17547 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:45.649508 17481 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:45.811909 11049 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:45.809877  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:22:45.806648 11085 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:45.818928 11085 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:45.747841 17537 consensus_queue.cc:1059] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:22:45.750787 17131 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:45.749496 17306 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.845543 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:45.847239 10927 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:45.732609 17352 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:45.804956 17257 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:45.748899 17470 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 12:22:45.679132 17539 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.845479 11656 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:22:45.856163 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:45.817878 17382 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:45.837662 17498 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:45.827174 17353 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:45.864869 17566 log.cc:927] Time spent T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:22:45.865911 11006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2996) took 1500 ms. Trace:
W20260709 12:22:45.866724 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.866358 11006 rpcz_store.cc:276] 0709 12:22:44.365749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.574995 (+209246us) service_pool.cc:224] Handling call
0709 12:22:44.670771 (+ 95776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:44.685211 (+ 14440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.865691 (+1180480us) spinlock_profiling.cc:243] Waited 95.4 ms on lock 0x7b5400243950. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:45.865842 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219385600}
I20260709 12:22:45.811743 17416 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.849885 17240 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:45.813540 17346 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.874907 11082 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 12:22:45.646441 17497 consensus_queue.cc:1175] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2201bad9e18849b09cf82de29dd032d3" responder_term: 17 status { last_received { term: 15 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:22:45.874992 10899 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:45.880096 10927 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:22:45.887066 11085 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.818086 17244 consensus_queue.cc:237] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.890388 10935 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:45.713351 17541 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.873816 17543 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:45.864887 17297 consensus_queue.cc:260] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.897421 17550 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.192s
I20260709 12:22:45.871372 17353 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:45.901847 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 3380) took 1508 ms. Trace:
I20260709 12:22:45.902349 11080 rpcz_store.cc:276] 0709 12:22:44.393874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.553084 (+159210us) service_pool.cc:224] Handling call
0709 12:22:44.664265 (+111181us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:44.664915 (+   650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.901634 (+1236719us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400167bd0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:45.901782 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254816512}
W20260709 12:22:45.904973 17508 consensus_meta.cc:287] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.577s	user 0.005s	sys 0.005s
I20260709 12:22:45.890314 17525 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:45.907127 10928 raft_consensus.cc:3055] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:45.916797 10928 raft_consensus.cc:740] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:45.912910 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:45.917440 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:45.917735 10928 consensus_queue.cc:260] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:45.919982 10928 raft_consensus.cc:3060] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:45.921909 17413 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:45.922710 11650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59414 (request call id 452) took 2601 ms (client timeout 1723 ms). Trace:
W20260709 12:22:45.923122 11650 rpcz_store.cc:269] 0709 12:22:43.314859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.317517 (+  2658us) service_pool.cc:224] Handling call
0709 12:22:45.916486 (+2598969us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540009d3d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:45.916606 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2393639168}
I20260709 12:22:45.924345 11085 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:45.899663 17451 raft_consensus.cc:3055] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:22:45.905368 17469 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:45.914971 17411 consensus_meta.cc:287] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.535s	user 0.001s	sys 0.008s
I20260709 12:22:45.925930 11624 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:45.894369 17502 raft_consensus.cc:2243] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 12:22:45.914480 17524 consensus_meta.cc:287] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.584s	user 0.000s	sys 0.008s
W20260709 12:22:45.907090 17345 consensus_meta.cc:287] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.000s
I20260709 12:22:45.913965 17416 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:45.925104 17555 log.cc:927] Time spent T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:22:45.927304 17138 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:45.936323 10928 raft_consensus.cc:1275] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:22:45.919468 17525 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:45.746174 17415 consensus_queue.cc:260] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.912209 17352 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 13 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:45.910467 17306 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:45.894722 17131 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:22:45.915839 17508 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.892891 17382 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
W20260709 12:22:45.931715 17556 log.cc:927] Time spent T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.114s	user 0.000s	sys 0.002s
W20260709 12:22:45.931586 17565 log.cc:927] Time spent T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:22:45.927513 17451 raft_consensus.cc:740] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:45.926812 17404 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:45.945804 17525 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:45.927184 17413 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:45.953280 17496 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:45.933187 17411 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:45.946075 17345 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:45.962901 17506 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:45.966297 17415 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:45.936693 17524 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.984989 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2975) took 2490 ms. Trace:
I20260709 12:22:45.985394 11003 rpcz_store.cc:276] 0709 12:22:43.494175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.495766 (+  1591us) service_pool.cc:224] Handling call
0709 12:22:43.496132 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:43.496527 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:43.496556 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:45.172676 (+1676120us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b2c0005c228. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9baf859a11 00007f9baf869372 00007f9bb0f9ba01 00007f9bb0f6043a 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2
0709 12:22:45.173137 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 12:22:45.566029 (+392892us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:45.566070 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.566148 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:45.982744 (+416596us) raft_consensus.cc:1685] finished
0709 12:22:45.982764 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:45.984919 (+  2155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6005,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":52801280,"thread_start_us":333448,"threads_started":1,"wal-append.queue_time_us":633675}
W20260709 12:22:45.981055 17559 log.cc:927] Time spent T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:22:45.990571 17451 consensus_queue.cc:260] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:45.992133 17572 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.116s
I20260709 12:22:45.992435 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:45.993388 17413 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:45.994284 17508 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:45.994949 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:45.980140 17502 raft_consensus.cc:2272] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.001634 17524 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:46.024022 17158 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:46.028270 17561 log.cc:927] Time spent T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:22:46.032877 10930 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 12:22:46.050038 10930 pending_rounds.cc:85] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 11
I20260709 12:22:46.050282 10930 pending_rounds.cc:107] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 12:22:46.050521 10930 raft_consensus.cc:2889] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:46.033401 17496 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:46.033987 17571 log.cc:927] Time spent T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:22:46.034672 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:46.051743 17541 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:46.040467 17451 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:46.052670 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.053413 11085 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 22.
I20260709 12:22:46.053604 17411 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:46.051793 17502 ts_tablet_manager.cc:1916] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:46.044385 11010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2984) took 2240 ms. Trace:
I20260709 12:22:46.057968 11051 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:46.062927 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:46.063710 11085 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:22:46.065306 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:46.065917 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:46.066246 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.049695 17481 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:46.071246 11085 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 21.
I20260709 12:22:46.073426 11081 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 690) took 1422 ms. Trace:
I20260709 12:22:46.073875 11081 rpcz_store.cc:276] 0709 12:22:44.651141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:45.218058 (+566917us) service_pool.cc:224] Handling call
0709 12:22:45.218396 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:45.555302 (+336906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:46.073158 (+517856us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b5400277ed4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:46.073361 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":770714368}
I20260709 12:22:46.077304 17138 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:46.077380 17404 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.078161 17404 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:46.078595 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:46.079852 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:46.080600 11008 raft_consensus.cc:2393] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 21: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:46.081633 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:46.081918 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:46.080477 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:46.082297 11004 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:22:46.082717 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:46.083222 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:46.055842 11010 rpcz_store.cc:276] 0709 12:22:43.804109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.804249 (+   140us) service_pool.cc:224] Handling call
0709 12:22:43.867722 (+ 63473us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:43.868205 (+   483us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:45.578596 (+1710391us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b180037e880. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade70455 00007f9bb49583c7 00007f9bb0f6a9a7 00007f9bb0f735e5 00007f9bb0f73568
0709 12:22:45.712138 (+133542us) log.cc:844] Serialized 14 byte log entry
0709 12:22:45.825405 (+113267us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:45.840449 (+ 15044us) log.cc:844] Serialized 52 byte log entry
0709 12:22:45.840641 (+   192us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:45.840676 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.840805 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:46.043987 (+203182us) raft_consensus.cc:1685] finished
0709 12:22:46.044112 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:46.044314 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":490357,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":5742,"raft.queue_time_us":2272,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":6411,"spinlock_wait_cycles":5253376,"thread_start_us":238241,"threads_started":2,"wal-append.queue_time_us":172300}
I20260709 12:22:46.083591 11006 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:46.084820 11006 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:22:46.084707 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:46.085774 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:46.086503 11006 raft_consensus.cc:2393] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 19: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:46.087055 11008 raft_consensus.cc:2393] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 16: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:46.089759 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:46.088032 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:46.088995 17503 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:46.093242 17306 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:46.094901 11010 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:22:46.099184 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:46.115762 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:46.118495 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:46.118909 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:46.120656 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:46.080862 17404 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:46.120749 17306 raft_consensus.cc:697] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:46.123903 17306 consensus_queue.cc:237] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:46.125202 10901 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:46.128679 17258 raft_consensus.cc:3055] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:46.129139 17258 raft_consensus.cc:740] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:46.123703 17498 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:46.131850 10931 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:46.135418 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:46.136137 11076 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:46.089313 17138 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:46.156232 11076 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 16.
I20260709 12:22:46.095839 17525 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:46.147419 17382 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:46.157352 17258 consensus_queue.cc:260] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:46.138873 17497 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.149322 17248 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:46.177163 17258 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:46.173808 17497 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:46.229429 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:46.232451 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:46.225828 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:46.193773 17525 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:46.244225 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.256729 17158 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:46.278100 17158 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:46.235903 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 97101.9us
I20260709 12:22:46.281203 11081 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:22:46.281694 11081 pending_rounds.cc:85] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 7
I20260709 12:22:46.282012 11081 pending_rounds.cc:107] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:22:46.282306 11081 raft_consensus.cc:2889] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:46.258817 17138 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:46.236922 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 2989) took 2076 ms. Trace:
I20260709 12:22:46.262434 17497 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:46.262365 17552 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:46.266027 17503 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:46.267233 17408 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:46.221704 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:46.222805 10933 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:22:46.276074 10935 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:22:46.279026 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2886) took 1548 ms. Trace:
I20260709 12:22:46.272219 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:46.286968 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.288117 11005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3703) took 1014 ms. Trace:
I20260709 12:22:46.288570 11005 rpcz_store.cc:276] 0709 12:22:45.273802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:45.273920 (+   118us) service_pool.cc:224] Handling call
0709 12:22:45.274200 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:45.304778 (+ 30578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:46.287571 (+982793us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b540012cad4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:46.287918 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68589824}
I20260709 12:22:46.290066 17158 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:46.290691 17408 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:46.292160 17503 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:46.292795 10927 raft_consensus.cc:3055] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:46.293310 10927 raft_consensus.cc:740] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:46.294410 10927 consensus_queue.cc:260] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:46.286496 10936 rpcz_store.cc:276] 0709 12:22:44.730162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.731968 (+  1806us) service_pool.cc:224] Handling call
0709 12:22:44.732274 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:45.182414 (+450140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:45.182447 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:45.277309 (+ 94862us) spinlock_profiling.cc:243] Waited 6.48 ms on lock 0x7b1800150ac0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade412a6 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9baf859a11 00007f9baf869372 00007f9bb0f9ba01 00007f9bb0f6043a
0709 12:22:45.277709 (+   400us) spinlock_profiling.cc:243] Waited 6.75 ms on lock 0x7b2c00057318. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9baf859a11 00007f9baf869372 00007f9bb0f9ba01 00007f9bb0f6043a 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2
0709 12:22:45.278156 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 12:22:45.565682 (+287526us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:45.565722 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:46.278253 (+712531us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b54001630d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:46.278331 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:46.278443 (+   112us) raft_consensus.cc:1685] finished
0709 12:22:46.278460 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:46.278826 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124708,"raft.queue_time_us":136697,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":11641,"spinlock_wait_cycles":761559424,"thread_start_us":287106,"threads_started":1,"wal-append.queue_time_us":368760}
I20260709 12:22:46.300923 10977 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:46.302770 10977 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:46.302930 17158 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:22:46.308353 17158 raft_consensus.cc:697] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:46.308745 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3580) took 2095 ms. Trace:
I20260709 12:22:46.309293 11084 rpcz_store.cc:276] 0709 12:22:44.213138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.214418 (+  1280us) service_pool.cc:224] Handling call
0709 12:22:44.224776 (+ 10358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:44.541074 (+316298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:46.308194 (+1767120us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b5400217d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:46.308553 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601978240}
I20260709 12:22:46.282074 10901 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:46.310014 17158 consensus_queue.cc:237] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:46.312491 10927 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:46.313524 17525 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:46.314188 17525 raft_consensus.cc:697] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:46.318967 17525 consensus_queue.cc:237] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:46.331024 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.307444 17408 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:46.332744 17408 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:46.333555 17408 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:46.338150 17515 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:46.338907 17515 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:22:46.343050 17539 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:46.295058 17503 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:46.345489 10977 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:46.346632 17503 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:46.347126 17503 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.347558 17503 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:46.348502 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.333000 17416 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:46.350091 17416 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:46.313325 17520 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:46.356062 17520 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:46.356509 17520 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:46.358968 17562 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.509s	user 0.002s	sys 0.002s
I20260709 12:22:46.284128 11002 rpcz_store.cc:276] 0709 12:22:44.160787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.160939 (+   152us) service_pool.cc:224] Handling call
0709 12:22:44.161306 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:44.162658 (+  1352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:44.162692 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:44.167430 (+  4738us) log.cc:844] Serialized 26 byte log entry
0709 12:22:45.212923 (+1045493us) spinlock_profiling.cc:243] Waited 9.76 ms on lock 0x7b4800130158. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb5e89aa1 00007f9bb5e80b37 00007f9bb5e809ca 00007f9bb5f7826f 00007f9bb5f77f37 00007f9bb5f8c55c 00007f9bb5f8c508 00007f9bb5f8c488 00007f9bb5f8c443 00007f9bb5f8b6ec 00007f9bb4eb5a96
0709 12:22:45.953062 (+740139us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b1800265780. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b 00007f9bb0affd23 00007f9bb0b000d1 00007f9bb0f1ba0f
0709 12:22:46.146282 (+193220us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:46.146353 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:46.146484 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:46.236185 (+ 89701us) raft_consensus.cc:1685] finished
0709 12:22:46.236250 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:46.236636 (+   386us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12081,"raft.queue_time_us":1537,"raft.run_cpu_time_us":20340,"raft.run_wall_time_us":1046209,"spinlock_wait_cycles":86196352,"thread_start_us":192924,"threads_started":1,"wal-append.queue_time_us":1996232}
I20260709 12:22:46.370996 11622 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:46.372781 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.376471 10932 raft_consensus.cc:2410] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:22:46.405761 17346 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:46.408360 10882 auto_rebalancer.cc:629] Failed to schedule move for tablet 78fb947776bd4e70b1f04a0af3390ae3: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:22:46.411597 17537 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:46.412531 17537 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:46.413769 17297 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:46.415251 17537 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:46.419745 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:46.420099 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:46.420506 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:46.421362 11655 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:46.423491 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:46.359540 17552 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:46.394383 17408 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:46.436385 17496 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:22:46.436961 17496 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:46.437387 17496 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:22:46.438037 17416 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:46.438807 17481 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:46.439167 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 68552.7us
W20260709 12:22:46.440158 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 90747us
W20260709 12:22:46.442854 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 60373us
I20260709 12:22:46.447357 10934 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:46.448482 11650 raft_consensus.cc:2393] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 16: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:46.408553 17572 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:46.456313 11659 raft_consensus.cc:1240] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:46.456911 17240 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:46.457152 17248 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:46.457751 17248 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:46.457952 17353 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:46.458320 17241 raft_consensus.cc:3055] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:46.458747 17241 raft_consensus.cc:740] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:46.460198 17572 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:46.463377 17572 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:46.448750 17481 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:46.457518 17240 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:46.466274 17241 consensus_queue.cc:260] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:46.473564 11622 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:46.476563 17241 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:46.471197 17552 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:46.480136  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:46.481678  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:46.484999 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:46.487300 10927 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:22:46.487052 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:46.486997 11652 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:46.489514 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.490374 11078 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:22:46.493552 10901 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:46.502553 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.503609 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:46.504150 11078 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:46.504211 11002 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 14.
I20260709 12:22:46.499697 17353 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:46.506999 17580 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:46.509907 17580 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:46.501930 17572 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:22:46.507030 17353 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:46.514722 17580 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:46.517333 17353 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:46.531418 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.532199 17342 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.533114 17342 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:46.534935 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.535136 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.536058 11081 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:46.536168 17356 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.536136 11085 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 12:22:46.540316 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:46.543047 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:46.538540 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:46.541846 11657 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:46.548098 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:46.546141 11650 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:46.548471 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:46.551826 11659 raft_consensus.cc:1813] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Handling vote request from an unknown peer 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:46.553381 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.554137 11080 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:22:46.554677 10975 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:46.556913 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 92258.6us
I20260709 12:22:46.561483 11659 raft_consensus.cc:2368] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13.
I20260709 12:22:46.557945 17469 raft_consensus.cc:3055] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:22:46.556113 11624 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:46.543381 17572 raft_consensus.cc:697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:46.564122 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:46.557972 11049 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:46.565888 17356 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:46.569037 11078 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 22. Current term is 23. Ops: []
W20260709 12:22:46.569415 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:46.569995 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:46.570427 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.570621 17356 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:46.571779 16959 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:46.572279 11084 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:22:46.574136 17360 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:46.546759 17552 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:22:46.578673 17481 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:46.568440 17342 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:46.576905 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.580438 11077 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 17: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:46.551756 17520 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:46.579187 17580 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:46.582003 17580 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:46.562968 17469 raft_consensus.cc:740] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:22:46.584105 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 134298us
I20260709 12:22:46.582542 17580 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:46.585742 11622 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:46.586756 17411 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:46.574770 17360 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:46.576843 10900 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:46.582533 17536 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:46.584427 17520 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:46.604476 10929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2885) took 1875 ms. Trace:
W20260709 12:22:46.607226 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 141154us
I20260709 12:22:46.627761 10975 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:46.630494 17572 consensus_queue.cc:237] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:46.636835 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.583444 17469 consensus_queue.cc:260] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:46.644495 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.621785 17411 raft_consensus.cc:697] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:46.655375 11084 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:22:46.634793 17297 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:22:46.657757 17297 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:46.658221 17297 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:22:46.649075 17360 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:46.661056 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 80130.1us
I20260709 12:22:46.607071 10929 rpcz_store.cc:276] 0709 12:22:44.728698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.728874 (+   176us) service_pool.cc:224] Handling call
0709 12:22:44.729212 (+   338us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:22:44.791434 (+ 62222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:44.791461 (+    27us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:22:44.792207 (+   746us) log.cc:844] Serialized 78 byte log entry
0709 12:22:46.510991 (+1718784us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b180043d200. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bb0b084bc 00007f9bade5648b 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b 00007f9bb0affd23 00007f9bb0b000d1
0709 12:22:46.511371 (+   380us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:46.511768 (+   397us) log.cc:844] Serialized 14 byte log entry
0709 12:22:46.603786 (+ 92018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:46.603982 (+   196us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:46.604028 (+    46us) raft_consensus.cc:1685] finished
0709 12:22:46.604115 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:46.604313 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29072,"prepare.queue_time_us":1414,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":257901,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":17642,"spinlock_wait_cycles":24548736,"thread_start_us":358314,"threads_started":3,"wal-append.queue_time_us":423708,"wal-append.run_cpu_time_us":2089,"wal-append.run_wall_time_us":1033414}
I20260709 12:22:46.634544 17552 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:46.635160 17158 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:46.643874 17241 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:46.603951 17345 consensus_queue.cc:1059] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.048s
W20260709 12:22:46.742221 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:46.670570 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.672077 11083 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 20. Current term is 21. Ops: []
I20260709 12:22:46.724388 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.695178 10901 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:46.675681 11085 raft_consensus.cc:2410] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 12:22:46.671739 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 159056us
I20260709 12:22:46.705147 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.698122 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.700932 11078 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:46.736799 17257 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.697644 10900 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:46.703207 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:46.671415 17594 log.cc:927] Time spent T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 12:22:46.676002 17592 log.cc:927] Time spent T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:22:46.670267 17158 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:46.774089 11080 raft_consensus.cc:2393] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 16: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
W20260709 12:22:46.705936 17595 log.cc:927] Time spent T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 12:22:46.779968 17158 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:46.781160 17523 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:46.688024 17356 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.676776 17469 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:22:46.788591 17411 consensus_queue.cc:237] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:46.781876 17523 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:46.828365 17356 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:46.828789 17523 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:46.830513 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:46.830906 17523 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:46.789373 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 91860.9us
I20260709 12:22:46.832502 10900 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:46.832666 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 164518us
I20260709 12:22:46.833020 17408 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:46.833438 10900 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:46.707692 17520 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.789928 17552 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:46.792474 17416 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:46.792531 17601 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:22:46.834775 17508 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:46.837191 17450 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:46.839681 17508 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:46.795918 11651 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:22:46.797233 11652 raft_consensus.cc:1240] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:46.796280 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.802538 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.839838 17450 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:46.843142 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:46.803380 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 108355us
I20260709 12:22:46.840108 17416 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:46.839214 17525 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:46.844776 17520 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:46.845166 10901 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:46.846177 17360 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:46.804062 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.840763 17408 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:46.844929 17525 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:22:46.807794 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.848234 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:46.847891 17408 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:46.822712 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:46.823953 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:46.821382 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:46.670339 17241 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:46.848147 17346 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:46.834960 10900 leader_election.cc:400] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13.
I20260709 12:22:46.832839 17537 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:46.849604 17346 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.850087 17537 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:46.850443 17349 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:46.850747 17416 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:46.852438 17537 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:46.845467 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:46.853503 11002 raft_consensus.cc:2410] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:22:46.848955 11078 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 21: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:46.847075 17520 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:46.851003 11652 raft_consensus.cc:2410] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 17 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 12:22:46.854513 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:46.855079 11009 raft_consensus.cc:1813] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Handling vote request from an unknown peer 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:46.848623 17427 consensus_queue.cc:1059] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:22:46.855603 11009 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 12: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:46.855901 10900 leader_election.cc:403] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:46.847654 11085 raft_consensus.cc:2393] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 19: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:46.856786 17451 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:22:46.685349 17248 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:46.799144 17158 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:46.858529 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.794525 17503 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:46.816267 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:46.855098 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:46.855413 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:46.826891 17297 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:46.763600 11084 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:46.857164 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.849473 17241 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:46.867875 11650 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 13: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:46.727757 17240 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:46.850060 17346 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:46.874182 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.689121 10833 catalog_manager.cc:5697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 12 to 13, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 13 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:46.843648 17450 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:46.864470 17525 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:46.853612 17408 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:46.879280 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:46.830529 17356 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:46.759459 17257 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:46.884238 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:46.730636 17496 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:46.855770 17427 raft_consensus.cc:3055] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:46.887951 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:46.891145 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.891139 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:46.842056 17508 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:46.890805 17427 raft_consensus.cc:740] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:46.844434 17342 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 12:22:46.898432 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.901460 10833 catalog_manager.cc:5697] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 6 to 11, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 11 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:46.903205 10833 catalog_manager.cc:5697] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 8 to 17, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 17 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:46.897022 11002 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:22:46.902297 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.859742 17552 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:22:46.871767 17601 consensus_queue.cc:1048] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 12:22:46.912372 11656 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 22. Current term is 23. Ops: []
I20260709 12:22:46.909759 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:46.916013 17345 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.910069 11082 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:22:46.916652 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:46.912200 10833 catalog_manager.cc:5697] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 13 to 16, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 16 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:46.914049 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:46.924644 11654 raft_consensus.cc:1240] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 12:22:46.926195 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.926980 11085 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:46.879971 17580 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:46.939203 11007 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:46.942034 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:46.942804 11085 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:46.932750 11009 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:22:46.949395 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:46.958452 17248 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:46.897094 17427 consensus_queue.cc:260] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:46.960984 17503 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:46.965070 17240 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:46.966382 10899 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:46.967420 17451 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:22:46.968567 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 87791.6us
I20260709 12:22:46.924657 17345 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:46.971079 17451 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:46.972401 17345 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:46.974439 17530 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:22:46.974759 17297 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:46.976724 10833 catalog_manager.cc:5697] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 16 to 19, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 19 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:46.978591 10833 catalog_manager.cc:5697] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 13 to 18, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 18 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:46.980697 10833 catalog_manager.cc:5697] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 7 to 12, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 12 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:46.981963 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:46.982940 10833 catalog_manager.cc:5697] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 16 to 17, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 17 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:46.988941 11652 raft_consensus.cc:1240] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:46.997350 11002 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 17. Ops: []
I20260709 12:22:46.993611 17353 raft_consensus.cc:3055] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:22:47.031677 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.998216 17240 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.995553 17523 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:22:47.013613 17353 raft_consensus.cc:740] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:47.049240 11002 raft_consensus.cc:1240] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:47.049994 17257 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:47.051517 11079 raft_consensus.cc:2410] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:22:47.052102 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:47.052556 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:47.054957 17349 consensus_queue.cc:1059] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:47.028754 17158 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:47.062788 11011 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 16.
I20260709 12:22:47.036566 10833 catalog_manager.cc:5697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 12 to 15, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 15 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:47.073393 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.041054 17503 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:47.071022 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:47.079425 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
W20260709 12:22:47.080003 17598 log.cc:927] Time spent T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 12:22:47.076385 10831 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35608 (request call id 264) took 26344 ms (client timeout 15000 ms). Trace:
W20260709 12:22:47.100025 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 160579us
I20260709 12:22:47.102748 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:47.103806 11002 raft_consensus.cc:2410] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 12:22:47.070286 17240 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.077240 17248 consensus_queue.cc:1059] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.031s
I20260709 12:22:47.111641 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:22:47.113484 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 123535us
I20260709 12:22:47.070226 17496 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:47.117591 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.117096 10833 catalog_manager.cc:5697] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 13 to 15, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 15 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:47.121594 10899 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:47.120301 17257 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.130187 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:47.082649 17508 consensus_queue.cc:1059] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 12:22:47.130846 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:47.152048 17349 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:47.152511 17349 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:47.153278 11654 raft_consensus.cc:2393] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 23: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:47.118141 17503 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.153889 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:47.154862 11002 raft_consensus.cc:2410] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:22:47.155140 17503 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:47.146234 17257 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.156138 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:47.156244 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:47.157739 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:47.153195 17349 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:47.158499 11010 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:47.160506 17257 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:47.157961 11011 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:22:47.162393 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.153147 17450 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:47.164633 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:47.165899 17502 ts_tablet_manager.cc:1929] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 12:22:47.166703 17502 log.cc:1199] T 9b6c427f0a234dbab806dced4d3ba0fb P 2201bad9e18849b09cf82de29dd032d3: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-1-root/wals/9b6c427f0a234dbab806dced4d3ba0fb
I20260709 12:22:47.167270 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:47.166793 17450 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:47.175271 17349 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.177968 11011 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:22:47.181155 11085 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
W20260709 12:22:47.181792 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 60280.6us
I20260709 12:22:47.185149 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:47.188505 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:47.189283 11005 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:47.189497 17349 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:47.188812 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.193902 10899 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:47.196034 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:47.196324 11051 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:47.199314 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:47.152755 17240 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:47.199357 11004 raft_consensus.cc:2393] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 19: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:47.196516 17360 raft_consensus.cc:3055] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:47.201628 11011 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:22:47.204342 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:47.151161 17580 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:47.120913 17241 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:47.209451 11007 raft_consensus.cc:2393] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 16: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:47.184156 17508 consensus_queue.cc:1243] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 0b171b6aaedc4f809f2753dcfadb14ce log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:22:47.213732 17349 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:47.206907 17360 raft_consensus.cc:740] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:47.220634 17508 consensus_queue.cc:1059] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:47.221340 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60046 (request call id 3392) took 1672 ms. Trace:
I20260709 12:22:47.218993 10833 catalog_manager.cc:5697] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 16 to 20, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 20 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:47.222949 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.225310 11009 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 15: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:47.227839 11079 rpcz_store.cc:276] 0709 12:22:45.549340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:45.551445 (+  2105us) service_pool.cc:224] Handling call
0709 12:22:47.221075 (+1669630us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54001a4fd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:47.221260 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3302746368}
I20260709 12:22:47.217206 17536 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:47.239965 17240 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:47.242188 11004 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:22:47.225752 17349 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:47.193806 17353 consensus_queue.cc:260] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:47.248059 11011 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:22:47.236338 17536 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.246943 17349 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:47.257468 17536 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:22:47.098681 10831 rpcz_store.cc:269] 0709 12:22:20.594228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.594442 (+   214us) service_pool.cc:224] Handling call
0709 12:22:46.930641 (+26336199us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:41.425517 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:41.693318 (+267801us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:41.696356 (+  3038us) write_op.cc:435] Acquired schema lock
0709 12:22:41.697849 (+  1493us) tablet.cc:662] Decoding operations
0709 12:22:41.916927 (+219078us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:41.917007 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:41.917032 (+    25us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:22:41.917732 (+   700us) tablet.cc:701] Row locks acquired
0709 12:22:41.917751 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:22:41.917896 (+   145us) write_op.cc:270] Start()
0709 12:22:41.918017 (+   121us) write_op.cc:276] Timestamp: P: 1783599761917845 usec, L: 0
0709 12:22:41.918036 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:22:41.956468 (+ 38432us) log.cc:844] Serialized 3604 byte log entry
0709 12:22:42.785672 (+829204us) op_driver.cc:464] REPLICATION: finished
0709 12:22:43.021803 (+236131us) write_op.cc:301] APPLY: starting
0709 12:22:43.030883 (+  9080us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:43.394148 (+363265us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:43.394256 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:43.566380 (+172124us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:43.566660 (+   280us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=0,mrs_lookups=0
0709 12:22:43.566708 (+    48us) write_op.cc:312] APPLY: finished
0709 12:22:43.567007 (+   299us) log.cc:844] Serialized 89 byte log entry
0709 12:22:43.567207 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:43.567346 (+   139us) write_op.cc:454] Released schema lock
0709 12:22:43.567398 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:43.567819 (+   421us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:43.567851 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15567,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":214115,"apply.run_cpu_time_us":15221,"apply.run_wall_time_us":559601,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41693,"num_ops":9,"prepare.queue_time_us":87739,"prepare.run_cpu_time_us":26637,"prepare.run_wall_time_us":615065,"raft.queue_time_us":276272,"raft.run_cpu_time_us":9954,"raft.run_wall_time_us":185955,"replication_time_us":847028,"thread_start_us":456745,"threads_started":4,"wal-append.queue_time_us":122462,"wal-append.run_cpu_time_us":102603,"wal-append.run_wall_time_us":2487409}]]}
I20260709 12:22:47.253835 17502 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50260 (request call id 0) took 3262 ms. Trace:
I20260709 12:22:47.271687 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:47.274252 11624 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:47.268042 17508 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:22:47.281286 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:47.284698 11004 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:47.287384 11011 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:22:47.293710 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:47.295112 17611 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:47.279917 17530 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13.
I20260709 12:22:47.295531 11010 raft_consensus.cc:3055] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:22:47.298496 11010 raft_consensus.cc:740] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:47.276572 17346 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.314905 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:47.295607 17611 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:47.315618 10833 catalog_manager.cc:5697] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 6 to 14, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 14 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:47.318574 11010 consensus_queue.cc:260] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:47.278224 17360 consensus_queue.cc:260] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:47.325443 11002 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:47.325213 10833 catalog_manager.cc:5697] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 14 to 18, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 18 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:47.325290 11010 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:22:47.331924 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 117402us
I20260709 12:22:47.315939 17257 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.332947 11011 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 22. Current term is 23. Ops: []
I20260709 12:22:47.322723 17611 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:47.338006 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.332654 17530 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:47.345510 17610 log.cc:927] Time spent T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:22:47.345808 10899 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:47.271157 17502 rpcz_store.cc:276] 0709 12:22:44.019844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.028015 (+  8171us) service_pool.cc:224] Handling call
0709 12:22:44.427601 (+399586us) ts_tablet_manager.cc:1151] Deleting tablet 9b6c427f0a234dbab806dced4d3ba0fb
0709 12:22:44.427704 (+   103us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:22:46.718797 (+2291093us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:47.119732 (+400935us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:47.236698 (+116966us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1133330,"tablet-delete.queue_time_us":311683,"thread_start_us":235104,"threads_started":1}
W20260709 12:22:47.348343 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.358403 11084 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:22:47.365129 17158 raft_consensus.cc:3055] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:22:47.371659 11002 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:22:47.375823 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.376886 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.334116 17525 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:47.381821 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:47.383575 17606 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.364s	user 0.000s	sys 0.003s
I20260709 12:22:47.384174 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.353737 17523 consensus_queue.cc:1059] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:22:47.383939 10936 consensus_queue.cc:237] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:22:47.370851 17158 raft_consensus.cc:740] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:47.375516 17615 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:47.395605 17615 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:22:47.395841 17607 log.cc:927] Time spent T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.352s	user 0.001s	sys 0.003s
I20260709 12:22:47.396093 17615 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:47.356876 17530 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:47.381889 17614 log.cc:927] Time spent T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:22:47.401626 17530 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:47.402837 17346 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:47.405176 10934 raft_consensus.cc:2393] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 15: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:47.408321 11002 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:47.337421 17257 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:47.409233 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.413790 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:47.377379 17427 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:47.422156 11085 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:22:47.388720 17360 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:47.431370 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:47.432459 11084 raft_consensus.cc:2393] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 23: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:47.431571 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:47.434245 10820 catalog_manager.cc:5028] TS 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): tablet 9b6c427f0a234dbab806dced4d3ba0fb (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:22:47.435173 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.435971 10933 raft_consensus.cc:2393] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 19: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:47.439340 17342 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:47.440068 17342 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.442517 17342 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:47.443955 17346 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:47.444540 17346 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.446623 17346 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:47.439980 11006 raft_consensus.cc:1275] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:22:47.451543 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:47.452422 11006 pending_rounds.cc:85] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 8
I20260709 12:22:47.453081 11006 pending_rounds.cc:107] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:22:47.453353 11006 raft_consensus.cc:2889] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:47.467314 11051 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:47.469102 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.468086 10933 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:22:47.474948 10934 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 22. Current term is 23. Ops: []
I20260709 12:22:47.479447 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.480477 11005 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:22:47.480583 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.490042 11005 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:22:47.499429 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.500751 11008 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:47.496562 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.504964 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:47.507814 11010 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 12:22:47.508675 11010 pending_rounds.cc:85] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 14
I20260709 12:22:47.509147 10929 raft_consensus.cc:2368] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18.
I20260709 12:22:47.509826 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.510421 10927 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:22:47.511584 11010 pending_rounds.cc:107] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 12:22:47.512101 11010 raft_consensus.cc:2889] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:47.516309 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.520336 10935 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
W20260709 12:22:47.521152 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.505385 17342 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:47.527585 17342 raft_consensus.cc:697] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:47.528291 17241 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:47.528643 17342 consensus_queue.cc:237] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.530076 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.530802 10929 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:47.515479 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.531653 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:47.539054 10933 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:22:47.517130 10928 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:47.545748 10929 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:47.533610 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:47.527109 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.554116 10927 raft_consensus.cc:1275] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:47.457015 17158 consensus_queue.cc:260] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:47.560017 11011 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:47.575807 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.559186 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:47.580899 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:47.580899 17615 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.581849 11011 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:47.583289 17615 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:47.589200 10935 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:22:47.592320 11004 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 15.
I20260709 12:22:47.589417 11011 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:47.596359 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:47.594061 11624 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:47.553218 17523 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:47.599499 11002 raft_consensus.cc:2393] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 19: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:22:47.601737 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 88810.2us
I20260709 12:22:47.556676 17530 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.605125 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:47.557600 17580 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 12:22:47.621940 17627 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.610822 11622 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:47.614089 10927 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:22:47.620175 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.620378 17630 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.621551 17615 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:47.622623 10974 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:47.629691 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:47.632074 10974 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:47.633081 17615 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.632656 17349 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.635406 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:47.640897 10931 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:47.610363 17481 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:22:47.610625 17503 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260709 12:22:47.643172 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:47.641624 11007 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:47.622490 17627 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.646216 11007 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 20. Current term is 21. Ops: []
W20260709 12:22:47.646955 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.647280 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.650995 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:47.641404 17241 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:47.640630 17525 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:47.655591 11002 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:22:47.611919 17530 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:47.658216 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.658710 10901 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:47.657086 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
W20260709 12:22:47.664603 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.652855 17537 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:47.669046 17349 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:47.642776 17523 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.652853 17481 raft_consensus.cc:697] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:47.671036 11079 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:22:47.660271 17615 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:47.672210 17413 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:22:47.672580 17248 raft_consensus.cc:3055] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:22:47.673476 17628 log.cc:927] Time spent T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:22:47.684478 17248 raft_consensus.cc:740] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:47.673780 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:47.685245 11003 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:22:47.675712 10930 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:47.652010 17637 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.686125 17637 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.686630 17248 consensus_queue.cc:260] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.687640 17248 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:47.688406 17637 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:47.641764 17345 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 12:22:47.679522 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.645648 17520 consensus_queue.cc:1059] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:22:47.683219 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:47.684749 17620 log.cc:927] Time spent T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:22:47.691327 11008 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:22:47.701166 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:47.703130 17469 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:47.676605 17451 raft_consensus.cc:3055] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:22:47.644011 17630 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.677218 17537 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:47.690423 17552 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:47.728356 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 167703us
I20260709 12:22:47.730259 17530 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:47.731163 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:47.731300 17257 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:47.713157 17451 raft_consensus.cc:740] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:47.717895 17537 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:47.731980 11080 raft_consensus.cc:1813] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Handling vote request from an unknown peer 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:47.732537 11080 raft_consensus.cc:2368] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 12. Current term is 13.
I20260709 12:22:47.733079 17627 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:47.733636 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.724304 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:47.725914 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 70669.1us
I20260709 12:22:47.726289 17536 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.715798 17342 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 12:22:47.728130 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:47.728437 17520 raft_consensus.cc:3055] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:47.725086 10929 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:22:47.723474 17408 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.759955 10934 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 21. Current term is 22. Ops: []
I20260709 12:22:47.709003 11051 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:47.725107 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.736248 11625 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:47.756955 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.757531 10932 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:47.758966 10977 leader_election.cc:400] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18.
I20260709 12:22:47.760653 10928 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
W20260709 12:22:47.763434 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 54547.2us
I20260709 12:22:47.766567 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:47.768493 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:47.769412 17632 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:47.771044 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:47.762042 10977 leader_election.cc:403] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:22:47.781562 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:47.784253 11625 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:47.786271 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 121036us
I20260709 12:22:47.769949 17632 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.787124 17632 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:47.790385 11083 raft_consensus.cc:2368] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20.
I20260709 12:22:47.793339 11081 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:22:47.719642 17345 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 12:22:47.758059 17520 raft_consensus.cc:740] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:47.714380 17611 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:47.800112 10928 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:22:47.803460 10901 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:22:47.803107 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 151761us
I20260709 12:22:47.805649 10899 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:47.792229 10977 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:47.807256 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:47.807927 11081 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:47.796864 17240 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:22:47.788039 17515 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18.
I20260709 12:22:47.820350 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:47.770179 17408 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.820001 10901 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:47.818483 11652 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:47.848729 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:47.851706 17520 consensus_queue.cc:260] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.892424 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:47.856415 17536 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:47.864050 17631 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:47.864655 17635 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:47.816818 17627 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:47.866621 17611 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:47.867493 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:47.910068 11005 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:47.874631 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:47.876807 17630 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:47.877110 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:47.819849 17530 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.883826 10899 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:47.884088 17345 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:47.884413 10974 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:47.876706 11077 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:47.889786 11081 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:47.889679 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:47.816998 17240 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:47.896711 10932 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
W20260709 12:22:47.889807 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 69941.8us
I20260709 12:22:47.906947 11082 raft_consensus.cc:2393] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 22: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:47.916147 11078 raft_consensus.cc:2393] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 17: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:47.900885 17349 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:47.886504 17642 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:47.910408 17635 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:47.932480 17635 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:47.844422 17481 consensus_queue.cc:237] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:47.912523 17342 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.916687 17631 raft_consensus.cc:697] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:47.943169 11081 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
W20260709 12:22:47.936133 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 151968us
I20260709 12:22:47.929388 17248 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:47.817981 17451 consensus_queue.cc:260] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.949195 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.951527 11005 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 17.
I20260709 12:22:47.935642 17644 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:22:47.954473 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 109135us
W20260709 12:22:47.954717 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 134044us
I20260709 12:22:47.954828 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:47.953755 11625 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:47.961658 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.919449 17627 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.965615 10899 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:47.966499 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60046 (request call id 3421) took 1254 ms. Trace:
I20260709 12:22:47.967736 10974 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:47.962445 10927 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:22:47.961833 11085 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:22:47.941499 17349 raft_consensus.cc:697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:47.966853 11080 rpcz_store.cc:276] 0709 12:22:46.712674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.902020 (+189346us) service_pool.cc:224] Handling call
0709 12:22:47.962637 (+1060617us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b540044cfd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:47.966450 (+  3813us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1894931328}
I20260709 12:22:47.970505 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:47.971482 11624 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:47.966094 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.973126 11625 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:47.929625 17530 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:47.972537 10936 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:22:47.955457 17520 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:47.982723 17349 consensus_queue.cc:237] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.984483 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:47.984819 17631 consensus_queue.cc:237] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.985666 10930 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:47.986927 10930 raft_consensus.cc:1240] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:47.987628 17644 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.988158 17644 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.989778 10931 raft_consensus.cc:2410] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 17 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
W20260709 12:22:48.000910 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.971031 17345 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.945091 17342 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.003953 11010 raft_consensus.cc:1240] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15. Ops: []
W20260709 12:22:48.032369 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 64716.2us
I20260709 12:22:48.010987 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:48.033771 11007 raft_consensus.cc:2393] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 21: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:47.992018 17630 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:48.017190 17408 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:48.017665 11003 raft_consensus.cc:1240] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:47.992179 17346 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:22:48.015594 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 50064.3us
I20260709 12:22:48.045746 10899 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:48.045958 11081 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:48.022944 17552 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:22:48.024890 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.001579 17642 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:48.028833 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:48.055491 10936 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:47.970621 17536 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:48.059547 11005 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:48.010098 17632 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:47.981030 17248 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:47.960752 17637 consensus_queue.cc:1059] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
W20260709 12:22:48.053894 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 62175.6us
I20260709 12:22:48.073005 10974 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:48.075201 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:48.072744 17346 raft_consensus.cc:697] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:48.076435 17618 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:48.050957 17580 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:48.091240 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:48.092051 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:48.089165 10899 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:48.094702 11003 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:22:48.094695 11005 raft_consensus.cc:2368] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17.
I20260709 12:22:48.089339 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:48.098222 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 128489us
I20260709 12:22:48.097318 11007 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:22:48.074709 17248 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:48.088902 17408 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:48.044548 17345 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:48.044752 17630 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.079705 17642 raft_consensus.cc:697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
W20260709 12:22:48.115216 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.128324 10899 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:48.089241 17649 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:48.140544 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 167488us
I20260709 12:22:48.079478 17536 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.141958 11625 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:48.147017 17342 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:48.147367 17536 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:48.144941 17450 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:48.148494 17450 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:48.148931 17450 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:48.152354 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:48.153295 11008 raft_consensus.cc:2410] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 22 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 12:22:48.107415 17248 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:22:48.148190 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 94049.7us
I20260709 12:22:48.107304 17408 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:48.205628 10974 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:48.205628 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 60754us
I20260709 12:22:48.127761 17481 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 12:22:48.209163 17408 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:22:48.217177 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 74147.1us
I20260709 12:22:48.224867 11008 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:22:48.225297 17654 log.cc:927] Time spent T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:22:48.228037 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.128688 17618 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.084s
W20260709 12:22:48.232695 17650 log.cc:927] Time spent T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:22:48.220378 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:48.206043 17644 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:48.216291 17580 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:22:48.243140 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.244045 17520 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:48.244782 17503 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:22:48.216176 17653 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:48.246886 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:48.235294 17450 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.249280 10977 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:48.262305 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 104143us
W20260709 12:22:48.265051 17537 consensus_meta.cc:287] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.000s
I20260709 12:22:48.210170 17346 consensus_queue.cc:237] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.251464 17503 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:48.254784 17520 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:48.277372 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:48.278407 10933 raft_consensus.cc:2410] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 21 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:22:48.279722 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:48.280288 10931 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:48.266896 10977 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:48.283987 17629 log.cc:927] Time spent T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.567s	user 0.003s	sys 0.013s
I20260709 12:22:48.267702 17536 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.285863 17632 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:48.241995 17642 consensus_queue.cc:237] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:48.273102 17537 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.292398 17630 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:48.293085 11010 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20. Ops: []
I20260709 12:22:48.272475 17241 consensus_queue.cc:1059] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
W20260709 12:22:48.292042 10900 consensus_peers.cc:597] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 80db8b3fbfd046e8a5535ff4a7380107. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:48.294188 17241 consensus_queue.cc:1243] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 1abf4b385a2b493ab83f593a1f8c9cd1 log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:22:48.294757 17416 raft_consensus.cc:3055] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:22:48.295128 17416 raft_consensus.cc:740] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:48.296017 17416 consensus_queue.cc:260] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.297400 17416 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:22:48.297948 17408 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.293717 17608 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:48.300107 17608 raft_consensus.cc:697] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:48.301059 17608 consensus_queue.cc:237] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.302618 17158 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:22:48.257542 17635 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.304920 17530 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:48.306026 17635 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:48.307307 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:48.268941 17248 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.309814 17248 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:48.300323 11003 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20. Ops: []
I20260709 12:22:48.307992 11010 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:48.315546 10936 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:22:48.316535 10977 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:48.318630 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:48.319034 10974 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:48.276268 17520 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.322628 17240 raft_consensus.cc:2764] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:22:48.285882 17345 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:48.279510 17515 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:22:48.324851 17520 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:48.325603 17503 consensus_queue.cc:1059] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:48.285919 17536 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.328809 17536 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:48.330315 17451 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:48.293955 17537 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:48.334389 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:48.336163 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:48.312675 17649 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:48.348896 17515 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:48.353319 10927 raft_consensus.cc:1240] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:48.355410 17637 consensus_queue.cc:1059] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:48.356683 17637 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:48.359126 17662 raft_consensus.cc:3055] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:48.360908 17662 raft_consensus.cc:740] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:48.353541 10901 leader_election.cc:400] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17.
I20260709 12:22:48.362366 10901 leader_election.cc:403] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:22:48.363083 17635 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:48.363102 10901 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:48.364616 10901 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:48.365376 17670 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:48.365638 17450 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:48.366051 17668 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:48.366503 17668 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:48.366889 17668 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:48.368129 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:22:48.368434 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 49487.4us
I20260709 12:22:48.369220 10974 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:48.361827 17662 consensus_queue.cc:260] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:48.370707 10974 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:48.370841 17503 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:48.371537 17503 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:22:48.387754 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 283040us
I20260709 12:22:48.372664 10974 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:48.352617 17240 raft_consensus.cc:3055] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:22:48.392549 17240 raft_consensus.cc:740] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:48.393127 17653 consensus_queue.cc:1059] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:48.393416 17240 consensus_queue.cc:260] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.394083 17665 raft_consensus.cc:3055] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:22:48.394459 17665 raft_consensus.cc:740] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:48.351128 17360 consensus_queue.cc:1059] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 12:22:48.394110 17667 consensus_queue.cc:1059] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:22:48.361899  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:48.351584 17408 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:48.391923 10901 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:48.409827 10974 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:48.415282 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:48.416774 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:48.400329 17644 raft_consensus.cc:3055] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:48.395316 17665 consensus_queue.cc:260] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.422358 10974 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:48.422958 17408 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:48.427649 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:48.388312 17670 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.417393 17503 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:48.371464 17515 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:22:48.408702 17508 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.390033 17634 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:22:48.432674 11006 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:48.417543 17552 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:48.434228 11004 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:22:48.418859 17240 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:48.424503 17644 raft_consensus.cc:740] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:48.419041 17416 consensus_queue.cc:1059] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
W20260709 12:22:48.440865 17663 log.cc:927] Time spent T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.232s	user 0.002s	sys 0.001s
I20260709 12:22:48.437350 17552 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.443943 17508 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.461457 10974 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:48.432698 17670 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:48.434837 17618 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:48.443507 17520 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.437796 17515 consensus_queue.cc:1243] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 1abf4b385a2b493ab83f593a1f8c9cd1 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:22:48.452772 17408 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:48.460676 17552 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:48.481535 10974 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:48.473632 17416 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:48.487133 10974 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:48.478813 17408 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:48.470840 17536 consensus_queue.cc:1059] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 12:22:48.516103 17632 raft_consensus.cc:3055] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:48.516505 17632 raft_consensus.cc:740] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:48.517393 17632 consensus_queue.cc:260] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:48.518539 17520 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:48.504613 17508 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:48.495000 17158 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:48.522697 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:48.523363 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:48.509373 17523 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:48.514741 17248 raft_consensus.cc:3055] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:48.515148 17634 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.480114 17618 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:48.523393 11079 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 13.
I20260709 12:22:48.526512 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:48.530298 11004 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 12.
W20260709 12:22:48.502959 17643 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:22:48.518733 17632 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:48.495755 17644 consensus_queue.cc:260] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:48.534454 17684 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:48.536450 11624 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:48.525343 17408 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:48.544615 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.550478 17679 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:48.555266 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:48.553006 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:48.557017 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 69960.8us
I20260709 12:22:48.557845 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:48.558773 10974 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:48.559090 11085 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:48.555756 11051 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:48.529036 17248 raft_consensus.cc:740] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:48.571532 17158 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:48.572237 17158 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:48.577982 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.564575 11051 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:48.592614 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:48.597029 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:48.600773 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:48.602077 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:48.614243 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:48.556542 17679 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.619837 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:48.596009 17257 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:48.620224 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:48.621480 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:48.622696 10929 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:48.531503 17634 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.624341 17635 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17.
I20260709 12:22:48.625212 11085 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:48.625627 10928 raft_consensus.cc:1240] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:48.626166 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:48.621260 17668 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.626966 10927 raft_consensus.cc:1240] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:48.628546 17668 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:48.630389 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:48.631187 11084 raft_consensus.cc:2368] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18.
I20260709 12:22:48.626331 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:48.634480 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:48.635398 11085 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:48.636605 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:48.642870 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:48.643003 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 117204us
I20260709 12:22:48.645110 10899 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:48.646127 10927 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:22:48.631901 17679 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:48.626266 17634 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:48.656697 10899 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:48.652755 11085 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 21. Current term is 22. Ops: []
I20260709 12:22:48.654208 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:48.650660 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:48.669142 11082 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:48.667882 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:48.653292 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:48.669831 11081 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:22:48.670099 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:48.632395 17257 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.671819 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:48.668574 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:48.673043 11084 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:48.677284 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:48.636212 17682 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:22:48.678778 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 83371.7us
W20260709 12:22:48.694011 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.677314 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:48.710487 10934 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:22:48.706413 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:48.707795 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 143280us
I20260709 12:22:48.706960 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:48.667343 17689 ts_tablet_manager.cc:933] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109)
I20260709 12:22:48.668273 17668 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:48.734216 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 77610.7us
I20260709 12:22:48.735479 11011 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:22:48.710492 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:48.738675 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:48.740113 11051 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:48.670940 17536 raft_consensus.cc:2764] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:22:48.744587 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:48.745991 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:48.741118 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:48.745944 10899 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:48.747478 11010 raft_consensus.cc:2410] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 23 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 12:22:48.745353 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:48.748347 11003 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 21: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:22:48.748302 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.676159 17257 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:48.674412 17508 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.757908 10899 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:48.753928 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:48.756382 11050 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:48.761381 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:48.762032 11011 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:48.740360 17635 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:22:48.766485 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:48.766654 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:48.767699 11007 raft_consensus.cc:2410] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:22:48.767946 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:48.768083 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:48.771989 11010 raft_consensus.cc:2376] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23. Re-sending same reply.
I20260709 12:22:48.767356 11004 raft_consensus.cc:2376] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21. Re-sending same reply.
W20260709 12:22:48.776626 17687 log.cc:927] Time spent T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:22:48.778805 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:48.668426 17248 consensus_queue.cc:260] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.781584 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:48.781402 17552 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.761551 17346 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:48.785071 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:48.794991 11084 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:48.796270 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:48.811985 11008 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:48.812728 11003 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:48.802776 11002 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:48.810823 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:48.796896 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:48.744670 17342 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:22:48.824767 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:48.820273 11010 raft_consensus.cc:2376] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19. Re-sending same reply.
I20260709 12:22:48.828603 11004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "015a67e38c364985be24b18358579506"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:22:48.763641 17450 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:22:48.835731 11011 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:22:48.839038 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:48.844771 11004 raft_consensus.cc:606] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:48.837450 11007 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 12:22:48.850148 11004 raft_consensus.cc:614] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:48.841454 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:48.851457 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:48.854988 11010 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:48.855311 17353 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:48.762974 17660 consensus_queue.cc:1059] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.265s
I20260709 12:22:48.851575 11076 raft_consensus.cc:2393] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 19: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:48.856544 17660 raft_consensus.cc:3055] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:48.856914 17660 raft_consensus.cc:740] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:48.857301 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:48.857803 17660 consensus_queue.cc:260] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.859043 17660 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:48.841869 17618 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:48.860883 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:48.858484 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:48.862303 11082 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:48.863495 11076 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:22:48.857969 17668 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:48.850446 11007 pending_rounds.cc:85] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 9
I20260709 12:22:48.864773 17342 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:22:48.844810 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 58711.5us
I20260709 12:22:48.801172 17536 consensus_queue.cc:1059] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 12:22:48.866967 11076 raft_consensus.cc:1240] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:48.882510 17631 raft_consensus.cc:3055] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:22:48.794106 17451 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:22:48.874460 17411 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:22:48.835656 17689 tablet_copy_client.cc:323] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.65:46109
I20260709 12:22:48.892330 17695 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:22:48.900231 17695 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.900704 17695 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:48.763700 17508 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.903306 17508 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:48.877017 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:48.892233 17631 raft_consensus.cc:740] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:48.869688 11082 pending_rounds.cc:85] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 7
I20260709 12:22:48.905588 11082 pending_rounds.cc:107] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:22:48.905962 11082 raft_consensus.cc:2889] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:48.891546 11007 pending_rounds.cc:107] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:22:48.913116 11007 raft_consensus.cc:2889] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:48.914428 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:48.915194 11011 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:22:48.918129 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:48.905972 17631 consensus_queue.cc:260] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.921751 17631 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:48.892737 17451 raft_consensus.cc:697] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:48.925312 17451 consensus_queue.cc:237] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.887997 17694 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.157s
I20260709 12:22:48.933441 11010 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
W20260709 12:22:48.932689 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 192645us
I20260709 12:22:48.876993 17665 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:48.915940 11008 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:22:48.938534 11051 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:48.873543 17552 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:48.888384 17671 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.941404 11008 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:22:48.942467 11008 raft_consensus.cc:606] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:48.942879 11008 raft_consensus.cc:614] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:22:48.943326 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 185494us
I20260709 12:22:48.882407 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:48.944756 11002 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:48.947446 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.951040 11004 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20. Ops: []
I20260709 12:22:48.948359 10974 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:48.963197 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:48.969475 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:48.971772 17704 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:22:48.972638 17704 consensus_queue.cc:1243] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 20.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:22:48.977943 17342 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:22:48.979470 17342 raft_consensus.cc:697] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:48.979809 17257 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:48.983189 11002 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
W20260709 12:22:48.984762 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.987365 10899 leader_election.cc:400] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20.
I20260709 12:22:48.988152 10899 leader_election.cc:403] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:22:48.939481 17694 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:22:48.969653 17508 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:22:48.990702 17670 consensus_meta.cc:287] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.000s
I20260709 12:22:48.997205 17257 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:49.001857 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:49.002960 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:49.005113 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:49.005141 17670 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.013368 17408 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.013839 17670 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:49.015560 17408 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:49.005684 17346 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20.
W20260709 12:22:49.038085 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 85350.4us
I20260709 12:22:49.016611 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:49.009369 17679 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:49.024372 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 76093.1us
I20260709 12:22:48.982686 17342 consensus_queue.cc:237] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.043759 10974 leader_election.cc:400] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18.
I20260709 12:22:49.044513 10974 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:49.016844 11005 raft_consensus.cc:1240] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:48.950393 17671 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:49.029366 10929 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:49.047035 10974 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:49.041311 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 137129us
I20260709 12:22:49.026813 17670 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.045552 11002 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:49.016968 10928 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:49.048290 10974 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:49.045357 11051 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:49.053224 10934 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:49.057222 10974 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:49.058468 11010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:22:49.059089 11010 raft_consensus.cc:606] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:49.059473 11010 raft_consensus.cc:614] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:49.050240 17408 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:49.064222 17408 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:49.064636 17408 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:49.066538 17240 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:22:49.067931 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.055088 17536 consensus_queue.cc:1059] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:22:49.048694 17241 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:49.058004 11051 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:49.044665 17353 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 12:22:49.051378 17670 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.079373 10946 tablet_copy_service.cc:140] P 9e8170bbe8244e40a2b2e5011e69b697: Received BeginTabletCopySession request for tablet 80db8b3fbfd046e8a5535ff4a7380107 from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:53346)
I20260709 12:22:49.082732 10946 tablet_copy_service.cc:161] P 9e8170bbe8244e40a2b2e5011e69b697: Beginning new tablet copy session on tablet 80db8b3fbfd046e8a5535ff4a7380107 from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:53346: session id = 0b171b6aaedc4f809f2753dcfadb14ce-80db8b3fbfd046e8a5535ff4a7380107
I20260709 12:22:49.083365 17698 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:49.083829 17698 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.084219 17698 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:49.084312 10934 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:22:49.084947 10934 raft_consensus.cc:606] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:49.084005 17670 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:49.086582 11083 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 17.
I20260709 12:22:49.080382 17240 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:49.081952 17679 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:49.088372 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:49.089051 17695 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.091156 17695 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:49.089006 11008 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:22:49.094022 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:49.094696 11011 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:22:49.096088 17707 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:49.099649 17240 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:49.101994 17627 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:49.102828 17240 consensus_queue.cc:1059] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:49.103919 17240 raft_consensus.cc:3055] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:49.104322 17240 raft_consensus.cc:740] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:49.104594 17158 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:49.105710 11002 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
W20260709 12:22:49.111259 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.110364 17451 raft_consensus.cc:2955] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:22:49.084036 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:49.113585 17679 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:49.115445 17704 raft_consensus.cc:3055] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:49.115917 17704 raft_consensus.cc:740] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:49.105494 17240 consensus_queue.cc:260] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.116792 17704 consensus_queue.cc:260] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.119995 11011 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
W20260709 12:22:49.123306 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.117255 17240 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:49.125005 17671 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:49.127460 17662 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:49.122999 11008 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 14.
I20260709 12:22:49.127753 10901 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:49.141660 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 66032.5us
W20260709 12:22:49.142189 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 65322.2us
I20260709 12:22:49.143791 10974 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:49.147146 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:49.147326 10974 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:49.147903 11008 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 19.
I20260709 12:22:49.147162 10901 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:49.196192 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 48942.5us
I20260709 12:22:49.149427 11624 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:49.197382 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 50304.1us
I20260709 12:22:49.199023 17634 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:49.210711 17634 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.211194 17634 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:49.200278 17520 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:22:49.200850 17644 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:49.217808 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 68240.5us
I20260709 12:22:49.203061 17671 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:49.197037 17695 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:22:49.146402 17667 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:49.219578 11050 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:49.221869 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 164341us
W20260709 12:22:49.221937 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 80900.6us
I20260709 12:22:49.222997 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:22:49.203545 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 54213.7us
I20260709 12:22:49.223726 11654 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:22:49.254447 11011 raft_consensus.cc:606] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:49.256246 11011 raft_consensus.cc:614] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:49.220335 17671 raft_consensus.cc:697] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:49.257664 11050 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:49.224573 10901 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:49.253536 17257 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:22:49.260460 17257 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.260871 17257 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:22:49.265022 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.257710 11624 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:49.146157 17708 raft_consensus.cc:3055] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:49.161351 17704 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:49.269733 17706 consensus_queue.cc:1059] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:49.151347 17158 raft_consensus.cc:2764] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:22:49.268249 17660 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:22:49.271247 17530 consensus_queue.cc:1059] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:49.271821 17353 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:49.150120 17670 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:49.269001 11050 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:49.257630 10974 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:49.270458 17536 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 12:22:49.319182 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 52968.4us
W20260709 12:22:49.324404 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:49.324156 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 46793.2us
I20260709 12:22:49.146909 17631 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.129s
W20260709 12:22:49.337549 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 80002.1us
I20260709 12:22:49.225034 17630 consensus_queue.cc:1059] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 12:22:49.150399 17682 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.127s
I20260709 12:22:49.268836 17705 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:49.342036 17660 raft_consensus.cc:697] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:49.343101 17660 consensus_queue.cc:237] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.345054 17552 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:49.345712 17552 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.346310  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:49.348357 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:52496 (request call id 1) took 2005 ms. Trace:
I20260709 12:22:49.349246 17346 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.349776 17346 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.350124 17699 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:49.350670 17699 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.352938 11006 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:22:49.354175 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:49.354816 11004 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23.
I20260709 12:22:49.355149 10975 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:49.338450 10974 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:49.340682 11051 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:49.253484 17667 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.268131 17708 raft_consensus.cc:740] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:49.332229 17411 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.358891 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:49.358737 10974 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:49.358624 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:49.334455 17353 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.379303 10974 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:49.381525 11002 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:22:49.378509 11004 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:22:49.385666 11006 raft_consensus.cc:2393] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:49.353336 17699 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:49.387596 10901 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:49.388988 10974 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:49.348235 17670 raft_consensus.cc:697] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:49.266314 17408 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:22:49.357395 17240 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:22:49.323346 17707 consensus_queue.cc:1059] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 12:22:49.375337 17515 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:22:49.410122 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.369416 17241 raft_consensus.cc:2764] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:22:49.376850 17706 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:49.377028 17536 raft_consensus.cc:697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:49.390717 17353 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:22:49.419193 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.383044 17695 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:49.425186 11010 raft_consensus.cc:1240] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:49.394488 17158 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:22:49.394162 17416 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:22:49.406252 17644 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:22:49.392338 17700 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:22:49.477916 17342 raft_consensus.cc:3055] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:49.348858 17451 rpcz_store.cc:276] 0709 12:22:47.352259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.356110 (+  3851us) service_pool.cc:224] Handling call
0709 12:22:47.467373 (+111263us) log.cc:844] Serialized 499 byte log entry
0709 12:22:47.525366 (+ 57993us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b54002a97a0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0ed9142 00007f9bb0eb9eaa 00007f9bb0ec0d53 00007f9bb0ec0cd9 00007f9bb0ec0c69 00007f9bb0ec0c31 00007f9bb0ebfdfd 0000000000388634 0000000000388479 00007f9bade73475
0709 12:22:47.529559 (+  4193us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x7b54002a97a0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0ed9142 00007f9bb0eb9eaa 00007f9bb0ec0d53 00007f9bb0ec0cd9 00007f9bb0ec0c69 00007f9bb0ec0c31 00007f9bb0ebfdfd 0000000000388634 0000000000388479 00007f9bade73475
0709 12:22:47.983767 (+454208us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b54002a97a0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0ee0b26 00007f9bb0eda49a 00007f9bb0ed9714 00007f9bb0eb9eaa 00007f9bb0ec0d53 00007f9bb0ec0cd9 00007f9bb0ec0c69 00007f9bb0ec0c31 00007f9bb0ebfdfd 0000000000388634
0709 12:22:49.348248 (+1364481us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8391,"raft.queue_time_us":33715,"raft.run_cpu_time_us":6646,"raft.run_wall_time_us":560389,"spinlock_wait_cycles":34116992,"thread_start_us":5703,"threads_started":1,"wal-append.queue_time_us":107878,"wal-append.run_cpu_time_us":2600,"wal-append.run_wall_time_us":1104768}
I20260709 12:22:49.477747 17708 consensus_queue.cc:260] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.428252 17450 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 12:22:49.478399 17342 raft_consensus.cc:740] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:49.479275 17708 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:49.479543 17342 consensus_queue.cc:260] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:49.480755 17667 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:49.481105 17342 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:49.481479 17707 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:49.482048 17707 raft_consensus.cc:697] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:22:49.483287 17715 log.cc:927] Time spent T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:22:49.483024 17707 consensus_queue.cc:237] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.387604 17411 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:49.499843 17411 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:49.501212 17670 consensus_queue.cc:237] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.502606 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:49.503247 11005 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 23.
I20260709 12:22:49.505098 17408 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:49.469651 17644 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:49.507267 17644 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:22:49.422130 17552 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:49.483971 17536 consensus_queue.cc:237] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:49.428687 17515 raft_consensus.cc:697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:49.426220 17240 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:49.516453 11624 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:49.391649 17671 consensus_queue.cc:237] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:49.472903 17349 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:49.470173 17706 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.472702 17694 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:22:49.516655 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 127744us
I20260709 12:22:49.524673 10974 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:49.471197 17695 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.519074 17248 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:49.525934 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 256993us
I20260709 12:22:49.529928 11050 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:49.533064 10974 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:49.538811 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 198168us
I20260709 12:22:49.522508 17451 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:49.527909 17240 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:49.572404 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:49.573097 11077 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:49.550743 17694 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:22:49.523643 17349 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:49.592962 17525 raft_consensus.cc:3055] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:49.593457 17525 raft_consensus.cc:740] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:49.594348 17632 consensus_queue.cc:1059] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:49.579934 17684 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:22:49.594362 17525 consensus_queue.cc:260] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.528935 17158 consensus_queue.cc:1059] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:22:49.598652 11050 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:49.597237 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:49.602381 11082 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:49.776625 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:49.841485 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.583420 17725 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:49.864202 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 265602us
I20260709 12:22:49.865247 11050 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:49.604918 17411 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:22:49.574643 17451 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.834802 17408 raft_consensus.cc:3055] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:22:49.595453 17632 consensus_queue.cc:1059] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.254s
I20260709 12:22:49.928808 17618 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.929497 17618 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.934468 17706 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:49.934778 17552 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.935488 17552 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.936800 17705 raft_consensus.cc:3055] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:49.937192 17705 raft_consensus.cc:740] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:49.937638 17552 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:49.934762 17618 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:49.938074 17705 consensus_queue.cc:260] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.940932 10946 tablet_copy_source_session.cc:215] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:49.942129 17705 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:49.578315 17515 consensus_queue.cc:237] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:49.946116 17720 log.cc:927] Time spent T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.372s	user 0.000s	sys 0.000s
I20260709 12:22:49.948127 11650 raft_consensus.cc:1240] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:49.960366 17708 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:22:49.961176 17708 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:49.862771 17240 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.914405 17411 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.962123 17240 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.962716 17411 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:22:49.914111 17662 consensus_meta.cc:287] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.768s	user 0.010s	sys 0.000s
W20260709 12:22:49.964325 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 99272us
I20260709 12:22:49.968369 11050 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:49.971024 11050 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:49.972949 11050 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:49.974787 11050 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:49.976087 17706 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:49.976843 17706 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:22:49.977303 17706 raft_consensus.cc:697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:22:49.977708 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:49.978538 17257 consensus_meta.cc:287] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.717s	user 0.007s	sys 0.002s
I20260709 12:22:49.978178 17706 consensus_queue.cc:237] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.978971 17257 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.981132 17349 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:49.981828 17724 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:22:49.977314 17634 consensus_meta.cc:287] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.766s	user 0.007s	sys 0.002s
I20260709 12:22:49.983530 17634 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:49.985764 17634 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:49.844805 17694 consensus_queue.cc:1059] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.120s
I20260709 12:22:49.988597 17708 raft_consensus.cc:3055] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:49.988994 17708 raft_consensus.cc:740] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:49.989897 17708 consensus_queue.cc:260] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:49.996131 11050 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:49.923064 17408 raft_consensus.cc:740] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:49.962036 17695 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:49.991904 17353 consensus_meta.cc:287] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.522s	user 0.006s	sys 0.003s
I20260709 12:22:49.983023 17451 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:50.012348 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 437975us
I20260709 12:22:50.015084 11050 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:49.917404 17725 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.011088 17632 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:50.014077 17662 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:50.043567 17704 consensus_meta.cc:287] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.719s	user 0.009s	sys 0.000s
I20260709 12:22:50.043634 17630 raft_consensus.cc:3055] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:22:50.053031 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:50.014655 17353 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:50.070566 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 483904us
I20260709 12:22:50.072184 11082 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:50.070827 17695 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:50.076845 17451 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.095988 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:50.079727 17630 raft_consensus.cc:740] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:50.140686 11654 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:50.044768 17408 consensus_queue.cc:260] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.144198 17257 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:50.083950 17632 raft_consensus.cc:697] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:50.146495 17632 consensus_queue.cc:237] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.079845 17707 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:50.150173 17707 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:50.082409 17704 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:50.152465 17707 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:50.153493 17630 consensus_queue.cc:260] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.154819 17630 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:50.079449 17662 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:50.152331 17704 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:50.156282 17451 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.140666 17695 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:50.157775 17732 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:50.158440 17732 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:50.158912 17451 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:50.158912 17695 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:50.160833 17729 log.cc:927] Time spent T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 12:22:50.133181 17698 consensus_meta.cc:287] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 1.048s	user 0.011s	sys 0.001s
W20260709 12:22:50.097770 17644 consensus_meta.cc:287] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.000s
I20260709 12:22:50.173653 17732 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:50.140781 17726 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.113709 17608 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:50.095850 17416 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.186975 17732 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:50.138660 17723 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 12:22:50.095955 17724 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:22:50.199606 11077 consensus_meta.cc:287] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.000s
I20260709 12:22:50.200089 11077 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:50.181432 17734 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:22:50.188277 17408 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:50.178316 17698 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:50.217741 10974 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.007s	sys 0.026s
W20260709 12:22:50.219063 10974 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.007s	sys 0.026s
I20260709 12:22:50.192746 17240 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:50.190179 17416 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.189100 17644 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.186445 17726 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:50.189976 17608 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.227439 17240 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.224453 17704 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:50.204128 17732 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:50.263680 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:50.235227 17670 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.014s	sys 0.024s
W20260709 12:22:50.253523 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:50.332115 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 256841us
I20260709 12:22:50.334841 11051 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:50.294067 17670 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.015s	sys 0.024s
I20260709 12:22:50.293504 17353 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 20 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:50.345400 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 324527us
I20260709 12:22:50.292568 17725 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:50.349249 11050 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:50.344630 10900 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:50.246452 17240 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.356846 11050 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:50.352187 17662 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:50.369138 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:50.356101 17704 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:22:50.372932 11050 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:50.355842 17670 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:50.373202 11051 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:50.376713 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:50.390640 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:50.375484 17670 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:50.373201 17746 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:50.382754 17747 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:50.361475 17411 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:50.447474 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 92991.8us
I20260709 12:22:50.439448 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 3455) took 1885 ms. Trace:
I20260709 12:22:50.440769 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:50.527993 10974 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:50.438433 11007 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:22:50.529667 10974 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:50.445902 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:50.446312 10899 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:50.532958 11008 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:50.529052 11004 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:22:50.538273 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:50.538329 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:50.544366 11009 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:50.536171 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:50.545487 11008 raft_consensus.cc:2393] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 15: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:50.544286 11004 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:50.542966 11083 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 12:22:50.543514 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:50.546861 11084 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:50.540470 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:50.417328 17736 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 12:22:50.394743 17248 consensus_meta.cc:287] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.844s	user 0.010s	sys 0.001s
I20260709 12:22:50.394069 17670 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:50.551932 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:50.530686 17451 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:50.426004 17713 log.cc:927] Time spent T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.861s	user 0.000s	sys 0.003s
I20260709 12:22:50.416826 17520 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.423493 17708 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:50.557631 11009 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:50.554888 17408 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:50.528733 17634 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.404719 17608 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:50.553051 11007 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:22:50.558741 17631 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:50.406730 17416 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:50.393539 17698 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:50.406664 17240 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:50.393977 17682 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.528708 11080 rpcz_store.cc:276] 0709 12:22:48.553705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.553819 (+   114us) service_pool.cc:224] Handling call
0709 12:22:48.554201 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:48.557798 (+  3597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:48.557832 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:49.356860 (+799028us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b18004014a0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade412a6 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9baf859a11 00007f9baf869372 00007f9bb0f9ba01 00007f9bb0f6043a
0709 12:22:50.192382 (+835522us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b2c000040c8. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9baf859a11 00007f9baf869372 00007f9bb0f9ba01 00007f9bb0f6043a 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2
0709 12:22:50.202802 (+ 10420us) log.cc:844] Serialized 26 byte log entry
0709 12:22:50.360675 (+157873us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:50.360749 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:50.360869 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:50.439242 (+ 78373us) raft_consensus.cc:1685] finished
0709 12:22:50.439266 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:50.439390 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3200,"raft.queue_time_us":3300,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":31695,"spinlock_wait_cycles":98317952,"thread_start_us":129453,"threads_started":1,"wal-append.queue_time_us":165296}
I20260709 12:22:50.392048 17706 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:22:50.559484 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:50.419162 17411 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 24 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:50.405507 17732 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:50.561327  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:50.534759 17683 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.530937 17349 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:50.559075 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:50.564069 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 196176us
I20260709 12:22:50.406975 17644 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:50.713531 17770 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:50.558349 17158 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.400175 17704 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:50.566685 17241 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:50.593317 17756 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.737704 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:50.740471 11050 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:50.741425 11082 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:50.743615 10901 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:50.754290 11050 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:50.566525 17451 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:50.755534 11004 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:22:50.734727 17706 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.734458 17608 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:50.739347 17408 raft_consensus.cc:697] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:50.739688 17618 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:22:50.725178 17634 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:50.602563 17520 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:50.738777 17683 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.769053 17630 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:50.778659 17762 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:50.771921 17240 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.762992 17756 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.785846 11007 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23.
I20260709 12:22:50.796366 17722 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:50.743795 17349 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.764536 17644 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.800032 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3367) took 1697 ms. Trace:
I20260709 12:22:50.763535 17416 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:50.739315 17682 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:50.813186 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:50.812253 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:50.765479 17627 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:22:50.802198 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 355970us
I20260709 12:22:50.820036 11079 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:22:50.864773 17769 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:22:50.733912 17631 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.768520 17706 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:22:50.764315 17698 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:50.798540 17257 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:50.769598 17704 raft_consensus.cc:697] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:50.821578 17771 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:22:50.868943 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:50.869977 11654 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:50.775631 17608 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.872305 17773 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:50.872911 17773 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.873647 17634 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:50.837456 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:50.774782 17241 raft_consensus.cc:697] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:50.841256 17756 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:50.842859 17346 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:50.865373 17662 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:50.833259 17763 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:50.833346 17726 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:50.835804 17240 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.750115 17158 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.749575 17770 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:50.851156 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:50.846005 10934 rpcz_store.cc:276] 0709 12:22:49.102761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.102889 (+   128us) service_pool.cc:224] Handling call
0709 12:22:49.103233 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:49.103622 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:49.103650 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:49.104153 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 12:22:49.341066 (+236913us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:49.341107 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:49.341176 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:50.425423 (+1084247us) spinlock_profiling.cc:243] Waited 6.18 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:22:50.770199 (+344776us) raft_consensus.cc:1685] finished
0709 12:22:50.770224 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:50.799953 (+ 29729us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1113,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"spinlock_wait_cycles":14203648,"thread_start_us":236526,"threads_started":1,"wal-append.queue_time_us":417958}
I20260709 12:22:50.810793 17721 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:50.874250 17634 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:50.877445 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 90756.6us
I20260709 12:22:50.879957 11082 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:22:50.882323 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:50.883617 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:50.884757 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:50.897802 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:50.836153 17536 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.870540 17771 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.894241 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:50.856621 17644 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.861956 17416 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.897207 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:50.886334 17618 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.899102 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:50.837672 17762 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:50.898382 11078 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:50.896803 10901 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:50.871445 17257 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.903009 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:50.903505 11081 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:50.927875 17684 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:50.865703 17408 consensus_queue.cc:237] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.928544 17684 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.929797 17240 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:50.930892 17684 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:50.845237 17722 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.867442 17627 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:50.913750 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:50.943131 11083 raft_consensus.cc:2410] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:22:50.915412 17349 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:50.916018 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:50.908506 17536 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.895784 17662 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.912451 17618 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:50.919319 17676 log.cc:927] Time spent T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 1.534s	user 0.009s	sys 0.014s
I20260709 12:22:50.920323 17770 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:50.924026 17726 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:50.924530 17774 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.926306 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:50.964721 11084 raft_consensus.cc:2393] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 22: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:50.898634 11650 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 23. Current term is 24. Ops: []
I20260709 12:22:50.902727 17771 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:22:50.932463 17765 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:22:50.933831 17608 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:50.934017 17670 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:50.913543 10901 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:50.938300 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:50.938766 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:50.970368 11077 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:50.971747 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:50.972177 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:50.935523 17158 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:50.942011 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:50.974682 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 61225.1us
I20260709 12:22:50.947165 17773 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:50.896772 17763 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.901894 17634 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:50.975498 10901 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:50.979595 11002 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20. Ops: []
I20260709 12:22:50.979643 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:50.981312 17536 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:50.982571 17634 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:50.983131 17634 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:50.983470 17634 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.983843 17634 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:50.985805 17346 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:50.986250 17346 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.986581 17346 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:22:50.983531 11624 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.039s	sys 0.061s
W20260709 12:22:50.990845 11624 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.039s	sys 0.061s
I20260709 12:22:50.966312 17451 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:50.927798 17683 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:50.951918 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:50.940943 17508 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:50.908754 17721 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:50.967710 11080 raft_consensus.cc:1240] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:22:50.936779 17778 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:50.972754 11004 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:50.972544 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:51.008221 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:51.013788 11007 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:51.013892 11002 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:51.015173 11050 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:51.013437 11084 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:22:50.973618 11008 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:22:51.017349 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:51.017990 11008 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:51.018841 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:51.019347 11008 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:50.947691 11085 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:22:50.971940 11006 pending_rounds.cc:85] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 9
I20260709 12:22:51.020330 11006 pending_rounds.cc:107] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 20.10
I20260709 12:22:51.020615 11006 raft_consensus.cc:2889] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:50.978159 11009 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: [18.11-20.12]
I20260709 12:22:50.989497 10901 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:50.950884 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 83297us
I20260709 12:22:50.966867 17726 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.036933 17618 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:51.038335 17726 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:51.038626 17763 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:51.039716 17670 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:50.969770 17698 consensus_queue.cc:1059] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.041s
I20260709 12:22:50.998520 17731 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:51.022535 10899 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:22:50.993512 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.024646 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.033210 17762 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:51.034096 17644 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:51.034725 17631 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:51.034895 17768 log.cc:927] Time spent T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:22:51.070850 11010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3784) took 1721 ms. Trace:
I20260709 12:22:51.071090 11084 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20. Ops: []
I20260709 12:22:51.071316 11008 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 20.
I20260709 12:22:51.035686 17416 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:51.036226 17662 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:51.077358 17349 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.077884 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:50.945859 17704 consensus_queue.cc:237] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:51.078615 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 56153.4us
I20260709 12:22:51.012064 17778 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:51.043767 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:51.049458 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:51.049870 11082 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:51.052376 11078 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 14.
I20260709 12:22:51.054314 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.055601 11007 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:51.084147 11083 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:22:51.084731 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:51.085014 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.055747 17634 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.013083 17683 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.089612 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:51.054936 17682 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:51.053138 17670 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:51.064731 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.093523 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.094398 11081 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:51.094754 11080 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:51.094925 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:51.095638 11654 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:51.023952 17536 consensus_queue.cc:1059] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 12:22:51.077529 17726 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:50.968823 17774 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.068969 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:51.105616 11650 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 13.
I20260709 12:22:51.049748 17508 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:51.012337 17520 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:51.071310 11010 rpcz_store.cc:276] 0709 12:22:49.349336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.354192 (+  4856us) service_pool.cc:224] Handling call
0709 12:22:49.354468 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:49.470332 (+115864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.070622 (+1600290us) spinlock_profiling.cc:243] Waited 70.5 ms on lock 0x7b54002db254. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:51.070791 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162175744}
I20260709 12:22:51.076467 10900 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:50.967020 17241 consensus_queue.cc:237] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:22:51.079358 10899 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:51.111093 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:22:51.044720 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 55291.6us
I20260709 12:22:51.087646 17778 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:51.080789 11076 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 16.
I20260709 12:22:51.085842 11083 raft_consensus.cc:2393] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 23: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:51.115471 11010 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:22:51.083346 11009 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:22:51.117621 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:51.088255 11011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3785) took 1738 ms. Trace:
I20260709 12:22:51.093345 17763 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:51.121274 11009 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:22:51.078090 17349 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.098055 17670 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.060906 17706 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.066108 17725 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:51.099694 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:51.065030 11004 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:22:51.118877 11011 rpcz_store.cc:276] 0709 12:22:49.349635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.352016 (+  2381us) service_pool.cc:224] Handling call
0709 12:22:50.926656 (+1574640us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b5800223598. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f39fc0 00007f9bb5f24929 00007f9bb5f243d2 00007f9baf49bbd4
0709 12:22:50.926847 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:50.927054 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:22:50.947886 (+ 20832us) log.cc:844] Serialized 14 byte log entry
0709 12:22:51.087938 (+140052us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:51.087987 (+    49us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:22:51.088027 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.088099 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.088205 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12582,"prepare.queue_time_us":19793,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":103,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":3309,"spinlock_wait_cycles":8393984,"thread_start_us":139451,"threads_started":1}
I20260709 12:22:51.104221 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:51.073182 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:51.077764 17723 consensus_queue.cc:1059] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:22:51.076465 11050 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:51.113755 11624 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:51.114930 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:51.086236 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:51.121960 11005 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:22:51.092445 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.118283 11650 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:51.129642 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:51.071310 17731 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:51.129105 10900 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:51.094192 17779 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:51.137277 10900 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:51.124588 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:51.101085 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.127336 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:51.128213 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 51841.6us
W20260709 12:22:51.113965 10977 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.543s (SENT) [suppressed 22 similar messages]
I20260709 12:22:51.106920 17257 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:51.127951 11656 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:51.140699 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.131523 17733 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:22:51.134846 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 55568.5us
I20260709 12:22:51.135457 10975 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:51.140729 11050 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:51.144387 10899 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:51.136191 17723 raft_consensus.cc:3055] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:22:51.136799 17644 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:51.123077 17708 raft_consensus.cc:3055] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:22:51.136616 17694 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:51.124101 17670 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:51.136565 17731 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:51.138906 11002 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:22:51.133214 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:51.115386 17627 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:51.139297 11080 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:51.160816 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.161571 11080 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:22:51.162257 17774 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:51.148334 17694 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:51.163334 17349 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:51.164321 17721 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:51.097302 17683 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.166671 17683 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:51.112197 17726 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:51.142076 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.142597 11010 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:22:51.135587 17451 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:22:51.123458 17662 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:51.146209 17618 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:51.147339 17552 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:51.144619 11050 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:51.189047 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 44464.3us
I20260709 12:22:51.128822 17725 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:51.147702 17536 consensus_queue.cc:1059] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:22:51.148124 17723 raft_consensus.cc:740] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:51.151602 17257 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:51.158370 17346 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.173770 17694 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:51.141434 11083 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:51.139575 11654 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:51.176265 10899 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:51.201632 11079 raft_consensus.cc:1240] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:51.149037 17631 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:51.202392 17631 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.202800 17631 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:51.164541 17634 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:51.192263 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:51.147975 17708 raft_consensus.cc:740] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:51.177738 17662 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.151556 17733 raft_consensus.cc:697] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:51.197618 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.198906 11050 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:51.131649 17763 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:51.205958 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 88908.2us
I20260709 12:22:51.213531 11002 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 24.
I20260709 12:22:51.187660 17618 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.238938 10901 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:51.239259 17618 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:51.201766 17725 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:51.244473 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 130530us
W20260709 12:22:51.229707 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 53530us
I20260709 12:22:51.250521 11010 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:51.253432 10901 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:51.254658 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 117479us
I20260709 12:22:51.206022 17721 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:51.258423 11008 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:22:51.259384 10899 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:51.257462 11624 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:51.268115 11077 raft_consensus.cc:1240] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:51.233311 17662 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:51.229266 17552 raft_consensus.cc:697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:51.247292 17451 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:51.205670 17698 consensus_queue.cc:1059] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:22:51.282186 17796 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.252368 17257 raft_consensus.cc:697] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:22:51.308441 17784 log.cc:927] Time spent T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:22:50.733044  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:51.304632 17552 consensus_queue.cc:237] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.454267 17618 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:51.456591 17618 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:51.255286 17508 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:51.309937 17723 consensus_queue.cc:260] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.459050 17723 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:51.259083 17721 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:51.460232 17721 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:51.254138 17771 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.263672 17724 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:22:51.285028 17708 consensus_queue.cc:260] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.282987 17731 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:22:51.465391 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 206084us
I20260709 12:22:51.257386 17790 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:51.330925 10900 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:51.466387 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 135543us
I20260709 12:22:51.433257 17634 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:22:51.449213 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 250356us
I20260709 12:22:51.283442 17780 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:22:51.312175 17733 consensus_queue.cc:237] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:51.450464 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 171337us
I20260709 12:22:51.306905 17631 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:51.283237 17779 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:22:51.469201 10899 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:51.472289 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.463444 17536 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.432497 17769 consensus_queue.cc:1059] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:22:51.479832 17631 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:51.480504 17536 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:51.467777 17794 log.cc:927] Time spent T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.239s	user 0.003s	sys 0.005s
I20260709 12:22:51.471709 17731 raft_consensus.cc:697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:51.464076 17257 consensus_queue.cc:237] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.471876 17708 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:51.431457 17796 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:51.478830 17346 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:51.484488 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.468904 17618 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:51.469429 17706 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:51.488910 10899 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:51.490306 17627 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:51.499500 17634 raft_consensus.cc:3055] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:51.499953 17634 raft_consensus.cc:740] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:51.492910 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:51.501540 11654 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:22:51.469290 17694 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.499136 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:51.502955 11651 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:51.487928 17790 raft_consensus.cc:697] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:51.514966 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3798) took 1077 ms. Trace:
I20260709 12:22:51.515954 17248 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:51.516712 17779 raft_consensus.cc:697] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:51.516533 17248 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.517728 17779 consensus_queue.cc:237] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:51.522068 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.523790 17408 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.524362 17408 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.526407 17408 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:51.526793 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:51.527886 11011 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:51.528019 17756 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.528482 17756 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.528918 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:51.529342 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.529491 17797 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:22:51.524631 17774 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.530548 17774 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.531414 17520 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:51.531884 17520 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.530591 17756 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:51.532833 17774 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:51.534729 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:51.535475 10974 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:51.537242 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 52988us
I20260709 12:22:51.532243 17520 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:51.530014 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:51.527263 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:51.540869 11002 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:22:51.541306 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:51.529950 11076 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:51.540234 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:51.542507 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.543089 11077 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:22:51.541569 11008 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 12:22:51.546808 10974 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
W20260709 12:22:51.542304 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 53482.7us
I20260709 12:22:51.531311 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:51.531164 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 395760us
I20260709 12:22:51.551074 17241 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:51.551554 17241 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:51.551959 17241 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:51.552673 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:51.552817 10975 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:51.541910 11009 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:22:51.554785 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:51.551101 11006 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:51.558229 11651 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:51.557655 10974 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:51.498003 17618 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.515458 11003 rpcz_store.cc:276] 0709 12:22:50.437844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.445982 (+  8138us) service_pool.cc:224] Handling call
0709 12:22:50.533673 (+ 87691us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:50.856353 (+322680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:50.856386 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:50.866992 (+ 10606us) log.cc:844] Serialized 52 byte log entry
0709 12:22:51.088823 (+221831us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:51.104901 (+ 16078us) log.cc:844] Serialized 14 byte log entry
0709 12:22:51.288610 (+183709us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b180015d6c0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:22:51.514368 (+225758us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b180015d6c0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9baddedc0a 00007f9bb752d219 00007f9bade75a40 00007f9bade704e4 00007f9bade70455 00007f9bb0f58060 00007f9bb0f6a716 00007f9bb0f7b287 00007f9bb0f7b208
0709 12:22:51.514593 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.514686 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:51.514730 (+    44us) raft_consensus.cc:1685] finished
0709 12:22:51.514743 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.514897 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118519,"prepare.queue_time_us":15947,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":436132,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":30856,"spinlock_wait_cycles":9965696,"thread_start_us":509176,"threads_started":2,"wal-append.queue_time_us":247833}
I20260709 12:22:51.574204 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:51.574204 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.531085 17704 raft_consensus.cc:3055] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:22:51.561801 11654 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:51.592918 11079 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 16.
I20260709 12:22:51.575714 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:51.559664 10900 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:51.595063 11084 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:51.554091 17416 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:22:51.596033 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:51.597163 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 48980.8us
W20260709 12:22:51.599725 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 104558us
I20260709 12:22:51.599664 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:51.600533 11011 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:51.500792 17634 consensus_queue.cc:260] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:22:51.601378 10927 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 18: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:51.505214 17726 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:51.594368 10974 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:51.579716 17763 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:51.602783 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:51.538211 17731 consensus_queue.cc:237] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:51.527640 17408 consensus_queue.cc:1059] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:22:51.606861 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:51.503940 17724 raft_consensus.cc:697] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:22:51.604552 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 44986.9us
I20260709 12:22:51.560881 17346 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:22:51.605520 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:51.605878 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:51.610980 10933 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:51.592096 17618 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:51.596979 17794 log.cc:927] Time spent T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:22:51.616662 17781 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:51.616974 17670 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.618126 17520 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:51.619127 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.619383 11010 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 16: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:51.604362 10974 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:51.607434 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:51.608227 10930 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:22:51.619707 17790 consensus_queue.cc:237] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.560169 17682 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.621115 17682 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.623221 17682 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:51.624078 11006 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:22:51.573707 17775 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:51.610015 10934 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:22:51.613863 17248 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:51.614365 10900 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:51.611227 17763 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:51.628255 17763 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.628728 17763 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:51.593691 17704 raft_consensus.cc:740] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:51.632068 17769 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:51.632628 17769 raft_consensus.cc:697] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:51.633177 17722 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:51.633478 17769 consensus_queue.cc:237] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:51.634286 17634 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:51.635896 17798 consensus_queue.cc:1059] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:51.637032 17798 raft_consensus.cc:3055] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:22:51.637405 17798 raft_consensus.cc:740] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:51.638199 17798 consensus_queue.cc:260] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.639256 17798 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:22:51.639669 17793 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.201s	user 0.000s	sys 0.007s
I20260709 12:22:51.640986 17408 raft_consensus.cc:3055] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:22:51.641409 17408 raft_consensus.cc:740] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:51.642230 17682 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.642736 17682 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:51.644032 17248 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.644534 17248 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.645668 17611 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:51.642262 17408 consensus_queue.cc:260] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.651388 17408 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:51.601137 17740 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:51.652245 17740 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:51.652626 17740 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:22:51.645576 17665 consensus_queue.cc:1175] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" responder_term: 14 status { last_received { term: 13 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 13. Current term is 14. Ops: [13.9-13.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:22:51.656629 17525 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:51.657145 10975 consensus_peers.cc:597] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 80db8b3fbfd046e8a5535ff4a7380107. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:51.659165 17682 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:51.660554 17248 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:51.660949 17796 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:51.662228 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:51.664404 17536 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:51.665275 17644 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:51.574173 17774 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:22:51.665771 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 54630.4us
W20260709 12:22:51.667697 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:51.666337 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 52887us
I20260709 12:22:51.669034 10899 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:51.671607 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
W20260709 12:22:51.672534 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 68218.8us
I20260709 12:22:51.673100 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:51.671710 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 66612.7us
I20260709 12:22:51.674875 10933 raft_consensus.cc:2410] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 22 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 12:22:51.673887 10974 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:51.698189 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:51.697592 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:51.698408 11011 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:22:51.703429 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:51.628492 17771 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:51.708379 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:51.709384 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:51.753643 11003 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:22:51.753759 11656 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:51.709280 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:51.666530 17257 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.707007 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:51.649974 17775 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:51.748463 10882 auto_rebalancer.cc:629] Failed to schedule move for tablet 74d2f9dca08d41e7a77146322049c40c: Illegal state: Replica 1abf4b385a2b493ab83f593a1f8c9cd1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:22:51.749032 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:51.755144 11006 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 16: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:51.754715 10934 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:22:51.758090 10936 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 17: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:51.665854 17644 raft_consensus.cc:697] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:51.756006 17733 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 12:22:51.788545 17644 consensus_queue.cc:237] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:51.614670 17662 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:51.668562 17774 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:51.790347 17774 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:51.699493 17665 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:51.792116 17665 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:51.792505 17665 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:51.792965 10931 raft_consensus.cc:2368] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 16. Current term is 17.
I20260709 12:22:51.752589 17536 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:51.793829 17536 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.795949 17662 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:51.796967 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:51.797518 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:51.798062 11654 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:22:51.800076 17801 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:51.671196 17778 consensus_meta.cc:287] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.542s	user 0.004s	sys 0.006s
I20260709 12:22:51.800704 17801 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.801259 17778 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.801707 17618 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:51.803000 17801 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:51.803645 17778 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:51.804479 10934 raft_consensus.cc:2368] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 16. Current term is 17.
W20260709 12:22:51.754228 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 80401.6us
I20260709 12:22:51.667973 17706 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.761212 11622 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:51.805452 10974 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:51.855225 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 94099.3us
I20260709 12:22:51.856401 11622 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:51.706995 17670 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:51.812216 10932 raft_consensus.cc:1240] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:51.761746 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:51.855362 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 50004.1us
I20260709 12:22:51.861959 10974 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:51.761806 17725 consensus_meta.cc:287] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.518s	user 0.014s	sys 0.001s
I20260709 12:22:51.863606 17762 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:51.864125 17762 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.864442 17508 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:51.863727 17725 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:51.864477 10974 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:51.866981 17762 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:51.867652 17725 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:51.868505 11076 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:51.869364 17508 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:51.869302 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:51.869839 10974 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:51.870030 17508 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:51.870591 17508 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:51.871145 17726 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:22:51.871549 17726 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:51.871955 17726 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:51.697355 17346 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:51.874420 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.875098 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.875458 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.878171 11078 raft_consensus.cc:2393] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 20: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:51.875923 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.877661 11085 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:22:51.878283 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.879204 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.875094 11080 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:51.891682 11078 raft_consensus.cc:2410] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 12:22:51.880615 11077 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:22:51.892338 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:51.883577 11081 raft_consensus.cc:2393] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 24: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:51.889530 11654 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:51.893790 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:51.759258 17248 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:51.876639 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.805792 17632 raft_consensus.cc:3055] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:22:51.922523 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:51.697065 17416 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:22:51.913489 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:51.955848 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.889783 17536 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:51.884214 11082 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:22:51.912685 11011 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:51.920015 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:51.965683 10930 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:22:51.913870 17733 raft_consensus.cc:2764] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:22:51.933342 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:51.952133 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:51.983907 10974 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:51.893895 17682 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:51.787565 17775 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:51.958571 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 313273us
I20260709 12:22:51.961112 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.917503 17248 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:51.860504 17618 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:51.967617 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.982411 10935 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:22:51.786244 17257 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:51.953835 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 485613us
I20260709 12:22:51.889236 17756 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:22:51.926183 17649 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:51.981081 17726 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:51.804415 17704 consensus_queue.cc:260] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.026211 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:51.890545 17706 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.988343 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:52.031387 11049 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:52.036800 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:51.916848 17721 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:51.955603 17416 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.044688 11050 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:52.034991 17248 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:51.926405 17611 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.095s
I20260709 12:22:52.048063 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:52.048367 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.065148 10930 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:52.053356 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:52.034502 17520 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:52.046343 17346 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:22:52.046986 17698 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.024s	sys 0.039s
I20260709 12:22:51.921592 17632 raft_consensus.cc:740] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:51.878677 17508 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:52.095952 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:52.041401 17708 consensus_meta.cc:287] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.550s	user 0.006s	sys 0.002s
I20260709 12:22:52.029520 17694 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:51.985878 17682 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:52.076244 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:52.108886 11077 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:52.063660 17723 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:52.054648 11081 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:52.044842 17649 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:52.024402 17763 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.052038 17801 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 12:22:52.092926 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 236595us
I20260709 12:22:52.054615 17796 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 12:22:52.026804 17769 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.125793 17769 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.126688 17726 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:52.128724 17774 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:52.130924 17774 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:51.991570 10977 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:52.063846 17416 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:52.105921 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.110016 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:52.144809 11077 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:22:52.145429 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:52.145665 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:52.076956 11079 raft_consensus.cc:2393] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 23: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:52.075922 17408 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:52.110795 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 114344us
I20260709 12:22:51.950004 17724 consensus_queue.cc:237] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:52.092450 17552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.007s	sys 0.010s
I20260709 12:22:52.121100 10933 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:52.156695 17689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80db8b3fbfd046e8a5535ff4a7380107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.112406 17723 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:52.093802 17698 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.024s	sys 0.039s
I20260709 12:22:52.132254 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:52.111280 17632 consensus_queue.cc:260] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.19, Last appended by leader: 19, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:52.131794 17769 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:52.142740 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:52.142937 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 151461us
I20260709 12:22:52.146049 11004 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:52.112788 17682 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:52.097076 17808 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:22:52.151906 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 128762us
I20260709 12:22:52.159808 11077 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 21: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:52.115378 17649 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:52.161851 10900 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:52.162328 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:52.084564 17773 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:52.167310 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:52.158313 17726 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:22:52.170188 11081 raft_consensus.cc:2410] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 12:22:52.164831 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:52.164407 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
W20260709 12:22:52.124866 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 141306us
I20260709 12:22:52.214715 11656 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 16: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:52.200129 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:52.215314 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.222373 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:52.223331 11077 raft_consensus.cc:2393] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 22: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:52.173029 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:52.205842 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:52.176129 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:52.210670 11625 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:52.162771 17812 log.cc:927] Time spent T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:22:52.157373 17552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.008s	sys 0.010s
I20260709 12:22:52.220990 11004 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:52.226397 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:52.226547 10974 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:52.227003 11079 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 21
W20260709 12:22:52.200752 17241 consensus_meta.cc:287] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.000s
I20260709 12:22:52.191272 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:52.224552 11084 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:22:52.224588 11009 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:52.179710 17706 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:52.166903 17723 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:52.230949 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:52.236393 11625 leader_election.cc:400] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 16. Current term is 17.
I20260709 12:22:52.238040 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:52.248291 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:52.245023 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:52.249256 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:52.259017 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 126099us
I20260709 12:22:52.209362 17808 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:22:52.225699 17525 consensus_meta.cc:287] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.569s	user 0.006s	sys 0.003s
I20260709 12:22:52.163012 17408 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.178920 17257 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:52.212623 17773 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.177670 17762 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.227198 17801 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:52.268383 11084 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20. Ops: []
I20260709 12:22:52.269215 17829 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.108s
I20260709 12:22:52.237562 17241 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.323978 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.321058 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.322046 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:52.364095 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:52.376715 10936 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:22:52.377291 11002 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23.
I20260709 12:22:52.377904 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.378227 11079 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:22:52.285889 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.380957 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:52.384394 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 158010us
I20260709 12:22:52.386149 10977 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:52.390915 11080 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22. Ops: []
I20260709 12:22:52.392010 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:52.392791 10936 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:22:52.311439 17665 consensus_meta.cc:287] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.002s
I20260709 12:22:52.279119 17451 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:52.321816 17817 log.cc:927] Time spent T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
W20260709 12:22:52.364356 17795 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.765s	user 0.003s	sys 0.009s
I20260709 12:22:52.275544 17808 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:52.398047 11003 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:52.281731 17773 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:52.277518 17827 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:52.286114 17611 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:52.400722 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.401408 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.311182 17763 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:52.374842 17721 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:52.395694 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:52.461865 11002 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:22:52.404829 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:52.463146 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:52.409317 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.411053 17722 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.387977 17801 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.416967 17682 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.419332 17241 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:52.423647 10936 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 24.
I20260709 12:22:52.425308 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:52.425721 17725 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:52.426975 17408 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:52.428879 17798 consensus_meta.cc:287] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.789s	user 0.010s	sys 0.002s
I20260709 12:22:52.431010 17756 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:52.488945 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.489704 10932 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
W20260709 12:22:52.432960 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:52.491549 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.492827 11051 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:52.434465 17808 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:52.434890 11009 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:22:52.498629 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:52.503654 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:52.505067 10927 raft_consensus.cc:2410] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:22:52.435564 17773 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:52.402241 17451 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.359436 17775 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:52.409190 17827 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.445176 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:52.512312 11085 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:52.446583 17248 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.402912 17520 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:52.403190 17665 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:52.454284 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 194353us
I20260709 12:22:52.518608 11051 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:52.482740 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.466099 17762 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:52.481482 17740 consensus_meta.cc:287] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.828s	user 0.006s	sys 0.005s
I20260709 12:22:52.506176 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:52.542131 11007 raft_consensus.cc:2393] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 15: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:52.485927 17725 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.515341 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.475123 17722 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.479705 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:52.521790 11002 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 24.
I20260709 12:22:52.538969 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:52.545759 11078 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:52.539981 10936 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:22:52.508141 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.546574 10932 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:52.547995 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:52.544688 10931 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:52.511899 17721 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:52.504659 17756 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.548992 10929 raft_consensus.cc:1240] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:52.548743 11077 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:52.550527 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:52.516892 17520 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:52.513629 17827 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:52.556136 11078 raft_consensus.cc:2393] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 22: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:52.555927 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.562916 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.551904 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:52.565192 10936 raft_consensus.cc:2410] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 21 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 8.
I20260709 12:22:52.561733 11085 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:52.568022 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:52.568861 17665 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:52.569196 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:52.550407 17408 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:52.569950 11002 raft_consensus.cc:2393] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 18: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:52.570341 17416 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.570853 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:52.571287 17725 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:52.548494 17830 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:22:52.563938 17520 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:52.572875 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.569896 17408 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.575387 11002 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:22:52.573628 10932 raft_consensus.cc:2393] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 17: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:52.575814 17408 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:52.576634 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:52.573160 17773 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:52.577811 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.578998 17248 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:52.579676 10932 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 18: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:52.548065 17740 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.581223 17801 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:52.581485 17740 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:52.582738 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.583387 10932 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:22:52.584365 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.584977 10932 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:52.585834 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.586408 10932 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:52.594344 17416 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:52.595178 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.596015 10932 raft_consensus.cc:2393] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 24: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:52.596210 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:52.596904 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.597483 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.598119 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.598563 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.598924 10932 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 22: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:52.599360 17682 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:52.599749 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.600076 17649 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:52.600795 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:52.601084 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:52.601639 11085 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:52.602203 17649 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:52.602938 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 727) took 1038 ms. Trace:
I20260709 12:22:52.603247 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.603974 10931 raft_consensus.cc:2393] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 19: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:52.604720 10936 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 21. Current term is 22. Ops: []
I20260709 12:22:52.605973 10936 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:22:52.587244 17611 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:52.589359 17722 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:52.516434 17698 consensus_queue.cc:1059] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:22:52.590176 17723 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:52.591269 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:52.592164 17775 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:52.520153 17837 consensus_queue.cc:1059] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:22:52.566287 17762 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.577889 17808 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:52.591292 17756 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:52.600811 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:52.602195 11004 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:22:52.602861 11650 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:52.603274 11076 rpcz_store.cc:276] 0709 12:22:51.564705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.564823 (+   118us) service_pool.cc:224] Handling call
0709 12:22:51.594394 (+ 29571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.868918 (+274524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.602735 (+733817us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b540011cbd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:52.602888 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":629913344}
I20260709 12:22:52.624702 11077 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:52.594455 11006 raft_consensus.cc:1240] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:52.608487 11083 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:52.625501 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:52.625703 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:52.626981 11076 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:52.627357 11081 raft_consensus.cc:2393] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 17: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:52.563961 11051 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:52.628058 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:52.628336 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 64475.1us
I20260709 12:22:52.609767 10930 raft_consensus.cc:2393] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 19: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:22:52.612649 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.610296 17708 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:22:52.622885 17840 log.cc:927] Time spent T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:22:52.614114 11078 raft_consensus.cc:2393] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 17: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:52.617414 10936 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:22:52.622068 11655 raft_consensus.cc:1240] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:52.624404 10932 raft_consensus.cc:2410] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 12:22:52.616048 17698 consensus_queue.cc:1243] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:22:52.613317 11085 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:52.625599 17837 consensus_queue.cc:1243] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:22:52.636080 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:52.659396 11077 raft_consensus.cc:2368] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 17. Current term is 18.
I20260709 12:22:52.660301 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:52.637821 11006 raft_consensus.cc:1240] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:22:52.625857 17520 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:52.641079 10930 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 21. Current term is 22. Ops: []
I20260709 12:22:52.642540 17689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59384 (request call id 824) took 4152 ms. Trace:
I20260709 12:22:52.625247 17762 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.630271 17721 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:52.655969 10927 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:22:52.663894 11083 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:52.666675 11006 raft_consensus.cc:1240] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 21. Current term is 22. Ops: []
I20260709 12:22:52.668985 11009 raft_consensus.cc:1240] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20. Ops: []
I20260709 12:22:52.670405 11077 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 17. Current term is 18. Ops: [17.16-17.16]
I20260709 12:22:52.673164 10936 raft_consensus.cc:1240] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:52.674307 11622 leader_election.cc:400] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 17. Current term is 18.
I20260709 12:22:52.675549 11077 raft_consensus.cc:1240] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 21. Current term is 22. Ops: []
I20260709 12:22:52.668279 11650 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:52.684058 17630 raft_consensus.cc:3055] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:52.684531 17630 raft_consensus.cc:740] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:52.685395 17630 consensus_queue.cc:260] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.684474 11009 raft_consensus.cc:1240] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:52.693364 17520 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:52.697875 17841 consensus_queue.cc:1059] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:22:52.698840 17841 raft_consensus.cc:3055] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:52.699169 17841 raft_consensus.cc:740] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:52.700671 17841 consensus_queue.cc:260] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:52.671173 17611 consensus_queue.cc:1059] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:22:52.656154 17708 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.702205 17821 raft_consensus.cc:3055] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:52.702678 17821 raft_consensus.cc:740] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:52.703573 17821 consensus_queue.cc:260] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:52.704062 17708 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:52.704823 17821 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:52.706415 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.706746 17841 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:52.654220 17722 consensus_queue.cc:1059] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 12:22:52.708971 17722 raft_consensus.cc:3055] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:52.709357 17722 raft_consensus.cc:740] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:52.710137 17722 consensus_queue.cc:260] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.711279 17722 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:52.714424 17827 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.715811 11010 raft_consensus.cc:2368] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21.
I20260709 12:22:52.686656 17630 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:52.721310 11004 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:22:52.723187 17723 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:52.670727 17689 rpcz_store.cc:276] 0709 12:22:48.489894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.490018 (+   124us) service_pool.cc:224] Handling call
0709 12:22:48.744456 (+254438us) ts_tablet_manager.cc:934] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109)
0709 12:22:52.025995 (+3281539us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:22:52.451714 (+425719us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:52.451834 (+   120us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:22:52.641735 (+189901us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:22:52.642041 (+   306us) tablet_replica.cc:206] Creating consensus instance
0709 12:22:52.642375 (+   334us) ts_tablet_manager.cc:989] Replica registered.
0709 12:22:52.642439 (+    64us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":334,"tablet-copy.queue_time_us":73978,"thread_start_us":57887,"threads_started":2}
I20260709 12:22:52.725975 17689 tablet_copy_client.cc:806] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:52.726539 17689 tablet_copy_client.cc:670] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:52.727398 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:52.729123 10932 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 12:22:52.734217 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:52.735174 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.671350 17837 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:52.728454 17833 consensus_queue.cc:1059] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 12:22:52.745563 17834 raft_consensus.cc:3055] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:22:52.683065 17649 consensus_queue.cc:1059] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 12:22:52.745714 17837 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:52.746029 17834 raft_consensus.cc:740] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:52.747738 17834 consensus_queue.cc:260] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:52.749028 17520 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.748366 17837 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:52.752488 10931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3377) took 1040 ms. Trace:
I20260709 12:22:52.764070 11076 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:52.767442 11076 raft_consensus.cc:3055] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:22:52.749027 17834 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:52.762068 10931 rpcz_store.cc:276] 0709 12:22:51.712140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.605273 (+893133us) service_pool.cc:224] Handling call
0709 12:22:52.605545 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:52.605771 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:52.605793 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:52.606231 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 12:22:52.728447 (+122216us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:52.728485 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.728571 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:52.752220 (+ 23649us) raft_consensus.cc:1685] finished
0709 12:22:52.752244 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:52.752416 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":121887,"threads_started":1,"wal-append.queue_time_us":136074}
I20260709 12:22:52.772261 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:52.773239 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:52.746606 17649 raft_consensus.cc:3055] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:52.773928 11076 raft_consensus.cc:740] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:52.777320 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:52.778170 11657 raft_consensus.cc:2393] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 15: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:52.778128 11076 consensus_queue.cc:260] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:52.784518 11076 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:52.777349 17649 raft_consensus.cc:740] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:52.755120 17520 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:52.784439 17731 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.136s	user 0.015s	sys 0.017s
W20260709 12:22:52.796555 17731 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.148s	user 0.015s	sys 0.017s
I20260709 12:22:52.797291 11652 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 23. Current term is 24. Ops: [23.19-23.19]
I20260709 12:22:52.792694 11076 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 12:22:52.783414 17632 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:22:52.798444 11076 pending_rounds.cc:85] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 13
I20260709 12:22:52.799345 11076 pending_rounds.cc:107] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 12:22:52.800504 11076 raft_consensus.cc:2889] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:52.813526 17520 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:52.842867 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2961) took 1156 ms. Trace:
I20260709 12:22:52.844004 11005 raft_consensus.cc:1240] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:22:52.843371 10935 rpcz_store.cc:276] 0709 12:22:51.686143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.686389 (+   246us) service_pool.cc:224] Handling call
0709 12:22:51.686849 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:52.038908 (+352059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.842562 (+803654us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b540005ffd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:52.842792 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679054592}
I20260709 12:22:52.845855 10933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 3369) took 1141 ms. Trace:
I20260709 12:22:52.846395 10933 rpcz_store.cc:276] 0709 12:22:51.704782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.761485 (+ 56703us) service_pool.cc:224] Handling call
0709 12:22:52.845507 (+1084022us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b540024d454. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:52.845642 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":584705280}
I20260709 12:22:52.852134 17827 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:52.852653 10930 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:22:52.852875 17649 consensus_queue.cc:260] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:52.856485 17649 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:52.859520 17451 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:52.862201 17508 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:52.871201 11010 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 12:22:52.855693 17814 log.cc:927] Time spent T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.578s	user 0.004s	sys 0.005s
I20260709 12:22:52.874387 17796 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.874962 17796 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.875108 17834 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:52.877251 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 2954) took 1280 ms. Trace:
W20260709 12:22:52.878491 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.879359 10901 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:52.880779 17831 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:52.881312 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 719480us
W20260709 12:22:52.882383 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.882915 10929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53346 (request call id 601) took 1182 ms. Trace:
I20260709 12:22:52.883263 10929 rpcz_store.cc:276] 0709 12:22:51.700106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.700229 (+   123us) service_pool.cc:224] Handling call
0709 12:22:51.700537 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:52.556601 (+856064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.882700 (+326099us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b5400204ed4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:52.882862 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1950824832}
I20260709 12:22:52.884061 17627 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:52.884577 17627 raft_consensus.cc:697] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:52.885902 11652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59414 (request call id 491) took 1210 ms. Trace:
I20260709 12:22:52.886683 10900 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:52.885486 17627 consensus_queue.cc:237] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:52.886266 11652 rpcz_store.cc:276] 0709 12:22:51.675968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.676161 (+   193us) service_pool.cc:224] Handling call
0709 12:22:51.676493 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:52.797663 (+1121170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.885616 (+ 87953us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54004df8d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:52.885817 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2577004416}
I20260709 12:22:52.899003 11002 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:22:52.878077 17796 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:52.877653 10928 rpcz_store.cc:276] 0709 12:22:51.597032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.597155 (+   123us) service_pool.cc:224] Handling call
0709 12:22:51.597412 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.597650 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:22:52.021254 (+423604us) log.cc:844] Serialized 14 byte log entry
0709 12:22:52.114237 (+ 92983us) log.cc:844] Serialized 14 byte log entry
0709 12:22:52.876772 (+762535us) spinlock_profiling.cc:243] Waited 5.07 ms on lock 0x7b18003f7a20. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9baddedc0a 00007f9bb752d219 00007f9bade75a40 00007f9bade704e4 00007f9bade70455 00007f9bb0f58060 00007f9bb0f6a716 00007f9bb0f7b287 00007f9bb0f7b208
0709 12:22:52.876925 (+   153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:52.876970 (+    45us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:52.877019 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.877083 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:52.877186 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":737498,"prepare.queue_time_us":149730,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":75,"raft.queue_time_us":762713,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":1964,"spinlock_wait_cycles":11663104,"thread_start_us":482439,"threads_started":2,"wal-append.queue_time_us":295633}
I20260709 12:22:52.909693 11010 raft_consensus.cc:1240] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:52.911396 17809 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 12:22:52.917583 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:52.918370 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:52.919072 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:52.920096 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:52.925427 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:52.931612 11077 raft_consensus.cc:2393] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 24: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:22:52.932204 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:52.939200 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.940797 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:52.941221 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:52.942930 11077 raft_consensus.cc:1275] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:22:52.943403 11077 pending_rounds.cc:85] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 8
I20260709 12:22:52.943720 11077 pending_rounds.cc:107] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:22:52.944063 11077 raft_consensus.cc:2889] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:52.881314 17831 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:52.923257 10901 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:52.918279 17632 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.958098 10901 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:52.958613 11082 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:52.926191 17660 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.933992 17771 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:52.961229 10901 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:52.909018 17630 consensus_queue.cc:1059] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 12:22:52.964846 17660 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.965505 17771 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.979727 17771 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:52.981051 17660 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:52.957868 17781 consensus_queue.cc:1059] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:22:52.984618 17781 raft_consensus.cc:3055] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:22:52.984970 17781 raft_consensus.cc:740] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:52.956382 17508 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.962976 17632 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.986035 17508 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.988165 17508 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:52.961714 17796 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.989004 17796 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:52.990654 17831 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:52.991775 11655 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:22:52.968753 17665 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:22:52.992337 17665 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.992713 17665 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:22:52.993038 17630 raft_consensus.cc:3055] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:52.993412 17630 raft_consensus.cc:740] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:52.994189 17630 consensus_queue.cc:260] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:52.995369 17630 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:52.970443 10901 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:52.998220 17762 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:52.998886 17451 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:52.999306 17451 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.999716 10901 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:52.985785 17781 consensus_queue.cc:260] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.000555 17660 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:52.971429 17839 consensus_queue.cc:1059] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:22:53.000983 17660 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.001438 17660 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:52.959199 17683 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:53.008158 17683 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:53.008587 17683 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:52.957763 17634 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:52.973568 11085 pending_rounds.cc:85] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 18
I20260709 12:22:53.010609 11085 pending_rounds.cc:107] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 23.19
I20260709 12:22:53.010895 11085 raft_consensus.cc:2889] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:52.963792 17670 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:53.020409 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:53.021159 17660 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.025534 17660 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:53.025882 17346 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:53.030930 17796 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:53.031885 17632 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:52.999675 17451 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:53.032063 17649 consensus_queue.cc:1059] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:22:53.033321 17831 raft_consensus.cc:3055] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:53.033552 17704 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:53.034991 17831 raft_consensus.cc:740] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:53.034659 17809 raft_consensus.cc:3055] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:53.036042 17809 raft_consensus.cc:740] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:53.016321 10974 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:53.017058 17837 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:53.017475 10977 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:53.018250 17634 raft_consensus.cc:697] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:53.018569 17722 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:53.015931 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.049924 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:53.051299 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:53.052125 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:53.053532 10977 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:53.055446 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:53.057040 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:53.041189 10974 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:53.000698 10901 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:53.056380 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:53.007237 11654 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:53.030834 17781 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:53.062467 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:53.062974 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.063318 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:53.066835 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:53.066738 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 66115.4us
I20260709 12:22:53.068670 11084 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:53.070859 11077 raft_consensus.cc:2393] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 20: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:53.063233 17827 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:53.075872 10901 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:53.076844 17772 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:53.077378 17772 raft_consensus.cc:697] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:53.078222 17772 consensus_queue.cc:237] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.064116 17726 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:53.080240 17726 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.080633 17726 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:53.081030 17845 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:53.081564 17845 raft_consensus.cc:697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:53.081791 10974 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:22:53.084774 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:53.085423 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.080506 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:53.080273 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:53.082942 10901 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:53.094357 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.094817 10977 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:53.097091 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.096874 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:53.096812 10899 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:53.098438 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:53.099126 11082 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:22:53.100131 11076 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:22:53.101078 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:53.104287 11050 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:53.082959 10974 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:53.106925 10899 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:53.106274 10901 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:53.060979 17740 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:22:53.117587 10899 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:53.118402 17780 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:53.118767 17780 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:53.119093 17780 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:53.123452 10977 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:53.124063 17416 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:53.124648 10977 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:53.125411 10974 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:53.061139 17762 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:53.126507 17520 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:53.064503 17508 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:53.112980 17797 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:53.127389 17520 raft_consensus.cc:697] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:53.128316 10977 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:53.128059 17809 consensus_queue.cc:260] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:53.128242 17520 consensus_queue.cc:237] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.093246 17632 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.127024 17762 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.080233 17832 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.108767 17660 raft_consensus.cc:2764] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 12:22:53.105934 17248 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:53.060525 17837 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.113276 17824 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:53.113566 17769 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:53.105618 17408 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:53.168860 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:53.114279 17644 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:22:53.093604 17682 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:53.084156 17670 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:22:53.115895 17552 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:53.064353 17722 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.124781 17416 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:53.082438 17845 consensus_queue.cc:237] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:53.126444 17827 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:22:53.129585 11084 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:53.130304 11079 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 12:22:53.203706 11079 pending_rounds.cc:85] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 11
I20260709 12:22:53.203995 11079 pending_rounds.cc:107] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 12:22:53.204237 11079 raft_consensus.cc:2889] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:53.132261 10977 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:53.143196 11083 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:22:53.137600 10899 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:22:53.205525 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 73350.9us
W20260709 12:22:53.205933 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 68424.2us
I20260709 12:22:53.130041 17525 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 12:22:53.164309 11051 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:53.139992 11050 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:53.208547 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 68620.4us
I20260709 12:22:53.173554 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:53.208747 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 44528.2us
I20260709 12:22:53.175215 11002 raft_consensus.cc:1240] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:53.174333 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:53.209853 11006 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:53.186825 11082 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:22:53.130477 17740 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:22:53.148422 17704 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.133832 17762 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:53.196274 11009 raft_consensus.cc:1240] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:53.210757 11050 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:53.201884 11003 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:22:53.126585 10974 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:53.129411 17809 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:53.177959 17824 raft_consensus.cc:697] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:53.224238 10977 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:53.187553 17682 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.214488 11051 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:53.207507 10899 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:53.227423 11050 leader_election.cc:400] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21.
I20260709 12:22:53.227774 11050 leader_election.cc:403] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:53.132419 17632 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.228345 10899 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:53.230289 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 103797us
I20260709 12:22:53.136354 17832 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:53.178083 17660 consensus_queue.cc:1059] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:22:53.191414 17644 raft_consensus.cc:697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:53.135430 17780 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.195554 17416 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:53.178861 17627 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:22:53.225070 17796 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:22:53.137151 17634 consensus_queue.cc:237] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:53.229059 17723 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:53.289116 11076 raft_consensus.cc:2410] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 12:22:53.222832 17346 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:53.212327 17797 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:53.263044 17829 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:53.264542 17408 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:22:53.289358 17416 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:53.111748 17831 consensus_queue.cc:260] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:53.291739 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 57395.5us
I20260709 12:22:53.325544 10974 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:53.326968 10974 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:53.232270 17724 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.235486 17822 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
W20260709 12:22:53.285609 17817 log.cc:927] Time spent T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:22:53.338282 17804 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:22:53.291921 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 56415.5us
I20260709 12:22:53.229924 17704 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.340943 17632 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:53.341272 17704 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:53.342087 17724 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.320169 17631 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:22:53.313613 17756 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:53.351953 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.288239 17683 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.365329 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.367131 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.316221 17827 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:22:53.372490 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.373193 10934 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:53.368906 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:53.333946 17248 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:53.370911 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.374647 10935 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:22:53.334847 17723 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21.
I20260709 12:22:53.343931 17740 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:22:53.369901 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:53.354167 17525 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:22:53.391786 10929 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:22:53.393182 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:53.402493 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 175208us
W20260709 12:22:53.403985 11623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.389544 17631 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:53.405118 17631 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.405704 17771 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.407171 17631 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:53.408638 17863 log.cc:927] Time spent T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:22:53.409214 17451 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.411408 17451 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:53.411201 17665 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.364817 17756 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.413313 17665 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:53.413691 17756 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:53.352669 17824 consensus_queue.cc:237] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.414202 17756 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.367468 17408 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:53.414671 17756 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.414963 17408 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.387212 17740 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.420360 17740 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:22:53.407691 17771 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:53.420943 17832 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:53.421838 17756 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:53.423832 10930 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 18: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:22:53.427511 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 213073us
I20260709 12:22:53.436623 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:53.437616 10935 raft_consensus.cc:2410] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:22:53.439320 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.439971 10935 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:53.442042 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:53.445091 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:53.448098 17864 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 12:22:53.449512 17861 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.161s	user 0.001s	sys 0.001s
I20260709 12:22:53.451071 11011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3835) took 1412 ms. Trace:
I20260709 12:22:53.451443 11011 rpcz_store.cc:276] 0709 12:22:52.038699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.043724 (+  5025us) service_pool.cc:224] Handling call
0709 12:22:52.044160 (+   436us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:52.835244 (+791084us) spinlock_profiling.cc:243] Waited 6.53 ms on lock 0x7b1800269d40. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bb0b084bc 00007f9bade5648b 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade70455 00007f9bb0f58060 00007f9bb0f58bfb 00007f9bb0f6364b
0709 12:22:52.835381 (+   137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:52.835405 (+    24us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:52.836008 (+   603us) log.cc:844] Serialized 52 byte log entry
0709 12:22:53.093100 (+257092us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:53.093142 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.093216 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:53.450757 (+357541us) raft_consensus.cc:1685] finished
0709 12:22:53.450781 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.451011 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11411,"raft.queue_time_us":42017,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":12812,"spinlock_wait_cycles":15015808,"thread_start_us":311469,"threads_started":2,"wal-append.queue_time_us":366813}
I20260709 12:22:53.460662 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.465963 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:53.467211 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 138778us
I20260709 12:22:53.463483 11051 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:53.468361 10974 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:53.469504 11051 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:53.475869 10934 raft_consensus.cc:2368] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21.
I20260709 12:22:53.360488 17644 consensus_queue.cc:237] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:53.478274 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.480204 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.483003 10974 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:53.551277 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 74621us
W20260709 12:22:53.553289 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 70365.7us
I20260709 12:22:53.554066 10974 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:53.482183 10928 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:22:53.524864 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:53.560416 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 84052.9us
W20260709 12:22:53.560600 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.561546 11658 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:22:53.462373 17670 raft_consensus.cc:697] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:53.480046 17723 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:22:53.463284 17724 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:53.568739 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 340452us
I20260709 12:22:53.466809 17837 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:53.550464 17756 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:53.582671 17877 consensus_queue.cc:1059] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:22:53.583643 17859 log.cc:927] Time spent T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 12:22:53.480126 17630 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:53.589771 10935 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 12:22:53.596176 10935 pending_rounds.cc:85] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 12
I20260709 12:22:53.596592 10935 pending_rounds.cc:107] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 12:22:53.598335 10935 raft_consensus.cc:2889] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:53.584712 17722 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:53.610338 11006 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:22:53.591598 17831 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:53.566040 17797 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:22:53.607884 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.610316 10899 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:53.590971 17780 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:53.612653 10928 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:53.596446 17756 raft_consensus.cc:697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:53.628158 17508 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:53.615168 17829 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:53.630717 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.631702 10935 raft_consensus.cc:2410] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:22:53.601639 17408 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:53.597687 17630 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:53.635808 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:53.636489 10928 raft_consensus.cc:2376] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 24. Re-sending same reply.
I20260709 12:22:53.596817 17724 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:22:53.613915 17762 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:53.601327 17872 consensus_queue.cc:1059] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
W20260709 12:22:53.654961 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.638558 17829 raft_consensus.cc:697] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:53.639400 17630 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:53.637569 17883 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:22:53.666039 17756 consensus_queue.cc:237] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:53.674324 17726 consensus_meta.cc:287] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.593s	user 0.003s	sys 0.006s
I20260709 12:22:53.674825 17726 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.655992 17683 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:53.676403 17683 raft_consensus.cc:3055] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:22:53.676780 17683 raft_consensus.cc:740] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:53.677618 17683 consensus_queue.cc:260] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.679095 17683 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:53.680207 17682 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:53.686412 10833 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35620 (request call id 248) took 30746 ms (client timeout 15000 ms). Trace:
I20260709 12:22:53.688941 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:53.657940 17525 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:22:53.695072 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.698561 17416 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:53.699396 17871 log.cc:927] Time spent T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:22:53.699946 17627 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:53.700943 17416 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:53.633266 17670 consensus_queue.cc:237] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:53.708864 17862 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.334s	user 0.000s	sys 0.004s
I20260709 12:22:53.693348 17883 raft_consensus.cc:697] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:53.711203 17883 consensus_queue.cc:237] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.696585 17552 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:53.717803 11651 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:22:53.719151 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:53.719786 10928 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:53.723933 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:53.724118 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:53.724592 10934 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:53.725888 10935 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:22:53.727214 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.732095 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.732704 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:53.732864 10930 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:22:53.734015 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:53.686883 10833 rpcz_store.cc:269] 0709 12:22:22.940314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.973594 (+ 33280us) service_pool.cc:224] Handling call
0709 12:22:23.588241 (+614647us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b5400096d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0eca090 00007f9bb0f68f3a 00007f9bb6d1ee9c 00007f9bb6e1d04e 00007f9bb52de2a4 00007f9bb52de232 00007f9bb52de161 00007f9bb52de0dc 00007f9bb52dd392 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:53.686326 (+30098085us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:47.556618 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:47.704045 (+147427us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:47.704112 (+    67us) write_op.cc:435] Acquired schema lock
0709 12:22:47.704131 (+    19us) tablet.cc:662] Decoding operations
0709 12:22:47.705300 (+  1169us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:47.705393 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:47.705420 (+    27us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:22:47.706616 (+  1196us) tablet.cc:701] Row locks acquired
0709 12:22:47.706660 (+    44us) write_op.cc:260] PREPARE: finished
0709 12:22:47.706837 (+   177us) write_op.cc:270] Start()
0709 12:22:47.706983 (+   146us) write_op.cc:276] Timestamp: P: 1783599767706766 usec, L: 0
0709 12:22:47.707012 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:22:47.707786 (+   774us) log.cc:844] Serialized 5159 byte log entry
0709 12:22:48.208143 (+500357us) op_driver.cc:464] REPLICATION: finished
0709 12:22:48.388310 (+180167us) write_op.cc:301] APPLY: starting
0709 12:22:48.405605 (+ 17295us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:48.669615 (+264010us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:48.710029 (+ 40414us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:48.856752 (+146723us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:48.857636 (+   884us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 12:22:48.858008 (+   372us) write_op.cc:312] APPLY: finished
0709 12:22:48.864653 (+  6645us) log.cc:844] Serialized 121 byte log entry
0709 12:22:48.874971 (+ 10318us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:48.875354 (+   383us) write_op.cc:454] Released schema lock
0709 12:22:48.875502 (+   148us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:48.929316 (+ 53814us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:48.929352 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":118825,"reported_tablets":54,"spinlock_wait_cycles":39194880,"child_traces":[["op",{"apply.queue_time_us":126918,"apply.run_cpu_time_us":24680,"apply.run_wall_time_us":578982,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58389,"num_ops":13,"prepare.queue_time_us":92536,"prepare.run_cpu_time_us":14937,"prepare.run_wall_time_us":302607,"raft.queue_time_us":153621,"raft.run_cpu_time_us":14977,"raft.run_wall_time_us":137900,"replication_time_us":451936,"thread_start_us":190691,"threads_started":4,"wal-append.queue_time_us":106205,"wal-append.run_cpu_time_us":34720,"wal-append.run_wall_time_us":1987927}]]}
I20260709 12:22:53.746610 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:53.716838 17796 raft_consensus.cc:697] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:53.747323 11004 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 16.
I20260709 12:22:53.751919 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.754587 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:53.756621 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:53.762799 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 208806us
I20260709 12:22:53.764814 11004 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:22:53.772037 11006 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: [18.9-20.10]
I20260709 12:22:53.777635 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:53.781526 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:53.698436 17829 consensus_queue.cc:237] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.726830 17874 consensus_queue.cc:1059] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:22:53.788038 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:53.788864 11006 raft_consensus.cc:2393] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 17: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:53.788936 17874 raft_consensus.cc:3055] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:53.789388 17874 raft_consensus.cc:740] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:53.790284 17874 consensus_queue.cc:260] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.791458 17874 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:53.775764 17827 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:53.791832 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 3511) took 1385 ms. Trace:
I20260709 12:22:53.814903 11079 rpcz_store.cc:276] 0709 12:22:52.406091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.629172 (+223081us) service_pool.cc:224] Handling call
0709 12:22:52.631614 (+  2442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.213177 (+581563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.791587 (+578410us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b54001a4ad4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:53.791775 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1146089216}
I20260709 12:22:53.794158 11006 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:53.817034 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:53.818167 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:53.806239 11011 raft_consensus.cc:1217] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 12.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 12:22:53.819670 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:53.819789 11011 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:22:53.820359 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.820868 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:53.821933 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:53.822468 11011 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:22:53.823005 11004 raft_consensus.cc:2393] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 20: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:53.823258 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:53.823835 11011 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:53.812186 11051 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:53.786139 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.784701 17451 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.787382 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:53.787556 17796 consensus_queue.cc:237] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.813232 11005 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 23. Current term is 24. Ops: []
I20260709 12:22:53.818753 11006 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:22:53.813747 11002 raft_consensus.cc:1240] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:53.812554 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:53.827433 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.803799 10928 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:53.825783 11051 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:53.796264 17879 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:22:53.841621 10933 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 12:22:53.832310 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.792773 17827 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:53.814100 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:53.833227 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.843715 10932 raft_consensus.cc:2376] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16. Re-sending same reply.
I20260709 12:22:53.836756 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:53.844103 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:53.827440 17451 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:22:53.845206 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:53.835763 11010 raft_consensus.cc:2393] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 22: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:53.835036 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:53.829548 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:53.837517 11051 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:53.838480 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:53.848029 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:53.836766 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:53.849743 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.794584 17704 raft_consensus.cc:3055] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:22:53.851181 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.857292 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.863574 11002 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:22:53.865180 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:53.866338 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:53.867518 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:53.868494 11002 raft_consensus.cc:2410] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:22:53.869745 11011 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:22:53.811216 17346 raft_consensus.cc:3055] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:53.872334 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.873131 11051 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:53.874192 11051 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:53.875550 11009 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 12:22:53.875406 11051 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:53.878857 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.879616 10935 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:22:53.845530 17797 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:53.880488 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.878978 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.871248 11011 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:22:53.886252 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:53.905150 11076 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:22:53.905187 10928 raft_consensus.cc:2393] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 23: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:53.905921 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:53.888232 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:53.906682 11082 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 23.
I20260709 12:22:53.807475 17630 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.813455 17780 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 12:22:53.891330 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:53.891428 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:53.911968 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.912968 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:53.893503 17827 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:53.814342 17552 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 12:22:53.899047 11078 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:22:53.900173 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.924696 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:53.900558 17451 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:53.900899 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:53.906247 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:53.967482 11076 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:22:53.907519 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:53.910169 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:53.880424 17346 raft_consensus.cc:740] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:53.913501 10901 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:53.901302 17876 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:22:53.915704 11051 leader_election.cc:400] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21.
I20260709 12:22:53.973345 11625 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:53.977530 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 61923.2us
I20260709 12:22:53.978363 11051 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:53.833806 17878 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:53.920110 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.908108 17837 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:53.921813 10931 raft_consensus.cc:2393] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 19: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:53.925882 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:53.981297 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:53.929044 17630 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:53.929808 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:53.919178 17723 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:53.935045 11004 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:22:53.936484 10974 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:53.938176 11006 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 12:22:53.986763 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 50393.6us
I20260709 12:22:53.987416 10974 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:53.948455 17881 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:22:53.987655 11625 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:53.952553 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:53.954783 17884 log.cc:927] Time spent T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 12:22:53.964550 17740 consensus_meta.cc:287] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.000s
I20260709 12:22:53.857343 17704 raft_consensus.cc:740] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:53.840821 17248 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.908281 17722 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:54.014659 17824 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:22:54.031944 17824 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:54.032068 17762 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:54.014994 17831 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:54.033406 17831 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:54.022274 17630 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:22:53.925444 10928 raft_consensus.cc:2393] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 21: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:54.013602 17882 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:54.014262 17451 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.903015 17797 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:53.980641 10933 raft_consensus.cc:2393] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 19: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:54.035526 17451 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:53.873387 17724 consensus_queue.cc:1059] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 12:22:54.036892 17724 raft_consensus.cc:3055] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:22:54.037256 17724 raft_consensus.cc:740] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:53.924386 17877 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:54.039084 17346 consensus_queue.cc:260] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:54.040539 17346 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:53.987284 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 73867.5us
I20260709 12:22:54.042603 17683 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:22:54.023211 10977 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:53.980057 17878 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:54.032425 17824 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:54.044459 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:54.025339 17704 consensus_queue.cc:260] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:53.983332 17837 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:54.049537 10934 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:54.052968 10977 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:54.059020 10977 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:54.060480 17704 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:54.050325 17683 consensus_queue.cc:1059] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 12:22:54.035669 17797 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:54.064638 10901 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:54.069159 10977 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:54.070611 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 322158us
I20260709 12:22:54.034358 17630 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.982560 17827 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 12:22:54.073889 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:54.075788 10977 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:54.050670 17416 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:54.063301 17689 tablet_copy_client.cc:538] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:54.013850 17723 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:54.021559 17740 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:54.093955 11624 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:54.054235 17878 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:54.031121 17248 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:54.073562 17508 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:22:54.099539 10901 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:54.073992 17630 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:54.066937 17837 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:54.097937 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:54.075362 17823 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:54.105268 10927 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:22:54.127532 10977 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:54.066231 17631 consensus_queue.cc:1059] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:22:54.106978 17682 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:22:54.144744 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 45257.8us
I20260709 12:22:54.166594 10901 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:54.146400 17416 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:54.146874 17670 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:22:54.154234 10977 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:54.156500 17832 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:22:54.160238 17866 log.cc:927] Time spent T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:22:54.108959 17880 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:22:54.179250 10974 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:54.151561 17726 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:54.202505 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:54.218626 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 51871.5us
I20260709 12:22:54.221082 17248 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:54.225606 17797 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:54.238533 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:54.076189 17724 consensus_queue.cc:260] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:54.185978 17832 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:54.274319 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 95176us
W20260709 12:22:54.280011 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 113477us
I20260709 12:22:54.288268 10974 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:54.289830 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 374662us
I20260709 12:22:54.291599 11050 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:54.304097 11050 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:54.311190 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 49744.3us
I20260709 12:22:54.233029 17682 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:22:54.241887 17772 raft_consensus.cc:3055] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:54.242627 17781 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.271340 17798 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.289012 17883 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:54.325636 11050 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:54.328079 11079 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 19. Current term is 20. Ops: []
W20260709 12:22:54.333979 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.339377 11050 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:54.311259 17832 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:54.345259 17780 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.345794 17780 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:54.341882 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:54.313133 17704 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:54.326915 17772 raft_consensus.cc:740] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:54.286541 17876 consensus_queue.cc:1059] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:22:54.331202 17877 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:54.314814 17631 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:54.325106 17241 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:54.349265 11085 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:22:54.331908 17881 consensus_queue.cc:1059] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:22:54.325507 17886 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:22:54.344204 17889 log.cc:927] Time spent T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 12:22:54.343037 11083 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
W20260709 12:22:54.362941 11008 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.015s	sys 0.039s
W20260709 12:22:54.387904 11008 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.015s	sys 0.039s
I20260709 12:22:54.369323 17797 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:54.334704 17508 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:22:54.347800 17780 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:54.335163 17769 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 12:22:54.336956 17781 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:54.340687 17798 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:54.379652 17704 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:54.394766 10974 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:54.404241 17890 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:22:54.412357 17762 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:22:54.413074 17904 raft_consensus.cc:3055] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:54.413445 17904 raft_consensus.cc:740] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:54.414294 17904 consensus_queue.cc:260] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:54.416764 17740 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:54.415271 17824 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:54.412902 17762 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.412604 17772 consensus_queue.cc:260] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:54.422992 17762 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:54.423771 17772 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:54.424647 17723 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:54.426484 17886 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:54.426955 17886 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:22:54.392088 17508 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:54.428419 17508 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:54.430642 17878 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:54.431888 11084 raft_consensus.cc:1240] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:54.392261 17631 raft_consensus.cc:697] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:54.433296 17631 consensus_queue.cc:237] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:54.434365 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:54.435014 11077 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:54.390375 17722 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:22:54.445852 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 373549us
I20260709 12:22:54.434437 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:54.446676 11085 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:22:54.446899 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 468598us
I20260709 12:22:54.447743 11051 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:54.448314 11079 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:22:54.453110 11077 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:22:54.455137 10974 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:54.481694 17670 raft_consensus.cc:697] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:54.482884 17670 consensus_queue.cc:237] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:54.484047 17880 raft_consensus.cc:697] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:54.485077 17880 consensus_queue.cc:237] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:54.462885 11051 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:54.489962 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:54.491261 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 179306us
I20260709 12:22:54.438730 11082 raft_consensus.cc:2955] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
W20260709 12:22:54.422361 17874 consensus_meta.cc:287] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.631s	user 0.011s	sys 0.000s
I20260709 12:22:54.527088 17839 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.527767 17839 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:54.415486 17904 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:54.531272 10929 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
W20260709 12:22:54.462491 17902 log.cc:927] Time spent T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:22:54.422398 17824 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:54.451411 17722 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.503304 17888 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:22:54.545742 11652 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:22:54.544678 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 205329us
I20260709 12:22:54.550055 11077 raft_consensus.cc:1240] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:54.555003 11085 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 23.
I20260709 12:22:54.562215 11050 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:54.551402 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 217951us
I20260709 12:22:54.551682 11076 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22. Ops: []
I20260709 12:22:54.563102 10974 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:54.554297 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 400107us
I20260709 12:22:54.564752 10977 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:54.503739 17704 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:54.538023 17796 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:54.567119 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:54.570444 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:54.571718 11079 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:22:54.580981 11077 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:54.450960 17726 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.096s
I20260709 12:22:54.462999 17740 consensus_queue.cc:1059] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 12:22:54.539680 17552 raft_consensus.cc:3055] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:54.539839 17881 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.537403 17831 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.581116 11076 raft_consensus.cc:2393] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 21: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:54.598150 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:54.642163 11079 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 21: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:54.600239 10977 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:54.503018 17520 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 12:22:54.606196 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:54.597640 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:54.644248 11085 raft_consensus.cc:2368] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16.
W20260709 12:22:54.607426 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 157672us
I20260709 12:22:54.644408 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:54.648089 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 47902.9us
I20260709 12:22:54.649871 10977 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:54.650794 10977 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:54.607946 11077 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:22:54.557107 17722 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:54.531457 17877 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:22:54.654846 10977 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:54.555333 17908 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:54.545802 17797 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:22:54.673408 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 110075us
W20260709 12:22:54.640326 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 70070.5us
I20260709 12:22:54.539714 17837 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:54.652181 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:54.665439 11076 raft_consensus.cc:2393] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 20: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:54.570787 17756 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:22:54.689500 10977 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:54.739120 17887 log.cc:927] Time spent T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:22:54.739830 17451 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:54.740330 17921 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.740869 17921 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:54.692224 17248 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:22:54.742997 17921 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:54.602684 17888 raft_consensus.cc:697] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:54.575454 17796 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:54.692579 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:54.694329 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:54.688800 17878 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:54.643709 17683 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:22:54.726373 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.706256 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:54.765298 17907 log.cc:927] Time spent T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 12:22:54.768565 17683 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:54.689603 17908 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:54.784710 17908 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:54.785280 11077 raft_consensus.cc:1813] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Handling vote request from an unknown peer 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:54.785843 11077 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 14: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
W20260709 12:22:54.787218 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 97798.7us
I20260709 12:22:54.788367 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:22:54.789222 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 227087us
I20260709 12:22:54.788600 10977 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:54.695595 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:54.796171 11081 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: []
W20260709 12:22:54.754227 17905 log.cc:927] Time spent T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:22:54.817436 10977 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:54.826078 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:54.826987 11083 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 16.
I20260709 12:22:54.829109 11622 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:54.692618 17797 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:54.688580 17682 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:54.786191 17649 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.850888 17921 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:54.651989 17881 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:54.907442 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:54.653373 17897 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:54.656801 17914 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.640122 17872 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:54.653604 17740 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:54.667297 17829 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:54.673573 17416 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:54.744989 11652 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 12:22:54.602632 17552 raft_consensus.cc:740] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:22:54.947881 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.948477 17552 consensus_queue.cc:260] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:54.949577 17552 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:54.951066 17936 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.951650 17936 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:54.643486 17660 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.095s
I20260709 12:22:54.655320 17831 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:54.957551 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3423) took 1140 ms. Trace:
I20260709 12:22:54.958933 10929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43552 (request call id 3422) took 1142 ms. Trace:
I20260709 12:22:54.957949 10934 rpcz_store.cc:276] 0709 12:22:53.817096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.057913 (+240817us) service_pool.cc:224] Handling call
0709 12:22:54.058231 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:54.058428 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:22:54.097173 (+ 38745us) log.cc:844] Serialized 14 byte log entry
0709 12:22:54.359498 (+262325us) log.cc:844] Serialized 14 byte log entry
0709 12:22:54.688096 (+328598us) log.cc:844] Serialized 14 byte log entry
0709 12:22:54.748931 (+ 60835us) spinlock_profiling.cc:243] Waited 38.6 ms on lock 0x7b4800002958. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb5e89aa1 00007f9bb5e80b37 00007f9bb5e809ca 00007f9bb5f7826f 00007f9bb5f77f37 00007f9bb5f8c55c 00007f9bb5f8c508 00007f9bb5f8c488 00007f9bb5f8c443 00007f9bb5f8b6ec 00007f9bb4eb5a96
0709 12:22:54.957124 (+208193us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:54.957179 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:54.957228 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.957291 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:54.957480 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":318493,"prepare.queue_time_us":175376,"prepare.run_cpu_time_us":153,"prepare.run_wall_time_us":2958,"raft.queue_time_us":73604,"raft.run_cpu_time_us":2015,"raft.run_wall_time_us":370195,"spinlock_wait_cycles":88823680,"thread_start_us":539632,"threads_started":3,"wal-append.queue_time_us":763988}
W20260709 12:22:54.959746 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 350614us
I20260709 12:22:54.960171 17885 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:22:54.961052 17886 consensus_meta.cc:287] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.001s
I20260709 12:22:54.957257 17689 tablet_bootstrap.cc:492] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
W20260709 12:22:54.962589 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:54.963052 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.748374 17883 raft_consensus.cc:3055] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:22:54.963495 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 273117us
I20260709 12:22:54.963795 17883 raft_consensus.cc:740] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:54.964345 17923 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:54.964833 17883 consensus_queue.cc:260] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:54.959312 10929 rpcz_store.cc:276] 0709 12:22:53.816846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.835310 (+ 18464us) service_pool.cc:224] Handling call
0709 12:22:54.958766 (+1123456us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b54002049d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:54.958874 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1513687936}
I20260709 12:22:54.966076 17883 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:54.968037 11651 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:54.970471 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:54.970901 17797 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:54.846217 11083 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:22:54.971139 10931 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 17.
W20260709 12:22:54.766836 17892 log.cc:927] Time spent T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 12:22:54.972041 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:54.972523 11083 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:22:54.973881 11083 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:22:54.974167 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:54.974764 11011 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:22:54.762759 17796 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:22:54.881819 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.990600 11049 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:54.816057 17827 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:54.899438 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 109096us
I20260709 12:22:54.801563 17241 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:54.800748 17723 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.816367 17704 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:22:54.745783 17756 raft_consensus.cc:697] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:54.640079 17824 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:22:54.847675 17520 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:54.908443 11082 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 17.
I20260709 12:22:54.792672 17832 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:54.861624 17781 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:54.855813 17839 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:54.861241 17921 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.897997 17908 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.825047 17508 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:54.923709 17872 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:54.926556 11078 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:22:55.068097 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:54.927892 17837 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:54.929834 17926 log.cc:927] Time spent T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:22:54.920375 17914 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:54.920799 17897 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:54.931803 17925 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.926644 17740 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:22:54.937451 17630 consensus_meta.cc:287] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.772s	user 0.010s	sys 0.000s
W20260709 12:22:54.938086 17772 consensus_meta.cc:287] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.000s
I20260709 12:22:54.938158 17416 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:22:54.939672 17762 consensus_meta.cc:287] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.000s
I20260709 12:22:55.089085 17946 consensus_queue.cc:1059] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:22:55.089277 17762 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:55.090173 17900 log.cc:927] Time spent T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 12:22:55.091456 17762 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:54.928791 17878 consensus_queue.cc:1059] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:54.940755 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3862) took 1118 ms. Trace:
I20260709 12:22:54.944321 17683 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:55.097937 11009 rpcz_store.cc:276] 0709 12:22:53.822740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.921826 (+ 99086us) service_pool.cc:224] Handling call
0709 12:22:53.922103 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:53.922449 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:53.922477 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:53.926775 (+  4298us) log.cc:844] Serialized 26 byte log entry
0709 12:22:54.315228 (+388453us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:54.315267 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.315377 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:54.940531 (+625154us) raft_consensus.cc:1685] finished
0709 12:22:54.940562 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:54.940697 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":44695,"thread_start_us":388063,"threads_started":1,"wal-append.queue_time_us":617524}
W20260709 12:22:54.946208 10961 heartbeater.cc:646] Failed to heartbeat to 127.9.131.126:46265 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.9.131.126:46265 timed out after 15.000s (SENT)
I20260709 12:22:55.099967 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:55.100672 11009 raft_consensus.cc:2393] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 16: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:55.101536 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:55.102057 11009 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 17.
I20260709 12:22:55.102807 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:54.897634 17682 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:55.104800 17682 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:54.968228 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:54.602336 17915 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:55.105471 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 119147us
W20260709 12:22:55.106047 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 111463us
I20260709 12:22:55.106582 10899 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:54.968196 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:55.107306 11655 raft_consensus.cc:1813] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Handling vote request from an unknown peer 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:55.107735 11655 raft_consensus.cc:2368] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15.
I20260709 12:22:55.067811 17908 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:55.066658 17248 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.959918 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3701) took 1064 ms. Trace:
I20260709 12:22:54.970410 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:54.979224 10930 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:22:54.979130 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:54.984990 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:54.990600 11083 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 12:22:54.996814 11004 raft_consensus.cc:1240] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:22:55.001952 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:55.003115 11050 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:55.003305 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:55.010507 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:54.915300 17649 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:54.959164 17831 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:55.025408 10931 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:22:55.011139 17913 log.cc:927] Time spent T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:22:55.009233 17904 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:54.961476 17886 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:55.146968 11656 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:22:55.155764 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:55.062885 11622 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
W20260709 12:22:55.157032 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 94223.1us
W20260709 12:22:55.060765 17931 log.cc:927] Time spent T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.002s
I20260709 12:22:55.079523 11654 raft_consensus.cc:1240] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:22:55.080922 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:55.162400 11078 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:22:55.001284 17888 consensus_queue.cc:237] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:55.010788 17827 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:55.082854 11006 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22. Ops: []
W20260709 12:22:55.084550 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 182265us
I20260709 12:22:55.022997 17723 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:55.104990 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 126922us
I20260709 12:22:55.070036 17797 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 12:22:55.171204 10900 leader_election.cc:400] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15.
I20260709 12:22:55.171571 10900 leader_election.cc:403] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:55.142113 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:55.109474 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.144003 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:55.069697 17921 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:55.110590 17627 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:22:55.175433 17627 consensus_queue.cc:1243] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 1abf4b385a2b493ab83f593a1f8c9cd1 log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 12:22:55.175829 17941 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:22:55.163158 17831 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:55.176765 17831 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.177145 17831 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:55.145609 11083 pending_rounds.cc:85] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 12
I20260709 12:22:55.180056 11083 pending_rounds.cc:107] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 12:22:55.180361 11083 raft_consensus.cc:2889] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:55.145941 10927 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:22:55.110771 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:55.145198 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:55.146924 11005 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
W20260709 12:22:55.182004 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 178955us
I20260709 12:22:55.112196 11010 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22. Ops: []
I20260709 12:22:55.106787 17724 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:55.079272 17520 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.090s
I20260709 12:22:55.105499 11003 raft_consensus.cc:1813] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Handling vote request from an unknown peer 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:55.151119 10977 leader_election.cc:336] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.701s (SENT)
I20260709 12:22:55.107818 10899 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:55.111694 17908 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:55.141947 17781 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:55.142491 17740 raft_consensus.cc:697] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:55.112761 17881 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:55.106969 10901 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:55.087885 17925 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:55.182761 11050 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:55.145387 11084 rpcz_store.cc:276] 0709 12:22:53.895054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.895204 (+   150us) service_pool.cc:224] Handling call
0709 12:22:53.895488 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:54.432325 (+536837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.959676 (+527351us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b540011c1d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:54.959836 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1233129216}
I20260709 12:22:55.153661 17904 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:55.181576 10932 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:55.113081 17630 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:55.194238 10927 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 23.
I20260709 12:22:55.109810 17508 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:55.108793 17771 consensus_queue.cc:1059] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 12:22:55.105847 17915 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:55.112032 17248 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:55.186269 10977 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:55.190799 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 83063.8us
I20260709 12:22:55.185771 11003 raft_consensus.cc:2368] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15.
I20260709 12:22:55.194846 17924 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 15
W20260709 12:22:55.204746 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 97842.9us
I20260709 12:22:54.961562 17823 raft_consensus.cc:2955] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:22:55.195999 17822 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:22:55.186654 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 3106) took 1380 ms. Trace:
I20260709 12:22:55.209697 17880 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:22:55.224300 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 73243us
I20260709 12:22:55.234918 10899 leader_election.cc:400] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16.
I20260709 12:22:55.235255 10899 leader_election.cc:403] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:22:55.204734 17946 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.207334 17904 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:55.226222 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3434) took 1320 ms. Trace:
I20260709 12:22:55.209364 17877 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:55.231434 17837 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:55.185281 17945 raft_consensus.cc:3055] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:22:55.249365 17945 raft_consensus.cc:740] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:22:55.250373 17952 log.cc:927] Time spent T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:22:55.258185 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 75503.7us
I20260709 12:22:55.259466 11050 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:55.236459 10928 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:22:55.238152 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:55.207701 17951 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.240079 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:55.263114 17951 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:55.240731 10899 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:55.230445 11007 rpcz_store.cc:276] 0709 12:22:53.806673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.808707 (+  2034us) service_pool.cc:224] Handling call
0709 12:22:53.809018 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.809232 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:22:53.809560 (+   328us) log.cc:844] Serialized 14 byte log entry
0709 12:22:54.773701 (+964141us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b1800133420. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade70455 00007f9bb49583c7 00007f9bb0f6a9a7 00007f9bb0f7a0bf 00007f9bb0f7a038
0709 12:22:54.900183 (+126482us) log.cc:844] Serialized 14 byte log entry
0709 12:22:55.186239 (+286056us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:55.186300 (+    61us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:55.186360 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.186460 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:55.186593 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44597,"prepare.queue_time_us":18721,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":2245,"raft.queue_time_us":73346,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":8302,"spinlock_wait_cycles":12339584,"thread_start_us":891829,"threads_started":3,"wal-append.queue_time_us":985022}
I20260709 12:22:55.226944 17508 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.274520 11050 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:55.243619 10936 rpcz_store.cc:276] 0709 12:22:53.905497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.158895 (+253398us) service_pool.cc:224] Handling call
0709 12:22:54.159292 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:54.159665 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:54.159692 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:54.164267 (+  4575us) log.cc:844] Serialized 26 byte log entry
0709 12:22:54.472666 (+308399us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:54.472938 (+   272us) log.cc:844] Serialized 14 byte log entry
0709 12:22:54.473144 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.473224 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:54.752867 (+279643us) spinlock_profiling.cc:243] Waited 8.16 ms on lock 0x7b4800002958. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb5e89aa1 00007f9bb5e80b37 00007f9bb5e809ca 00007f9bb5f7826f 00007f9bb5f77f37 00007f9bb5f8c55c 00007f9bb5f8c508 00007f9bb5f8c488 00007f9bb5f8c443 00007f9bb5f8b6ec 00007f9bb4eb5a96
0709 12:22:55.221863 (+468996us) raft_consensus.cc:1685] finished
0709 12:22:55.226035 (+  4172us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:55.226164 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":342912,"prepare.queue_time_us":504,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":62868,"raft.run_cpu_time_us":1937,"raft.run_wall_time_us":520836,"spinlock_wait_cycles":18757888,"thread_start_us":308078,"threads_started":1,"wal-append.queue_time_us":481994}
I20260709 12:22:55.248828 17917 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:55.112861 17756 consensus_queue.cc:237] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:55.260381 17877 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:22:55.203289 17938 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:22:55.275393 11051 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:55.273959 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:55.276104 11050 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:55.239199 17880 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.283653 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:55.247056 17771 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16.
I20260709 12:22:55.284760 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:22:55.379802 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.387773 11084 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:22:55.293722 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:55.314980 11004 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 12:22:55.386555 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 110519us
I20260709 12:22:55.384740 11650 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:22:55.348299 11006 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 23. Current term is 24. Ops: []
I20260709 12:22:55.390993 11050 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:55.391517 10975 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:55.391952 11006 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 12:22:55.263264 10931 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:22:55.279549 10899 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:55.273653 17722 consensus_meta.cc:287] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.579s	user 0.010s	sys 0.000s
W20260709 12:22:55.325937 17920 log.cc:927] Time spent T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.545s	user 0.004s	sys 0.000s
I20260709 12:22:55.277648 17881 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:22:55.410467 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 131008us
I20260709 12:22:55.409543 11076 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:22:55.277396 17951 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:55.412521 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:55.398913 17704 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:22:55.286564 17649 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:55.399197 17520 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:22:55.460549 17520 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.280236 17627 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:55.287580 17630 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:55.293005 17248 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:55.277691 17797 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:55.386319 17880 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:22:55.485034 11084 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:22:55.486797 17831 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:55.282425 17827 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:55.281231 17886 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:55.285588 17925 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:55.327085 17832 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:55.286007 17723 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:55.457867 10899 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:55.272473 17947 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:55.289428 17798 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:55.283491 17872 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:55.459234 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:55.427397 11083 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:55.409701 10901 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:55.287395 17915 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:55.462973 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:55.508424 11078 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:55.319348 17796 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:55.465777 17824 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:22:55.246978 17946 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:55.466190 17520 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:22:55.427250 17660 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:22:55.287719 17508 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:55.456730 17883 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.457476 17908 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:55.473549 11658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59384 (request call id 858) took 1306 ms. Trace:
I20260709 12:22:55.280236 17955 consensus_queue.cc:1059] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.182s
I20260709 12:22:55.482905 17924 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15.
I20260709 12:22:55.484103 17928 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.274039 17837 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:55.287227 17914 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:55.291702 17921 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:55.506884 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:55.464201 17935 log.cc:927] Time spent T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260709 12:22:55.462108 17877 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:55.553246 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:55.554440 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 404964us
I20260709 12:22:55.563143 10933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3437) took 1596 ms. Trace:
I20260709 12:22:55.532653 17908 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:55.608544 17908 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:55.540635 17726 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:22:55.295202 17917 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:55.617508 17917 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:55.514226 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 238883us
I20260709 12:22:55.507457 17798 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:55.411759 17722 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:55.620100 17798 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.620574 17798 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:55.621729 17722 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:55.622455 17722 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:55.497799 17938 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:55.517340 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 126435us
I20260709 12:22:55.531777 11078 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:22:55.539388 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:55.539669 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:55.541818 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:55.542858 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:55.250342 17945 consensus_queue.cc:260] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:55.533041 11658 rpcz_store.cc:276] 0709 12:22:54.167598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.167704 (+   106us) service_pool.cc:224] Handling call
0709 12:22:54.218385 (+ 50681us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:54.467345 (+248960us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:54.467375 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:54.467930 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 12:22:54.645960 (+178030us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:22:54.646000 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.646077 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:55.469599 (+823522us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b24003383d8. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badcf99c4 00007f9badcf7acb 00007f9badeb2dc9 00007f9badeb2a55 00007f9badeb1fb0 00007f9bb0b28488 00007f9bb0b28be8 00007f9bb0b00398 00007f9bb0afb76a 00007f9bb0afabb6
0709 12:22:55.473255 (+  3656us) raft_consensus.cc:1685] finished
0709 12:22:55.473277 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:55.473481 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":308153,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":23220096,"thread_start_us":426207,"threads_started":2,"wal-append.queue_time_us":554453}
I20260709 12:22:55.509191 17248 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:22:55.624420 11085 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 20. Current term is 21. Ops: []
I20260709 12:22:55.630162 17886 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:55.630807 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 3529) took 1078 ms. Trace:
I20260709 12:22:55.631176 11085 rpcz_store.cc:276] 0709 12:22:54.552186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.762428 (+210242us) service_pool.cc:224] Handling call
0709 12:22:54.766189 (+  3761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:55.630082 (+863893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.630602 (+   520us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b54000dff54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:55.630752 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1973308288}
I20260709 12:22:55.278126 17740 consensus_queue.cc:237] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:55.550103 11076 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:22:55.624468 11050 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:55.509407 17845 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 12:22:55.552621 17928 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:55.635023 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:55.635466 17928 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:55.561460 17873 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 12:22:55.564009 11083 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:22:55.572608 17781 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:55.636034 10936 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 17.
I20260709 12:22:55.625861 10931 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 15.
I20260709 12:22:55.626773 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:55.574352 17831 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:55.637490 17781 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:55.575297 11654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59384 (request call id 857) took 1408 ms. Trace:
I20260709 12:22:55.627898 10928 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:22:55.625470 11078 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:55.639483 17781 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:55.558087 11624 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:55.578096 17955 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.638236 11654 rpcz_store.cc:276] 0709 12:22:54.167292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.167425 (+   133us) service_pool.cc:224] Handling call
0709 12:22:54.167757 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:55.162156 (+994399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.575041 (+412885us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b5400528854. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:55.575237 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2079049472}
I20260709 12:22:55.628444 17945 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:22:55.579551 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:55.644208 11084 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:22:55.520084 17771 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:22:55.665833 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:55.666746 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:55.668721 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:55.669910 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:55.637612 10932 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:55.666855 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:55.587257 17627 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:55.532961 17772 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
W20260709 12:22:55.589620 17961 log.cc:927] Time spent T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:22:55.644140 17831 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:55.591120 17508 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:55.592854 17904 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:55.597951 17796 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:55.533038 17872 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:22:55.598291 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3709) took 1264 ms. Trace:
I20260709 12:22:55.599380 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:55.536782 17883 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:55.603451 17946 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:55.544863 17660 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:55.604693 17936 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:55.605486 17921 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:55.605924 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:55.606801 17885 raft_consensus.cc:3055] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:22:55.607514 17922 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:55.706048 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:55.706681 11077 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:22:55.607890 17241 raft_consensus.cc:3055] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:55.610821 17837 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:55.549324 17929 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
I20260709 12:22:55.613534 17822 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:55.718667 17822 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:55.715173 17946 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.721093 17946 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:55.613600 17958 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.715083 17829 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:22:55.724246 17958 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:55.615495 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:55.710409 17922 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:55.726547 11079 raft_consensus.cc:2410] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 21 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
W20260709 12:22:55.644598 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 86602.2us
I20260709 12:22:55.649694 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:55.728148 11011 raft_consensus.cc:2393] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 16: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:55.729029 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:55.730111 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:55.649830 11076 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 24.
I20260709 12:22:55.577663 17939 raft_consensus.cc:3055] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:55.731005 17939 raft_consensus.cc:740] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:55.731410 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:55.732511 11076 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 17: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:55.733274 11005 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 15: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:55.629061 10935 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 12:22:55.734006 10935 pending_rounds.cc:85] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 11
I20260709 12:22:55.734290 10935 pending_rounds.cc:107] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 12:22:55.734544 10935 raft_consensus.cc:2889] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:55.657984 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:55.736009 10928 raft_consensus.cc:3060] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:55.662621 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:55.563617 10933 rpcz_store.cc:276] 0709 12:22:53.966879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.160533 (+193654us) service_pool.cc:224] Handling call
0709 12:22:54.160905 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:54.161269 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:54.161297 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:54.184028 (+ 22731us) log.cc:844] Serialized 26 byte log entry
0709 12:22:54.553798 (+369770us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:54.644822 (+ 91024us) log.cc:844] Serialized 14 byte log entry
0709 12:22:54.780626 (+135804us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b180047ca40. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:22:54.953433 (+172807us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b180047ca40. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9baddedc0a 00007f9bb752d219 00007f9bade75a40 00007f9bade704e4 00007f9bade70455 00007f9bb0f58060 00007f9bb0f6a716 00007f9bb0f7b287 00007f9bb0f7b208
0709 12:22:54.953655 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.953749 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:55.325130 (+371381us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:22:55.562898 (+237768us) raft_consensus.cc:1685] finished
0709 12:22:55.562923 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:55.563076 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":156135,"prepare.queue_time_us":91209,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":14487,"raft.queue_time_us":315122,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":79527,"spinlock_wait_cycles":116543872,"thread_start_us":282141,"threads_started":1,"wal-append.queue_time_us":462080}
I20260709 12:22:55.658725 10900 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:55.736972 11654 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:55.664395 11625 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:55.664595 11084 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 12:22:55.738305 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:55.738660 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 74351.8us
I20260709 12:22:55.739391 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:55.674105 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:55.672580 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:55.741739 11004 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:55.677271 10831 catalog_manager.cc:5697] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 14 to 16, leader changed from 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 16 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:22:55.590008 11081 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3703) took 1688 ms. Trace:
I20260709 12:22:55.742628 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:55.678275 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:55.674705 17722 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:22:55.679045 17968 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.679464 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:55.640542 17955 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:55.753001 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:55.683822 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:55.753250 11003 raft_consensus.cc:2368] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19.
I20260709 12:22:55.691267 11050 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:55.754170 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 64208.2us
I20260709 12:22:55.755108 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:55.509358 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 99627.9us
I20260709 12:22:55.756377 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:55.697811 10930 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 19. Current term is 20. Ops: []
I20260709 12:22:55.693671 17945 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.700707 10977 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:55.755937 11006 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
W20260709 12:22:55.760103 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 59479.8us
I20260709 12:22:55.760864 11006 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:22:55.695431 11080 rpcz_store.cc:276] 0709 12:22:54.333546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.334368 (+   822us) service_pool.cc:224] Handling call
0709 12:22:54.334699 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:54.335042 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:54.473936 (+138894us) log.cc:844] Serialized 14 byte log entry
0709 12:22:54.986948 (+513012us) log.cc:844] Serialized 14 byte log entry
0709 12:22:54.987153 (+   205us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:54.987654 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 12:22:54.987781 (+   127us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:54.987814 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.987911 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:55.598095 (+610184us) raft_consensus.cc:1685] finished
0709 12:22:55.598116 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:55.598237 (+   121us) inbound_call.cc:177] Queueing success response
0709 12:22:55.616109 (+ 17872us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b18002cb420. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
Metrics: {"mutex_wait_us":257909,"prepare.queue_time_us":67111,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":80,"raft.queue_time_us":301400,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":63590,"spinlock_wait_cycles":45624576,"thread_start_us":416724,"threads_started":3,"wal-append.queue_time_us":552153}
I20260709 12:22:55.707971 17885 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:55.711159 10974 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:55.762652 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 51580.2us
I20260709 12:22:55.762699 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:55.763921 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:55.739981 11084 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:55.748935 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:55.764773 11076 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 22.
I20260709 12:22:55.743263 11011 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:22:55.750483 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:55.743060 11081 rpcz_store.cc:276] 0709 12:22:53.901853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.902017 (+   164us) service_pool.cc:224] Handling call
0709 12:22:53.919373 (+ 17356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:54.801098 (+881725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.589757 (+788659us) spinlock_profiling.cc:243] Waited 876 ms on lock 0x7b54000e1d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:55.589947 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2015896320}
I20260709 12:22:55.765652 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:55.766347 11076 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:55.766851 11622 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
W20260709 12:22:55.749574 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 90961.5us
I20260709 12:22:55.685706 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:55.756518 10901 leader_election.cc:400] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15.
I20260709 12:22:55.708601 17241 raft_consensus.cc:740] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:55.677732 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:55.752038 11625 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:55.755471 11050 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:55.763686 10974 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:55.761233 10977 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:55.751210 11077 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 18.
I20260709 12:22:55.623916 17880 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:55.767489 11076 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:22:55.793874 11004 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:22:55.787564 17416 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.786864 17945 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:55.795527 17416 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:55.796006 17915 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:22:55.796294 17823 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:55.797302 17756 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:22:55.797446 17945 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:55.797773 17416 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:55.787247 17248 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:22:55.798520 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:55.732085 17630 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:22:55.800436 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 45057.8us
I20260709 12:22:55.802856 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:55.735483 17922 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:55.877996 11082 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:55.879041 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:55.877902 11081 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:22:55.723786 17946 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:55.878333 11050 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:55.748410 17831 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:55.766779 17627 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:22:55.886794 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 95606.8us
I20260709 12:22:55.940737 10927 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 12:22:55.708918 17660 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:55.878854 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.887790 11083 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 23. Current term is 24. Ops: [22.12-23.13]
W20260709 12:22:55.884078 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.854058 17915 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.759842 17796 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:55.855846 17248 raft_consensus.cc:697] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:55.931787 11084 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 18.
W20260709 12:22:55.942005 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 63746.8us
I20260709 12:22:55.798058 17832 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:55.768359 17726 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:22:55.943627 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 150957us
I20260709 12:22:55.945679 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:55.945856 10899 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:55.939941 17683 consensus_queue.cc:1059] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.013s
W20260709 12:22:55.953533 17959 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.399s	user 0.000s	sys 0.001s
I20260709 12:22:55.883987 17722 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:55.900674 17928 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.965036 11008 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:22:55.886974 17824 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.768745 17968 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:55.786880 17939 consensus_queue.cc:260] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:55.788137 17829 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.163s
I20260709 12:22:55.985224 11050 leader_election.cc:400] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19.
I20260709 12:22:56.051484 11050 leader_election.cc:403] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:22:55.962566 17915 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:22:55.988484 11078 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 10. (term mismatch)
I20260709 12:22:55.925010 17416 consensus_queue.cc:1059] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.098s
I20260709 12:22:55.945511 17946 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:22:55.996763 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 50995.5us
I20260709 12:22:56.001184 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60046 (request call id 3527) took 1449 ms. Trace:
I20260709 12:22:55.908628 17831 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.941756 10928 raft_consensus.cc:2468] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 18.
I20260709 12:22:55.945197 17772 consensus_queue.cc:1059] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
W20260709 12:22:56.053617 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 86348.5us
I20260709 12:22:56.064851 11078 pending_rounds.cc:85] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 9
I20260709 12:22:56.101325 11078 pending_rounds.cc:107] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 20.10
I20260709 12:22:56.101811 11078 raft_consensus.cc:2889] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:55.972651 11657 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.040s	sys 0.048s
I20260709 12:22:55.996023 17927 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.104s
I20260709 12:22:56.075101 11079 rpcz_store.cc:276] 0709 12:22:54.551663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.647516 (+ 95853us) service_pool.cc:224] Handling call
0709 12:22:55.987958 (+1340442us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b54000e0e54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:56.001114 (+ 13156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2143070080}
I20260709 12:22:56.103458 11050 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:55.941504 17627 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:56.007292 17525 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:56.103979 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:56.104292 17627 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:55.988495 17832 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:56.102713 11657 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.044s	sys 0.051s
I20260709 12:22:56.105185 17832 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:56.117625 11050 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:56.010805 17955 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:56.122702 17722 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:56.010241 17922 consensus_queue.cc:1059] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.108s
W20260709 12:22:56.123204 17967 log.cc:927] Time spent T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 12:22:56.122454 17837 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:22:56.119311 17929 consensus_queue.cc:1059] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 12:22:55.883255 17885 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:55.985034 17634 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 12:22:56.049768 17928 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:56.118728 11050 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:55.964107 17873 consensus_queue.cc:1059] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.110s
I20260709 12:22:55.966611 17346 consensus_queue.cc:1059] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.147s
I20260709 12:22:56.100652 17831 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:56.070206 17965 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19.
I20260709 12:22:56.123205 17722 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:56.127920 17908 consensus_meta.cc:287] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.001s
I20260709 12:22:56.053573 17824 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:56.145350 11050 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:56.128866 17772 consensus_queue.cc:1243] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 1abf4b385a2b493ab83f593a1f8c9cd1 log is divergent from this leader: its last log entry 19.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:22:55.992331 17241 consensus_queue.cc:260] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:56.126021 17945 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:56.137537 17917 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:22:56.182739 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 303669us
I20260709 12:22:56.175688 11079 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:22:56.182636 17908 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:56.201790 17726 raft_consensus.cc:3055] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:56.150276 17904 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:56.175246 17722 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:56.168933 17946 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:56.265985 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:56.174737 17883 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:56.142859 17872 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 12:22:56.184067 17945 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.184911 17346 raft_consensus.cc:3055] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:22:56.190004 17965 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:22:56.202260 17726 raft_consensus.cc:740] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:56.337782 11658 raft_consensus.cc:2410] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:22:56.270424 17829 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.209460 17756 raft_consensus.cc:697] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:56.268253 17796 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.352852 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:56.275935 17845 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.151579 17248 consensus_queue.cc:237] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:56.353992 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:56.341526 17945 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:56.356899 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:56.339946 17241 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:56.295219 17880 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:56.341851 17346 raft_consensus.cc:740] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:56.342070 17928 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:56.380229 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:56.351562 17508 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.382519 11004 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:56.383401 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:56.376731 17660 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:56.388373 17756 consensus_queue.cc:237] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:56.402709 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 352834us
I20260709 12:22:56.355938 17829 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:56.384542 10974 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:56.405695 17822 consensus_meta.cc:287] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.000s
I20260709 12:22:56.419287 11004 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 18.
W20260709 12:22:56.420116 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 429242us
I20260709 12:22:56.361989 17796 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:56.431440 11051 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:56.421600 10974 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:56.406912 17762 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.437835 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:56.407508 17968 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:56.445529 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:56.445926 11004 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:22:56.416929 17947 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:22:56.405426 17508 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:56.376622 17845 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:56.453085 11009 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22. Ops: []
I20260709 12:22:56.387691 17726 consensus_queue.cc:260] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:56.436415 17946 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:56.432579 17822 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:56.469820 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:56.470499 11002 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:22:56.457652 17520 consensus_meta.cc:287] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.924s	user 0.005s	sys 0.005s
I20260709 12:22:56.478024 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:56.478767 11009 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:22:56.440111 17904 consensus_queue.cc:1059] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:22:56.444794 17762 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:56.492905 11625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.009s	sys 0.037s
W20260709 12:22:56.493579 11625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.009s	sys 0.038s
I20260709 12:22:56.463318 17947 raft_consensus.cc:697] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 24 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:56.467900 17978 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:56.479730 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:56.472401 17824 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:56.431615 17346 consensus_queue.cc:260] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:56.490237 17970 log.cc:927] Time spent T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 12:22:56.512662 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:56.518482 11079 raft_consensus.cc:2410] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:22:56.520008 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:56.514082 11624 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:56.521588 11624 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:56.474399 17416 consensus_queue.cc:1059] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:22:56.523523 11624 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:56.524559 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.520690 11079 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:22:56.486364 17520 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:56.525779 17914 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:56.526551 17914 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:56.527006 17914 raft_consensus.cc:697] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:56.533211 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:56.534263 11079 raft_consensus.cc:2410] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 22 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 8.
I20260709 12:22:56.501920 17977 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:56.504884 17978 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:22:56.528077 17972 log.cc:927] Time spent T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
W20260709 12:22:56.531417 17973 log.cc:927] Time spent T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:22:56.528046 17975 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:56.549567 17796 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:56.557181 17978 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:56.575568 17831 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:56.578248 17831 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:56.570329 17947 consensus_queue.cc:237] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:56.580780 17845 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:56.546021 17832 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:56.559054 17977 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:56.540738 17914 consensus_queue.cc:237] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:56.602371 17958 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:56.609323 17968 raft_consensus.cc:3055] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:22:56.609720 17968 raft_consensus.cc:740] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:56.610400 17968 consensus_queue.cc:260] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:56.611307 17968 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:22:56.613003 17955 raft_consensus.cc:3055] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:56.613520 17955 raft_consensus.cc:740] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:56.615408 17977 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:56.618801 17978 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:56.648634 10899 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.008s	sys 0.028s
I20260709 12:22:56.649520 10974 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:56.652206 10974 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:56.507361 11009 raft_consensus.cc:2393] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 22: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:56.505374 11005 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 16.
W20260709 12:22:56.669211 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 523759us
I20260709 12:22:56.670733 11050 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:56.672792 10928 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 12:22:56.673346 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:56.650195 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 210459us
I20260709 12:22:56.674765 10930 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:56.675757 10900 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:56.678292 11050 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:56.679145 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:56.649557 10899 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.009s	sys 0.029s
I20260709 12:22:56.680365 10927 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
W20260709 12:22:56.680586 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 605929us
I20260709 12:22:56.678236 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:56.669490 11008 raft_consensus.cc:2393] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 23: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:56.682174 10935 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:56.537709 11079 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:22:56.670622 11010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 3124) took 1021 ms. Trace:
W20260709 12:22:56.700700 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.589943 17915 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:56.582716 17829 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:56.714892 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:56.711544 17958 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:56.547065 17508 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:56.582824 17798 consensus_meta.cc:287] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.961s	user 0.012s	sys 0.000s
I20260709 12:22:56.581115 17722 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:56.557442 17346 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:56.713451 17965 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:56.715848 11081 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:22:56.724560 11657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59398 (request call id 642) took 1395 ms. Trace:
I20260709 12:22:56.551083 17520 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:56.764616 11654 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 18: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:56.707767 11010 rpcz_store.cc:276] 0709 12:22:55.648708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.649020 (+   312us) service_pool.cc:224] Handling call
0709 12:22:55.649553 (+   533us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:55.649942 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:55.649970 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:55.675099 (+ 25129us) log.cc:844] Serialized 52 byte log entry
0709 12:22:56.129692 (+454593us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:22:56.129737 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.129815 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:56.669929 (+540114us) raft_consensus.cc:1685] finished
0709 12:22:56.669982 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.670350 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6598,"raft.queue_time_us":5002,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":14242,"spinlock_wait_cycles":1988480,"thread_start_us":442394,"threads_started":1,"wal-append.queue_time_us":660282}
I20260709 12:22:56.767113 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:56.734519 17762 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:56.721194 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:56.768301 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:56.769006 11077 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:56.769407 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:56.771003 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:56.771710 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:56.773972 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:56.726163 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:56.775908 11659 raft_consensus.cc:2410] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:22:56.732405 17660 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:56.769285 10927 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:22:56.752017 11657 rpcz_store.cc:276] 0709 12:22:55.328829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.328981 (+   152us) service_pool.cc:224] Handling call
0709 12:22:55.329317 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:55.329732 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:55.329756 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:55.330208 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 12:22:56.105564 (+775356us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:22:56.105607 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.105688 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:56.723974 (+618286us) raft_consensus.cc:1685] finished
0709 12:22:56.724023 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.724297 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":141,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":775032,"threads_started":1,"wal-append.queue_time_us":837777}
I20260709 12:22:56.764986 17955 consensus_queue.cc:260] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:56.739961 17915 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:56.770869 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:56.727149 17416 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:56.733367 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:56.716517 17958 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:56.729904 17880 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:56.725438 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:56.727768 17756 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:22:56.781102 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 99482.1us
I20260709 12:22:56.729578 17634 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.727939 17888 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:56.779156 17660 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.795707 11010 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 15: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:56.798210 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:56.808099 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:56.808799 17904 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:22:56.812167 17978 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:56.813531 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:56.814577 11079 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:56.815932 17965 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:56.816839 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:56.818033 11080 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 3561) took 1127 ms. Trace:
I20260709 12:22:56.818629 17965 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:56.818966 17880 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:56.820467 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60046 (request call id 3560) took 1129 ms. Trace:
I20260709 12:22:56.820962 11082 rpcz_store.cc:276] 0709 12:22:55.690486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.756110 (+ 65624us) service_pool.cc:224] Handling call
0709 12:22:56.820036 (+1063926us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b5400218c54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:56.820230 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120523520}
I20260709 12:22:56.822538 17880 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:56.823223 17796 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:56.824498 18005 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:56.824957 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 3555) took 1171 ms. Trace:
I20260709 12:22:56.825177 18005 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:56.828100 17946 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:56.829046 17634 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:56.818905 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:56.828605 11656 raft_consensus.cc:2410] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:22:56.824173 17796 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:56.822767 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.792188 17756 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.723821 17798 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:56.833330 11083 rpcz_store.cc:276] 0709 12:22:55.652994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.653858 (+   864us) service_pool.cc:224] Handling call
0709 12:22:55.732959 (+ 79101us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:55.947360 (+214401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.823443 (+876083us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54001a54d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:56.824555 (+  1112us) spinlock_profiling.cc:243] Waited 78.7 ms on lock 0x7b54001a54d0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:56.824773 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":536416384}
I20260709 12:22:56.833906 17955 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:56.849325 11081 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 23.
W20260709 12:22:56.853793 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.823968 17832 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:56.789216 17762 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.857890 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:56.827739 18005 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:56.843082 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.800916 17660 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:56.843971 17756 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:56.882296 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:56.884025 17829 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:56.884220 11008 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 24 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 23. Current term is 24. Ops: []
I20260709 12:22:56.884778 17829 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:56.886566 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 1.11306e+06us
I20260709 12:22:56.887450 17829 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:56.888062 17822 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:56.890689 11051 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:56.824038 17416 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:56.894276 17416 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:56.896242 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 52139.7us
I20260709 12:22:56.897130 10899 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:56.865887 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:56.820505 17888 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:56.904745 10901 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:56.906019 17888 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:56.906558 10901 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:56.908238 11010 raft_consensus.cc:2393] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 23: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:56.818470 11080 rpcz_store.cc:276] 0709 12:22:55.690742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.771347 (+ 80605us) service_pool.cc:224] Handling call
0709 12:22:55.771684 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:56.115043 (+343359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.115077 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:56.115605 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 12:22:56.421247 (+305642us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:22:56.421297 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.817336 (+396039us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b540044cad4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:56.817400 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:56.817474 (+    74us) raft_consensus.cc:1685] finished
0709 12:22:56.817488 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.817846 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13077,"raft.queue_time_us":13926,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":6582,"spinlock_wait_cycles":758564096,"thread_start_us":295224,"threads_started":1,"wal-append.queue_time_us":416900}
I20260709 12:22:56.880527 18005 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.927887 11009 raft_consensus.cc:2393] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 16: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:56.928215 17525 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:56.929195 10974 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:56.930109 17977 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:22:56.931015 17822 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:56.935020 11659 raft_consensus.cc:1240] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:22:56.887987 17997 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.883533 17946 raft_consensus.cc:697] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:56.940488 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:56.940898 17634 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:56.941244 17845 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:22:56.941504 17762 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:56.943271 11622 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:56.944283 17974 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:56.945034 17965 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:56.950126 17798 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:56.950376 17928 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:57.012239 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 69205.7us
I20260709 12:22:56.952697 17976 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.935441 10975 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:56.954974 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:56.956064 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:56.956931 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:56.957892 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:56.961228 17796 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:57.022380 17976 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.023216 17796 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.023819 17796 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.025692 11656 raft_consensus.cc:2393] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 17: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:57.025959 17796 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:56.951995 18004 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 12:22:56.924382 17880 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:57.028271 11655 raft_consensus.cc:2393] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 17: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:56.965111 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:56.965459 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:57.019053 18009 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:57.031339 18009 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:56.941027 17958 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:57.019172 18016 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:57.034606 18016 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.019542 18011 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:57.036892 18011 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.038506 17897 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:57.030349 17965 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:57.039837 17965 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:57.015514 17525 consensus_queue.cc:1059] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 12:22:57.046052 17976 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:57.042171 17908 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:57.031458 17762 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:57.047950 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 112762us
I20260709 12:22:57.048475 17762 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:56.975337 11658 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:22:56.977788 10932 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:22:56.976593 10935 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:22:56.989027 17822 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:56.990511 11009 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 21. Current term is 22. Ops: []
W20260709 12:22:56.994060 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 103790us
I20260709 12:22:56.998509 11650 raft_consensus.cc:2393] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 23: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
W20260709 12:22:56.998708 11002 consensus_meta.cc:287] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.528s	user 0.003s	sys 0.018s
I20260709 12:22:56.999366 18005 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:57.000203 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 76797.2us
W20260709 12:22:56.968626 17945 consensus_meta.cc:287] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.569s	user 0.016s	sys 0.003s
I20260709 12:22:57.063158 17945 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.000953 17997 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:57.001786 17241 consensus_meta.cc:287] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.007s
I20260709 12:22:57.002606 17946 consensus_queue.cc:237] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:57.003633 17689 log.cc:927] Time spent T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:22:56.952004 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:57.070431 11010 raft_consensus.cc:2393] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 19: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:22:57.013501 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 84454.1us
I20260709 12:22:57.014626 18006 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.016172 17756 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.020123 17974 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.020975 17915 raft_consensus.cc:2804] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:22:57.021445 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 115052us
I20260709 12:22:57.022145 17947 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:56.993485 17904 raft_consensus.cc:697] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:22:57.020797 17627 consensus_meta.cc:287] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.916s	user 0.007s	sys 0.011s
I20260709 12:22:57.090679 11051 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:57.091837 17958 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:22:57.092294 17958 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:57.069250 11002 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23.
I20260709 12:22:57.092621 11051 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:57.094308 11011 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 12:22:57.070544 17997 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:57.095928 17997 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:22:57.096767 17631 raft_consensus.cc:3055] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:22:57.080147 18009 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:57.097702 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3733) took 1088 ms. Trace:
I20260709 12:22:57.082676 17922 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.083408 18006 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.097321 17631 raft_consensus.cc:740] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:57.098063 11085 rpcz_store.cc:276] 0709 12:22:56.009440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.009612 (+   172us) service_pool.cc:224] Handling call
0709 12:22:56.069601 (+ 59989us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.101797 (+ 32196us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:22:56.412712 (+310915us) log.cc:844] Serialized 14 byte log entry
0709 12:22:56.413006 (+   294us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:56.413059 (+    53us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:22:56.413116 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.097277 (+684161us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b5400219154. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:57.097343 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.097544 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":414454,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"raft.queue_time_us":3686,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":12397,"spinlock_wait_cycles":73491328,"thread_start_us":310586,"threads_started":1}
I20260709 12:22:57.099951 18006 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:57.101248 11051 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:57.036815 17660 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:57.103732 17922 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.104068 18006 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:57.104856 10936 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 18: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:57.100399 17631 consensus_queue.cc:260] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.105897 17631 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:22:57.106215 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:57.107312 17845 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:57.107872 17845 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:57.110103 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:57.114379 17929 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.115154 17929 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.116461 17945 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:57.092845 17822 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:57.092748 17958 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:57.117481 17525 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:57.125236 17525 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.127483 17525 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:57.088835 17947 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:57.122273 11049 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:22:57.104393 17660 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:57.132791 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.110678 17915 raft_consensus.cc:697] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:57.134570 17928 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:57.133783 17947 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:57.174899 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 61684.2us
I20260709 12:22:57.176530 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.181586 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.182423 18005 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:57.184535 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.188390 10935 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:22:57.189864 10935 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:57.190167 17976 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.190745 17976 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.191016 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.192067 17525 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.192613 17525 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.193046 17976 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:57.194018 17904 consensus_queue.cc:237] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.195384 17928 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:57.195806 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.196027 17928 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.198601 17928 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:57.200357 17974 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:57.196632 10935 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
W20260709 12:22:57.202070 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.194723 17525 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:57.172475 17977 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:56.765235  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:57.216900 10831 catalog_manager.cc:5697] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 6 to 10, term changed from 10 to 13, leader changed from 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) to <none>, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New cstate: current_term: 13 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:22:57.220068 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 116226us
I20260709 12:22:57.221251 11051 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:57.221799 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:57.222198 18005 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:22:57.222822 11051 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:57.223901 18005 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:22:57.224905 10935 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:22:57.224648 17915 consensus_queue.cc:237] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:57.226145 10830 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35620 (request call id 247) took 59112 ms (client timeout 15000 ms). Trace:
W20260709 12:22:57.226575 10830 rpcz_store.cc:269] 0709 12:21:58.099344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:58.109290 (+  9946us) service_pool.cc:224] Handling call
0709 12:22:57.205304 (+59096014us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1996385,"reported_tablets":52}
I20260709 12:22:57.227981 17908 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:57.228696 17908 raft_consensus.cc:697] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:57.230120 17908 consensus_queue.cc:237] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:57.127949 17627 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:57.188732 17968 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:57.219141 10831 catalog_manager.cc:5697] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:22:57.263629 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.228641 17827 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:57.266714 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.245263 11004 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:57.246162 17929 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:57.281514 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 58775.7us
I20260709 12:22:57.285902 11051 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:57.286852 17946 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:57.265532 17897 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:57.305492 17781 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:22:57.307986 17897 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:57.309685 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3886) took 2082 ms. Trace:
I20260709 12:22:57.310412 17897 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:57.310810 17927 consensus_queue.cc:1059] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:22:57.311666 17927 consensus_queue.cc:1243] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:22:57.312405 17630 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:57.313067 17630 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.314632 11653 raft_consensus.cc:1240] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:22:57.315217 17630 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:57.265375 17968 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.316143 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:57.316877 10936 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:57.319007 17968 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:57.322337 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:57.323283 11003 raft_consensus.cc:2393] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 19: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:57.330549 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:57.328909 17873 raft_consensus.cc:3055] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:57.326025 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:57.329753 11051 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:57.296043 10831 catalog_manager.cc:5697] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:22:57.326861 10901 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:57.280645 17827 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.325901 17660 consensus_queue.cc:1059] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:22:57.329171 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:57.331460 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.336580 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:57.336807 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:57.344511 11082 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:57.344563 10831 catalog_manager.cc:5697] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:57.346511 11077 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:57.347105 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:57.348050 11085 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:22:57.346531 10831 catalog_manager.cc:5697] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:57.356952 11050 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:57.357939 17946 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:22:57.364907 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.337209 17873 raft_consensus.cc:740] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:57.365499 10932 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:57.367561 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:57.366532 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.294530 17977 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.369174 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.352602 17630 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:57.370611 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:57.369679 10933 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:22:57.373219 11084 raft_consensus.cc:2393] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 21: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:57.310103 11007 rpcz_store.cc:276] 0709 12:22:55.227113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.276677 (+ 49564us) service_pool.cc:224] Handling call
0709 12:22:55.277049 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:55.559784 (+282735us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:55.573255 (+ 13471us) log.cc:844] Serialized 14 byte log entry
0709 12:22:56.054465 (+481210us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:56.054961 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 12:22:56.055093 (+   132us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:56.055127 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.308952 (+1253825us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b540037a5d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:57.309023 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:57.309093 (+    70us) raft_consensus.cc:1685] finished
0709 12:22:57.309207 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.309473 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60104,"prepare.queue_time_us":16026,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":27494,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":3796,"spinlock_wait_cycles":626486144,"thread_start_us":480826,"threads_started":1,"wal-append.queue_time_us":618428}
I20260709 12:22:57.374962 11051 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:57.375238 17520 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.397866 17520 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.385870 17762 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.399129 17762 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.377096 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.379974 17827 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:57.385020 10929 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 12:22:57.386019 17965 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.390295 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:57.391067 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:57.401222 10831 catalog_manager.cc:5697] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:22:57.369457 17946 consensus_queue.cc:1059] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:22:57.393080 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:57.393853 11083 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:22:57.394222 17917 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:57.394629 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:57.410293 11004 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:57.396245 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:57.396427 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:57.397024 17630 raft_consensus.cc:697] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:57.398231 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 3554) took 1745 ms. Trace:
I20260709 12:22:57.391803 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:57.410607 11082 raft_consensus.cc:2410] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:22:57.376518 17627 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:57.400573 10927 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:22:57.399966 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:57.405745 10929 pending_rounds.cc:85] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 12
I20260709 12:22:57.402094 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.411454 11081 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:22:57.411945 11077 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:22:57.413630 17683 raft_consensus.cc:3055] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:22:57.413302 17630 consensus_queue.cc:237] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.413740 11007 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22. Ops: []
I20260709 12:22:57.414270 17880 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:57.416138 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:57.444604 11002 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:57.416674 17781 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:57.412528 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 85773.6us
W20260709 12:22:57.419071 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 63742.3us
I20260709 12:22:57.420127 17946 raft_consensus.cc:3055] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:22:57.420341 17873 consensus_queue.cc:260] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:57.406425 18014 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:57.422036 17726 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:22:57.416807 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.408409 11085 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:22:57.389400 17958 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.439283 10936 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:22:57.446365 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.429347 10929 pending_rounds.cc:107] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 12:22:57.483955 10929 raft_consensus.cc:2889] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:57.397982 17845 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.413866 17977 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:57.444298 17880 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:57.440390 17917 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:57.455981 11084 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:22:57.456609 11081 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:22:57.457185 17762 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:57.460170 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.460820 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:57.438446 17683 raft_consensus.cc:740] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:57.463131 10974 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:57.464666 10831 catalog_manager.cc:5697] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:22:57.465636 17946 raft_consensus.cc:740] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:57.466569 17965 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:57.411073 11078 rpcz_store.cc:276] 0709 12:22:55.652680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.652832 (+   152us) service_pool.cc:224] Handling call
0709 12:22:55.988091 (+335259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.102352 (+114261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.397828 (+1295476us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b54000e0e50. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f5f8ad 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:57.398057 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":770251520}
I20260709 12:22:57.469142 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:57.472070 10933 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:22:57.427325 17947 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.472679 10931 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:57.473448 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.473430 18014 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:57.493079 11004 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:22:57.454968 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:57.508486 11079 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 21. Current term is 22. Ops: []
I20260709 12:22:57.593245 10932 raft_consensus.cc:2410] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:22:57.594780 10927 raft_consensus.cc:2393] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 21: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:57.512846 11082 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
W20260709 12:22:57.593703 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.613361 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:57.613768 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.614322 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:57.614934 11653 raft_consensus.cc:2368] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17.
I20260709 12:22:57.614276 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:57.505897 17880 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:57.622823 11084 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:22:57.515441 18009 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:57.626368 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 163360us
I20260709 12:22:57.592365 17520 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:57.633909 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.596832 17873 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:57.636804 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.638247 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:57.643887 18029 log.cc:927] Time spent T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 12:22:57.645493 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.646767 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.647298 10927 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 23.
W20260709 12:22:57.648211 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 152364us
I20260709 12:22:57.649883 10977 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:57.653862 11081 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:57.657081 17845 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:57.657811 17876 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:57.658428 17876 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.631778 17977 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:57.648167 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.660828 10900 leader_election.cc:400] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17.
I20260709 12:22:57.661057 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.662230 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:57.663226 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:57.663914 10927 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 18: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:57.664608 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:57.665385 17631 consensus_meta.cc:287] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.559s	user 0.006s	sys 0.006s
I20260709 12:22:57.666147 10927 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:22:57.640816 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.670063 11002 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:22:57.670657 17947 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:57.671221 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:57.671517 11006 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:22:57.637162 10901 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:57.672962 10900 leader_election.cc:403] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:22:57.676666 11002 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:22:57.677572 10931 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:22:57.678092 17922 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:57.661001 17958 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:57.615964 18014 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:57.683305 18009 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.684927 17876 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:57.685861 17946 consensus_queue.cc:260] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.686830 17917 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.641978 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:57.639171 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:57.661057 18035 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:22:57.690652 11007 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
W20260709 12:22:57.698781 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 61700.9us
I20260709 12:22:57.676585 17689 tablet_bootstrap.cc:492] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:57.660169 17977 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:57.704618 10974 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:57.706634 10933 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:57.698000 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:57.691157 10831 catalog_manager.cc:5697] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:57.640440 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:57.705843 11076 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 23.
I20260709 12:22:57.711689 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:57.713212 10901 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:57.514183 17781 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:57.717048 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 56398.6us
I20260709 12:22:57.731063 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.731618 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.732401 10936 raft_consensus.cc:2393] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 21: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:22:57.732666 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:57.736276 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 86536.5us
I20260709 12:22:57.705703 17762 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:22:57.714463 17631 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.717769 17977 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:57.747296 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.748046 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.751760 10936 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 21. Current term is 22. Ops: []
I20260709 12:22:57.753628 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.748171 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.759258 18009 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:57.728780 17525 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:57.676291 17683 consensus_queue.cc:260] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.766134 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.769309 10932 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:22:57.756767 10831 catalog_manager.cc:5697] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:57.770414 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 135255us
I20260709 12:22:57.750933 17946 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:57.750748 17947 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:22:57.763180 17525 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:57.783622 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:57.786335 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.790273 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:22:57.777133 11624 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.66:41383 timed out after 2.180s (SENT) [suppressed 16 similar messages]
W20260709 12:22:57.791074 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:57.791575 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.790934 10930 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:57.790163 10831 catalog_manager.cc:5697] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 12 to 15, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 15 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:22:57.765333 18006 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:57.787353 17525 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:57.805032 17781 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:57.805660 17772 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:22:57.805958 10974 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:57.806201 17772 raft_consensus.cc:697] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:57.806864 10974 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
W20260709 12:22:57.811172 18000 log.cc:927] Time spent T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 1.042s	user 0.003s	sys 0.000s
I20260709 12:22:57.812740 17689 tablet_bootstrap.cc:492] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:22:57.814046 17689 ts_tablet_manager.cc:1403] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 2.857s	user 0.048s	sys 0.039s
I20260709 12:22:57.792569 17683 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:57.793222 17947 raft_consensus.cc:697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:57.820828 11082 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 12:22:57.815732 11003 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:57.811667 17740 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:57.821723 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.811739 17726 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:57.792292 17631 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:57.807282 17772 consensus_queue.cc:237] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.833791 10831 catalog_manager.cc:5697] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 12 to 14, leader changed from 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 14 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:22:57.831367 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.824939 17976 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:57.832799 10932 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:22:57.825645 17845 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.827471 17740 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:57.823271 18009 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:57.852777 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:57.868052 10936 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:22:57.818379 18006 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.869112 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:57.873517 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:57.828212 17974 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:22:57.875391 11081 raft_consensus.cc:2410] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 12:22:57.869870 10831 catalog_manager.cc:5697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:22:57.838974 17726 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:57.885254 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:57.872052 17740 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:57.897818 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:57.881821 17726 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:57.881721 17827 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:57.868345 17845 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:57.909902 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 132802us
I20260709 12:22:57.915977 11082 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:22:57.918365 17689 raft_consensus.cc:359] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:22:57.900301 17917 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:57.924817 18042 log.cc:927] Time spent T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
W20260709 12:22:57.928932 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.898458 18009 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:57.934473 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.919286 17689 raft_consensus.cc:740] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:22:57.935958 11653 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:57.938669 18010 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.939288 18010 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:57.941404 18010 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:57.876106 17947 consensus_queue.cc:237] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:22:57.952226 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.939232 18009 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:57.914335 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 107552us
W20260709 12:22:57.956758 18048 log.cc:927] Time spent T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:22:57.961942 10977 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:57.964257 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:57.970420 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:57.971149 11081 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:22:57.972679 10930 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:22:57.956307 18010 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:22:57.975476 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:57.977969 10977 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:57.974574 10974 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:57.989225 10974 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:57.997422 11006 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
W20260709 12:22:58.001283 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:58.002540 18049 log.cc:927] Time spent T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:22:58.006245 11010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3908) took 1173 ms. Trace:
I20260709 12:22:58.010056 17939 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:58.013305 18011 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:58.015730 11654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59414 (request call id 504) took 2213 ms (client timeout 2214 ms). Trace:
W20260709 12:22:58.016230 11654 rpcz_store.cc:269] 0709 12:22:55.802427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.802579 (+   152us) service_pool.cc:224] Handling call
0709 12:22:58.015469 (+2212890us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b540082e954. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:58.015636 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1982157696}
I20260709 12:22:58.020556 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:58.022156 17670 raft_consensus.cc:3055] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:22:58.022604 17670 raft_consensus.cc:740] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:57.981616 17917 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:22:58.023475 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3905) took 1580 ms. Trace:
I20260709 12:22:58.024190 18006 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:58.023893 11008 rpcz_store.cc:276] 0709 12:22:56.443427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.817962 (+374535us) service_pool.cc:224] Handling call
0709 12:22:56.818453 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.884733 (+ 66280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:58.023210 (+1138477us) spinlock_profiling.cc:243] Waited 64.1 ms on lock 0x7b54000de3d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:58.023411 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147383680}
I20260709 12:22:58.006739 11010 rpcz_store.cc:276] 0709 12:22:56.832878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.073529 (+240651us) service_pool.cc:224] Handling call
0709 12:22:57.076562 (+  3033us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:57.123077 (+ 46515us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:22:57.123460 (+   383us) log.cc:844] Serialized 14 byte log entry
0709 12:22:57.239635 (+116175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:57.239692 (+    57us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:22:57.245294 (+  5602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:58.005957 (+760663us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b5400243454. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:58.006009 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:58.006167 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":515,"prepare.queue_time_us":192,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":2776,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":23657,"spinlock_wait_cycles":96170880,"thread_start_us":115631,"threads_started":1,"wal-append.queue_time_us":180233}
W20260709 12:22:58.031443 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:58.037330 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 48186.1us
I20260709 12:22:57.996694 17520 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:22:58.035439 17726 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:58.046267 17726 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:58.047457 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:58.041159 17762 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:58.060724 17762 raft_consensus.cc:697] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:58.061872 17762 consensus_queue.cc:237] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:58.067701 11005 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41098 (request call id 610) took 1714 ms (client timeout 2180 ms). Trace:
W20260709 12:22:58.068276 11005 rpcz_store.cc:269] 0709 12:22:56.353616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.353750 (+   134us) service_pool.cc:224] Handling call
0709 12:22:58.067297 (+1713547us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b540029d1d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:58.067489 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328884480}
I20260709 12:22:58.070137 17722 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:58.073436 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 95548.2us
I20260709 12:22:58.074703 10977 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:58.031213 17781 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.081557 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:58.083948 11082 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:58.086539 10977 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:58.083345 10974 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:58.042141 18016 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:57.974869 17689 consensus_queue.cc:260] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:22:58.093611 17979 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:22:58.086771 17416 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.094570 17416 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.093495 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:58.073056 17520 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:58.104980 10901 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:58.106280 10977 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:58.086673 17726 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:58.089682 17631 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:58.117978 10933 raft_consensus.cc:2468] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 17.
W20260709 12:22:58.122153 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 81803.9us
I20260709 12:22:58.124459 11625 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:58.129592 17552 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17.
I20260709 12:22:58.130004 17416 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:58.130770 17740 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.132771 17929 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:22:58.133406 17929 raft_consensus.cc:697] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:58.097644 17520 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:22:58.084077 17880 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.130646 17525 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.137714 18050 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:58.138234 17883 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:22:58.139618 11005 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:22:58.140688 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:58.147426 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:58.086668 17241 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:22:58.142242 11006 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22. Ops: []
W20260709 12:22:58.148337 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.108417 17917 raft_consensus.cc:2764] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 12:22:58.150789 11083 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:58.158771 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:58.159121 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:58.152333 10977 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:58.160382 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:58.159647 11011 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:22:58.129812 17822 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:58.159848 11009 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:22:58.133087 17740 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:58.157037 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 45970.6us
I20260709 12:22:58.173000 18062 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:58.175051 18068 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:22:58.204847 10974 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:58.208019 11004 raft_consensus.cc:1813] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Handling vote request from an unknown peer 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:58.107573 17781 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.147145 18050 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.210709 11004 raft_consensus.cc:2410] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 16 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:22:58.219972 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 44131.1us
I20260709 12:22:58.225656 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:58.226377 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:58.227002 10930 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:58.228272 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:58.230839 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 49659.6us
W20260709 12:22:58.234129 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 109885us
I20260709 12:22:58.239663 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 3923) took 1016 ms. Trace:
I20260709 12:22:58.239468 10974 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:58.179302 17241 consensus_queue.cc:1243] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 1abf4b385a2b493ab83f593a1f8c9cd1 log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:22:58.176919 17772 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:58.236968 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:58.240190 11003 rpcz_store.cc:276] 0709 12:22:57.223058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.362004 (+138946us) service_pool.cc:224] Handling call
0709 12:22:58.239469 (+877465us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b540012b1d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:58.239597 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1019623168}
I20260709 12:22:58.250370 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:58.250931 10901 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:58.134370 17929 consensus_queue.cc:237] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.222260 18068 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.134917 17670 consensus_queue.cc:260] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.231978 17627 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.258621 11083 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:58.237836 17740 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:58.264468 10930 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:58.231217 18050 raft_consensus.cc:3060] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:58.237417 18060 raft_consensus.cc:2804] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:58.245292 17979 raft_consensus.cc:697] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:58.266705 18068 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:22:58.261631 17822 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:22:58.209772 18070 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.093s
I20260709 12:22:58.285420 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:58.287151 17248 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.134s
W20260709 12:22:58.287600 18054 log.cc:927] Time spent T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 12:22:58.288636 18052 log.cc:927] Time spent T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:22:58.274396 17740 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:58.296629 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:58.262190 17660 consensus_queue.cc:1059] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:22:58.281893 17670 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:22:58.302637 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.298645 11009 raft_consensus.cc:1240] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 20. Current term is 21. Ops: []
I20260709 12:22:58.304723 18072 consensus_queue.cc:1059] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 12:22:58.305683 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:58.306371 17660 raft_consensus.cc:3055] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:22:58.266229 17772 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.258453 18063 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 12:22:58.281004 17822 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:58.313449 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:58.282083 18060 raft_consensus.cc:697] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:22:58.274190 17627 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.316342 11077 raft_consensus.cc:2393] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 17: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:58.278535 18061 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.180s
I20260709 12:22:58.303125 17740 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:58.325392 10933 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:58.313797 17660 raft_consensus.cc:740] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:58.336685 11005 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:58.316916 17822 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:58.313529 17756 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:58.340502 10933 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:22:58.319140 17872 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:58.342572 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:58.349092 11657 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 LEARNER]: Advancing to term 14
I20260709 12:22:58.352126 17976 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:58.352685 17976 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:58.353191 17689 ts_tablet_manager.cc:1434] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.539s	user 0.006s	sys 0.006s
W20260709 12:22:58.353554 17689 ts_tablet_manager.cc:1467] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce: Tablet startup took 539ms
I20260709 12:22:58.358376 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:58.361150 17660 consensus_queue.cc:260] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:58.362428 17683 consensus_meta.cc:287] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.001s
I20260709 12:22:58.361219 17979 consensus_queue.cc:237] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.343353 17525 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:58.367141 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:58.368006 11084 raft_consensus.cc:2393] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:58.368332 17872 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.368811 17872 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:58.368911 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:58.370385 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:22:58.344645 18014 consensus_meta.cc:287] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.643s	user 0.008s	sys 0.004s
I20260709 12:22:58.371402 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:58.371557 18014 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:58.373471 18059 log.cc:927] Time spent T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:22:58.373799 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:58.374035 18014 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:58.361688 17845 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:58.376358 17880 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:58.377905 10901 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:58.378208 11078 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:22:58.379266 10901 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:58.380182 10901 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:58.358170 17827 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:58.382562 11006 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:22:58.382884 17873 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:22:58.383344 17873 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.384639 18075 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:58.384408 18060 consensus_queue.cc:237] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:58.385418 18075 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:58.385800 18075 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:58.386165 18075 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:58.389096 18016 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.389283 11050 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:58.389644 18016 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.391708 17904 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.392300 17904 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.393663 17908 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.395737 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:58.396556 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:58.397264 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:58.398425 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:58.399075 11081 raft_consensus.cc:2393] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 20: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:22:58.401295 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.397418 11077 raft_consensus.cc:2410] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:22:58.401888 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:58.406744 11654 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 18: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:22:58.383671 17873 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:22:58.378580 17880 consensus_queue.cc:1059] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:22:58.409439 17880 raft_consensus.cc:3055] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:22:58.362353 17660 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:58.406258 11077 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 12:22:58.380378 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:58.421067 11076 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22. Ops: []
I20260709 12:22:58.422986 11003 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:22:58.427606 11003 raft_consensus.cc:1240] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:58.425918 11050 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:58.428877 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.428676 11050 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:58.433490 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:58.451361 11004 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:58.442677 11050 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:58.455164 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:58.409970 17880 raft_consensus.cc:740] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:58.458109 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:58.461153 11084 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:22:58.426951 17977 consensus_meta.cc:287] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.655s	user 0.008s	sys 0.006s
I20260709 12:22:58.463352 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:58.460837 10901 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:58.459488 17724 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:22:58.469311 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:58.470829 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 162608us
I20260709 12:22:58.394268 17908 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:58.465323 11050 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:58.474375 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:58.454095 18014 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:22:58.441920 17796 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.478330 10930 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:22:58.480630 11081 raft_consensus.cc:2393] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 23: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:58.453797 17630 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:22:58.464097 17946 consensus_meta.cc:287] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.678s	user 0.007s	sys 0.006s
I20260709 12:22:58.460479 17917 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.483554 10977 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:58.491029 11085 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:22:58.473308 17939 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:58.493338 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:58.495898 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:58.476006 17631 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:58.481420 18014 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.469425 17724 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.490609 18011 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:58.488536 17630 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.510063 11082 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:22:58.475241 17525 consensus_queue.cc:1059] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:22:58.470043 17977 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.511900 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:22:58.353864 17689 ts_tablet_manager.cc:1469] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce: Trace:
0709 12:22:48.489894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.490018 (+   124us) service_pool.cc:224] Handling call
0709 12:22:48.744456 (+254438us) ts_tablet_manager.cc:934] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109)
0709 12:22:52.025995 (+3281539us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:22:52.451714 (+425719us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:52.451834 (+   120us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:22:52.641735 (+189901us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:22:52.642041 (+   306us) tablet_replica.cc:206] Creating consensus instance
0709 12:22:52.642375 (+   334us) ts_tablet_manager.cc:989] Replica registered.
0709 12:22:52.642439 (+    64us) inbound_call.cc:177] Queueing success response
0709 12:22:52.831213 (+188774us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b1800463780. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:22:54.956811 (+2125598us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:22:57.814455 (+2857644us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:22:57.915763 (+101308us) tablet_replica.cc:261] Starting instrumentation
0709 12:22:57.916423 (+   660us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":334,"mutex_wait_us":5265,"raft.queue_time_us":4243,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":9794,"spinlock_wait_cycles":12934400,"tablet-copy.queue_time_us":73978,"tablet-download-pool.queue_time_us":168,"tablet-download-pool.run_cpu_time_us":1506,"tablet-download-pool.run_wall_time_us":1231796,"thread_start_us":57887,"threads_started":2}
I20260709 12:22:58.517154 11010 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:22:58.518828 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:58.498679 17726 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:58.518323 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:58.511059 18014 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:22:58.527251 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:58.528689 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 62932.7us
I20260709 12:22:58.533264 11009 raft_consensus.cc:2393] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 20: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:58.492758 17917 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.534096 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:58.492547 17796 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.516424 17630 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:58.538460 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:58.517573 18016 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:58.538828 11002 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 20. Current term is 21. Ops: []
I20260709 12:22:58.523480 17627 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:58.552739 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:58.521024 18011 raft_consensus.cc:697] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:58.557281 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:58.557965 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:58.560282 18080 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:58.560009 18036 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 12:22:58.561005 17683 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:58.564268 17968 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.565009 10931 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:22:58.566461 17946 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:22:58.567368 17772 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:58.532373 17877 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:58.569427 11083 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:58.557303 18076 consensus_queue.cc:1059] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.078s
W20260709 12:22:58.571767 18047 log.cc:927] Time spent T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.614s	user 0.003s	sys 0.002s
I20260709 12:22:58.577606 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:58.578436 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:58.538793 17904 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:58.575523 11080 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:22:58.576061 11010 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:58.551635 17927 raft_consensus.cc:3055] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:58.509922 17880 consensus_queue.cc:260] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.578161 18080 raft_consensus.cc:697] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:58.602106 11084 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:22:58.603628 17877 raft_consensus.cc:697] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:58.604755 17877 consensus_queue.cc:237] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.609341 11081 raft_consensus.cc:1240] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 20. Current term is 21. Ops: []
I20260709 12:22:58.611080 11622 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:58.580739 18005 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.582716 17631 raft_consensus.cc:697] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:22:58.620375 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.624065 11051 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:58.624747 11622 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:58.628245 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 94073.9us
I20260709 12:22:58.598536 17927 raft_consensus.cc:740] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:58.639892 17781 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:58.630267 11622 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:58.642145 18011 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.645823 11006 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:22:58.649535 17873 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.651189 18075 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.592011 17968 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:58.620560 17832 raft_consensus.cc:3055] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:22:58.583398 17683 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.656361 17908 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:58.584604 17976 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:58.654047 11076 raft_consensus.cc:1275] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:22:58.686049 11084 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:22:58.688925 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 44824.7us
W20260709 12:22:58.687515 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:58.688385 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 58217.4us
I20260709 12:22:58.656970 17965 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:58.708410 11622 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:58.692147 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 76902.4us
I20260709 12:22:58.630664 17880 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:58.626655 18076 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:22:58.693305 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 64404.7us
I20260709 12:22:58.695456 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:58.601662 17946 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:58.699301 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:58.688658 17897 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:58.690973 17904 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:58.624042 18005 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:58.745019 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.693468 17832 raft_consensus.cc:740] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
W20260709 12:22:58.758273 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:58.758826 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 50533.6us
I20260709 12:22:58.761307 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:58.762764 11004 raft_consensus.cc:1240] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:58.761673 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:58.764330 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:58.764400 11051 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:58.765143 10927 raft_consensus.cc:2368] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20.
I20260709 12:22:58.768563 11051 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:58.693256 17552 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:22:58.770406 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:58.771134 11006 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:22:58.772061 11005 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 21. Current term is 22. Ops: []
I20260709 12:22:58.769254 18020 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.761965 18076 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:58.779771 18020 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.793494 18020 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:58.794027 17683 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:58.779230 10974 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:58.794441 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:58.795285 17726 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:22:58.795667 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:58.797015 10927 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 22. Current term is 23. Ops: []
I20260709 12:22:58.797444 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:58.798275 10927 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:58.799234 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:58.799513 10974 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:58.800400 17726 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:58.800835 17873 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:58.801559 17724 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:58.780460 18074 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:22:58.802461 10974 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:58.780624 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:58.803598 18075 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:58.786031 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:58.788100 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:58.804939 11076 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
W20260709 12:22:58.782742 18086 log.cc:927] Time spent T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 12:22:58.781203 17946 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:58.832990 11082 pending_rounds.cc:85] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 11
I20260709 12:22:58.833382 11082 pending_rounds.cc:107] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 12:22:58.833623 11082 raft_consensus.cc:2889] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:58.807811 10899 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:58.834144 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:58.835369 11006 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:58.835886 10899 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:58.798282 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:58.780072 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:58.790508 11051 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:58.841826 11006 raft_consensus.cc:1240] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:58.844161 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:58.844686 11078 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:22:58.844558 11011 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 19: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:22:58.845564 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 55144.6us
I20260709 12:22:58.843900 17552 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:58.849967 17552 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:58.850545 17552 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:58.852880 11654 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:22:58.854708 17726 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:22:58.847895 11079 raft_consensus.cc:1240] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:58.769649 17772 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.857179 17772 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:58.785566 17977 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:58.790688 17965 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:58.859509 17772 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:58.788007 18080 consensus_queue.cc:237] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.783944 17976 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:58.803603 17827 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:22:58.859529 17630 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.780282 10946 tablet_copy_service.cc:342] P 9e8170bbe8244e40a2b2e5011e69b697: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-80db8b3fbfd046e8a5535ff4a7380107 received from {username='slave'} at 127.0.0.1:53346
I20260709 12:22:58.884425 10946 tablet_copy_service.cc:434] P 9e8170bbe8244e40a2b2e5011e69b697: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-80db8b3fbfd046e8a5535ff4a7380107 on tablet 80db8b3fbfd046e8a5535ff4a7380107 with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:58.848896 17670 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:22:58.885708 17630 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:58.788250 17904 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
W20260709 12:22:58.889505 17872 consensus_meta.cc:287] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.001s
I20260709 12:22:58.890021 17872 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.890738 17904 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:58.747399 17927 consensus_queue.cc:260] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.892349 17968 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:58.893173 18095 consensus_queue.cc:1059] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:22:58.894114 18095 raft_consensus.cc:3055] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:58.802480 17917 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:58.894455 18095 raft_consensus.cc:740] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:58.789363 17631 consensus_queue.cc:237] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:58.872998 18068 consensus_meta.cc:287] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.576s	user 0.005s	sys 0.008s
I20260709 12:22:58.896261 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:58.891594 10932 raft_consensus.cc:2393] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 21: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:22:58.898239 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 50806.9us
I20260709 12:22:58.861289 17552 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.860992 11051 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:58.862502 11006 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:58.863830 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:22:58.864987 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 62587.3us
W20260709 12:22:58.891710 17520 consensus_meta.cc:287] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.715s	user 0.004s	sys 0.004s
I20260709 12:22:58.901304 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:58.901602 10974 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
W20260709 12:22:58.871300 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.872232 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:58.804539 18093 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.805015 18016 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:58.829416 18005 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:58.857035 17724 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:22:58.883639 17740 consensus_meta.cc:287] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.000s
W20260709 12:22:58.876855 17822 consensus_meta.cc:287] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.006s
I20260709 12:22:58.901703 17520 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.904636 18093 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.905035 17822 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.905815 10935 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:22:58.907249 17822 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:58.922050 17872 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:58.926407 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:58.927155 11009 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:58.897854 10929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:57884
W20260709 12:22:58.929826 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 82964us
I20260709 12:22:58.895287 18095 consensus_queue.cc:260] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.933729 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:58.937515 18014 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.938290 17552 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:58.907267 17917 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:22:58.939667 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:58.940352 11004 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:22:58.896257 18068 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.941394 11051 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:58.942435 18068 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:58.943413 18014 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:58.944078 18016 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:22:58.944445 11005 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:22:58.945689 18050 consensus_meta.cc:287] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.652s	user 0.012s	sys 0.000s
I20260709 12:22:58.945884 11051 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:58.946830 18016 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:58.948076 11051 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:58.904721 17740 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.950752 11051 leader_election.cc:400] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20.
I20260709 12:22:58.951051 11051 leader_election.cc:403] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:22:58.951128 17740 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:58.951457 18014 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:22:58.951892 18014 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:58.952328 18014 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:58.953393 17968 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:58.921715 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:58.955655 11005 raft_consensus.cc:1240] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:58.945629 10929 raft_consensus.cc:606] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:58.956432 10929 raft_consensus.cc:614] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:58.957378 11010 raft_consensus.cc:2393] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 14: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:58.962826 17520 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:58.965297 11004 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23.
I20260709 12:22:58.966701 11004 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22. Ops: []
I20260709 12:22:58.968117 11004 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:22:58.969236 11004 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 22. Current term is 23. Ops: []
I20260709 12:22:58.970659 11010 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:22:58.971002 17917 raft_consensus.cc:697] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:58.973508 17724 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:58.983106 17927 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:58.986311 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60046 (request call id 3573) took 1103 ms. Trace:
I20260709 12:22:58.986757 11085 rpcz_store.cc:276] 0709 12:22:57.882631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.882845 (+   214us) service_pool.cc:224] Handling call
0709 12:22:58.986151 (+1103306us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b54000c21d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:58.986250 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1362554752}
I20260709 12:22:58.987998 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:58.974936 18016 consensus_queue.cc:1059] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:58.975965 18050 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:58.976293 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:58.958840 10974 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:58.996703 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:58.990351 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.990545 11009 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:22:58.954521 17885 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:58.975637 18011 consensus_queue.cc:1059] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:22:58.978679 11006 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:58.989316 17917 consensus_queue.cc:237] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:58.997030 10974 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:59.001305 11008 raft_consensus.cc:2368] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17.
I20260709 12:22:59.001577 11076 raft_consensus.cc:2393] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 17: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:58.993180 10899 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:59.012799 17822 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:59.013250 17822 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.013597 17822 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:59.016227 17976 consensus_queue.cc:1059] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:59.017151 17976 raft_consensus.cc:3055] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:59.017478 17976 raft_consensus.cc:740] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:59.017992 18011 raft_consensus.cc:3055] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:59.018270 17976 consensus_queue.cc:260] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:58.996309 18073 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 12:22:59.019511 17976 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:59.016484 18050 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:59.020664 17772 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:59.021174 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:58.997984 17977 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:22:59.023607 11050 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:22:59.025632 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.026885 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:59.032203 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:59.050156 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:58.996227 18074 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 12:22:59.098269 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:59.109678 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 86237.1us
I20260709 12:22:59.022454 18011 raft_consensus.cc:740] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:59.111900 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:59.117873 11077 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
W20260709 12:22:59.117014 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 93496.3us
I20260709 12:22:59.119385 11050 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:59.121112 10899 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:59.121907 11085 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 21. Current term is 22. Ops: []
I20260709 12:22:59.122887 17927 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:59.123194 18005 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.122943 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:59.125775 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:59.128489 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:59.129316 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:59.131443 11077 raft_consensus.cc:2393] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 24: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:59.132861 11050 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:59.022594 18014 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:59.136272 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:59.113759 17756 raft_consensus.cc:3055] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:22:59.136749 10899 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:22:59.146778 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:59.138696 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:59.030468 18016 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 12:22:59.150285 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3931) took 1006 ms. Trace:
I20260709 12:22:59.096917 17979 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.094s
I20260709 12:22:59.150662 11002 rpcz_store.cc:276] 0709 12:22:58.144162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.144279 (+   117us) service_pool.cc:224] Handling call
0709 12:22:58.168487 (+ 24208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:58.544091 (+375604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:59.150047 (+605956us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b540012c0d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:59.150227 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":851400960}
I20260709 12:22:59.156169 18011 consensus_queue.cc:260] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:59.157721 18011 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:59.166685 18094 log.cc:927] Time spent T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.382s	user 0.000s	sys 0.002s
I20260709 12:22:59.172736 17927 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:59.173485 17927 raft_consensus.cc:697] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:59.174744 17927 consensus_queue.cc:237] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:59.130421 17630 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:22:59.182029 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 3925) took 1041 ms. Trace:
I20260709 12:22:59.182497 11008 rpcz_store.cc:276] 0709 12:22:58.140287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.140410 (+   123us) service_pool.cc:224] Handling call
0709 12:22:59.181792 (+1041382us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b540029d1d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:59.181958 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1956343552}
I20260709 12:22:59.145627 11006 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:59.147625 11004 raft_consensus.cc:2393] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 24: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:22:59.149678 10899 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:59.141250 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:22:59.193109 11080 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 3758) took 1802 ms (client timeout 1896 ms). Trace:
W20260709 12:22:59.193542 11080 rpcz_store.cc:269] 0709 12:22:57.390510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.395975 (+  5465us) service_pool.cc:224] Handling call
0709 12:22:59.192954 (+1796979us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540044d4d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:22:59.193055 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2675958144}
I20260709 12:22:59.195960 18014 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:59.196703 18093 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:22:59.197582 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 47988.6us
I20260709 12:22:59.137795 17965 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:22:59.172968 18103 log.cc:927] Time spent T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.393s	user 0.001s	sys 0.000s
I20260709 12:22:59.198349 10899 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:59.140437 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:22:59.204263 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 71506.3us
I20260709 12:22:59.206250 11050 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:59.207545 11050 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:59.207628 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:59.208739 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:59.211385 11082 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 12:22:59.211839 11082 pending_rounds.cc:85] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 12
I20260709 12:22:59.212075 11082 pending_rounds.cc:107] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 12:22:59.212462 11082 raft_consensus.cc:2889] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:59.212955 11080 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 20. Current term is 21. Ops: []
I20260709 12:22:59.213634 18073 consensus_queue.cc:1048] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:22:59.213837 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:59.248581 11082 raft_consensus.cc:2393] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:59.214733 17968 raft_consensus.cc:3055] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:22:59.249482 17968 raft_consensus.cc:740] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:59.250411 17968 consensus_queue.cc:260] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:59.213907 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:59.251603 17968 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:22:59.254673 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.215734 17670 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:22:59.190281 17724 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20.
I20260709 12:22:59.209301 11085 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:22:59.260679 11051 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:59.262835 17630 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:59.263279 17630 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.263620 17630 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:59.218684 17726 consensus_queue.cc:1059] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:22:59.218973 18046 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:22:59.270018 17796 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:22:59.270661 18109 log.cc:927] Time spent T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.152s	user 0.002s	sys 0.000s
I20260709 12:22:59.219441 18014 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:59.273061 10934 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:22:59.274726 10934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3460) took 2096 ms. Trace:
I20260709 12:22:59.275072 10934 rpcz_store.cc:276] 0709 12:22:57.178379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.178510 (+   131us) service_pool.cc:224] Handling call
0709 12:22:57.178945 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:59.273450 (+2094505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:59.274437 (+   987us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b54001a7cd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:22:59.274645 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4815183744}
I20260709 12:22:59.275938 18004 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.276451 18004 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:59.276825 11079 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:22:59.277245 11005 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:22:59.282910 11080 raft_consensus.cc:2410] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 12:22:59.234836 18095 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:59.237088 18060 consensus_queue.cc:1059] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:22:59.123661 18005 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:59.289803 18005 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:59.292174 17832 consensus_queue.cc:260] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:59.208956 18093 raft_consensus.cc:2764] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:22:59.295966 18004 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:59.146047 17756 raft_consensus.cc:740] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:22:59.304396 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 96912.4us
I20260709 12:22:59.305634 11050 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:59.296296 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:59.259718 10901 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:59.317126 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 57484.8us
I20260709 12:22:59.319262 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:59.321282 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:59.322793 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:59.325220 11084 raft_consensus.cc:2368] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20.
I20260709 12:22:59.325716 11050 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:59.326792 18004 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.293792 17832 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:22:59.329823 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:59.337736 11079 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:22:59.340565 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:59.339130 11005 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:59.327327 18004 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:59.343463 11050 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:59.347132 11050 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:59.353827 10977 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:59.328873 18005 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:59.336452 17968 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:59.351480 11006 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:22:59.338472 17772 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:22:59.342083 18093 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.327000 17726 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:22:59.377463 11050 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:59.383410 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:59.390497 18016 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:22:59.390924 18016 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.391428 17947 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:59.391261 18016 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:22:59.355743 18046 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:59.355013 17796 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:59.394284 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:59.399387 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:22:59.399730 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:59.394410 10901 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:59.400807 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:59.391248 10977 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:59.401798 10901 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:59.344913 18073 consensus_queue.cc:1059] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:22:59.400075 10929 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:22:59.361092 17965 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:59.399215 11650 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:22:59.412598 10928 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:22:59.408654 10900 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:59.377748 17885 consensus_queue.cc:1059] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 12:22:59.360988 17822 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:59.415251 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:59.415851 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:59.417739 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:59.426301 10930 raft_consensus.cc:2393] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 20: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:22:59.418463 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:59.426427 10936 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:22:59.420254 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:22:59.421804 10928 raft_consensus.cc:1275] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:22:59.397995 17796 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.427424 11050 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:59.391319 18004 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:59.396962 17772 raft_consensus.cc:697] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:59.405972 17552 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:22:59.406154 17627 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:59.396052 18091 consensus_queue.cc:1059] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:22:59.396330 17670 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:22:59.438349 11050 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:59.439220 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:22:59.439946 11011 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:59.432880 18108 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:59.494087 18108 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.494546 18108 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:59.452564 17946 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.500231 17946 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:59.500689 17827 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:22:59.396227 17660 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:22:59.502162 18091 raft_consensus.cc:3055] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:22:59.502530 18091 raft_consensus.cc:740] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:59.503533 17968 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:22:59.434563 17796 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:22:59.459736 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.422875 17525 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.396595 18093 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:59.487174 10901 leader_election.cc:400] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17.
I20260709 12:22:59.501791 17552 raft_consensus.cc:697] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:59.420709 10899 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:59.504845 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 66570.6us
I20260709 12:22:59.426106 18005 consensus_queue.cc:1059] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 12:22:59.460449 17965 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:22:59.507210 17627 raft_consensus.cc:697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:59.510661 17525 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:59.507290 18014 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:59.512905 17756 consensus_queue.cc:260] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:59.519518 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 98904.3us
I20260709 12:22:59.551996 10899 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:22:59.509857 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 74262.4us
I20260709 12:22:59.431197 18046 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 12:22:59.503376 18091 consensus_queue.cc:260] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:59.567732 10899 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:22:59.522576 17683 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:59.584878 10936 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 24.
I20260709 12:22:59.589969 17781 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.596774 17781 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:59.596921 17630 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:59.599558 11079 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:22:59.549978 18014 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:59.582737 17872 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:59.542014 18108 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:59.566614 17660 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:22:59.587734 18091 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:22:59.587302 17756 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:22:59.625761 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.610819 17630 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:59.606015 17670 consensus_queue.cc:1059] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
W20260709 12:22:59.655390 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 436803us
I20260709 12:22:59.656301 10974 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:22:59.646901 17520 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.033s	sys 0.031s
I20260709 12:22:59.613186 17872 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:22:59.574502 17772 consensus_queue.cc:237] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:59.674373 18011 consensus_meta.cc:287] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.516s	user 0.012s	sys 0.000s
W20260709 12:22:59.673691 17520 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.033s	sys 0.031s
I20260709 12:22:59.607789 17552 consensus_queue.cc:237] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:59.673950 17974 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:59.676185 17872 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:59.686925 17917 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.016s	sys 0.012s
W20260709 12:22:59.683423 17631 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.021s	sys 0.016s
I20260709 12:22:59.636736 17627 consensus_queue.cc:237] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:59.688081 17822 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:59.686383 17927 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:22:59.696770 17917 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.016s	sys 0.012s
W20260709 12:22:59.696667 17631 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.022s	sys 0.016s
I20260709 12:22:59.694417 17974 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.705634 11006 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 12:22:59.714214 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:59.697731 17660 raft_consensus.cc:3055] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:59.717614 11007 raft_consensus.cc:1240] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 20. Current term is 21. Ops: []
I20260709 12:22:59.722131 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:22:59.723137 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:22:59.726105 18108 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:22:59.726513 17928 raft_consensus.cc:3055] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:22:59.723816 11008 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:22:59.727157 11009 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:22:59.711544 18093 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:59.716614 17974 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:59.720252 17660 raft_consensus.cc:740] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:59.726883 17928 raft_consensus.cc:740] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:59.729792 17525 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:22:59.728003 17927 raft_consensus.cc:697] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:59.761415 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:22:59.762094 11650 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:59.764212 18014 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:59.767849 11050 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:22:59.775875 11650 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:22:59.790944 10900 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:22:59.793624 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 402415us
W20260709 12:22:59.786082 18116 log.cc:927] Time spent T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:22:59.810475 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:22:59.785240 17904 raft_consensus.cc:3055] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:22:59.793121 17525 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:59.794754 18014 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:59.834139 11082 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:22:59.790402 18011 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:59.822800 17904 raft_consensus.cc:740] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:59.821825 18050 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:59.837360 11082 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 12:22:59.836786 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 269111us
W20260709 12:22:59.839581 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 256733us
I20260709 12:22:59.785161 17947 raft_consensus.cc:697] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:22:59.776258 17796 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:59.785645 17660 consensus_queue.cc:260] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:59.852523 11082 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:22:59.819739 18063 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 12:22:59.793612 17968 consensus_queue.cc:1059] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:22:59.837352 17525 raft_consensus.cc:697] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:22:59.859488 17947 consensus_queue.cc:237] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:59.860760 10901 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:22:59.858765 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:22:59.854689 18062 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:22:59.862016 18060 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 12:22:59.856770 17927 consensus_queue.cc:237] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:59.794207 17928 consensus_queue.cc:260] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:59.920413 18126 log.cc:927] Time spent T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:22:59.920774 17928 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:22:59.853777 17520 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.922821 17520 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:59.925136 17520 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:22:59.925652 18112 log.cc:927] Time spent T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:22:59.928440 17968 raft_consensus.cc:3055] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:22:59.928637 17630 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:59.928918 17968 raft_consensus.cc:740] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:59.929263 17630 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:59.843978 18014 raft_consensus.cc:697] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:22:59.917502 17904 consensus_queue.cc:260] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:22:59.929634 18016 consensus_meta.cc:287] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.000s
I20260709 12:22:59.897547 18011 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:22:59.931614 17630 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:22:59.936378 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:22:59.942238 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:22:59.939337 11076 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 21. Current term is 22. Ops: []
I20260709 12:22:59.942881 11078 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:59.937896 17670 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:22:59.945628 18060 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:22:59.947237 17904 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:59.929774 17968 consensus_queue.cc:260] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:59.941933 18016 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:59.982069 17915 raft_consensus.cc:3055] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:23:00.018661 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 159987us
W20260709 12:23:00.057516 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 50515.6us
W20260709 12:23:00.058141 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 113544us
I20260709 12:22:59.978412 17670 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:22:59.998840 18133 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:23:00.017822 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 157116us
I20260709 12:22:59.999269 18004 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:00.065464 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.009047 17915 raft_consensus.cc:740] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:23:00.067615 10927 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:00.012079 17772 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.069305 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:00.015377 17781 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:00.013264 17627 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:00.057106 17968 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:00.072978 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:00.009891 18139 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:00.068105 10899 leader_election.cc:400] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20.
I20260709 12:22:59.994647 18060 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:00.091248 10930 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:22:59.982800 17525 consensus_queue.cc:237] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:00.061666 18128 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:00.067981 17822 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:23:00.140987 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:00.079530 18095 consensus_meta.cc:287] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.794s	user 0.004s	sys 0.008s
W20260709 12:23:00.112299 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.111744 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:00.151181 10933 raft_consensus.cc:2410] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:23:00.142925 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:00.091998 10899 leader_election.cc:403] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:23:00.111361 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:00.148912 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:00.149572 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:00.154731 10930 raft_consensus.cc:2393] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 24: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:00.154269 10928 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:23:00.154748 10927 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:00.155484 10936 raft_consensus.cc:2410] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:23:00.161646 10929 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:23:00.167887 10928 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:23:00.056934 18014 consensus_queue.cc:237] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:00.074807 18004 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:00.176543 11009 raft_consensus.cc:1240] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 13. Current term is 14. Ops: []
W20260709 12:23:00.152729 17832 consensus_meta.cc:287] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.807s	user 0.010s	sys 0.003s
I20260709 12:23:00.086403 18139 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.158613 17822 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:00.187356 17740 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:00.187937 17883 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:23:00.188719 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 123774us
I20260709 12:23:00.153805 17630 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:00.067836 18133 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:00.176158 17756 consensus_meta.cc:287] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.532s	user 0.008s	sys 0.003s
W20260709 12:23:00.176493 18091 consensus_meta.cc:287] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.002s
I20260709 12:23:00.198663 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:00.200680 10899 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:00.203507 10930 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
W20260709 12:23:00.204090 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.205958 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:00.206799 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.206650 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:00.208993 17552 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:00.203293 17724 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.086402 17772 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:00.215960 17724 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:00.218267 18147 log.cc:927] Time spent T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:23:00.218508 17946 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:00.219946 18060 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:00.200345 17883 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:00.251658 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:00.252944 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:00.197249 17740 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:00.255453 17740 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:00.180280 17872 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:00.257628 17872 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:00.258311 10930 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 14.
I20260709 12:23:00.258944 18004 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:00.228875 18146 log.cc:927] Time spent T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.052s	user 0.002s	sys 0.000s
W20260709 12:23:00.229640 18144 log.cc:927] Time spent T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:23:00.233183 17915 consensus_queue.cc:260] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:00.224385 18136 log.cc:927] Time spent T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 12:23:00.236138 11657 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 12:23:00.225250 18143 log.cc:927] Time spent T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:23:00.255411 17822 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:00.193620 18139 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:00.245945 18125 log.cc:927] Time spent T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.412s	user 0.000s	sys 0.003s
I20260709 12:23:00.247711 11085 raft_consensus.cc:1240] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:00.248647 11076 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 12:23:00.249275 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:00.249948 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:00.250922 10977 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:00.276803 10977 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:00.277901 10977 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:00.253127 17883 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:00.180018 17974 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:00.197367 17796 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:00.212565 17630 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:00.265391 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:00.304916 11084 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:23:00.215673 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:00.270138 10927 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:23:00.272794 11078 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:23:00.278605 11082 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:23:00.283890 11051 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:00.307974 11051 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:00.200699 18095 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 12:23:00.289785 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:00.315804 10928 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:00.292514 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:00.295921 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 114897us
I20260709 12:23:00.317170 10933 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:23:00.303402 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:00.309475 11051 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:00.285815 10977 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:00.319478 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:00.178081 18128 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:00.321759 11051 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:00.319849 11011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 3174) took 1739 ms. Trace:
I20260709 12:23:00.318289 11008 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:23:00.289045 17976 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:00.307753 17631 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20.
I20260709 12:23:00.287127 17756 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:23:00.332209 11011 rpcz_store.cc:276] 0709 12:22:58.580254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.848388 (+268134us) service_pool.cc:224] Handling call
0709 12:22:58.848672 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:59.493816 (+645144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:00.319618 (+825802us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b540029d6d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:00.319791 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1359312768}
I20260709 12:23:00.263772 18155 consensus_queue.cc:1059] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 12:23:00.377919 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:00.379016 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 93278.4us
I20260709 12:23:00.400815 10977 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:00.380259 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:00.305224 17827 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:23:00.377689 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:00.374693 18153 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:00.279753 17822 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
W20260709 12:23:00.404006 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.407837 10932 raft_consensus.cc:2410] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
W20260709 12:23:00.410106 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 77464.1us
I20260709 12:23:00.313834 17904 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:00.409129 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:00.413602 11011 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:00.313467 17946 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:23:00.376670 18125 log.cc:927] Time spent T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:23:00.328214 18005 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:00.327136 18142 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:00.322480 17552 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:00.327157 18160 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:00.374302 18016 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:00.379297 17796 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:00.400177 17977 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:00.427677 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:00.413111 18149 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.396304 18133 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:00.419996 18130 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:23:00.448207 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 126537us
I20260709 12:23:00.455993 10977 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:00.467516 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:00.468304 11002 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:23:00.438525 17796 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:00.449256 17525 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.442219 17904 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.456030 17552 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:00.425639 18135 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:23:00.482264 11051 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:00.502694 11051 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:00.485446 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:00.505314 11002 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:23:00.432436 18138 consensus_queue.cc:1059] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:23:00.482524 17796 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:00.441659 18142 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:00.464035 17885 consensus_queue.cc:1059] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:23:00.411507 18153 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:00.476317 18133 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:00.545312 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:00.488878 18130 raft_consensus.cc:697] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 24 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:00.545385 18169 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:00.570101 11005 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22. Ops: []
I20260709 12:23:00.448817 18160 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:00.460611 18149 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:00.499531 18016 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 12:23:00.508194 17946 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:23:00.490876 17525 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:00.499836 17904 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:00.572177 17772 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:00.605707 17976 raft_consensus.cc:1064] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:23:00.629269 18142 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:00.640760 11081 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 3605) took 1431 ms. Trace:
I20260709 12:23:00.641640 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60046 (request call id 3615) took 1302 ms. Trace:
W20260709 12:23:00.609172 18145 log.cc:927] Time spent T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
W20260709 12:23:00.629557 18178 log.cc:927] Time spent T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.058s	user 0.000s	sys 0.012s
I20260709 12:23:00.665861 11079 rpcz_store.cc:276] 0709 12:22:59.339728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:59.340570 (+   842us) service_pool.cc:224] Handling call
0709 12:23:00.641443 (+1300873us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54000e1d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:23:00.641571 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":481943296}
W20260709 12:23:00.666085 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 119321us
I20260709 12:23:00.629546 17724 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:00.665153 11081 rpcz_store.cc:276] 0709 12:22:59.209650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:59.229479 (+ 19829us) service_pool.cc:224] Handling call
0709 12:22:59.229927 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:59.230376 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:59.230726 (+   350us) log.cc:844] Serialized 14 byte log entry
0709 12:22:59.652463 (+421737us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:59.653117 (+   654us) log.cc:844] Serialized 26 byte log entry
0709 12:22:59.653377 (+   260us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:59.663736 (+ 10359us) log.cc:844] Serialized 14 byte log entry
0709 12:22:59.664050 (+   314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:59.664142 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:00.245375 (+581233us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:23:00.640481 (+395106us) raft_consensus.cc:1685] finished
0709 12:23:00.640510 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:00.640677 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4415,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":106,"raft.queue_time_us":18162,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":6585,"spinlock_wait_cycles":10090752,"thread_start_us":421396,"threads_started":1,"wal-append.queue_time_us":554568}
I20260709 12:23:00.674409 10932 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:23:00.677899 11011 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:23:00.679364 11051 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:00.680727 10974 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:00.668071 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:00.632752 18128 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:00.682787 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:23:00.684742 11624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.614037 17832 consensus_queue.cc:1048] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 12:23:00.681437 11076 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:23:00.688702 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:00.659898 17630 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:00.691313 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 86570.6us
I20260709 12:23:00.679653 17946 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:00.683151 17827 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.731477 18062 consensus_queue.cc:1059] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:23:00.735625 18016 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:00.735888 17552 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:00.731662 18080 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:23:00.736413 18062 raft_consensus.cc:3055] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:00.737738 18062 raft_consensus.cc:740] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:23:00.738080 17928 consensus_meta.cc:287] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.817s	user 0.011s	sys 0.001s
I20260709 12:23:00.738652 18062 consensus_queue.cc:260] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:00.739558 18149 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:00.739845 18062 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:00.740166 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:00.741379 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:00.741770 17904 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:00.673991 18169 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:23:00.742436 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:00.743041 11079 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:23:00.702854 18130 consensus_queue.cc:237] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:00.746217 17525 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:00.734475 17946 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:00.750499 17946 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:00.750946 17827 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:00.753232 17827 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:00.736510 18183 log.cc:927] Time spent T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 12:23:00.759801 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:00.736622 18164 log.cc:927] Time spent T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:23:00.767341 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:00.768517 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:00.769577 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:00.769706 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:00.770810 18138 raft_consensus.cc:3055] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:00.771272 18138 raft_consensus.cc:740] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:00.772106 18138 consensus_queue.cc:260] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:00.773335 18138 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:00.775677 17772 raft_consensus.cc:3055] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:23:00.776113 17772 raft_consensus.cc:740] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:00.776957 18160 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:00.777712 17974 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:00.748970 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.777702 18174 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.782356 18174 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:00.735915 18166 log.cc:927] Time spent T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:23:00.785759 17627 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.786294 17627 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:00.753280 17660 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:00.788372 17627 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:00.789297 18135 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.789790 18135 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:00.790095 10901 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:00.790457 18011 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:00.794726 18139 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:00.797379 10936 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 18: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:23:00.798525 17968 consensus_meta.cc:287] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.712s	user 0.011s	sys 0.000s
I20260709 12:23:00.799022 18174 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:00.799531 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:00.800215 11010 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 15.
I20260709 12:23:00.802529 11624 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:00.803838 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:00.807634 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:00.808059 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 78644.7us
I20260709 12:23:00.809059 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:00.810024 11051 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:00.810304 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:00.811142 11079 raft_consensus.cc:2393] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 22: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:00.811666 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:00.812944 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:00.813556 10932 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:23:00.814033 17756 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:00.815025 17670 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:00.812498 17928 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:00.804533 18160 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:00.812124 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:00.818153 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:00.807233 17974 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.818771 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:00.892563 11011 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:23:00.819941 11051 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:00.893144 11006 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:23:00.812656 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:00.811682 10901 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:00.889299 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:00.894860 11005 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
W20260709 12:23:00.893661 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 73848.2us
I20260709 12:23:00.791796 18135 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:00.825774 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:00.827013 11079 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 12:23:00.903132 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:00.888695 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:23:00.888932 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 72076us
I20260709 12:23:00.900002 11003 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:23:00.900605 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:00.905100 11010 raft_consensus.cc:2393] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 14: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:00.896389 11051 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:00.906243 10974 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:00.824595 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.903204 11079 pending_rounds.cc:85] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 12
W20260709 12:23:00.841809 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.909078 11079 pending_rounds.cc:107] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 12:23:00.909401 11079 raft_consensus.cc:2889] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:00.823046 17883 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.161s
I20260709 12:23:00.911671 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:23:01.061419 10931 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.015s	sys 0.018s
I20260709 12:23:00.957396 10899 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:23:00.987052 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 175426us
W20260709 12:23:00.995500 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 84130.7us
I20260709 12:23:01.066009 11050 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:00.980921 11005 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:23:00.960673 11079 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:35562
I20260709 12:23:01.081584 11079 raft_consensus.cc:606] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
W20260709 12:23:01.051369 10928 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.018s	sys 0.015s
W20260709 12:23:00.956667 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 138933us
W20260709 12:23:01.079510 10931 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.019s	sys 0.018s
W20260709 12:23:01.080468 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:01.084443 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 127146us
W20260709 12:23:01.086311 10928 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.018s	sys 0.020s
I20260709 12:23:01.085695 11079 raft_consensus.cc:614] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:01.080477 10901 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:01.038740 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:01.017520 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:01.005546 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:01.014015 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41098 (request call id 627) took 1758 ms. Trace:
I20260709 12:23:00.829350 17968 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:01.090765 11007 rpcz_store.cc:276] 0709 12:22:59.255505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:59.257085 (+  1580us) service_pool.cc:224] Handling call
0709 12:22:59.257475 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:59.720534 (+463059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:01.013734 (+1293200us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b540032d2d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:01.013945 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1057729408}
I20260709 12:23:00.829831 18139 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:00.899060 18185 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:01.098906 10974 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:00.898646 18016 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:00.902391 18005 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:00.994524 17977 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:01.097524 18046 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:23:00.888489 17756 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:00.897115 18160 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:00.983989 17965 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:00.912420 18134 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.191s
I20260709 12:23:01.091308 18174 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:01.091076 18169 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:23:01.107327 10974 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:01.107369 11654 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:23:00.776917 17772 consensus_queue.cc:260] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.101428 17904 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.956223 17822 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.154s
I20260709 12:23:00.990854 18152 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:01.112301 10901 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:01.087745 17630 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:01.098058 18153 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:01.091329 18004 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:00.902590 17974 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.109841 18005 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:01.124862 17827 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:01.125576 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:01.124274 10974 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:01.101584 18014 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:01.104359 17525 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:01.100114 17968 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:01.134563 10901 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:01.116577 18160 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:01.122222 17965 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.111348 18080 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:00.993599 18011 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:01.143501 10974 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:01.100574 11003 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 18: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:01.132912 18046 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:23:01.187189 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 43770.3us
I20260709 12:23:01.153314 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:01.111738 18016 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.188014 10974 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:23:01.189041 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 54564.6us
I20260709 12:23:01.196780 10901 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:01.130012 17977 raft_consensus.cc:697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:01.140489 18091 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:01.144268 18005 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:01.146211 17827 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.128549 17946 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.152661 17726 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:01.190917 11011 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
W20260709 12:23:01.143584 17796 consensus_meta.cc:287] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.001s
I20260709 12:23:01.131085 18152 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.145529 17525 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.268452 17525 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:01.223901 17827 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:01.106642 18185 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:01.152730 17968 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:01.271332 17796 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:01.275321 18152 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:01.280200 17915 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:01.223680 17627 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 12:23:01.143913 17630 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:01.226835 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:01.185279 17965 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:01.250015 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:01.192857 18128 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:01.152413 18014 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.135222 17904 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.143206 18174 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.087s
I20260709 12:23:01.203240 17917 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:23:01.258261 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:01.298162 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.258734 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:01.203280 18091 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.146318 18004 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.248013 18046 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:01.224014 17929 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:01.202356 10901 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:01.285468 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:01.227331 17724 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:01.192615 18011 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.289141 11005 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 18: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:01.251765 18190 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.294167 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:01.299481 11003 raft_consensus.cc:2393] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 20: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:23:01.309327 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 107038us
I20260709 12:23:01.286804 18149 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.301225 18091 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:01.310246 11080 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
W20260709 12:23:01.324658 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.301717 17822 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.327682 17822 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.330040 17822 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:01.322986 17927 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 12:23:01.331027 17976 consensus_queue.cc:237] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:01.333103 17772 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:01.304963 17631 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.340261 18073 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:01.310931 17724 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.351418 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:01.302173 17917 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:01.261057 17946 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:01.358700 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:01.364178 17827 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.308643 17929 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:01.372148 11079 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:35562
I20260709 12:23:01.372373 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:01.379240 11079 raft_consensus.cc:606] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:01.379706 11079 raft_consensus.cc:614] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:01.354404 18016 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:01.386899 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:01.387203 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:01.387979 11003 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 22: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:01.381681 18139 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.315551 17977 consensus_queue.cc:237] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.375622 17917 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:01.395426 11622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.392669 11009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3958) took 1181 ms. Trace:
I20260709 12:23:01.395838 11009 rpcz_store.cc:276] 0709 12:23:00.211155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.211303 (+   148us) service_pool.cc:224] Handling call
0709 12:23:00.211609 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:00.234711 (+ 23102us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:00.234745 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:00.234790 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:00.234822 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:01.392410 (+1157588us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b54002d9954. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:01.392468 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:01.392600 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52615936}
I20260709 12:23:01.321519 18190 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.384335 17756 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:01.384548 17670 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.457050 17670 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.429596 18011 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:01.458746 18011 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.459291 17670 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:01.459210 18011 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.461124 17946 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:01.395699 18141 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:23:01.399421 18196 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:23:01.373138 17631 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.430047 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:01.381781 17929 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:01.450708 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:01.465847 11005 raft_consensus.cc:2410] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
W20260709 12:23:01.399540 18194 log.cc:927] Time spent T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:23:01.376375 18073 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:01.466068 11009 raft_consensus.cc:2393] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 23: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:01.462459 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:01.472903 11003 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:23:01.474206 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:01.474859 11003 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:01.395573 18192 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:23:01.455582 17827 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:01.326491 18149 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:01.448812 17796 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:01.373308 17683 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:01.474321 10901 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:01.479846 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:01.496901 11009 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 19: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:01.397718 17974 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:01.394444 18016 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:01.396054 18199 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:23:01.475466 17660 consensus_meta.cc:287] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.682s	user 0.009s	sys 0.001s
I20260709 12:23:01.498504 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:01.528450 11005 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23.
I20260709 12:23:01.500522 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:01.502140 18141 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:01.510041 18190 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:01.517271 17631 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:01.518036 18011 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:01.518785 17630 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:01.544497 10901 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:01.535777 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:01.545459 11009 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:01.401438 18139 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.546556 10901 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:01.515511 17917 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:01.542037 18138 consensus_meta.cc:287] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.768s	user 0.006s	sys 0.006s
I20260709 12:23:01.554251 11009 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260709 12:23:01.556258 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.558925 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:01.538070 18141 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:01.568876 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:01.549739 17631 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:23:01.576669 18093 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:01.531910 18199 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.581104 10931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3523) took 1277 ms. Trace:
I20260709 12:23:01.613329 10931 rpcz_store.cc:276] 0709 12:23:00.303362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.304635 (+  1273us) service_pool.cc:224] Handling call
0709 12:23:00.327681 (+ 23046us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:00.398404 (+ 70723us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:00.398432 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:00.398979 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 12:23:01.088380 (+689401us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:01.088421 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:01.088505 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:01.350916 (+262411us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:23:01.577907 (+226991us) raft_consensus.cc:1685] finished
0709 12:23:01.577931 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:01.581028 (+  3097us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74097,"raft.queue_time_us":85160,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":10870,"spinlock_wait_cycles":9566080,"thread_start_us":689013,"threads_started":1,"wal-append.queue_time_us":742186}
I20260709 12:23:01.589279 18141 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:01.621946 11084 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260709 12:23:01.622383 11084 pending_rounds.cc:85] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 10
I20260709 12:23:01.622620 11084 pending_rounds.cc:107] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 12:23:01.622852 11084 raft_consensus.cc:2889] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:01.558925 18011 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:01.527518 18016 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.539749 17683 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:01.580113 18198 log.cc:927] Time spent T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 12:23:01.586792 11654 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:23:01.560777 17660 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:01.582783 18138 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:01.626230 11009 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:01.591898 17631 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.640647 11008 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:01.623509 17630 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.641042 11049 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:23:01.625188 18190 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:01.623296 17627 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:23:01.636353 17660 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.646394 18202 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:01.652856 18016 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:01.640427 17631 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:01.658206 11004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3961) took 1382 ms. Trace:
I20260709 12:23:01.660276 11004 rpcz_store.cc:276] 0709 12:23:00.276230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.276402 (+   172us) service_pool.cc:224] Handling call
0709 12:23:00.302854 (+ 26452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:00.399620 (+ 96766us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:00.399649 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:00.399688 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:00.399716 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:01.657978 (+1258262us) spinlock_profiling.cc:243] Waited 96.6 ms on lock 0x7b540012cfd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:01.658027 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:01.658152 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222101248}
I20260709 12:23:01.655999 18202 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.629717 18011 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.664103 17683 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:01.645424 17630 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.640233 18138 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.665246 18091 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.742653 18091 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:01.646683 17670 consensus_queue.cc:1059] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 12:23:01.743958 17670 consensus_queue.cc:1243] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 19.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:23:01.703748 18004 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:01.658428 17660 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:01.744508 18091 raft_consensus.cc:3055] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:01.685300 18139 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:01.667428 18202 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:01.671600 18073 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:01.648561 18190 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.689618 18138 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:01.694505 17525 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.698429 18014 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:01.699460 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:01.700572 18046 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:01.704254 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:01.708545 17968 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.710048 17904 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:01.710301 17630 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:01.713788 18141 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.737620 18199 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:01.666371 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:01.768973 18152 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.988812 17872 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.817312 11003 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:23:02.080150 17872 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.081943 11003 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:23:02.082281 17872 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:02.083376 11003 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:23:01.655078 18005 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:02.016427 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:02.085649 18193 log.cc:927] Time spent T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.812s	user 0.004s	sys 0.008s
I20260709 12:23:01.978824 18091 raft_consensus.cc:740] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:01.978528 17977 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:02.086611 18091 consensus_queue.cc:260] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.087057 17977 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.087610 18091 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:02.089469 18160 consensus_meta.cc:287] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent flushing consensus metadata: real 0.898s	user 0.009s	sys 0.000s
I20260709 12:23:02.089908 18160 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:01.995818 17965 consensus_meta.cc:287] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.693s	user 0.010s	sys 0.000s
I20260709 12:23:01.681806 18011 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:02.051122 18152 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:01.998162 18204 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:02.092588 18204 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:01.989158 17670 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:01.979086 18004 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:02.093695 18004 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.094712 17525 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:02.073596 17968 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:02.093194 18141 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:02.106926 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:02.114663 10927 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:02.104914 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.115971 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.116585 10932 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:23:02.116436 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:02.117981 18204 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:02.118346 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.103125 18185 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:02.119601 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.114564 11011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37586 (request call id 3979) took 1225 ms. Trace:
I20260709 12:23:02.097894 11085 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:23:02.107585 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.131464 11011 rpcz_store.cc:276] 0709 12:23:00.888906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.902844 (+ 13938us) service_pool.cc:224] Handling call
0709 12:23:02.114378 (+1211534us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b540032d7d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:23:02.114495 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660070272}
I20260709 12:23:02.133355 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3814) took 1480 ms. Trace:
I20260709 12:23:02.101868 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:02.134505 11083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 3813) took 1481 ms. Trace:
I20260709 12:23:02.135151 11083 rpcz_store.cc:276] 0709 12:23:00.652679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.763287 (+110608us) service_pool.cc:224] Handling call
0709 12:23:02.101693 (+1338406us) spinlock_profiling.cc:243] Waited 47.3 ms on lock 0x7b5800017d98. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f260a0 00007f9bb5f25984 00007f9baf4a06d4 00007f9baf4a0662
0709 12:23:02.134450 (+ 32757us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108904320}
I20260709 12:23:02.107975 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.120488 11005 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:23:02.134416 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.107267 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.133823 11085 rpcz_store.cc:276] 0709 12:23:00.652973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.765931 (+112958us) service_pool.cc:224] Handling call
0709 12:23:02.097315 (+1331384us) spinlock_profiling.cc:243] Waited 44.7 ms on lock 0x7b5800017d98. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f39fc0 00007f9bb5f24929 00007f9bb5f243d2 00007f9baf49bbd4
0709 12:23:02.097535 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:02.131540 (+ 34005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.133295 (+  1755us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102905728}
I20260709 12:23:02.106546 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:02.101188 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 1.01381e+06us
I20260709 12:23:02.139247 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:02.083328 17772 consensus_meta.cc:287] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.716s	user 0.002s	sys 0.008s
I20260709 12:23:02.136487 10901 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:02.141695 10933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3532) took 1820 ms. Trace:
W20260709 12:23:02.109223 18186 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.976s	user 0.010s	sys 0.024s
I20260709 12:23:02.145227 10899 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:02.146759 10899 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:02.145582 10933 rpcz_store.cc:276] 0709 12:23:00.321470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.429331 (+107861us) service_pool.cc:224] Handling call
0709 12:23:00.429660 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:00.545809 (+116149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:00.545841 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:00.545884 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:00.545913 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.141453 (+1595540us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b540023afd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:02.141509 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:02.141637 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266673024}
I20260709 12:23:02.095789 18004 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:02.127691 18155 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.128739 18073 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:02.171620 18073 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:02.085474 18005 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:02.108734 18190 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:02.150024 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.148465 11050 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:02.150669 10934 raft_consensus.cc:2410] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 12:23:01.987414 17946 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:02.152603 10899 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:02.153316 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.153942 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:02.148851 17968 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.154847 17660 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.156888 17917 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:02.149531 18108 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 12:23:02.151340 18138 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:02.160863 18185 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:02.161123 11051 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:02.161437 18199 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.152256 17872 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:02.226584 11650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59398 (request call id 670) took 1734 ms. Trace:
I20260709 12:23:02.161759 10927 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:23:02.162088 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:02.162948 11077 pending_rounds.cc:85] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 10
I20260709 12:23:02.229568 11077 pending_rounds.cc:107] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:23:02.229856 11077 raft_consensus.cc:2889] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:02.163170 18016 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.163573 18011 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:02.240561 18011 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.242648 17947 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:02.242905 11659 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:02.243283 17947 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:02.245414 17947 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:02.150046 17979 raft_consensus.cc:1027] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: attempt to promote peer 0b171b6aaedc4f809f2753dcfadb14ce: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:23:02.170637 18155 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:02.248011 18130 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.248564 18130 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.249133 17979 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.249810 17872 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:02.250276 17872 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:02.250633 18130 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:02.240190 18016 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.180023 18152 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:02.257629 11079 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:23:02.177438 18153 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:02.258315 18153 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.223925 18204 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:02.257325 17660 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:02.175056 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:02.154950 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.157709 11006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3981) took 1251 ms. Trace:
I20260709 12:23:02.179064 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:02.263638 11085 raft_consensus.cc:2393] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:02.091766 17965 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.149829 17552 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:02.185024 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:02.119676 17670 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.191713 11050 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:02.142365 17525 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
W20260709 12:23:02.225694 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 65073.5us
I20260709 12:23:02.271523 11051 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:02.271947 11083 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:02.272675 11051 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:02.178501 18160 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:02.224220 18190 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:02.234993 18199 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:02.236128 18174 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:02.239303 18185 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.226933 11650 rpcz_store.cc:276] 0709 12:23:00.491852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.492058 (+   206us) service_pool.cc:224] Handling call
0709 12:23:00.492462 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:00.494591 (+  2129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:00.494626 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:00.506843 (+ 12217us) log.cc:844] Serialized 26 byte log entry
0709 12:23:00.833473 (+326630us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:23:00.833519 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:00.833592 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:02.108653 (+1275061us) spinlock_profiling.cc:243] Waited 51.7 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:23:02.226305 (+117652us) raft_consensus.cc:1685] finished
0709 12:23:02.226327 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:02.226521 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1590,"raft.queue_time_us":1778,"spinlock_wait_cycles":134085376,"thread_start_us":258963,"threads_started":1,"wal-append.queue_time_us":557112}
I20260709 12:23:02.267768 10928 raft_consensus.cc:2368] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 22. Current term is 23.
I20260709 12:23:02.262456 11006 rpcz_store.cc:276] 0709 12:23:00.906299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.956114 (+ 49815us) service_pool.cc:224] Handling call
0709 12:23:00.956396 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:01.134733 (+178337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:01.134764 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:01.134807 (+    43us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:01.134836 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.157450 (+1022614us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54004006d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:02.157511 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:02.157648 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409698176}
I20260709 12:23:02.220351 18005 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:02.301335 11051 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:02.260596 18204 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:02.270622 10933 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:23:02.272948 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:02.224171 18140 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:02.249670 17979 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.271147 10974 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:23:02.273931 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 82319.8us
I20260709 12:23:02.306581 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:02.307376 11078 raft_consensus.cc:2368] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15.
I20260709 12:23:02.307220 17977 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:02.188073 17946 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.242748 18011 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:02.257272 18016 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:02.311470 17670 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:02.312067 10932 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:23:02.306269 18190 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.288548 18014 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:02.249302 18155 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:02.314760 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:02.315124 11051 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:02.319608 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 48545us
I20260709 12:23:02.278323 18046 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:02.260522 18153 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:02.222128 17968 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:02.330374 11083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:35562
I20260709 12:23:02.322791 17947 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:23:02.312697 17631 consensus_meta.cc:287] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.000s
I20260709 12:23:02.257756 18152 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.312969 18189 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:02.247381 18202 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:02.346903 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 54564.4us
I20260709 12:23:02.321309 17827 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:02.321106 18005 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.331809 18011 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:02.331668 18016 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:02.313555 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:02.366394 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:02.322674 17904 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:02.332005 17928 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.307976 17683 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:23:02.331908 17660 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.332167 18184 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:02.366077 11083 raft_consensus.cc:606] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:02.393428 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:02.394289 11083 raft_consensus.cc:2393] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 24: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:02.395192 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:02.331897 17552 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:02.396307 17552 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.388610 10935 raft_consensus.cc:2368] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21.
I20260709 12:23:02.328531 18169 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:23:02.399641 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.367609 18130 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:02.400840 10935 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
W20260709 12:23:02.374878 17929 consensus_meta.cc:287] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.893s	user 0.010s	sys 0.001s
I20260709 12:23:02.395766 11083 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:02.373257 17917 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.388518 18046 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:02.389230 17904 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:02.433197 11083 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:23:02.346959 17977 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 12:23:02.372416 17631 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.445909 17631 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:02.446928 10931 raft_consensus.cc:2368] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 23. Current term is 24.
I20260709 12:23:02.414651 17976 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.445739 17977 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:02.449186 17976 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:02.451536 17976 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:23:02.425979 18213 log.cc:927] Time spent T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:23:02.436321 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:02.373067 17947 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:02.389494 18005 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.391987 18011 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:02.400792 17928 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.435015 17904 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:02.467912 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:02.400406 18016 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:02.474699 11080 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:23:02.414484 17827 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.467715 11652 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 LEARNER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:23:02.453022 18214 log.cc:927] Time spent T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:23:02.403507 18184 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:02.405058 17660 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:02.472581 10936 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 3075) took 2260 ms (client timeout 1848 ms). Trace:
W20260709 12:23:02.494143 10936 rpcz_store.cc:269] 0709 12:23:00.208127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.208309 (+   182us) service_pool.cc:224] Handling call
0709 12:23:02.468534 (+2260225us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b54001a81d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:23:02.468664 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1129828096}
I20260709 12:23:02.407276 17929 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.406136 18130 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:02.488684 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:02.506558 11650 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 14.
I20260709 12:23:02.492256 11080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:35562
I20260709 12:23:02.507465 11080 raft_consensus.cc:606] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:02.507845 11080 raft_consensus.cc:614] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:02.426213 17917 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.495738 11085 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 24.
I20260709 12:23:02.476027 17630 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:02.493729 17965 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:02.524616 10929 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:02.525801 10930 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:02.526700 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.527578 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.489264 17827 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.528733 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.529191 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:02.530544 10975 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:02.537288 10929 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 18: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:23:02.539745 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.527465 17979 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:02.549535 10929 raft_consensus.cc:2410] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:23:02.551276 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.553323 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.554561 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:02.555220 10929 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:02.560089 11004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 3991) took 1189 ms. Trace:
I20260709 12:23:02.560680 11004 rpcz_store.cc:276] 0709 12:23:01.370624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.048017 (+677393us) service_pool.cc:224] Handling call
0709 12:23:02.048399 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:02.328624 (+280225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:02.328654 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:02.329146 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:23:02.523556 (+194410us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:23:02.523596 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.523665 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:02.559721 (+ 36056us) raft_consensus.cc:1685] finished
0709 12:23:02.559742 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:02.560008 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26476,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":473891,"threads_started":2,"wal-append.queue_time_us":228538}
I20260709 12:23:02.562832 10929 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:23:02.538285 17683 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:02.539616 18199 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:02.570964 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.542685 17946 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:02.579989 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 108756us
I20260709 12:23:02.542533 18190 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:02.583989 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:02.549132 18014 raft_consensus.cc:697] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:23:02.585397 11078 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60046 (request call id 3626) took 1889 ms (client timeout 2231 ms). Trace:
W20260709 12:23:02.585848 11078 rpcz_store.cc:269] 0709 12:23:00.696250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.759259 (+ 63009us) service_pool.cc:224] Handling call
0709 12:23:01.699283 (+940024us) spinlock_profiling.cc:243] Waited 51.9 ms on lock 0x7b5800017d98. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f260a0 00007f9bb5f25984 00007f9baf4a06d4 00007f9baf4a0662
0709 12:23:02.585172 (+885889us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b540044d4d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:23:02.585331 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":839771648}
W20260709 12:23:02.589089 18210 log.cc:927] Time spent T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.540s	user 0.004s	sys 0.000s
I20260709 12:23:02.570264 17979 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:23:02.599967 18222 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:23:02.576253 18152 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:02.610687 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.595178 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.552016 17977 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:23:02.576033 18202 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:02.615072 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40200 (request call id 769) took 1921 ms. Trace:
I20260709 12:23:02.615322 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:02.566164 17872 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.618106 11078 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:23:02.584816 18156 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:02.598884 17979 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.630162 11078 raft_consensus.cc:1240] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:02.631687 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.578383 17683 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:02.633072 10929 raft_consensus.cc:2393] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 21: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:23:02.634886 11081 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:23:02.630510 17979 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:02.639592 18204 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:23:02.642516 18228 log.cc:927] Time spent T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:23:02.644629 18130 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:02.648093 18014 consensus_queue.cc:237] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.648989 17724 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:02.650103 17827 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:02.650815 18011 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:02.651603 17947 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:02.652505 17660 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:02.654863 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:02.615749 11082 rpcz_store.cc:276] 0709 12:23:00.694136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.779744 (+ 85608us) service_pool.cc:224] Handling call
0709 12:23:02.111683 (+1331939us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b5800017d98. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f39fc0 00007f9bb5f24929 00007f9bb5f243d2 00007f9baf49bbd4
0709 12:23:02.111928 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:02.112141 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:23:02.112390 (+   249us) log.cc:844] Serialized 14 byte log entry
0709 12:23:02.614477 (+502087us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:02.614541 (+    64us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:23:02.614594 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.614667 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:02.614997 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2179,"prepare.queue_time_us":6019,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":185051,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":6130,"spinlock_wait_cycles":95344640,"thread_start_us":501660,"threads_started":2,"wal-append.queue_time_us":364501}
I20260709 12:23:02.654500 17683 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:02.660789 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.661319 17928 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:02.662125 17929 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:02.662951 18184 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:02.651525 18005 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:02.628974 18156 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:02.677405 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:23:02.695202 18062 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.418s	user 0.010s	sys 0.003s
W20260709 12:23:02.695626 18062 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.418s	user 0.010s	sys 0.003s
I20260709 12:23:02.697652 18202 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.693795 18199 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:02.698486 18016 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:23:02.725176 18236 log.cc:927] Time spent T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:23:02.706216 17917 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:02.693382 18232 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:23:02.766733  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:02.773418 17977 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:02.821168 17977 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:02.775527 17968 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:02.778229 11008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 3196) took 1583 ms. Trace:
I20260709 12:23:02.824134 11008 rpcz_store.cc:276] 0709 12:23:01.195201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.195345 (+   144us) service_pool.cc:224] Handling call
0709 12:23:01.223602 (+ 28257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:01.643196 (+419594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.777909 (+1134713us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54000dd9d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:02.778149 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":956232064}
W20260709 12:23:02.800745 10934 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43556 (request call id 3079) took 1994 ms (client timeout 1715 ms). Trace:
I20260709 12:23:02.808416 17872 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:02.809871 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.728638 18202 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.735672 18199 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.816732 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:02.825417 10934 rpcz_store.cc:269] 0709 12:23:00.806126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.806436 (+   310us) service_pool.cc:224] Handling call
0709 12:23:02.800436 (+1994000us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540024b154. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:23:02.800633 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2889600384}
I20260709 12:23:02.827374 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.845010 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.845504 10928 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 13.
I20260709 12:23:02.807585 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.845605 11009 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:23:02.846400 10932 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:23:02.829247 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.829512 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.846966 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.847901 11009 raft_consensus.cc:2393] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 20: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:02.848498 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.848672 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.849330 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:02.849937 11658 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 14.
I20260709 12:23:02.849332 11009 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
W20260709 12:23:02.831178 10977 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.593s (SENT) [suppressed 6 similar messages]
W20260709 12:23:02.841295 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 69109.3us
I20260709 12:23:02.841827 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:02.851521 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.852232 11009 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:02.853971 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.854880 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.855239 10932 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:23:02.856583 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.857436 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:02.858106 11004 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 22: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:02.858819 17977 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:02.858155 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.860249 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.859701 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:02.862396 11003 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 22: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:02.862910 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.865473 11010 raft_consensus.cc:2393] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 22: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:02.866066 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:02.866971 10928 raft_consensus.cc:1240] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:02.868885 11009 raft_consensus.cc:2393] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 20: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:02.872323 11011 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 18: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:02.877938 10928 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:23:02.840962 18073 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:02.883651 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.884196 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.884791 11006 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:23:02.885270 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.885605 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:02.886330 11006 raft_consensus.cc:2393] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 15: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:02.886397 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.887491 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.879467 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:02.880863 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:02.888331 10934 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:23:02.844763 17968 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.882934 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.899910 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.883579 10900 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:02.888278 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:02.910493 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.898483 18232 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:02.919548 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.904803 17872 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:02.979947 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.985947 17627 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:02.986666 18202 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:02.991606 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:02.904268 17968 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:02.926915 17872 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:03.012064 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:03.018600 11011 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:23:03.016211 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:03.019692 11078 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:23:03.016916 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:02.914458 18232 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:03.025322 11050 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:03.033852 11050 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:03.036374 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:03.037009 11081 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:23:02.993513 18093 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:02.986572 17627 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:03.035756 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:03.039218 11080 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:23:03.040923 11050 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:03.042480 10974 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:03.046200 10974 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:03.024016 17872 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:03.090622 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 44515.1us
W20260709 12:23:03.037699 17904 consensus_meta.cc:287] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.546s	user 0.005s	sys 0.006s
I20260709 12:23:03.018020 18185 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:03.078959 11050 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:03.045887 18229 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:03.042011 18093 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:03.045454 17946 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:03.095481 11050 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:23:03.100718 18189 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.006s	sys 0.018s
I20260709 12:23:03.089967 18224 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:03.094128 18235 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:03.090013 18202 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:03.283775 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:03.283008 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:03.224680 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:03.244449 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:03.238790 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:23:03.237237 11051 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.007s	sys 0.007s
I20260709 12:23:03.359023 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:03.360198 11005 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
W20260709 12:23:03.362003 10977 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.035s	sys 0.052s
W20260709 12:23:03.362954 10977 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.035s	sys 0.052s
I20260709 12:23:03.244050 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:03.175490 11653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59398 (request call id 671) took 1005 ms. Trace:
I20260709 12:23:03.243603 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:03.366436 11011 raft_consensus.cc:1813] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Handling vote request from an unknown peer 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:03.235180 18238 log.cc:927] Time spent T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.515s	user 0.001s	sys 0.004s
W20260709 12:23:03.307782 18189 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.007s	sys 0.018s
I20260709 12:23:03.365299 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:23:03.167786 18236 log.cc:927] Time spent T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:23:03.360481 11051 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.020s	sys 0.021s
W20260709 12:23:03.375586 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 1.03768e+06us
W20260709 12:23:03.340914 18248 log.cc:927] Time spent T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.355s	user 0.001s	sys 0.000s
W20260709 12:23:03.367815 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 536628us
I20260709 12:23:03.383800 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:03.368716 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:03.364377 11653 rpcz_store.cc:276] 0709 12:23:02.169188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.171894 (+  2706us) service_pool.cc:224] Handling call
0709 12:23:02.172212 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:02.176367 (+  4155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:02.176396 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:02.176433 (+    37us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:23:02.176464 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:03.174505 (+998041us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b54000eb854. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:03.174603 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:03.174810 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9144192}
I20260709 12:23:03.369360 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:03.371264 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:03.367147 11011 raft_consensus.cc:2410] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:23:03.103211 18229 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.373898 11004 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:03.385829 11009 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:03.229022 18149 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:03.374632 11654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:03.146112 17947 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.273s
I20260709 12:23:03.376072 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:03.098603 17904 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:03.200443 18215 log.cc:927] Time spent T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 1.152s	user 0.006s	sys 0.000s
I20260709 12:23:03.377717 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:03.409081 11005 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:03.221532 17627 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:03.109382 18185 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:03.340886 18235 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:03.211679 18249 log.cc:927] Time spent T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:23:03.381026 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:03.339653 18202 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:03.380518 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:03.100178 17630 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:03.372496 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:03.391523 18229 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:03.219002 17968 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:03.309235 18014 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.365752 17977 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:03.219682 18232 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:03.213845 11659 raft_consensus.cc:1240] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:03.422104 18235 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:23:03.361600 18243 log.cc:927] Time spent T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.445s	user 0.000s	sys 0.001s
I20260709 12:23:03.340330 17883 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:03.166374 18062 consensus_queue.cc:1059] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.225s
I20260709 12:23:03.107477 17979 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:03.397434 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:23:03.389868 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.461086 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:03.461352 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:03.461735 10929 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:03.462641 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:03.463279 10929 raft_consensus.cc:2393] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 15: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:23:03.413136 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 295267us
I20260709 12:23:03.416951 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:03.390264 11049 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:03.464207 11011 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:23:03.464640 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 74455.4us
I20260709 12:23:03.465571 11049 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:03.445259 17630 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.430536 11004 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:23:03.364544 18224 raft_consensus.cc:697] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:03.389503 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:03.449177 10927 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 12:23:03.420094 18185 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.427749 18220 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.434489 18202 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:03.390561 18247 log.cc:927] Time spent T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.365s	user 0.000s	sys 0.001s
I20260709 12:23:03.463982 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:03.476046 18185 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:03.455124 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:03.468513 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:03.480692 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:03.468778 18062 raft_consensus.cc:3055] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:03.484251 18062 raft_consensus.cc:740] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:03.484540 11011 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23.
I20260709 12:23:03.471131 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:03.474630 11002 raft_consensus.cc:2393] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 15: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:03.474982 10927 pending_rounds.cc:85] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 12
I20260709 12:23:03.485553 10927 pending_rounds.cc:107] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 12:23:03.485867 10927 raft_consensus.cc:2889] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:03.485967 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:03.486361 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 3207) took 2132 ms. Trace:
I20260709 12:23:03.474761 11009 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:23:03.487017 18254 log.cc:927] Time spent T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:23:03.487283 10933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53346 (request call id 638) took 1259 ms. Trace:
I20260709 12:23:03.487659 10933 rpcz_store.cc:276] 0709 12:23:02.228360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.667714 (+439354us) service_pool.cc:224] Handling call
0709 12:23:02.668042 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:02.668364 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:02.668391 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:02.668818 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 12:23:02.716579 (+ 47761us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:23:02.716647 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.716799 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:03.487091 (+770292us) raft_consensus.cc:1685] finished
0709 12:23:03.487112 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:03.487232 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":741,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":16304,"thread_start_us":8317,"threads_started":1,"wal-append.queue_time_us":199822}
W20260709 12:23:03.488968 18261 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:23:03.478981 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:03.487035 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:03.474665 18232 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:03.491263 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:03.490233 10929 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:23:03.492234 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:03.489760 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:03.492909 10929 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 24.
I20260709 12:23:03.493453 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:03.493654 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:03.492304 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:03.494812 10927 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:23:03.486786 11007 rpcz_store.cc:276] 0709 12:23:01.354144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.711767 (+357623us) service_pool.cc:224] Handling call
0709 12:23:01.726607 (+ 14840us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:01.727103 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:01.727134 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:01.727685 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 12:23:01.989881 (+262196us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:01.989926 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:01.989996 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:03.199841 (+1209845us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:23:03.483437 (+283596us) raft_consensus.cc:1685] finished
0709 12:23:03.483468 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:03.486298 (+  2830us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1052,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":97,"spinlock_wait_cycles":58267008,"thread_start_us":222090,"threads_started":1,"wal-append.queue_time_us":320801}
I20260709 12:23:03.474833 17630 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:03.480983 17968 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:03.459059 17977 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:03.509912 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:03.510499 11007 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:03.494036 10933 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:23:03.482462 18220 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:03.496608 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:03.508945 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:03.456795 18014 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:03.516216 18229 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:03.516917 11009 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:23:03.460414 17883 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:03.536367 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:03.537698 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:03.538781 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:03.549566 11011 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:23:03.550386 11004 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:23:03.550606 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:03.570801 18235 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:03.572320 11003 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 12:23:03.574134 17904 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:03.485168 18062 consensus_queue.cc:260] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:03.578434 17977 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:03.485668 18224 consensus_queue.cc:237] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:03.580219 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:03.580844 11006 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 24.
I20260709 12:23:03.581077 10928 raft_consensus.cc:2410] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:23:03.534762 17872 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:03.583060 10930 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 14.
W20260709 12:23:03.583889 17917 consensus_queue.cc:1175] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" responder_term: 14 status { last_received { term: 14 index: 11 } last_committed_idx: 10 last_received_current_leader { term: 14 index: 11 } }
I20260709 12:23:03.584196 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:03.584882 10932 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 18: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:23:03.585731 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:03.586354 10933 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:23:03.587134 18220 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:03.598276 18265 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:03.598955 18265 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:03.615041 11007 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 24.
I20260709 12:23:03.563655 11005 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:03.621821 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:03.624915 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:03.623546 17525 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.575519 18062 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:03.628567 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:03.630903 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:03.575510 18093 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:03.617201 18014 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:03.634114 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:03.637219 10932 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:23:03.630223 17525 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:03.626883 17883 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:03.643950 11007 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
W20260709 12:23:03.636579 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 229400us
I20260709 12:23:03.616918 18229 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:03.646080 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:03.646468 11049 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:03.639806 17872 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:23:03.647946 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 254184us
I20260709 12:23:03.647899 11049 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:03.649436 17968 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:03.648203 18014 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:03.650430 17968 consensus_queue.cc:1059] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:03.650945 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:03.651666 17968 raft_consensus.cc:3055] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:03.652060 17968 raft_consensus.cc:740] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:03.652881 17968 consensus_queue.cc:260] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:03.654276 17968 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:03.654775 11079 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:03.656579 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:03.657305 11079 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:03.660934 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:03.661550 11651 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:03.662035 11078 raft_consensus.cc:1240] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:03.662623 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:03.639120 17979 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:03.664183 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:03.664772 11078 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:03.664855 10932 raft_consensus.cc:2410] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 21 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:23:03.665154 11079 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 12:23:03.668062 18239 log.cc:927] Time spent T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.944s	user 0.004s	sys 0.000s
I20260709 12:23:03.669191 17525 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:03.670459 18202 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:03.669391 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3827) took 1484 ms. Trace:
I20260709 12:23:03.672115 11076 rpcz_store.cc:276] 0709 12:23:02.184933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.544465 (+359532us) service_pool.cc:224] Handling call
0709 12:23:02.545006 (+   541us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:02.568428 (+ 23422us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:02.568461 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:02.568956 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 12:23:02.693639 (+124683us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:02.693680 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.693923 (+   243us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:03.667552 (+973629us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:23:03.669118 (+  1566us) raft_consensus.cc:1685] finished
0709 12:23:03.669138 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:03.669336 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24489,"raft.queue_time_us":53787,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":13827,"spinlock_wait_cycles":27069184,"thread_start_us":101649,"threads_started":1,"wal-append.queue_time_us":150771}
I20260709 12:23:03.674365 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:03.672546 11651 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:23:03.674623 18185 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:03.674981 11076 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:23:03.675993 10975 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:03.676357 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:03.676833 17979 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:03.677369 17979 raft_consensus.cc:697] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:03.677848 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:03.678325 17979 consensus_queue.cc:237] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:03.689553 18265 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:03.693397 18093 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:03.708238 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:03.709079 11082 raft_consensus.cc:2368] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18.
W20260709 12:23:03.715807 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 251567us
I20260709 12:23:03.762125 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:03.762848 11076 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:03.679095 18229 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:03.764674 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:03.766485 11076 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:03.767360 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:03.768057 11079 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:03.769912 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:03.778331 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:03.778963 11078 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:03.781013 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:03.781682 11078 raft_consensus.cc:2368] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18.
I20260709 12:23:03.782857 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:03.783414 11078 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:03.766376 17883 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:23:03.788302 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:03.800397 18185 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:03.780372 10974 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:03.813880  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:23:03.918821 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.777351 18229 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:03.970912 11078 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:23:03.820320 17552 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:03.972836 11076 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:23:03.975346 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:03.976084 11081 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:23:03.976914 11082 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:03.977886 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:03.978653 11076 raft_consensus.cc:2393] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 21: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:03.980851 11079 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:03.823485 17630 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:03.982553 18202 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:03.992588 11076 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 12:23:03.982065 18235 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:04.000532 11051 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:04.009294 11051 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:04.010311 18185 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:04.012135 18156 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:03.995738 18199 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:04.015977 18185 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:04.016454 18185 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:04.015154 11051 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:04.017153 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41098 (request call id 641) took 1386 ms. Trace:
I20260709 12:23:04.017531 11002 rpcz_store.cc:276] 0709 12:23:02.631257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.631409 (+   152us) service_pool.cc:224] Handling call
0709 12:23:04.015759 (+1384350us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b54002d9e54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:23:04.017091 (+  1332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1931917184}
W20260709 12:23:04.018863 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 238579us
I20260709 12:23:04.019414 10974 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:23:04.020140 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:04.021246 11079 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23.
I20260709 12:23:04.036123 11051 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:04.037546 11051 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:04.016815 18185 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:04.035162 17977 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:04.040346 18199 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:23:04.041899 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 283205us
I20260709 12:23:04.043037 11051 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:23:04.041326 18242 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 1.345s	user 0.020s	sys 0.012s
I20260709 12:23:04.040676 17979 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:23:04.045066 17979 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:23:04.046104 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.040552 18232 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:04.044301 11081 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23.
I20260709 12:23:04.049520 18014 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:04.050087 18014 raft_consensus.cc:697] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:04.051198 18014 consensus_queue.cc:237] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:04.055495 11051 leader_election.cc:400] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21.
I20260709 12:23:04.056362 18229 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:04.056710 17630 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:04.057231 11051 leader_election.cc:403] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:23:04.043848 17904 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:04.057873 17630 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21.
I20260709 12:23:04.058482 11051 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:04.059347 17630 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:04.059798 11051 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:04.059892 17630 raft_consensus.cc:697] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:04.061487 18229 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:04.061344 17630 consensus_queue.cc:237] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:04.061919 18229 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:04.062354 18229 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:04.041854 17977 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.064718 17977 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:04.045419 17979 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:04.070849 18229 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:04.072407 11051 leader_election.cc:400] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 23. Current term is 24.
I20260709 12:23:04.076318 11051 leader_election.cc:403] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:04.093297 11051 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:04.094507 10936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3540) took 1765 ms. Trace:
W20260709 12:23:04.096115 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 73899.4us
I20260709 12:23:04.094941 10936 rpcz_store.cc:276] 0709 12:23:02.329440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.751282 (+421842us) service_pool.cc:224] Handling call
0709 12:23:02.751608 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:02.826808 (+ 75200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:02.826839 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:02.843640 (+ 16801us) log.cc:844] Serialized 26 byte log entry
0709 12:23:03.693417 (+849777us) spinlock_profiling.cc:243] Waited 8.77 ms on lock 0x7b180036a540. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b 00007f9bb0affd23 00007f9bb0b000d1 00007f9bb0f1ba0f
0709 12:23:04.048722 (+355305us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:04.048761 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:04.048846 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:04.092117 (+ 43271us) raft_consensus.cc:1685] finished
0709 12:23:04.092136 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:04.094438 (+  2302us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49673,"raft.queue_time_us":75464,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":8090,"spinlock_wait_cycles":20161792,"thread_start_us":355106,"threads_started":1,"wal-append.queue_time_us":1142348}
I20260709 12:23:04.097733 11051 leader_election.cc:400] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 22. Current term is 23.
I20260709 12:23:04.098058 11051 leader_election.cc:403] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:04.104661 10974 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:04.107055 11051 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:04.092628 17904 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:23:04.109402 11051 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:04.110285 11051 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:04.105055 18232 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:23:04.112763 18232 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:04.113034 10974 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:04.113166 18232 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:04.096541 18229 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:04.118142 11051 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:04.116586 18199 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:04.120227 18199 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:04.120582 18199 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:04.124977 18232 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:04.127592 18232 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:04.107797 18189 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 22. Current term is 23.
I20260709 12:23:04.136746 10974 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:04.150657 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:04.151925 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:04.152738 11003 raft_consensus.cc:2368] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20.
I20260709 12:23:04.154065 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:04.154703 11003 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:23:04.156204 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:04.157539 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:04.159241 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:04.160980 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:04.163442 11625 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:04.164011 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:04.128203 18224 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:04.165599 11006 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:23:04.167182 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:04.165232 11050 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:04.172780 11050 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:04.173032 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:04.174165 11050 leader_election.cc:400] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20.
I20260709 12:23:04.174460 11050 leader_election.cc:403] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:23:04.175418 18189 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:04.175793 18189 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.176151 18189 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:04.133908 17630 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:04.180529 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:04.182952 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:04.147430 18229 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:04.185040 11008 raft_consensus.cc:2393] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 22: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:04.137179 17976 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:04.188066 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:04.189460 11076 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:23:04.190944 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:04.191691 11078 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 23.
W20260709 12:23:04.191129 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.195369 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:04.149648 18232 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:04.166742 17947 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:04.199991 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:04.180842 18224 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.171160 18014 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:04.185894 17552 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.204947 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:04.205163 11078 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 23. Current term is 24. Ops: []
I20260709 12:23:04.198416 17630 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:04.214589 11085 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:04.202090 18156 raft_consensus.cc:2764] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:23:04.200287 17947 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.204017 18224 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:23:04.219988 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 55755.3us
I20260709 12:23:04.220494 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:04.221519 11083 raft_consensus.cc:2393] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 22: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:04.202361 18232 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:04.229681 11625 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:04.221858 18202 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20.
I20260709 12:23:04.214478 17630 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:04.219774 17947 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:04.249967 18155 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:04.241312 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 67280.1us
I20260709 12:23:04.260038 11050 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:04.212152 17552 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:04.256543 17630 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:04.272372 18280 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:04.279172 10974 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:23:04.279071 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 161007us
I20260709 12:23:04.281543 11051 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:04.282106 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:04.282318 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:04.282397 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:04.277565 18280 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.283262 18280 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:23:04.268733 18251 log.cc:927] Time spent T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 1.160s	user 0.005s	sys 0.014s
I20260709 12:23:04.306290 18290 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:04.307096 18290 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:04.317433 11051 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:04.319010 11051 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:04.331658 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:04.335007 11009 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:23:04.332417 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:04.336367 11011 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:04.341058 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:04.344254 11004 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:04.328665 17968 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:04.326200 18276 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:04.347378 11011 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:23:04.349864 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:23:04.355801 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 75258us
I20260709 12:23:04.339378 18281 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:23:04.372228 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 53313.7us
I20260709 12:23:04.331156 18283 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:23:04.375874 18281 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:04.374022 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:04.374305 11051 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:04.367808 17968 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:04.362519 18290 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:04.419322 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:04.431389 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:04.386217 18299 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:23:04.434769 18219 log.cc:927] Time spent T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 1.912s	user 0.025s	sys 0.021s
I20260709 12:23:04.439083 17977 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:04.440641 17552 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:03.979272  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:04.429328 18279 log.cc:927] Time spent T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:23:04.444818 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:04.454782 11011 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23.
I20260709 12:23:04.428011 17904 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 23. Current term is 24.
I20260709 12:23:04.450344 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:04.417992 17968 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:04.456429 17968 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:23:04.458335 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 101364us
I20260709 12:23:04.429844 18290 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:04.432515 18232 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:04.459332 10974 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:04.461053 10977 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:04.464229 10974 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:04.467651 10901 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:04.474066 10901 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:04.475014 10901 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:04.476428 11003 raft_consensus.cc:2393] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 18: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:04.480423 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:04.481448 11007 raft_consensus.cc:2410] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:23:04.443795 18189 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:04.488394 10831 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 117) took 15376 ms (client timeout 15000 ms). Trace:
W20260709 12:23:04.484807 18252 log.cc:927] Time spent T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 1.273s	user 0.007s	sys 0.005s
I20260709 12:23:04.483961 17976 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:04.449759 18299 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:04.558593 18269 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:04.559216 18303 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:04.559751 18303 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.559240 18269 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:04.562831 18269 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:04.477252 18290 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:04.564396 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.576628 18286 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:04.487694 17883 consensus_queue.cc:1059] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 12:23:04.560103 18303 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:04.512626 17976 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:04.577853 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 111853us
I20260709 12:23:04.563726 17827 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:04.582595 11010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37594 (request call id 3233) took 1700 ms. Trace:
I20260709 12:23:04.595979 11010 rpcz_store.cc:276] 0709 12:23:02.882220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.020792 (+1138572us) service_pool.cc:224] Handling call
0709 12:23:04.042573 (+ 21781us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:04.095234 (+ 52661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:04.095268 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:04.095846 (+   578us) log.cc:844] Serialized 52 byte log entry
0709 12:23:04.231702 (+135856us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:04.231747 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:04.231823 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:04.582357 (+350534us) raft_consensus.cc:1685] finished
0709 12:23:04.582379 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:04.582530 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52244,"raft.queue_time_us":53208,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":964,"thread_start_us":111882,"threads_started":1,"wal-append.queue_time_us":155693}
W20260709 12:23:04.590785 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 129822us
I20260709 12:23:04.575450 18108 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:04.604110 18298 log.cc:927] Time spent T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:23:04.609025 18281 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:04.611977 18189 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:04.615484 18294 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:23:04.508174 17979 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:04.616083 18294 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:04.616516 18294 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:04.617846 17979 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:04.599170 17917 consensus_queue.cc:1059] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 7, Time since last communication: 0.020s
W20260709 12:23:04.488833 10831 rpcz_store.cc:269] 0709 12:22:49.108147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.108335 (+   188us) service_pool.cc:224] Handling call
0709 12:23:04.484766 (+15376431us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:58.225324 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:58.226089 (+   765us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:58.226146 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:22:58.226185 (+    39us) tablet.cc:662] Decoding operations
0709 12:22:58.227497 (+  1312us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:58.227602 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:58.227638 (+    36us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:22:58.289554 (+ 61916us) tablet.cc:701] Row locks acquired
0709 12:22:58.289605 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:22:58.289775 (+   170us) write_op.cc:270] Start()
0709 12:22:58.289921 (+   146us) write_op.cc:276] Timestamp: P: 1783599778289715 usec, L: 0
0709 12:22:58.289956 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:22:58.306414 (+ 16458us) log.cc:844] Serialized 5060 byte log entry
0709 12:22:58.927097 (+620683us) op_driver.cc:464] REPLICATION: finished
0709 12:22:59.573568 (+646471us) write_op.cc:301] APPLY: starting
0709 12:22:59.588011 (+ 14443us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:00.762582 (+1174571us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:00.762703 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:01.642548 (+879845us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:01.685754 (+ 43206us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 12:23:01.685802 (+    48us) write_op.cc:312] APPLY: finished
0709 12:23:01.686220 (+   418us) log.cc:844] Serialized 121 byte log entry
0709 12:23:02.182874 (+496654us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:02.189714 (+  6840us) write_op.cc:454] Released schema lock
0709 12:23:02.238165 (+ 48451us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:02.238729 (+   564us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:02.238760 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3474701,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":614888,"apply.run_cpu_time_us":90617,"apply.run_wall_time_us":2689331,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58389,"num_ops":13,"prepare.queue_time_us":87669,"prepare.run_cpu_time_us":28579,"prepare.run_wall_time_us":312651,"raft.queue_time_us":210060,"raft.run_cpu_time_us":169689,"raft.run_wall_time_us":428302,"replication_time_us":636958,"thread_start_us":1233476,"threads_started":5,"wal-append.queue_time_us":927416,"wal-append.run_cpu_time_us":19527,"wal-append.run_wall_time_us":2398683}]]}
W20260709 12:23:04.621454 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 247214us
I20260709 12:23:04.622262 11051 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:04.623739 18282 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.626348 18282 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:04.628414 18282 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:04.630756 11651 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:04.630534 18224 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:04.632141 11002 raft_consensus.cc:2368] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20.
I20260709 12:23:04.635437 17977 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:04.636137 18295 log.cc:927] Time spent T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:23:04.636508 18280 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:04.640538 18280 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:04.594537 17976 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:04.599468 17552 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:23:04.643347 18199 consensus_meta.cc:287] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.522s	user 0.011s	sys 0.000s
I20260709 12:23:04.643787 18199 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:04.644827 11081 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 22. Current term is 23. Ops: []
I20260709 12:23:04.645898 18108 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:04.646577 18108 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:04.656095 17552 raft_consensus.cc:697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:04.657114 17552 consensus_queue.cc:237] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:04.658459 18224 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:04.622347 18281 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:04.659292 18281 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:04.661199 18305 raft_consensus.cc:3055] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:04.661677 18305 raft_consensus.cc:740] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:23:04.662861 18185 consensus_meta.cc:287] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.619s	user 0.007s	sys 0.004s
I20260709 12:23:04.662528 18305 consensus_queue.cc:260] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:04.663311 18185 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:04.665517 11076 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 12:23:04.663759 18305 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:04.683720 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 61536.2us
I20260709 12:23:04.684867 11051 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:04.689837 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:04.711531 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:04.714717 11651 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
W20260709 12:23:04.715302 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 80865.7us
I20260709 12:23:04.715808 11651 pending_rounds.cc:85] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce: Aborting all ops after (but not including) 10
I20260709 12:23:04.719770 11051 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:04.722241 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:04.723114 11656 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 16: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:23:04.723671 11650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:04.727897 11051 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:04.736464 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 261497us
W20260709 12:23:04.740567 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.590519 18286 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:04.742233 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:04.737764 10901 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:04.743898 10901 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:23:04.726219 18304 log.cc:927] Time spent T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.113s	user 0.003s	sys 0.003s
I20260709 12:23:04.784585 10901 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:04.749534 11658 raft_consensus.cc:2368] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15.
I20260709 12:23:04.751269 10977 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:04.752568 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:04.789085 11079 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:23:04.717811 11651 pending_rounds.cc:107] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 14.11
I20260709 12:23:04.714437 18280 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:04.790784 11651 raft_consensus.cc:2917] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Aborting config change with OpId 14.11: Aborted: Op aborted by new leader
I20260709 12:23:04.791268 11651 raft_consensus.cc:2889] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:04.736399 17974 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:04.731077 18276 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:23:04.800806 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 50121.5us
I20260709 12:23:04.739292 18185 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:04.749491 18283 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:04.739658 18199 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:04.748508 18289 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:04.805323 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:23:04.806258 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 55081us
I20260709 12:23:04.725172 18224 consensus_queue.cc:1059] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.073s
I20260709 12:23:04.813921 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:23:04.813089 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 80834.6us
I20260709 12:23:04.816352 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:04.812330 11050 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:04.826344 11077 raft_consensus.cc:2393] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 18: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:04.828186 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:04.837261 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:04.837536 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:04.852912 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:04.854277 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:04.856298 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:23:04.854449 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 109331us
I20260709 12:23:04.857331 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:04.858251 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:04.862635 11085 raft_consensus.cc:2368] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 22. Current term is 23.
I20260709 12:23:04.809847 18302 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:04.865483 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:04.809830 18289 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:04.867360 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:04.877183 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:23:04.879779 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 67537.4us
I20260709 12:23:04.870246 11084 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 24.
I20260709 12:23:04.882193 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:04.883067 11084 raft_consensus.cc:2368] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15.
I20260709 12:23:04.883983 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:04.832875 18281 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:04.898258 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:04.900957 11083 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:23:04.861168 18108 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:04.906298 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:04.831481 17977 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 12:23:04.874735 18290 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:04.863495 18312 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:23:04.910912 11083 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:04.911964 11050 leader_election.cc:400] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20.
W20260709 12:23:04.912427 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 66474.2us
I20260709 12:23:04.879878 18289 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:04.912901 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 54528.1us
I20260709 12:23:04.897737 18309 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:04.871201 18299 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:04.937467 10901 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:04.924386 11077 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:04.874420 17883 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:23:04.907721 18155 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:04.910678 18315 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:23:04.946497 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:23:04.938916 17630 consensus_meta.cc:287] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.653s	user 0.006s	sys 0.005s
I20260709 12:23:04.922751 18308 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:23:04.941924 17947 consensus_meta.cc:287] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.679s	user 0.012s	sys 0.000s
I20260709 12:23:04.945653 18309 raft_consensus.cc:697] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:04.945106 18299 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:23:04.982278 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 172902us
W20260709 12:23:04.980746 18317 log.cc:927] Time spent T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:23:04.980051 17947 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:04.964656 18155 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:04.991942 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:04.992761 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:05.077803 11077 raft_consensus.cc:2393] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 23: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:23:04.982653 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 129148us
I20260709 12:23:04.976316 18315 raft_consensus.cc:697] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:23:05.014189 18314 log.cc:927] Time spent T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:23:05.016355 18290 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:23:05.006572 18299 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:05.031491 18322 log.cc:927] Time spent T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:23:05.035053 18286 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:05.010465 10899 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:23:05.086982 18319 log.cc:927] Time spent T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 12:23:05.135703 17947 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:05.094734 18309 consensus_queue.cc:237] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:05.087242 18316 log.cc:927] Time spent T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:23:05.100449 11004 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 22. Current term is 23. Ops: []
I20260709 12:23:04.975203 17630 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.137312 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:05.149140 18315 consensus_queue.cc:237] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.150422 17630 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:05.153604 11005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 4014) took 1700 ms. Trace:
I20260709 12:23:05.154070 11005 rpcz_store.cc:276] 0709 12:23:03.453165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.266783 (+813618us) service_pool.cc:224] Handling call
0709 12:23:04.267146 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:04.269077 (+  1931us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:04.269106 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:04.275553 (+  6447us) log.cc:844] Serialized 26 byte log entry
0709 12:23:04.613634 (+338081us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b18001b0a60. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade55e07 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b 00007f9bb0affd23 00007f9bb0b000d1 00007f9bb0f1ba0f
0709 12:23:04.728915 (+115281us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:04.728953 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:04.729024 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:05.153321 (+424297us) raft_consensus.cc:1685] finished
0709 12:23:05.153342 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:05.153540 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7387,"raft.queue_time_us":1877,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":3400,"spinlock_wait_cycles":9586944,"thread_start_us":115074,"threads_started":1,"wal-append.queue_time_us":524277}
I20260709 12:23:05.132771 18290 raft_consensus.cc:697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:05.160682 18290 consensus_queue.cc:237] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.133036 18301 raft_consensus.cc:3055] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Stepping down as leader of term 23
W20260709 12:23:05.172008 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 235323us
W20260709 12:23:05.176935 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 98446.6us
I20260709 12:23:05.177656 18320 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:05.178391 10977 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:05.179524 18130 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:05.169240 18300 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:23:05.188963 10974 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:23:05.171234 18301 raft_consensus.cc:740] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:05.187095 18308 raft_consensus.cc:697] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:05.213372 18308 consensus_queue.cc:237] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.217602 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3862) took 1006 ms. Trace:
I20260709 12:23:05.218119 11076 rpcz_store.cc:276] 0709 12:23:04.211629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.211775 (+   146us) service_pool.cc:224] Handling call
0709 12:23:04.216209 (+  4434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:04.665926 (+449717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:05.217340 (+551414us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54001a4fd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:05.217536 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1032770944}
I20260709 12:23:05.221765 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:05.223125 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:23:05.169245 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 385617us
I20260709 12:23:05.224907 18301 consensus_queue.cc:260] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.225960 18301 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:05.227654 18269 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:05.228200 18269 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:05.228582 18269 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:05.232750 18189 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:05.219652 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:05.223760 11085 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 24.
I20260709 12:23:05.260614 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:05.262048 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:05.270105 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:05.262694 11085 raft_consensus.cc:2376] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22. Re-sending same reply.
I20260709 12:23:05.272859 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:05.155407 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:05.291405 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:05.292065 11083 raft_consensus.cc:2376] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 24. Re-sending same reply.
W20260709 12:23:05.293282 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 284599us
W20260709 12:23:05.297209 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 108339us
W20260709 12:23:05.300370 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 122049us
I20260709 12:23:05.232841 18300 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:05.313937 11622 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:05.314162 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:05.315037 11085 raft_consensus.cc:2393] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 20: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:05.315534 11622 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:05.315914 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:05.316155 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:05.316607 11085 raft_consensus.cc:2376] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21. Re-sending same reply.
I20260709 12:23:05.317512 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:05.316732 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:05.316920 11077 raft_consensus.cc:2393] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 24: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:05.319923 11083 raft_consensus.cc:2376] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20. Re-sending same reply.
I20260709 12:23:05.320971 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:05.322371 11083 raft_consensus.cc:2368] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18.
I20260709 12:23:05.325191 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:05.328992 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:05.329777 11077 raft_consensus.cc:2393] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 19: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:05.331462 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:05.332252 11083 raft_consensus.cc:2376] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23. Re-sending same reply.
I20260709 12:23:05.334169 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:05.337503 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:05.346717 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:23:05.352954 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 415583us
I20260709 12:23:05.354410 10899 leader_election.cc:400] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 22. Current term is 23.
I20260709 12:23:05.354779 11076 raft_consensus.cc:2376] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23. Re-sending same reply.
I20260709 12:23:05.379760 11083 raft_consensus.cc:2368] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22.
W20260709 12:23:05.355334 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 427688us
I20260709 12:23:05.356793 18202 consensus_queue.cc:1059] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:05.358086 18235 consensus_queue.cc:1059] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:05.379803 10901 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:23:05.358490 17827 consensus_meta.cc:287] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.757s	user 0.013s	sys 0.009s
I20260709 12:23:05.367707 10829 catalog_manager.cc:5697] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
W20260709 12:23:05.369042 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.370311 11081 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 23. Current term is 24. Ops: []
I20260709 12:23:05.324517 18300 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:05.324997 18320 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:23:05.325315 18244 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:23:05.324783 18108 consensus_queue.cc:1059] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
W20260709 12:23:05.416913 11084 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.045s	sys 0.020s
W20260709 12:23:05.417263 11084 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.045s	sys 0.020s
I20260709 12:23:05.372509 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:05.334937 10977 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:05.379984 10899 leader_election.cc:403] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
W20260709 12:23:05.423358 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 88506.6us
W20260709 12:23:05.425153 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 107003us
I20260709 12:23:05.426752 10899 leader_election.cc:400] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15.
I20260709 12:23:05.427059 10899 leader_election.cc:403] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:23:05.334707 18281 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:05.325562 18286 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:05.400230 10975 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:05.400848 18310 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.402444 18235 raft_consensus.cc:3055] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:05.403226 18293 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.410115 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:05.442508 11004 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:05.396075 10829 catalog_manager.cc:5697] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 14 to 15, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 15 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:05.424232 10977 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:05.373144 18155 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:05.415736 17827 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:05.429334 18224 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:05.459685 10977 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:05.472105 11004 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:05.483987 10829 catalog_manager.cc:5697] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 16 to 19, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 19 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:05.491528 11080 consensus_meta.cc:287] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.619s	user 0.014s	sys 0.005s
I20260709 12:23:05.491919 11080 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 16.
I20260709 12:23:05.441869 17977 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:23:05.438673 18235 raft_consensus.cc:740] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:05.449635 18313 raft_consensus.cc:3055] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:23:05.456477 17974 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:05.441958 18312 raft_consensus.cc:697] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:05.499624 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:05.502372 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 122661us
I20260709 12:23:05.496803 10829 catalog_manager.cc:5697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 15 to 20, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 20 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.532346 10901 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:23:05.545221 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 164217us
W20260709 12:23:05.581833 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 49531us
I20260709 12:23:05.501097 18299 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:05.491811 17947 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:05.444171 18310 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:05.608119 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 62688us
I20260709 12:23:05.608662 10901 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:05.458652 18338 consensus_queue.cc:1059] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.133s
I20260709 12:23:05.508652 18313 raft_consensus.cc:740] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:05.614214 11083 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:23:05.538641 17974 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:23:05.616294 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 189655us
I20260709 12:23:05.625468 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:05.510246 18327 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:05.537294 17552 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15.
I20260709 12:23:05.497761 18330 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:05.457859 18293 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:05.497287 18185 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:05.507548 18308 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:05.614710 11050 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:23:05.632957 18336 log.cc:927] Time spent T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:23:05.632974 10901 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:05.637547 18313 consensus_queue.cc:260] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:05.642052 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 142490us
W20260709 12:23:05.643311 18294 consensus_meta.cc:287] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 1.026s	user 0.016s	sys 0.012s
I20260709 12:23:05.660317 10977 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:05.621369 10829 catalog_manager.cc:5697] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:05.624708 17968 consensus_meta.cc:287] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 1.168s	user 0.015s	sys 0.012s
I20260709 12:23:05.672183 17968 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.674662 17968 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:05.675081 18343 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:23:05.675320 11079 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 19. Current term is 20. Ops: []
W20260709 12:23:05.639783 18303 consensus_meta.cc:287] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 1.041s	user 0.015s	sys 0.008s
I20260709 12:23:05.645577 18299 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:23:05.640266 18305 consensus_meta.cc:287] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.974s	user 0.022s	sys 0.009s
W20260709 12:23:05.639452 17976 consensus_meta.cc:287] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.998s	user 0.002s	sys 0.023s
I20260709 12:23:05.676699 17976 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.660380 18185 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:05.677424 10901 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:23:05.658206 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 49850.7us
I20260709 12:23:05.678166 11011 raft_consensus.cc:2393] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 22: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:23:05.643430 18289 consensus_meta.cc:287] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.692s	user 0.009s	sys 0.005s
I20260709 12:23:05.666131 18302 raft_consensus.cc:3055] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:23:05.645259 17947 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:23:05.682773 10977 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:05.682147 10900 leader_election.cc:400] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15.
I20260709 12:23:05.681394 10829 catalog_manager.cc:5697] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 19 to 20, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 20 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:05.700371 10900 leader_election.cc:403] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:23:05.682098 11008 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 12:23:05.702719 11008 pending_rounds.cc:85] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 10
I20260709 12:23:05.703029 11008 pending_rounds.cc:107] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 14.11
I20260709 12:23:05.703328 11008 raft_consensus.cc:2917] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Aborting config change with OpId 14.11: Aborted: Op aborted by new leader
I20260709 12:23:05.703701 11008 raft_consensus.cc:2889] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:05.655624 18326 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:05.725862 10977 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:05.725589 10829 catalog_manager.cc:5697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 12 to 13, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 13 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
W20260709 12:23:05.726799 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 101424us
I20260709 12:23:05.661839 18330 raft_consensus.cc:697] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:23:05.730288 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 93322.1us
I20260709 12:23:05.728730 10899 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:05.733139 11622 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:05.658785 18108 consensus_queue.cc:1059] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
W20260709 12:23:05.734834 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 120230us
I20260709 12:23:05.685525 18320 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:05.683075 17883 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:05.679440 18343 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:05.680642 18299 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:05.773069 18299 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:05.736088 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:05.707163 18312 consensus_queue.cc:237] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.684520 18302 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:05.776934 18302 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.676136 18303 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.778192 18302 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:05.779024 18347 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:05.681161 18294 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.725363 18313 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:05.781579 18294 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:05.744052 11003 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 24. Current term is 25. Ops: []
W20260709 12:23:05.783774 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 44259us
I20260709 12:23:05.779587 18303 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:05.741071 17827 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:05.753101 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:05.753743 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:05.682005 18289 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.743425 18280 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:05.755775 18327 consensus_queue.cc:1059] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:05.756616 17979 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.760339 18244 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:05.761410 18338 consensus_queue.cc:1059] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:05.809516 18244 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.762101 18290 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:23:05.762614 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 83789.5us
I20260709 12:23:05.738440 18155 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:05.768244 17552 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:23:05.746218 18269 consensus_meta.cc:287] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.515s	user 0.014s	sys 0.001s
I20260709 12:23:05.734887 18348 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:05.727617 18199 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:05.751514 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:05.892378 18269 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:05.892856 11007 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 11.
I20260709 12:23:05.893638 18348 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.894016 18348 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:05.894603 18269 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:05.774922 18315 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:05.895341 18315 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:05.897482 18315 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:05.745939 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:05.740720 18337 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:05.898615 17552 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:05.899065 17552 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:05.899127 18293 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:05.729233 18130 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:23:05.783401 11081 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 24. Current term is 25. Ops: []
I20260709 12:23:05.900084 18155 raft_consensus.cc:697] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:23:05.775369 18283 raft_consensus.cc:1064] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
W20260709 12:23:05.901319 18283 raft_consensus.cc:1068] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Unable to promote non-voter 0b171b6aaedc4f809f2753dcfadb14ce: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:23:05.772138 10829 catalog_manager.cc:5697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 15 to 16, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 16 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.902752 10829 catalog_manager.cc:5697] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 8 to 14, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 14 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:05.663178 18235 consensus_queue.cc:260] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 13, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.792531 18343 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:23:05.802338 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 125011us
I20260709 12:23:05.802407 10899 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:05.808555 17979 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.849313 11078 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:05.798585 17827 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:05.849723 17883 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:05.844921 17917 raft_consensus.cc:3055] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:05.850402 18347 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955) with higher term. Message: Invalid argument: T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 14. Current term is 15.
I20260709 12:23:05.850543 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:05.854844 18280 raft_consensus.cc:697] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:23:05.855394 18301 consensus_meta.cc:287] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.006s
I20260709 12:23:05.856786 18300 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.917243 18300 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:05.917668 18299 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.918105 17827 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:05.910684 18355 consensus_queue.cc:1059] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:23:05.858600 17974 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.919371 18347 raft_consensus.cc:3055] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:05.919755 18347 raft_consensus.cc:740] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:05.919615 18338 consensus_queue.cc:1243] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:23:05.848337 18185 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:05.918282 18280 consensus_queue.cc:237] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.924283 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:05.863305 18335 raft_consensus.cc:3055] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:23:05.926371 18335 raft_consensus.cc:740] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:05.927256 18335 consensus_queue.cc:260] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.927979 18356 consensus_queue.cc:1059] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:05.928623 18335 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:05.847556 18289 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:05.871330 17976 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:05.874452 18330 consensus_queue.cc:237] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.920522 17974 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:05.937345 17979 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:05.911373 18312 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:23:05.939215 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:05.920598 18347 consensus_queue.cc:260] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.945318 18347 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:05.935552 10901 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:23:05.950332 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.952178 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:05.952881 11079 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:23:05.956204 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:05.956936 11002 raft_consensus.cc:2368] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20.
I20260709 12:23:05.957114 18309 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:23:05.957512 18309 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.958039 18185 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.884513 11659 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:05.958177 17979 consensus_queue.cc:1059] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:05.875815 18310 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:05.958576 18185 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:05.885494 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.958320 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:05.871436 18308 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 22. Current term is 23.
I20260709 12:23:05.900920 18155 consensus_queue.cc:237] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:05.783562 11624 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:05.957842 18309 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:23:05.965242 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 181760us
I20260709 12:23:05.966342 11624 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:05.908607 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:05.908870 10829 catalog_manager.cc:5697] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 16 to 19, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 19 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:05.909659 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 107343us
I20260709 12:23:05.908823 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:05.912321 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:05.909198 18199 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.914253 17883 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:05.911444 17917 raft_consensus.cc:740] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:05.954193 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:05.977008 10899 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:05.977679 11003 raft_consensus.cc:2393] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 25: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:05.978204 10899 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:05.978380 17883 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:05.965188 18329 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:05.979460 18308 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:05.980258 18329 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:05.981600 18199 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:05.982074 18283 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:23:05.970929 18156 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:05.984062 18156 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 LEARNER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:05.984534 10899 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:05.985872 10829 catalog_manager.cc:5697] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 17 to 19, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 19 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.962960 11078 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:23:05.959211 18310 raft_consensus.cc:3055] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:23:05.964813 18281 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:06.002156 18281 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:05.999145 18325 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:06.005311 18281 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:05.987449 18286 consensus_queue.cc:1059] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 24.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.019s
I20260709 12:23:06.006546 18286 raft_consensus.cc:3055] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:23:06.006901 18286 raft_consensus.cc:740] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:23:06.007022 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:05.988761 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:06.009662 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:05.989744 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:05.990976 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:05.993927 11085 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 22. Current term is 23. Ops: []
I20260709 12:23:05.847762 18244 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:06.014124 11084 raft_consensus.cc:2393] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 22: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:05.996632 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:05.998204 10899 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:05.986423 18309 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.019480 18309 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:05.998968 18310 raft_consensus.cc:740] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:06.013468 11083 raft_consensus.cc:2393] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 19: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:06.016325 17883 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.019085 17917 consensus_queue.cc:260] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.020447 10829 catalog_manager.cc:5697] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 16 to 17, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 17 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:06.024192 11079 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 16: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:23:06.030210 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:06.000394 11050 leader_election.cc:400] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20.
I20260709 12:23:06.039232 11050 leader_election.cc:403] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:23:06.012567 18290 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:06.040589 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:06.031679 10899 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:06.046886 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:23:06.044878 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 44623.3us
I20260709 12:23:06.048331 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:06.049036 10935 raft_consensus.cc:2368] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 24. Current term is 25.
I20260709 12:23:06.049288 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:06.049942 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:06.047852 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:06.044906 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:06.049974 11007 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:23:06.052906 11050 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:06.023228 18309 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:06.056432 10933 raft_consensus.cc:2393] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 18: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:23:06.056614 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:06.057389 10935 raft_consensus.cc:1240] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:06.042436 10829 catalog_manager.cc:5697] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.058528 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:06.059005 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:06.059305 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:06.059698 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:06.059937 10931 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:06.060132 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:06.060794 10929 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:06.063036 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:06.060313 10935 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:06.065119 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:06.007777 18286 consensus_queue.cc:260] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:06.066927 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:06.070708 11003 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:23:06.059175 10932 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:23:06.072312 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:06.068933 11081 raft_consensus.cc:2393] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 21: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:06.065747 10935 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:23:06.000698 17974 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:23:06.076689 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:06.077641 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:23:06.077906 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 46306.7us
I20260709 12:23:06.079447 10899 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:06.081029 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:06.078382 11009 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 23: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:06.083571 10935 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:06.040731 18321 raft_consensus.cc:3055] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:06.095257 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:06.088526 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 122230us
I20260709 12:23:06.089018 11050 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:06.097470 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:06.094220 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:06.098050 10932 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:06.097872 11624 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:06.042613 18280 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20.
I20260709 12:23:06.105677 10929 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 24.
I20260709 12:23:06.044831 17917 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:06.099083 10936 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:23:06.055694 18289 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.109002 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:06.067619 18108 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.121943 10899 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:06.109697 10829 catalog_manager.cc:5697] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 17 to 18, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 18 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.126922 10829 catalog_manager.cc:5697] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 17 to 18, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 18 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.129864 10931 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:23:06.122597 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:06.123833 11084 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:23:06.040092 17883 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.111212 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:06.135210 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:06.136466 11624 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:06.095304 18199 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:06.089996 18356 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:06.109534 18281 raft_consensus.cc:2804] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:06.095060 18321 raft_consensus.cc:740] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:06.109745 18014 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:06.140898 10936 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 22. Current term is 23. Ops: []
I20260709 12:23:06.138487 10899 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:06.045462 18348 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.151054 10932 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:23:06.131824 18309 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:06.152851 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:06.152386 10829 catalog_manager.cc:5697] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.161864 10899 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:06.164101 10829 catalog_manager.cc:5697] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 11 to 16, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 16 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:06.165249 17883 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:06.165843 10829 catalog_manager.cc:5697] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 16 to 19, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 19 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:06.168049 18312 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:23:06.168725 17552 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.168744 10974 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:06.107766 18310 consensus_queue.cc:260] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.171185 10974 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:06.172565 18321 consensus_queue.cc:260] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:06.173153 17827 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:06.173869 18321 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:06.175032 10974 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:06.154096 18281 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:06.137650 18108 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.177350 10974 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:06.181031 10899 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:06.182984 10936 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:06.183722 18348 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:06.167518 10829 catalog_manager.cc:5697] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.188413 10829 catalog_manager.cc:5697] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:06.189759 18108 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:06.151190 18286 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:06.193395 18185 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:06.190274 10829 catalog_manager.cc:5697] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 15 to 18, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 18 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.156060 18014 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:06.192797 10936 raft_consensus.cc:1240] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:06.194149 18014 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:06.194509 10829 catalog_manager.cc:5697] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 18 to 21, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 21 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:06.197444 18235 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:06.181288 18315 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.200959 18315 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.203081 18315 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:06.205914 10899 leader_election.cc:400] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18.
I20260709 12:23:06.207249 18308 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:06.208112 18308 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:06.213284 10899 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:06.214644 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:06.215284 10936 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:06.216636 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:06.217242 10931 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:06.218385 11051 leader_election.cc:400] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 24. Current term is 25.
I20260709 12:23:06.218699 11051 leader_election.cc:403] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 12:23:06.219225 18280 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.219694 18280 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.220126 18360 raft_consensus.cc:3055] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:06.171628 18301 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:06.220333 10930 raft_consensus.cc:2410] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 22 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 12:23:06.223717 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:06.224334 11009 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:06.225239 10935 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:23:06.225397 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:06.226495 10931 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 25.
I20260709 12:23:06.227912 10899 leader_election.cc:400] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22.
I20260709 12:23:06.228253 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:06.229161 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:06.229879 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:06.230271 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:06.231598 11051 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:06.232565 10928 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:23:06.234084 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:06.138175 18359 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:06.252697 10901 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:06.236474 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:06.255056 11005 raft_consensus.cc:2368] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22.
I20260709 12:23:06.132236 18289 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.242583 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60030 (request call id 3876) took 1415 ms. Trace:
I20260709 12:23:06.237460 11051 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:06.257020 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:06.240370 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:06.248497 17904 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:06.159844 18155 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:06.176162 18281 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:06.271556 10933 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:06.271147 11078 rpcz_store.cc:276] 0709 12:23:04.827617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.827793 (+   176us) service_pool.cc:224] Handling call
0709 12:23:06.242341 (+1414548us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b54001a59d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:23:06.242508 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2285763968}
I20260709 12:23:06.273594 11051 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:06.274317 11008 raft_consensus.cc:1240] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:06.269203 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:06.208984 18310 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:06.276177 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:06.273473 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:06.285142 10930 raft_consensus.cc:2393] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 15: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:06.230640 18356 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:06.221557 17827 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:06.180235 18299 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:06.263741 18329 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:06.310886 18199 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:06.289099 11051 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:06.220553 18360 raft_consensus.cc:740] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:06.241204 18301 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:06.248921 18348 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:06.260815 18185 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:06.292124 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:06.292706 10930 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:06.259948 18313 consensus_queue.cc:1059] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:23:06.283905 11009 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 25.
I20260709 12:23:06.290844 17968 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:06.295166 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:06.341121 10933 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:06.297739 18289 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:06.298105 18189 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:06.300436 10934 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:23:06.302727 17552 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:06.311956 18244 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:06.312049 11625 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:06.312973 18320 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:06.251804 18283 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:06.171527 18343 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.295895 10936 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:23:06.342314 18199 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:06.334839 10932 raft_consensus.cc:2376] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15. Re-sending same reply.
W20260709 12:23:06.293155 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 115872us
I20260709 12:23:06.284538 18335 raft_consensus.cc:2764] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:23:06.335475 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:06.365959 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:06.366679 10930 raft_consensus.cc:2393] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 22: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:06.276782 10931 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:23:06.284250 17904 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.372205 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:06.343241 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:06.373370 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:06.374275 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:06.374408 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:06.375355 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:06.375478 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:06.347672 10935 raft_consensus.cc:2393] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 21: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:23:06.377527 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:06.340302 17630 raft_consensus.cc:1064] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:23:06.378325 10931 raft_consensus.cc:2393] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 23: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
W20260709 12:23:06.378371 17630 raft_consensus.cc:1068] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Unable to promote non-voter 0b171b6aaedc4f809f2753dcfadb14ce: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:23:06.337642 18301 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:06.379338 10974 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:06.380980 10974 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:06.382185 17979 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:06.382562 17979 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.382886 17979 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:06.364001 10977 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:06.340577 17968 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:06.384234 17968 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:06.386842 11078 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:06.387712 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:06.388464 11079 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 24.
I20260709 12:23:06.371517 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:06.389015 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:06.390153 10977 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:06.390341 10930 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 24. Current term is 25. Ops: [22.14-24.15]
I20260709 12:23:06.390894 18293 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:06.391384 18293 raft_consensus.cc:697] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:06.321911 18315 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:06.391842 18337 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:06.392627 18337 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:23:06.346167 18189 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:06.392274 18293 consensus_queue.cc:237] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.364961 18199 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:06.394860 10933 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:06.339388 18310 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:23:06.403803 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:06.404172 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:06.399158 18189 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:06.405926 18014 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.402843 18199 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:06.411240 10934 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:06.395875 18360 consensus_queue.cc:260] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.413666 18360 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:06.416999 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:06.428645 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 139617us
I20260709 12:23:06.383728 17827 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:23:06.364967 18368 log.cc:927] Time spent T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.207s	user 0.001s	sys 0.001s
I20260709 12:23:06.352264 18156 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:06.399362 10929 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 24. Current term is 25. Ops: []
I20260709 12:23:06.397423 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:06.400419 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 129475us
I20260709 12:23:06.437081 10936 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:23:06.438297 10901 leader_election.cc:400] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22.
I20260709 12:23:06.438663 10901 leader_election.cc:403] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:23:06.429564 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:06.439337 11010 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:23:06.391597 10930 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 12:23:06.395598 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:06.440487 10932 raft_consensus.cc:2393] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 19: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:06.358932 18320 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.446350 18320 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:06.447995 17827 raft_consensus.cc:697] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:06.401789 18328 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.449026 17827 consensus_queue.cc:237] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.392189 18315 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.430464 10931 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 12:23:06.433611 11051 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:06.472451 11006 raft_consensus.cc:2410] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 12:23:06.455214 10901 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:06.452337 18199 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:06.484965 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.447912 18185 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:06.454900 17552 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22.
I20260709 12:23:06.441742 18014 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:06.458048 18343 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:06.453990 18315 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:06.449028 18328 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.457227 18280 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:06.500572 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.501571 10977 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:06.455287 18290 consensus_queue.cc:1059] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:23:06.489234 18308 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:23:06.522094 10977 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:06.503454 10974 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:06.523126 11084 raft_consensus.cc:1240] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:06.525997 11009 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22. Ops: []
I20260709 12:23:06.454636 18189 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.518741 10933 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:23:06.531567 11010 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:06.531517 11009 raft_consensus.cc:1240] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 23. Current term is 24. Ops: []
I20260709 12:23:06.476871 18281 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:06.536645 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 103123us
I20260709 12:23:06.536793 11008 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:23:06.538456 11051 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:06.537753 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:06.540872 10977 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:06.541618 11051 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:06.543013 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:06.526391 18315 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:06.506807 18185 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:06.574829 18337 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:06.579905 17979 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.574599 10977 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:06.602603 10977 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:06.603667 17976 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:23:06.584151 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:06.604379 17976 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:06.604823 10929 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 15.
I20260709 12:23:06.586620 10919 tablet_service.cc:1558] Processing DeleteTablet for tablet c1b75831227444d382e9c0fc5b367564 with delete_type TABLET_DATA_TOMBSTONED (TS 9e8170bbe8244e40a2b2e5011e69b697 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:46716
I20260709 12:23:06.583743 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:06.580504 18383 consensus_queue.cc:1059] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:23:06.607046 18383 raft_consensus.cc:3055] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:06.607362 18383 raft_consensus.cc:740] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:06.608179 18383 consensus_queue.cc:260] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.609391 18383 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:06.609817 10977 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:06.588739 18356 consensus_queue.cc:1059] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 12:23:06.611281 18356 raft_consensus.cc:3055] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:23:06.611620 18356 raft_consensus.cc:740] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:06.612437 18356 consensus_queue.cc:260] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.613677 18356 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:06.573767 11079 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:06.588138 18343 consensus_queue.cc:1059] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 21.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:23:06.617417 18343 raft_consensus.cc:3055] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:23:06.573225 18189 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:06.617888 17968 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.618928 11082 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 22. Current term is 23. Ops: []
I20260709 12:23:06.543031 18224 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:23:06.574601 18301 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.630602 11658 raft_consensus.cc:1240] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:06.525265 17917 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:23:06.664083 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 126499us
I20260709 12:23:06.536130 18310 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 12:23:06.656373 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 192754us
W20260709 12:23:06.632366 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 90822.7us
I20260709 12:23:06.674803 11009 raft_consensus.cc:1240] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:06.666918 11050 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:06.679015 11051 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:06.537343 18308 raft_consensus.cc:697] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:06.572778 18283 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 24. Current term is 25.
I20260709 12:23:06.677136 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:06.679740 17630 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:23:06.682950 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 54362.1us
I20260709 12:23:06.685212 11051 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:06.686435 11051 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:06.613610 18328 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:06.681326 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:06.683388 17630 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.690671 17630 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:06.690689 11076 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:06.617763 18343 raft_consensus.cc:740] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:06.682885 11077 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 23.
I20260709 12:23:06.581717 18199 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:06.602723 17979 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:06.554277 18014 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:23:06.695971 10977 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:06.696274 11006 raft_consensus.cc:1240] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:23:06.653838 18130 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:23:06.680222 18310 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.679507 18280 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:06.727195 17630 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:06.754287 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:06.698139 18321 consensus_meta.cc:287] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.524s	user 0.006s	sys 0.005s
W20260709 12:23:06.787688 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 58811.3us
I20260709 12:23:06.682531 18340 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:06.795316 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.700692 18376 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:23:06.806236 10928 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 19.
I20260709 12:23:06.702385 18189 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:06.826380 17630 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:06.722002 18185 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:06.786293 18315 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:06.785872 18310 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:06.853925 11076 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 23.
I20260709 12:23:06.784859 17979 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:06.824059 18369 log.cc:927] Time spent T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 12:23:06.896409 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 209985us
I20260709 12:23:06.701881 18224 consensus_queue.cc:1059] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.125s
I20260709 12:23:06.715842 18355 consensus_queue.cc:1059] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.120s
I20260709 12:23:06.885025 18189 raft_consensus.cc:697] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:06.972564 18189 consensus_queue.cc:237] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.817258 18340 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.980731 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:06.982365 11051 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:06.904661 18376 raft_consensus.cc:697] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:06.990600 11051 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:06.992898 11625 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:06.992998 11051 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:06.905761 18343 consensus_queue.cc:260] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:06.998332 11051 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:06.998035 18376 consensus_queue.cc:237] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:07.000885 18360 consensus_meta.cc:287] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.587s	user 0.006s	sys 0.003s
I20260709 12:23:06.998256 18343 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:07.004375 18390 tablet_replica.cc:333] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:07.009817 18014 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:23:07.012233 18156 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:06.987721 18199 consensus_queue.cc:1059] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:23:07.011443 18340 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:07.025483 18281 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:07.025815 18313 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:07.026494 18313 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:23:07.026943 18313 raft_consensus.cc:697] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:06.981007 18185 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:23:07.069977 18185 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:23:06.966885 18315 raft_consensus.cc:697] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:06.905511 18308 consensus_queue.cc:237] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:07.150746 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.156095 10935 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 12:23:07.168978 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 375014us
W20260709 12:23:07.212015 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.446352 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53346 (request call id 646) took 1192 ms. Trace:
W20260709 12:23:07.446678 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.219825 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:07.450057 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:07.260547 17968 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:07.323514 18202 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.019s	sys 0.023s
I20260709 12:23:07.325374 18224 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:07.452967 18224 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.454295 17904 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:07.455036 17904 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:07.332749 18281 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.456390 18281 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:07.458704 11004 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 12:23:07.353340 18156 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:07.461139 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:07.462009 11003 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:23:07.462567 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:07.358888 18301 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:07.027801 18313 consensus_queue.cc:237] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.464116 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:07.452440 17968 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.465674 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:07.465867 17968 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:07.074600 18380 log.cc:927] Time spent T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 12:23:07.101190 18388 log.cc:927] Time spent T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:23:07.424389 18391 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:23:07.452463 18202 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.019s	sys 0.023s
I20260709 12:23:07.467963 18391 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:07.452139 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:07.471829 18391 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:07.480365 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3918) took 1047 ms. Trace:
I20260709 12:23:07.480865 11079 rpcz_store.cc:276] 0709 12:23:06.432668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.433242 (+   574us) service_pool.cc:224] Handling call
0709 12:23:06.433504 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:06.616295 (+182791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.479754 (+863459us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b5400218754. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:07.480101 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322142976}
I20260709 12:23:07.480311 18244 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.482534 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:07.482941 18244 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.483361 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3587) took 1190 ms. Trace:
I20260709 12:23:07.483781 10935 rpcz_store.cc:276] 0709 12:23:06.292752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.377440 (+ 84688us) service_pool.cc:224] Handling call
0709 12:23:06.377704 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.437105 (+1059401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.483082 (+ 45977us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b5400451ad4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:07.483283 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1787575040}
I20260709 12:23:07.485101 17968 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:07.485332 18244 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:07.485625 18280 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:07.428087 18315 consensus_queue.cc:237] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.429594 18383 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.466264 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:07.459745 18281 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:07.455813 17904 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:07.071146 18374 log.cc:927] Time spent T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:23:07.503824 18156 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:23:07.463196 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:07.489030 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 47830.3us
I20260709 12:23:07.463230 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:07.447000 10928 rpcz_store.cc:276] 0709 12:23:06.253485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.268951 (+ 15466us) service_pool.cc:224] Handling call
0709 12:23:07.445816 (+1176865us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b54001a72d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f642fa 00007f9bb5f25b17 00007f9baf4a06d4 00007f9baf4a0662 00007f9baf4a0591 00007f9baf4a050c 00007f9baf49f7c2 00007f9baf29b48c 00007f9baf29a8c6 00007f9baf29a26f
0709 12:23:07.446120 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1202960640}
W20260709 12:23:07.504943 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.466396 11011 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:07.508159 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:07.525214 11651 raft_consensus.cc:2410] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:23:07.506258 18224 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:07.520123 18156 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:07.557895 18325 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.558859 18325 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.558775 18337 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:07.565780 18337 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:07.566606 18199 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.012s	sys 0.010s
W20260709 12:23:07.567087 18199 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.012s	sys 0.010s
I20260709 12:23:07.567585 18199 consensus_queue.cc:1243] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 12:23:07.568240 18376 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.015s	sys 0.013s
W20260709 12:23:07.568729 18376 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.015s	sys 0.013s
I20260709 12:23:07.572822 18395 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:07.573928  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:07.580763 18337 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:07.527693 18383 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.586483 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:07.586478 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:07.588376 18343 consensus_queue.cc:1059] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:07.591457 18360 raft_consensus.cc:3055] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:07.591909 18360 raft_consensus.cc:740] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:07.593217 18360 consensus_queue.cc:260] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:07.598414 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:07.599188 10928 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 24.
I20260709 12:23:07.600932 17904 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:07.601119 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:07.602752 18360 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:07.605242 18156 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:07.606355 10935 raft_consensus.cc:1275] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:07.607895 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:07.612145 10928 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:23:07.618100 11011 raft_consensus.cc:2468] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:07.619592 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:07.620784 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 59086.4us
I20260709 12:23:07.621227 10933 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
W20260709 12:23:07.623171 11051 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.008s	sys 0.006s
W20260709 12:23:07.623550 11051 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.008s	sys 0.006s
I20260709 12:23:07.577582 17979 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:07.611295 18289 raft_consensus.cc:3055] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:23:07.619113 17976 consensus_meta.cc:287] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.911s	user 0.013s	sys 0.012s
I20260709 12:23:07.628608 18289 raft_consensus.cc:740] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:23:07.631984 18014 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.010s	sys 0.011s
I20260709 12:23:07.642789 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:07.643831 18293 raft_consensus.cc:3055] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:07.644357 17552 raft_consensus.cc:3055] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:07.644798 17552 raft_consensus.cc:740] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:23:07.646528 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 648240us
I20260709 12:23:07.646207 17552 consensus_queue.cc:260] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.635543 17976 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:07.644886 18383 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:07.648422 11002 raft_consensus.cc:1240] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:07.644310 18293 raft_consensus.cc:740] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:07.659339 17552 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:23:07.661196 18014 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.011s	sys 0.012s
I20260709 12:23:07.668991 10933 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:07.668563 18293 consensus_queue.cc:260] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.669853 18293 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:07.671492 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 65081.8us
I20260709 12:23:07.672446 10974 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:07.673975 11050 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:07.674666 17883 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:23:07.675083 18315 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:23:07.675108 17883 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.675479 18315 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.676048 17883 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:07.684276 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:07.665858 18399 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:07.691284 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:07.682097 18315 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:07.690992 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:07.698606 11003 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:23:07.698408 18399 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.700788 18399 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:07.703156 17979 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.703837 17979 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:07.706844 17979 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:07.711807 18347 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.709291 11051 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:07.713761 18347 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.715544 11051 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:23:07.716868 18404 log.cc:927] Time spent T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:23:07.718668 11051 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:07.720182 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:07.720933 11659 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 25.
I20260709 12:23:07.680840 18014 raft_consensus.cc:697] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:07.692085 18325 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:07.725634 10975 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:07.723042 11050 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:07.725819 11006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 4049) took 1208 ms. Trace:
W20260709 12:23:07.709874 18393 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.029s	sys 0.018s
I20260709 12:23:07.731976 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:07.733026 18189 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:07.733333 18347 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:07.733896 18283 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:07.734553 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:07.720602 11084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 3917) took 1260 ms. Trace:
I20260709 12:23:07.739507 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:07.741572 11006 rpcz_store.cc:276] 0709 12:23:06.517065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.517287 (+   222us) service_pool.cc:224] Handling call
0709 12:23:06.517662 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:06.720653 (+202991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.725249 (+1004596us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b540029bdd4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:07.725643 (+   394us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393459456}
I20260709 12:23:07.752547 11082 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:23:07.750656 18189 raft_consensus.cc:697] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:07.754681 11002 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 12:23:07.748057 18393 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.029s	sys 0.019s
I20260709 12:23:07.749238 17976 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:23:07.756532 17976 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.756963 17976 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:07.734577 18383 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:07.748533 11084 rpcz_store.cc:276] 0709 12:23:06.398846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.399020 (+   174us) service_pool.cc:224] Handling call
0709 12:23:06.405221 (+  6201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:06.528700 (+123479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.621985 (+1093285us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54001a45d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:07.659530 (+ 37545us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270668544}
I20260709 12:23:07.754627 18189 consensus_queue.cc:237] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:07.769471 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 47476.4us
I20260709 12:23:07.775137 11080 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:07.775331 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:07.771167 18399 raft_consensus.cc:2804] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:07.776149 18185 raft_consensus.cc:3055] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:07.776290 18399 raft_consensus.cc:697] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:07.777819 11003 raft_consensus.cc:3060] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:07.775333 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:07.777122 11079 raft_consensus.cc:1275] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:07.779762 18337 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.780575 18337 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.780917 18224 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.781213 18301 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:07.782001 18301 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.782968 18337 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:07.784479 18399 consensus_queue.cc:237] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.782914 18395 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.776551 18185 raft_consensus.cc:740] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:07.770313 18283 raft_consensus.cc:697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:07.787123 17904 raft_consensus.cc:1064] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:23:07.778445 10974 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:07.774572 18383 raft_consensus.cc:697] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:07.784384 18301 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:07.794931 18347 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:07.798705 18347 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.799141 18014 consensus_queue.cc:237] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:07.800169 18310 consensus_meta.cc:287] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.841s	user 0.014s	sys 0.005s
I20260709 12:23:07.800640 18310 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.801851 18347 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:07.802882 18310 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:07.803544 11005 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 24. Current term is 25. Ops: []
I20260709 12:23:07.810055 11005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 4054) took 1275 ms. Trace:
I20260709 12:23:07.810411 11005 rpcz_store.cc:276] 0709 12:23:06.534610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.534724 (+   114us) service_pool.cc:224] Handling call
0709 12:23:06.535021 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.809044 (+1274023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.809710 (+   666us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400243454. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:07.809991 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2916489472}
I20260709 12:23:07.799538 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:07.804661 17904 consensus_queue.cc:237] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:07.812232 18185 consensus_queue.cc:260] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.805441 11050 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:07.812791 18395 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.813971 18185 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:07.814317 18400 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:23:07.814770 18400 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.815131 18400 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:07.813839 11050 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:07.798558 18283 consensus_queue.cc:237] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.770540 18289 consensus_queue.cc:260] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.808076 11007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 4056) took 1270 ms. Trace:
I20260709 12:23:07.781527 18224 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.819721 17968 consensus_queue.cc:1059] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:07.820819 18401 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:07.821242 18224 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:07.815586 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:07.822988 18383 consensus_queue.cc:237] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.824244 18289 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:23:07.828424 18410 log.cc:927] Time spent T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:23:07.815225 18395 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:07.829664 11079 raft_consensus.cc:1275] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:23:07.829761 11007 rpcz_store.cc:276] 0709 12:23:06.537531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.537658 (+   127us) service_pool.cc:224] Handling call
0709 12:23:06.537907 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:06.680528 (+142621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:06.680572 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:06.680610 (+    38us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:23:06.680640 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.796251 (+1115611us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54002dad54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:07.807649 (+ 11398us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.807894 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327568640}
I20260709 12:23:07.832095 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:07.832803 11085 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 25.
I20260709 12:23:07.841107 11080 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:23:07.773247 17883 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:07.846050 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 67709.6us
I20260709 12:23:07.848241 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:07.851625 17883 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:07.853000 11655 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 LEARNER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:07.853929 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:07.868673 17904 consensus_queue.cc:1059] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:23:07.869688 10899 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.67:40209 timed out after 1.594s (SENT) [suppressed 32 similar messages]
I20260709 12:23:07.869921 18383 raft_consensus.cc:3055] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:23:07.870425 10928 raft_consensus.cc:2393] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 25: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:23:07.857636 18301 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:23:07.871340 18301 raft_consensus.cc:697] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:07.870427 18383 raft_consensus.cc:740] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:07.872365 18301 consensus_queue.cc:237] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.874074 18383 consensus_queue.cc:260] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.853323 18281 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 12:23:07.875803 18383 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:07.879667 18189 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:23:07.888509 18412 log.cc:927] Time spent T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:23:07.890116 11051 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:07.891762 11051 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:07.894579 18313 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:07.895047 18313 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.895462 18313 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:07.811699 18315 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.901189 11003 raft_consensus.cc:2468] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 12.
W20260709 12:23:07.923039 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:07.923872 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 54224.1us
W20260709 12:23:07.924429 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.875607 18400 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.917937 18189 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:07.939210 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:07.867738 17976 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:07.945868 11079 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:23:07.950466 18347 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:07.950943 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:07.951185 18347 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.952031 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:07.952692 10929 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 23.
I20260709 12:23:07.953351 18347 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:07.941033 17974 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:07.958978 11003 raft_consensus.cc:1240] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:07.960248 17974 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:07.962724 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.967320 17974 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:07.969296 18390 raft_consensus.cc:2243] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:07.970554 18390 raft_consensus.cc:2272] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:07.972002 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 49599.5us
I20260709 12:23:07.973811 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:07.974483 11082 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 25.
I20260709 12:23:07.976387 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:07.977905 10977 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:07.981127 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:07.983162 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.985025 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:07.987138 11006 raft_consensus.cc:2393] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 26: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:07.931536 18293 consensus_queue.cc:1059] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 12:23:07.981963 17552 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 12:23:07.984213 17883 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:23:07.990348 17883 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.990703 17883 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:07.992085 10932 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 12:23:07.994258 18293 raft_consensus.cc:3055] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:23:07.994693 18293 raft_consensus.cc:740] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:07.995635 18293 consensus_queue.cc:260] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:07.996923 18293 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:23:08.000228 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 51554.6us
I20260709 12:23:07.989029 17974 consensus_queue.cc:1048] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
W20260709 12:23:08.001204 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.002925 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:08.001070 10977 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:08.007746 10977 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:08.008579 11003 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 22. Current term is 23. Ops: []
I20260709 12:23:08.008566 18310 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:08.014674 18310 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:08.014711 17976 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:08.008759 18189 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.015110 18310 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:08.015570 18189 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.016466 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:08.017022 11655 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:08.017685 18189 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:08.014200 11011 raft_consensus.cc:1240] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:08.021732 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:08.023254 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:08.023530 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:08.026001 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:08.026222 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:08.014714 18400 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:08.028250 10928 raft_consensus.cc:1240] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:08.029325 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:08.030366 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:08.031042 10927 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 25.
I20260709 12:23:08.036473 18413 consensus_queue.cc:1059] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.095s
I20260709 12:23:08.037770 18413 raft_consensus.cc:3055] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:08.038684 18413 raft_consensus.cc:740] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:08.040140 18313 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.041280 11011 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22. Ops: []
I20260709 12:23:08.042505 18313 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:08.043000 18315 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:08.043237 17974 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:08.043895 17974 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.044426 17974 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:08.045048 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:08.045730 11011 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:08.046067 17883 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.047731 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:08.050807 11006 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:23:08.052520 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:08.053860 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:08.056679 18390 ts_tablet_manager.cc:1916] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:08.057940 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:08.058874 10927 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:23:08.061885 11655 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 26.
I20260709 12:23:08.063215 10975 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:08.063215 17976 consensus_queue.cc:1059] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:08.065771 18244 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:23:08.066948 18366 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:08.066551 18413 consensus_queue.cc:260] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.069079 18413 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:08.069213 18244 raft_consensus.cc:697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:08.071632 10977 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:08.071973 18244 consensus_queue.cc:237] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:08.079125 18301 consensus_queue.cc:1048] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:08.079843 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:08.080569 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:08.081437 10928 raft_consensus.cc:2410] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:23:08.082263 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:08.083559 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:08.080135 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:08.084362 10929 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:23:08.084805 11624 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:08.082278 18301 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:08.087327 18366 raft_consensus.cc:2804] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:08.087941 18366 raft_consensus.cc:697] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:23:08.066929 17976 raft_consensus.cc:3055] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:08.088500 17976 raft_consensus.cc:740] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:08.091401 10974 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:08.103020 17883 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:08.112495 11003 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 12:23:08.121176 10977 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:08.089257 18366 consensus_queue.cc:237] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:08.129504 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:08.141928 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 50593.1us
I20260709 12:23:08.089452 17976 consensus_queue.cc:260] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.155946 10932 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:23:08.129528 18340 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:23:08.143508 18224 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:08.143366 18289 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:08.190574 18289 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.167610 18300 consensus_queue.cc:1048] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 12:23:08.168215 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.192802 18289 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:08.168888 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.169461 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:08.193785 11085 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:08.193282 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:08.152459 18325 consensus_queue.cc:1059] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:23:08.172011 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:08.173167 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.174396 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:08.196266 11077 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:08.176044 18244 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.177527 18390 ts_tablet_manager.cc:1929] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.9
I20260709 12:23:08.178642 11081 raft_consensus.cc:1240] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 12:23:08.181005 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.195369 11083 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:23:08.181510 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.182435 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.182924 18189 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:08.160367 18340 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.202359 11076 raft_consensus.cc:2393] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 24: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:08.159173 18360 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.213457 18360 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.204118 18390 log.cc:1199] T c1b75831227444d382e9c0fc5b367564 P 9e8170bbe8244e40a2b2e5011e69b697: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-0-root/wals/c1b75831227444d382e9c0fc5b367564
I20260709 12:23:08.204293 18189 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:08.202931 18340 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:08.205296 11079 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
W20260709 12:23:08.212009 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 46102.1us
I20260709 12:23:08.202867 18224 raft_consensus.cc:697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:08.215610 18390 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46716 (request call id 0) took 1629 ms. Trace:
W20260709 12:23:08.221632 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.230393 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:08.248466 11077 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 26.
I20260709 12:23:08.249053 11085 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 25.
I20260709 12:23:08.222189 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:08.253356 10935 raft_consensus.cc:2393] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 21: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:23:08.251974 11006 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23.
I20260709 12:23:08.253466 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:08.256624 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:08.257277 10936 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:08.220561 17552 raft_consensus.cc:3055] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:08.217262 18189 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:08.220371 18347 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.283658 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.284126 18347 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.285097 11078 raft_consensus.cc:1240] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 12:23:08.286273 18347 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:08.286931 11083 raft_consensus.cc:1240] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:08.286154 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:08.287778 18315 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.288359 11082 raft_consensus.cc:2368] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 23. Current term is 24.
I20260709 12:23:08.288269 18315 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:08.290539 18315 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:08.291962 10933 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:23:08.265501 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 137106us
I20260709 12:23:08.215772 18360 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:08.262252 18300 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.246217 18390 rpcz_store.cc:276] 0709 12:23:06.585964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.586352 (+   388us) service_pool.cc:224] Handling call
0709 12:23:06.991554 (+405202us) ts_tablet_manager.cc:1151] Deleting tablet c1b75831227444d382e9c0fc5b367564
0709 12:23:07.004020 (+ 12466us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:23:08.167693 (+1163673us) tablet_metadata.cc:665] Metadata flushed
0709 12:23:08.177398 (+  9705us) tablet_metadata.cc:665] Metadata flushed
0709 12:23:08.215485 (+ 38087us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":963098,"tablet-delete.queue_time_us":360336,"thread_start_us":92901,"threads_started":1}
I20260709 12:23:08.264962 17552 raft_consensus.cc:740] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:08.279263 18224 consensus_queue.cc:237] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.281008 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.281704 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.281965 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.282366 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.300261 11079 raft_consensus.cc:2368] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18.
I20260709 12:23:08.283042 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.301118 11080 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 25.
I20260709 12:23:08.283224 11084 raft_consensus.cc:1240] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:23:08.294433 10977 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:08.295336 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:08.302623 11077 raft_consensus.cc:2393] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 20: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:08.225067 18308 consensus_queue.cc:1059] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 12:23:08.222486 18244 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.326332 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:08.329713 10977 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:08.305071 17883 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:23:08.321866 18014 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:08.323518 18189 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:08.343922 18347 raft_consensus.cc:3055] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:23:08.344408 18347 raft_consensus.cc:740] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:08.347246 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.320796 18325 consensus_queue.cc:1059] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:23:08.336550 17883 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.337121 18293 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:08.360227 11078 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:08.361223 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:08.366361 10936 raft_consensus.cc:2468] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 25.
I20260709 12:23:08.367331 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.329202 18360 consensus_queue.cc:1059] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 12:23:08.320714 18300 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.374469 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:08.374539 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:08.345347 18347 consensus_queue.cc:260] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:08.374351 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.410423 11085 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 25.
I20260709 12:23:08.416606 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:23:08.415766 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:08.418376 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 86615.7us
I20260709 12:23:08.372545 17883 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:08.424984 11085 raft_consensus.cc:1240] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22. Ops: []
I20260709 12:23:08.372185 18293 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.423831 10977 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:08.369886 17976 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:08.428725 11011 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:08.427757 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:08.374780 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:08.430781 11003 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:23:08.432672 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.345371 18310 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.436968 11079 raft_consensus.cc:2410] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:23:08.432850 10901 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:08.446394 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:08.416640 18244 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:08.449563 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:08.448637 11006 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:23:08.452710 11007 raft_consensus.cc:2393] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 24: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:08.429277 18293 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:08.456310 11077 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 25.
I20260709 12:23:08.434618 18360 consensus_queue.cc:1243] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 23.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:23:08.409495 18189 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.458364 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:08.457751 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:08.407881 18014 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.473562 11078 raft_consensus.cc:1240] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 23. Current term is 24. Ops: []
I20260709 12:23:08.474412 11003 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 24.
I20260709 12:23:08.407438 18432 consensus_queue.cc:1059] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.109s
I20260709 12:23:08.451402 18430 raft_consensus.cc:2804] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:23:08.417347 17552 consensus_queue.cc:260] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.488883 11083 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:08.487574 11002 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:23:08.490553 11007 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:08.491446 18437 raft_consensus.cc:3055] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:23:08.491886 18437 raft_consensus.cc:740] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:08.492722 18437 consensus_queue.cc:260] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.490787 11005 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
W20260709 12:23:08.493597 10899 leader_election.cc:336] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Timed out: RequestConsensusVote RPC to 127.9.131.67:40209 timed out after 2.192s (SENT)
W20260709 12:23:08.494591 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.494043 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:08.496361 18437 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:08.475749 18289 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.475566 18347 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:08.497555 11078 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 24. Current term is 25. Ops: []
W20260709 12:23:08.505702 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:08.506186 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.484928 18360 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.499933 18395 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.500612 18432 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:08.502553 18440 raft_consensus.cc:3055] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:23:08.499387 18430 raft_consensus.cc:697] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:08.508834 11006 raft_consensus.cc:2393] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 24: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:08.515686 11011 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 12:23:08.516314 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 83547us
I20260709 12:23:08.487780 18436 raft_consensus.cc:3055] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:23:08.522924 10899 leader_election.cc:336] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Timed out: RequestConsensusVote RPC to 127.9.131.67:40209 timed out after 2.227s (SENT)
I20260709 12:23:08.526321 11005 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:23:08.522925 10901 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:08.528244 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:08.529263 11078 raft_consensus.cc:1240] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:08.510288 18289 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.514205 18360 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:08.524241 17552 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:08.514485 18432 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.531829 11081 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22. Ops: []
I20260709 12:23:08.552400 18300 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:08.532999 11076 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 22. Current term is 23. Ops: []
I20260709 12:23:08.517048 18440 raft_consensus.cc:740] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:08.566953 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.568790 11050 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:08.522794 18436 raft_consensus.cc:740] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:08.580118 11002 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:23:08.553690 18310 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:08.546043 18423 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.217s	user 0.003s	sys 0.000s
I20260709 12:23:08.584291 18400 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:08.573627 11050 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:08.572527 17552 consensus_queue.cc:1059] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:08.545939 18189 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:08.583552 18301 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:08.532804 18014 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:08.542390 18360 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:08.551822 18432 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:08.602170 11084 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:23:08.575318 11077 raft_consensus.cc:1240] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22. Ops: []
I20260709 12:23:08.561012 18325 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:08.518342 18395 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.535516 18289 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:08.583590 17974 consensus_meta.cc:287] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.000s
I20260709 12:23:08.599509 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.574558 10901 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:08.604509 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.610283 10974 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:08.609038 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:08.594247 18315 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:23:08.593566 18185 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:08.613096 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.616664 11078 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:23:08.617569 18185 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.617758 18310 consensus_queue.cc:1059] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:08.615665 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.612478 11050 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:08.618687 18310 raft_consensus.cc:3055] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:08.618096 18185 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:08.619065 18310 raft_consensus.cc:740] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:08.619065 18289 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:08.606016 18014 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
W20260709 12:23:08.621208 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 46737.1us
I20260709 12:23:08.626331 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.635402 18301 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:08.639830 18301 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:08.640291 18301 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:08.639007 10901 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:08.642491 18308 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:08.642941 18308 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.643287 18308 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:08.630056 10974 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:08.644939 18427 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:08.645339 18427 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:08.645673 18427 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:08.651085 18308 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:08.653803 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:08.654423 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.654675 18427 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.653581 10974 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:08.656970 17552 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:08.658532 11008 raft_consensus.cc:1240] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:08.659029 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:08.659629 11002 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:23:08.657357 18443 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:23:08.660437 18308 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:08.666760 17552 consensus_queue.cc:1059] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:08.666998 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:08.667795 11008 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:08.668219 18360 raft_consensus.cc:3055] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:08.668722 18360 raft_consensus.cc:740] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:08.669473 18360 consensus_queue.cc:260] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.671430 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:08.672278 11082 raft_consensus.cc:2410] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:23:08.664762 10974 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:08.673564 18443 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:23:08.673358 10901 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:08.674495 18427 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:08.675146 18443 raft_consensus.cc:697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:08.676229 18443 consensus_queue.cc:237] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.679076 18408 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:08.679769 18408 consensus_queue.cc:1243] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 1abf4b385a2b493ab83f593a1f8c9cd1 log is divergent from this leader: its last log entry 19.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:23:08.679294 10974 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:08.681663 18300 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:08.681767 18308 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:08.682101 18300 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.682484 18300 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:08.682981 18436 consensus_queue.cc:260] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.540359 18430 consensus_queue.cc:237] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.685304 11076 raft_consensus.cc:2393] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 20: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:08.685497 18315 raft_consensus.cc:697] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:08.686224 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:08.615662 11079 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
W20260709 12:23:08.688059 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 169858us
I20260709 12:23:08.682165 11008 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:23:08.689738 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.605744 18325 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.691545 11084 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:23:08.693439 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:08.694854 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:08.697865 11011 raft_consensus.cc:1275] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:23:08.699489 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:08.700610 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.702252 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.703281 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.601943 18313 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.086s
W20260709 12:23:08.701572 11049 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.599498 18189 consensus_queue.cc:1059] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.088s
I20260709 12:23:08.709813 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.623889 18444 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:08.718684 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:08.690486 18437 raft_consensus.cc:3055] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:23:08.723536 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:08.724043 11077 pending_rounds.cc:85] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 13
I20260709 12:23:08.682175 18308 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.720288 11078 raft_consensus.cc:2393] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 23: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:08.623507 18441 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.724200 11076 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:23:08.697602 18325 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:08.725633 11622 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:08.700223 17883 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.723409 18437 raft_consensus.cc:740] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:08.724413 11077 pending_rounds.cc:107] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 12:23:08.734119 11077 raft_consensus.cc:2889] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:08.726374 18436 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:08.615793 17974 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:08.734580 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 52299.6us
W20260709 12:23:08.739360 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 102608us
I20260709 12:23:08.729825 18308 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:08.622332 18310 consensus_queue.cc:260] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.723743 18444 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:08.686473 18315 consensus_queue.cc:237] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.740550 11622 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:08.722752 18400 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 12:23:08.733843 18289 raft_consensus.cc:3055] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:08.747066 11007 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 25. Current term is 26. Ops: []
W20260709 12:23:08.749096 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.754539 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:08.755172 10929 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:08.756265 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:08.756747 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:08.624145 18440 consensus_queue.cc:260] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.757730 10935 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 24. Current term is 25. Ops: []
W20260709 12:23:08.749706 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.756922 10932 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:23:08.761320 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:08.741427 18448 raft_consensus.cc:2764] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
I20260709 12:23:08.764358 10929 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 24.
I20260709 12:23:08.768369 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:08.764636 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:08.770226 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.775127 18439 consensus_queue.cc:1048] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:23:08.751912 18289 raft_consensus.cc:740] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:08.747561 18444 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:08.779491 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:08.783020 10929 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:23:08.794117 10931 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:23:08.776252 18437 consensus_queue.cc:260] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.796003 18437 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:08.796859 18366 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:08.747517 18301 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.798593 18310 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:08.762359 18432 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.803880 18432 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:08.804816 17974 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:08.805945 10930 raft_consensus.cc:1275] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:23:08.798594 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:08.807193 18301 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:08.810827 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:08.811474 11655 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:23:08.817188 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:08.834391 10935 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260709 12:23:08.834849 10935 pending_rounds.cc:85] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 14
I20260709 12:23:08.780215 10932 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 24.
I20260709 12:23:08.839691 10935 pending_rounds.cc:107] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 12:23:08.840116 10935 raft_consensus.cc:2889] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:08.741045 18441 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.842248 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:08.852164 11079 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 12:23:08.852622 11076 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:08.855065 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.862967 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:23:08.864183 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 117805us
W20260709 12:23:08.872395 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 131924us
W20260709 12:23:08.884583 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 49916us
I20260709 12:23:08.887055 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:08.892388 10935 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:23:08.877275 17974 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.870174 18432 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.915266 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:08.916846 10932 raft_consensus.cc:2410] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:23:08.894045 18464 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.925427 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:08.926378 18432 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.927953 18464 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.930200 18464 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:08.931074 11051 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:08.925392 10901 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:08.883126 18413 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.038s
I20260709 12:23:08.935935 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:08.932588 18395 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:08.937006 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:08.957356 11007 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:08.912226 11079 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:35562
I20260709 12:23:08.958889 11079 raft_consensus.cc:606] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:08.938977 18308 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.917953 17974 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:08.943467 18340 consensus_meta.cc:287] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.680s	user 0.006s	sys 0.001s
I20260709 12:23:08.936905 18300 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.946844 18185 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.955303 18441 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:08.961874 11076 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:23:08.965166 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:08.993326 11003 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
W20260709 12:23:08.989750 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 186470us
I20260709 12:23:08.996531 18432 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:08.997205 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:08.997890 10927 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:23:08.890851 18289 consensus_queue.cc:260] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:08.998380 18300 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:08.994817 10901 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:08.963035 18464 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:09.001123 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:09.001494 11006 raft_consensus.cc:2393] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 22: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:23:09.006561 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.976325 18395 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:09.013792 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 93931.6us
W20260709 12:23:09.025110 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.029448 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:09.000715 18289 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:09.019099 11083 raft_consensus.cc:2393] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 22: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:09.030099 11079 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:23:09.028920 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:23:09.019320 18293 consensus_meta.cc:287] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.000s
I20260709 12:23:09.003196 18441 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:08.993568 18340 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.038769 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:09.017799 18464 raft_consensus.cc:697] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:09.040597 11076 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:23:09.046262 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.018217 18395 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.038131 18441 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.053282 11009 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 23. Current term is 24. Ops: []
W20260709 12:23:09.054042 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.053479 10974 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:23:09.059087 18461 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:23:09.059265 17974 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:09.064081 11076 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:23:09.065321 18325 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.056700 18300 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:23:09.067924 18347 consensus_meta.cc:287] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.558s	user 0.008s	sys 0.003s
I20260709 12:23:09.068553 18300 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.070017 10928 raft_consensus.cc:2393] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 22: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:23:09.075837 18185 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:09.077245 18340 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:09.078495 11007 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23.
I20260709 12:23:09.075789 18300 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:09.078879 18464 consensus_queue.cc:237] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.067845 18325 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:09.084870 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:09.085342 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.086495 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:09.087113 11007 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:09.088721 18360 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:09.080030 18479 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:09.089761 18479 raft_consensus.cc:697] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:09.090734 18479 consensus_queue.cc:237] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.092732 10934 raft_consensus.cc:2410] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 24 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 12:23:09.105546 18395 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:09.105773 11004 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:09.038061 18293 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.106772 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:09.108114 18293 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:09.108812 11005 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:09.109645 18400 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:09.078773 18308 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:09.114127 11004 raft_consensus.cc:1240] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 24. Current term is 25. Ops: []
I20260709 12:23:09.120141 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:09.120800 11011 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:09.123138 11003 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:23:09.123046 10901 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:09.058115 18441 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:09.083688 17883 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:09.122354 11007 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:09.128270 18468 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:23:09.130640 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 199634us
I20260709 12:23:09.131448 11051 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:09.135954 18325 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:23:09.146759 18283 consensus_queue.cc:1059] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:09.147547 10974 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:09.148993 10974 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:09.150048 11051 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:09.149428 18014 raft_consensus.cc:2955] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 9 to 12, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:09.150641 18244 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:09.151042 18244 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.151389 18244 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:09.151464 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:09.152585 18293 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:09.153136 18462 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:09.153503 18383 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:23:09.153172 18293 raft_consensus.cc:697] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:09.152884 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:09.155318 18293 consensus_queue.cc:237] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.156704 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:09.153509 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:09.153069 11080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:35562
I20260709 12:23:09.157598 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:09.158663 11080 raft_consensus.cc:606] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:09.156617 11082 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:23:09.151723 11051 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:09.161047 11083 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:23:09.171126 10974 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:23:09.171612 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 43651us
W20260709 12:23:09.175608 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.175115 18448 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:09.183753 11051 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:09.184720 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:09.181541 11655 raft_consensus.cc:2955] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 9 to 12, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:09.173206 18325 raft_consensus.cc:697] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:09.193813 18383 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 12:23:09.191537 18395 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:09.173568 18189 consensus_queue.cc:1059] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:23:09.194344 18462 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:23:09.195066 18400 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:09.215710 11011 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:09.186604 18448 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:09.190068 18283 consensus_queue.cc:1059] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:23:09.206374 18395 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:09.228113 11051 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:09.225837 10901 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:09.234166 17979 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.234719 17979 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.236935 17979 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:09.243297 17552 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:23:09.243328 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.243903 17552 raft_consensus.cc:697] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:23:09.244701 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.245385 10901 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:09.245182 17552 consensus_queue.cc:237] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.221931 18445 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:09.248415 18445 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:09.249842 10899 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:09.252761 18325 consensus_queue.cc:237] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.256039 18283 consensus_queue.cc:1243] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 25.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:23:09.256764 18462 raft_consensus.cc:3055] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:23:09.257133 18462 raft_consensus.cc:740] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:09.257886 18462 consensus_queue.cc:260] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.259040 18462 raft_consensus.cc:3060] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:09.260030 18437 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:09.260752 18281 consensus_queue.cc:1048] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:09.250762 18445 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:09.201154 18468 consensus_queue.cc:1059] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 12:23:09.267145 10977 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:09.267962 18437 raft_consensus.cc:697] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:09.270413 17979 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:23:09.271363 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:09.272046 18457 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:23:09.278414 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.281658 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:09.281909 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:09.282358 10977 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:09.282395 10936 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:09.271577 18185 raft_consensus.cc:3055] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 LEADER]: Stepping down as leader of term 25
W20260709 12:23:09.287225 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.289165 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:09.289590 11076 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:23:09.290167 10935 raft_consensus.cc:2410] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:23:09.290514 18293 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:09.291152 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:09.291718 10933 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:09.271413 18437 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.295364 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:09.296026 18301 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:09.296499 18301 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:09.296873 18301 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:09.297164 17883 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:09.300099 18441 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.302364 18441 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:09.302589 18448 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:09.304607 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:23:09.304792 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 76774us
I20260709 12:23:09.305238 11002 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:09.305604 11051 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:09.306773 11051 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:09.308039 18189 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:09.308928 18189 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:09.309597 18189 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:09.312861 11085 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:23:09.305538 18347 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.313946 18347 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:09.314379 18440 raft_consensus.cc:3060] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:09.315744 11002 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:23:09.316475 18383 raft_consensus.cc:3055] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:09.316875 18383 raft_consensus.cc:740] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:09.316957 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:09.317745 10936 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:23:09.307801 11051 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:09.231891 18395 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:09.321045 11080 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 13. (term mismatch)
I20260709 12:23:09.321766 11080 pending_rounds.cc:85] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 12
I20260709 12:23:09.322059 11080 pending_rounds.cc:107] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 24.13
I20260709 12:23:09.323156 11080 raft_consensus.cc:2889] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:09.322669 10901 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:09.268079 18308 consensus_queue.cc:1059] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 12:23:09.328991 18289 raft_consensus.cc:3055] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:23:09.329456 18289 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:09.330344 18289 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.331471 18189 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:09.332950 11051 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:09.333817 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:09.334978 10927 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:23:09.335243 18485 log.cc:927] Time spent T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:23:09.336534 18360 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:09.337179 18308 raft_consensus.cc:3055] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:23:09.337565 18308 raft_consensus.cc:740] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:09.338466 18308 consensus_queue.cc:260] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.340198 18308 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:09.343559 10932 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 12:23:09.343995 10932 pending_rounds.cc:85] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 13
I20260709 12:23:09.344211 10932 pending_rounds.cc:107] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 12:23:09.344430 10932 raft_consensus.cc:2889] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:09.346397 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:09.347067 10932 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 24.
I20260709 12:23:09.347457 18360 raft_consensus.cc:697] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:09.348533 18360 consensus_queue.cc:237] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.351466 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:09.352131 10935 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:09.353847 10931 raft_consensus.cc:2468] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:23:09.356431 10927 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:23:09.358063 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:09.356742 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:09.359104 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:09.361325 10932 raft_consensus.cc:2393] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 19: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:23:09.361939 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:09.362699 10932 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 14. (term mismatch)
I20260709 12:23:09.363152 10932 pending_rounds.cc:85] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 13
I20260709 12:23:09.363415 10932 pending_rounds.cc:107] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 24.14
I20260709 12:23:09.363684 10932 raft_consensus.cc:2889] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:09.364975 11085 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:35562
I20260709 12:23:09.365746 11625 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:09.366662 10932 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 12:23:09.365940 10936 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:23:09.369412 17552 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:09.371977 17979 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:09.369859 10974 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:09.319996 18185 raft_consensus.cc:740] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:09.374655 17552 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.356673 18189 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:23:09.372027 18444 consensus_meta.cc:287] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.002s
I20260709 12:23:09.377905 10977 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:09.388310 18300 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:23:09.391980 17552 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:09.386116 18315 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:23:09.399718 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:09.400599 11005 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:23:09.403831 18281 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:09.404512 18281 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:09.317776 18383 consensus_queue.cc:260] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.405524 18462 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:09.405886 18347 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:09.409399 10901 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:09.410502 18244 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.410504 17552 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:09.411773 17552 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:09.412144 17552 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:09.378651 18489 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:23:09.417485 18185 consensus_queue.cc:260] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.417562 18383 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:09.426456 17552 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.428958 11051 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:09.375769 18479 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:09.391005 18444 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.433943 18283 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:09.434540 18444 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:09.436648 18479 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.437089 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:09.437704 10930 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:09.437114 18479 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:09.437597 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:09.440698 11655 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 12:23:09.442065 10900 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:09.444478 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:09.392174 18478 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:09.446694 18185 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:09.450423 18400 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:09.450732 18189 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:09.452186 17976 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:23:09.443640 18460 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:09.454614 18460 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.454977 18460 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:09.450786 10900 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:09.481773 18281 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:09.483603 18244 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:09.466454 11051 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:09.490303 10930 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 24.
I20260709 12:23:09.490866 10935 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:23:09.496878 11085 raft_consensus.cc:606] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:09.497076 10933 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 26.
I20260709 12:23:09.497390 11085 raft_consensus.cc:614] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:23:09.497972 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 66861us
W20260709 12:23:09.500720 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 48611.6us
W20260709 12:23:09.500754 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 50055.2us
I20260709 12:23:09.498694 10977 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:09.506484 18300 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:23:09.506971 18300 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.507357 18300 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:09.512717 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:09.513454 11084 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:08.656510 10821 catalog_manager.cc:5028] TS 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): tablet c1b75831227444d382e9c0fc5b367564 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:23:09.516795 11051 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:09.436532 18408 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 12:23:09.525923 17552 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:09.525274 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:23:09.535986 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.536258 11051 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:09.541006 10977 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:23:09.540763 10821 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 884378us
W20260709 12:23:09.536556 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 349415us
I20260709 12:23:09.523779 18400 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:23:09.547480 10977 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:09.543841 11051 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:09.555740 10977 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:09.504938 17976 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 12:23:09.540391 18315 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:09.555016 11007 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:23:09.549636 11002 raft_consensus.cc:2955] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 9 to 12, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:09.527009 18189 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:23:09.545358 18283 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:09.569403 11051 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:09.601380 18185 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:23:09.524477 18395 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.552932 18400 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:09.609833 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:09.610639 11005 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:23:09.606920 11050 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:09.555639 18413 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:09.588819 18469 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:09.589228 18436 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:09.589738 18473 raft_consensus.cc:2804] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:09.627904 10934 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 12:23:09.592029 10929 raft_consensus.cc:1275] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 12:23:09.593006 11084 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:23:09.628661 10929 pending_rounds.cc:85] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 14
I20260709 12:23:09.595352 18301 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.542811 18430 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 12:23:09.598259 18444 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:09.553673 18472 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 12:23:09.570065 17883 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:23:09.641685 10928 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:23:09.617061 18400 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:09.587679 11010 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23.
I20260709 12:23:09.622524 10927 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:23:09.623021 10935 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 25. Current term is 26. Ops: []
I20260709 12:23:09.623293 10930 raft_consensus.cc:1240] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:09.573570 10831 catalog_manager.cc:5697] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 16 to 21, leader changed from 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 21 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:09.629030 10929 pending_rounds.cc:107] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 12:23:09.649665 10929 raft_consensus.cc:2889] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:09.631212 18189 consensus_queue.cc:1059] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:09.633852 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:09.649279 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:09.651204 11077 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:23:09.650780 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:09.574051 18462 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:09.640295 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:09.663106 11084 raft_consensus.cc:2376] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 25. Re-sending same reply.
I20260709 12:23:09.662967 18462 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:09.641855 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 100637us
I20260709 12:23:09.582270 18300 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.644363 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:09.620535 18413 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.666806 18413 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:09.621001 18185 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:09.652069 11076 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:09.651299 11081 raft_consensus.cc:2376] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 25. Re-sending same reply.
I20260709 12:23:09.659942 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:09.676192 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:09.660655 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:09.660926 18313 consensus_queue.cc:1059] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:09.677976 18313 raft_consensus.cc:3055] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:09.678396 18313 raft_consensus.cc:740] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:09.679440 18189 consensus_queue.cc:1243] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer 2201bad9e18849b09cf82de29dd032d3 log is divergent from this leader: its last log entry 19.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:23:09.680006 18185 raft_consensus.cc:3055] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:09.680392 18185 raft_consensus.cc:740] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:09.681244 18185 consensus_queue.cc:260] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.682446 18185 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:09.661329 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:09.661998 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:09.686280 18289 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:09.690001 18301 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:09.692022 18440 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.692363 18395 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:09.694360 17883 raft_consensus.cc:697] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 24 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:09.695339 17883 consensus_queue.cc:237] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.699673 11078 raft_consensus.cc:2410] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:23:09.699772 10901 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:09.701164 10901 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:09.703830 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:09.704807 11080 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:09.722384 11080 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:23:09.727811 11076 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23.
I20260709 12:23:09.641458 18473 raft_consensus.cc:697] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:09.737859 11002 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 12:23:09.704600 10899 leader_election.cc:336] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Timed out: RequestConsensusVote RPC to 127.9.131.67:40209 timed out after 1.594s (SENT)
I20260709 12:23:09.729822 18347 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:23:09.708379 18436 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:09.749895 11005 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:23:09.761029 11051 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:09.702767 18440 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.653784 18444 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:09.679350 18313 consensus_queue.cc:260] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:09.794322 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 89742.3us
I20260709 12:23:09.795183 10899 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:09.801415 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:09.801678 18440 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:09.804292 18444 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:09.809582 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:09.810475 11083 raft_consensus.cc:2393] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 19: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:09.777645 18347 raft_consensus.cc:697] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:09.824806 18347 consensus_queue.cc:237] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.826865 18308 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:09.824829 18300 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:09.828850 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:09.829665 11081 raft_consensus.cc:2393] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 23: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:09.829406 18413 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.831096 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:09.833923 18479 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.835654 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:09.836294 11078 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:23:09.837549 18497 log.cc:927] Time spent T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:23:09.838939 18473 consensus_queue.cc:237] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.840054 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:09.840657 18313 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:09.839491 10929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 3184) took 1028 ms. Trace:
I20260709 12:23:09.785991 18436 raft_consensus.cc:697] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:09.841586 10929 rpcz_store.cc:276] 0709 12:23:08.836716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:08.841442 (+  4726us) service_pool.cc:224] Handling call
0709 12:23:08.841694 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:09.650215 (+808521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.839238 (+189023us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b540002c6d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:09.839429 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1724686720}
I20260709 12:23:09.844286 18325 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:09.844830 18325 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.831692 18413 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:09.852717 18460 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:09.854033 11078 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:09.855189 18460 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:09.856220 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:09.856932 11659 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:09.822993 18508 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:23:09.856149 18436 consensus_queue.cc:237] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.874486 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:09.874894 11659 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
W20260709 12:23:09.877023 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 81912.5us
I20260709 12:23:09.877331 10900 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:09.877848 10899 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:23:09.880075 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 52732.5us
I20260709 12:23:09.880689 10974 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:09.888069 11085 raft_consensus.cc:2393] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 22: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:09.884812 18479 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:09.842499 18469 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 12:23:09.895442 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:23:09.892565 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 111471us
I20260709 12:23:09.892887 11002 raft_consensus.cc:1240] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:09.913754 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:09.914590 11010 raft_consensus.cc:2368] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19.
I20260709 12:23:09.892887 18300 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:09.916764 18300 raft_consensus.cc:697] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:09.917706 18300 consensus_queue.cc:237] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:09.922297 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:09.923106 10931 raft_consensus.cc:2393] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 18: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:23:09.925758 11078 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 12:23:09.927359 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 373236us
I20260709 12:23:09.928160 10977 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:09.896705 18460 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:09.898737 18462 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:09.945187 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:09.946331 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:09.888242 18315 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.042s
W20260709 12:23:09.956548 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 78754.1us
I20260709 12:23:09.894603 18464 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:23:09.958429 18473 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:09.915308 18436 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:09.969370 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:09.971104 10977 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:09.971297 10899 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:09.965942 10933 raft_consensus.cc:2955] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 9 to 12, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:09.950374 18460 raft_consensus.cc:697] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:09.976425 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:09.977474 11085 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:09.986304 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:09.987388 11082 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:09.972602 18473 raft_consensus.cc:697] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:10.002559 11083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
 from {username='slave'} at 127.0.0.1:35562
I20260709 12:23:10.003427 11083 raft_consensus.cc:606] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Received request to transfer leadership to TS 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:23:10.003784 11083 raft_consensus.cc:614] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:10.008533 18473 consensus_queue.cc:237] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.009603 11085 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:23:10.017241 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:10.021862 18400 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.023222 11078 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:09.978274 18472 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:23:10.024488 10831 catalog_manager.cc:5697] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 16 to 18, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 18 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:09.982913 18457 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:23:10.026182 10831 catalog_manager.cc:5697] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:10.027688 10831 catalog_manager.cc:5697] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.029289 11077 raft_consensus.cc:2410] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 12:23:10.032002 11078 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 25.
I20260709 12:23:10.034087 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:10.034406 18400 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:10.037389 11080 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:23:10.038444 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:09.996626 18460 consensus_queue.cc:237] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:10.044644 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:10.047322 11624 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:10.024425 18472 raft_consensus.cc:697] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:23:10.052412 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 91454us
I20260709 12:23:10.055359 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:10.060446 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:10.061266 11076 raft_consensus.cc:2393] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 19: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:10.067579 11082 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:23:10.070143 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:10.070839 11005 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:23:10.072420 11002 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:23:10.080291 10931 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 24.
I20260709 12:23:10.076519 10901 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:23:10.098523 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.135190 10899 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:10.136287 11010 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 12:23:10.141300 11050 leader_election.cc:400] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19.
I20260709 12:23:10.142001 11050 leader_election.cc:403] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:10.070317 18445 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:23:10.145135 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 71615.2us
I20260709 12:23:10.067956 18517 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.178s
I20260709 12:23:10.135973 18457 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:10.100659 18383 consensus_queue.cc:1059] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 12:23:10.153903 18383 raft_consensus.cc:3055] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:10.154376 18383 raft_consensus.cc:740] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:10.156510 18474 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:23:10.160296 10974 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:10.143494 18347 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.147531 18360 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:10.100832 18400 consensus_queue.cc:1048] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 12:23:10.170855 11079 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:35562
I20260709 12:23:10.134775 18450 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 12:23:10.155320 18383 consensus_queue.cc:260] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.141554 18440 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:23:10.171696 11079 raft_consensus.cc:606] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:10.165612 10974 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:10.149009 18516 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19.
I20260709 12:23:10.136147 18443 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:23:10.200588 11079 raft_consensus.cc:614] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:23:10.173868 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 93915.7us
I20260709 12:23:10.152395 18457 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:10.168378 18514 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:10.207527 10974 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:10.214308 10974 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:10.217530 18300 raft_consensus.cc:2804] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:23:10.206938 18457 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:10.228197 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:10.213269 18479 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:10.224313 18395 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:10.171742 18347 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.226140 18514 raft_consensus.cc:697] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:10.203310 18472 consensus_queue.cc:237] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.262418 18383 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:10.204679 10899 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:10.289976 18494 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:10.290460 18523 log.cc:927] Time spent T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:23:10.290244 18514 consensus_queue.cc:237] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.291376 18395 raft_consensus.cc:697] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:10.294621 18436 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:10.273758 18189 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.297394 11082 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 16. (term mismatch)
I20260709 12:23:10.273836 18479 raft_consensus.cc:697] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:10.308925 11082 pending_rounds.cc:85] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 15
I20260709 12:23:10.310738 11082 pending_rounds.cc:107] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 23.16
I20260709 12:23:10.311062 11082 raft_consensus.cc:2889] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:10.283162 18300 raft_consensus.cc:697] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:10.306401 18494 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.308813 18450 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:10.316411 18360 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:10.314791 18189 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:10.332492 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 127924us
I20260709 12:23:10.336362 18395 consensus_queue.cc:237] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.341233 18494 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:10.341946 18300 consensus_queue.cc:237] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.352334 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:10.353282 11010 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:23:10.354712 11050 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:10.365252 18516 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:10.365772 18516 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.366117 18516 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:10.369357 18189 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:10.374948 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:10.353869 18360 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:10.387902 18360 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:10.351842 18479 consensus_queue.cc:237] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.393004 18360 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:10.410969 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 326466us
I20260709 12:23:10.412671 11051 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:10.414100 18289 raft_consensus.cc:2764] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader election decision vote started in defunct term 24: won
I20260709 12:23:10.416620 18494 raft_consensus.cc:993] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:10.417093 18494 raft_consensus.cc:1081] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:10.393661 18360 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:10.486891 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 109210us
I20260709 12:23:10.466358 11010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37594
I20260709 12:23:10.455370 18450 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.508642 18450 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.511180 18450 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:10.497164 11010 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:10.499289 18360 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:10.502449 18510 log.cc:927] Time spent T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.659s	user 0.012s	sys 0.000s
I20260709 12:23:10.487985 18457 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.504211 18189 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:10.514954 11010 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:10.488852 18347 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:10.493028 18289 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.534298 10899 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:10.541411 11010 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.524591 18189 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:10.537880 18347 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:10.528463 18289 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.564604 11010 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:10.569875 18325 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:10.571107 11083 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:23:10.572280 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:10.572906 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:23:10.577389 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 47274us
I20260709 12:23:10.578018 10899 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:10.569785 18189 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:10.585041 18325 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:23:10.585647 18325 raft_consensus.cc:697] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:10.586601 18325 consensus_queue.cc:237] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.587280 18289 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:10.587477 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:10.576730 18408 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.590065 18408 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.593421 18408 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:10.594050 11010 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 25.
I20260709 12:23:10.594770 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:10.595600 11078 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 25.
I20260709 12:23:10.598703 10831 catalog_manager.cc:5697] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 15 to 17, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 17 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:10.605420 11624 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:10.609141 10899 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:10.607249 18526 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:10.618412 11081 raft_consensus.cc:3055] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:23:10.618855 11081 raft_consensus.cc:740] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:10.622351 18360 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.626734 18360 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.629108 18360 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:10.629804 10829 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35608 (request call id 265) took 30926 ms (client timeout 15000 ms). Trace:
I20260709 12:23:10.631779 10831 catalog_manager.cc:5697] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:10.633261 10831 catalog_manager.cc:5697] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 14 to 17, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 17 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.634819 10831 catalog_manager.cc:5697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 22 to 24, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 24 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.638902 10831 catalog_manager.cc:5697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:10.640311 10831 catalog_manager.cc:5697] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:10.630236 10829 rpcz_store.cc:269] 0709 12:22:39.703527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.703808 (+   281us) service_pool.cc:224] Handling call
0709 12:23:10.629582 (+30925774us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:06.493395 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:06.494459 (+  1064us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:06.494504 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:23:06.494522 (+    18us) tablet.cc:662] Decoding operations
0709 12:23:06.621354 (+126832us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:06.621413 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:06.621440 (+    27us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:23:06.622874 (+  1434us) tablet.cc:701] Row locks acquired
0709 12:23:06.622895 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:23:06.623049 (+   154us) write_op.cc:270] Start()
0709 12:23:06.623168 (+   119us) write_op.cc:276] Timestamp: P: 1783599786622997 usec, L: 0
0709 12:23:06.623187 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:23:06.673164 (+ 49977us) log.cc:844] Serialized 8620 byte log entry
0709 12:23:07.720230 (+1047066us) op_driver.cc:464] REPLICATION: finished
0709 12:23:07.888541 (+168311us) write_op.cc:301] APPLY: starting
0709 12:23:07.888661 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:08.104168 (+215507us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:08.104328 (+   160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:08.499656 (+395328us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:08.500167 (+   511us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=0,mrs_lookups=0
0709 12:23:08.500242 (+    75us) write_op.cc:312] APPLY: finished
0709 12:23:08.500800 (+   558us) log.cc:844] Serialized 196 byte log entry
0709 12:23:08.501006 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:08.501502 (+   496us) write_op.cc:454] Released schema lock
0709 12:23:08.501580 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:08.502142 (+   562us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:08.502170 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":194659,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":167962,"apply.run_cpu_time_us":34725,"apply.run_wall_time_us":613575,"cfile_cache_hit":90,"cfile_cache_hit_bytes":95955,"num_ops":22,"prepare.queue_time_us":282235,"prepare.run_cpu_time_us":36104,"prepare.run_wall_time_us":490264,"raft.queue_time_us":593785,"raft.run_cpu_time_us":20944,"raft.run_wall_time_us":77667,"replication_time_us":1096860,"thread_start_us":1108547,"threads_started":4,"wal-append.queue_time_us":412162,"wal-append.run_cpu_time_us":53351,"wal-append.run_wall_time_us":2460971}]]}
I20260709 12:23:10.644246 10831 catalog_manager.cc:5697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 16 to 23, leader changed from 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 23 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:10.610589 18535 log.cc:927] Time spent T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.136s	user 0.002s	sys 0.000s
I20260709 12:23:10.648149 10831 catalog_manager.cc:5697] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 15 to 17, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 17 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:10.650761 18532 log.cc:927] Time spent T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:23:10.657774 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:10.658475 10929 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:23:10.659273 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:10.623107 18347 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:10.603705 18516 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.658905 11081 consensus_queue.cc:260] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.661267 10831 catalog_manager.cc:5697] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index -1 to 9, term changed from 13 to 15, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to <none>, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 15 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:10.666970 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:10.658272 18534 log.cc:927] Time spent T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.185s	user 0.006s	sys 0.000s
W20260709 12:23:10.669140 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 51028.7us
I20260709 12:23:10.669853 10899 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:10.674044 11051 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:10.676836 11051 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:10.677616 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:10.680193 18469 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:10.675899 18474 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:10.672039 18457 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:10.687602 18533 log.cc:927] Time spent T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.212s	user 0.002s	sys 0.000s
I20260709 12:23:10.671907 18400 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.705551 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:10.683386 18383 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:23:10.702579 18536 log.cc:927] Time spent T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 12:23:10.721359 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 51581us
I20260709 12:23:10.722150 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:10.723997 10899 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:10.704138 18400 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.728161 18400 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:10.732221 10919 tablet_service.cc:1558] Processing DeleteTablet for tablet c1b75831227444d382e9c0fc5b367564 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 10)) from {username='slave'} at 127.0.0.1:46716
I20260709 12:23:10.732628 18400 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:10.733785 18516 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:10.735728 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:10.736430 10930 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:23:10.740307 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:10.740984 11007 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:23:10.743292 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:10.748687 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:10.749230 11083 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:23:10.749610 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:10.750262 11007 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 24.
I20260709 12:23:10.750277 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:10.750982 10930 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:10.752642 11051 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:10.751071 11010 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:10.754863 11003 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:23:10.758817 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:10.745563 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:10.763644 11005 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:23:10.761713 11050 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:10.772372 11083 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:23:10.773950 11050 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:10.773836 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:10.787292 18185 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:23:10.787784 18185 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.788196 18185 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:23:10.790380 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 57657.5us
I20260709 12:23:10.794332 11658 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:23:10.796221 18360 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:10.781291 18430 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 12:23:10.776119 18408 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:10.803226 18408 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.777895 18494 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:10.804035 18494 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.804374 18494 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:10.775460 18383 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.809795 11081 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:10.810647 18408 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:10.777978 18516 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:10.814978 10929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
W20260709 12:23:10.814718 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 59174.8us
I20260709 12:23:10.823995 10929 raft_consensus.cc:606] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:10.782660 18440 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:10.824522 10929 raft_consensus.cc:614] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:10.733242 18400 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:10.823591 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 49744.4us
I20260709 12:23:10.824484 10901 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:10.827013 11010 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:10.832425 10901 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:10.835273 10901 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:23:10.846019 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 122078us
I20260709 12:23:10.832347 10974 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:10.835302 18408 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:23:10.831722 18516 raft_consensus.cc:697] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:10.835436 18457 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:10.835750 18360 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:23:10.849426 18460 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:10.824990 18383 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.859961 18473 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:23:10.835876 18347 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:23:10.864121 18408 consensus_queue.cc:1243] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 1abf4b385a2b493ab83f593a1f8c9cd1 log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:23:10.880481 18360 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.906728 18325 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:10.907451 18325 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.909713 18325 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:10.910243 18325 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:10.911926 18541 log.cc:927] Time spent T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:23:10.916296  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:23:10.918190  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:10.920482 18400 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:10.904028 18430 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:23:10.910677 18325 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.932370 11081 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 25.
I20260709 12:23:10.933084  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:10.942145 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:10.946792 11076 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 25.
I20260709 12:23:10.900722 18473 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:10.934439 18542 log.cc:927] Time spent T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:23:10.933849 18360 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:10.990713 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:11.002372 10936 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
W20260709 12:23:11.003021 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 152565us
I20260709 12:23:10.982033 18473 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:10.990788 10821 catalog_manager.cc:5028] TS 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): tablet c1b75831227444d382e9c0fc5b367564 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:23:10.991448 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:11.005913 10899 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:10.992568 18516 consensus_queue.cc:237] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:10.948774 18470 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.054s
W20260709 12:23:11.076668 10821 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 85905.9us
W20260709 12:23:11.085018 18529 log.cc:927] Time spent T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:23:11.050812 18440 raft_consensus.cc:697] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:11.074117 18551 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.076339 18450 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:11.090265 18526 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:11.093789 18347 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:11.123142 18472 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:11.124150 18450 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:11.125233 18325 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:11.126284 18383 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:11.126875 18383 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:11.127360 18383 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:11.128814 18450 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:11.123994 18526 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:11.132782 18526 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:11.110489 18289 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.133574 18289 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:11.139469 18494 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:11.140175 18517 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.140792 18517 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:11.142025 18494 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:11.142974 18517 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:11.143739 18347 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:11.151510 18440 consensus_queue.cc:237] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:11.153569 18347 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:11.153733 18360 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:11.155253 18548 log.cc:927] Time spent T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:23:11.146333 18557 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:11.156279 18557 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:11.156675 18472 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:11.116526 18551 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:11.158617 18557 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:11.158982 18472 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:11.159747 18551 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:11.161412 18543 log.cc:927] Time spent T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:23:11.156112 18555 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:23:11.168143 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 162289us
I20260709 12:23:11.129375 18383 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:11.173141 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:11.176759 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 184142us
I20260709 12:23:11.135771 18289 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:11.215425 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:11.215588 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:11.217738 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:11.218447 11076 raft_consensus.cc:2376] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23. Re-sending same reply.
W20260709 12:23:11.221122 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.223053 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:11.223616 11078 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:23:11.223692 11083 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:11.235107 11076 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 12:23:11.243284 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:11.243534 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:11.244304 11084 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 24.
I20260709 12:23:11.245699 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:11.248147 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:11.249855 11077 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 12:23:11.250278 11077 pending_rounds.cc:85] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 13
I20260709 12:23:11.250531 11077 pending_rounds.cc:107] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 12:23:11.250100 11081 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:23:11.251482 11077 raft_consensus.cc:2889] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:11.254550 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:11.254796 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:11.255481 11080 raft_consensus.cc:2393] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 16: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:11.257222 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:11.258275 11084 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:23:11.260288 11078 raft_consensus.cc:2393] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 16: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:11.260511 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:11.266405 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:11.247628 18360 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:11.283931 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:11.284125 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:11.285697 11078 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:11.286939 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:11.290541 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:11.291347 10935 raft_consensus.cc:2393] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 19: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:23:11.291851 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:11.292434 10927 raft_consensus.cc:3060] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:11.292623 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:11.293162 10936 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:11.293665 10934 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:23:11.294880 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:11.295711 11010 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:23:11.298339 10931 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:23:11.298872 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:11.299444 11010 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:11.299825 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:11.284394 18552 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:11.301108 18552 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:11.301808 18562 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:11.302343 18562 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:11.303335 18552 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:11.304250 18569 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:11.304898 18569 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:11.314136 11081 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 16. (term mismatch)
I20260709 12:23:11.314604 11081 pending_rounds.cc:85] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 15
I20260709 12:23:11.314817 11081 pending_rounds.cc:107] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 25.16
I20260709 12:23:11.315032 11081 raft_consensus.cc:2889] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:11.316548 11084 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:23:11.316505 11085 pending_rounds.cc:85] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 15
I20260709 12:23:11.317106 11085 pending_rounds.cc:107] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 12:23:11.317358 11085 raft_consensus.cc:2889] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:11.316466 11081 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:23:11.269524 18347 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:11.320098 11078 raft_consensus.cc:3060] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:11.320338 18347 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:11.322636 18347 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:11.305269 18571 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:11.323625 18571 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:11.324182 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:11.315603 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:11.324843 11081 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:23:11.325115 11077 raft_consensus.cc:2393] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 22: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:11.325519 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:11.325700 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:11.311226 18473 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:11.328431 18185 consensus_meta.cc:287] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.005s
I20260709 12:23:11.328891 18185 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:11.329717 10927 raft_consensus.cc:2468] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 25.
I20260709 12:23:11.329000 18473 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:11.330977 18185 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:11.300531 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:11.334961 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:11.335695 10929 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:11.337833 11077 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 25. Current term is 26. Ops: []
I20260709 12:23:11.335767 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:11.346747 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:11.342905 11051 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:11.348634 10974 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:11.339052 18571 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:11.304636 18562 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:11.358518 10936 raft_consensus.cc:2410] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:23:11.360004 11010 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:23:11.373039 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:11.374788 11078 raft_consensus.cc:1275] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:23:11.383320 10929 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:23:11.354487 18569 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:11.349081 18494 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:11.279707 18460 raft_consensus.cc:697] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:11.365374 18479 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:23:11.442461 10928 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:23:11.372936 18462 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:11.396935 10974 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:11.449965 10929 raft_consensus.cc:1275] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:23:11.456904 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:11.468277 10929 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:23:11.477692 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:11.478510 10936 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 24.
W20260709 12:23:11.480765 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 83924.3us
I20260709 12:23:11.481973 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:11.482637 11007 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:23:11.482889 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:11.483541 11002 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:11.483736 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:11.484330 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:23:11.464164 18474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.009s	sys 0.030s
I20260709 12:23:11.492645 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:11.497609 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:11.493317 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:11.498724 10936 raft_consensus.cc:2393] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 16: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:11.500839 10931 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:23:11.504438 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:11.515709 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:11.452261 18462 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:11.452260 18479 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:11.497728 10929 raft_consensus.cc:1275] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:23:11.519519 10931 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:23:11.527299 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:23:11.494982 18474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.009s	sys 0.030s
I20260709 12:23:11.530730 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:11.473928 18436 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:11.536250 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:11.538822 10935 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 12:23:11.541395 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:11.542429 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 50231.7us
I20260709 12:23:11.533030 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:11.570921 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:11.451823 18494 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:11.571492 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:11.572623 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:11.571676 10934 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 26.
I20260709 12:23:11.532186 18462 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:11.521771 18561 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:23:11.531584 18479 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:11.582183 11007 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:23:11.588352 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:23:11.591642 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 248538us
I20260709 12:23:11.592463 11002 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 25.
I20260709 12:23:11.575980 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:11.594135 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:11.593015 11050 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:11.571038 10935 pending_rounds.cc:85] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 11
I20260709 12:23:11.597512 10935 pending_rounds.cc:107] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 12:23:11.597898 10935 raft_consensus.cc:2889] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:11.602818 11083 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:23:11.606660 10935 raft_consensus.cc:3055] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:11.607100 10935 raft_consensus.cc:740] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:11.612066 18551 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.612730 18551 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:11.584632 18436 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:11.620105 18561 raft_consensus.cc:697] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:11.620566 18472 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:11.621122 18561 consensus_queue.cc:237] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:11.576799 18478 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:11.635067 10929 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:23:11.641287 10977 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:11.581391 18514 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:23:11.578275 18395 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 12:23:11.811796 18494 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:11.651331 18473 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.154s
W20260709 12:23:11.781180 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 139956us
I20260709 12:23:11.600966 18560 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 12:23:11.645721 18559 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.545607 18460 consensus_queue.cc:237] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:11.778438 18470 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.154s
I20260709 12:23:11.662791 10929 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260709 12:23:11.825826 18550 log.cc:927] Time spent T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 12:23:11.826285 18573 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:23:11.646679 18478 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:11.882727 18578 log.cc:927] Time spent T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 12:23:11.883596 18473 consensus_queue.cc:1048] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:23:11.884390 18576 log.cc:927] Time spent T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 12:23:11.886056 18473 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:23:11.884029 18565 log.cc:927] Time spent T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 12:23:11.835588 18436 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:23:11.860948 18579 log.cc:927] Time spent T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 12:23:11.895135 18478 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:11.862684 18559 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:11.903476 18551 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:11.908264 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 325087us
I20260709 12:23:11.912508 17883 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:11.913394 18572 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:11.913457 18559 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:11.914096 10899 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:11.928124 10977 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:23:11.959527 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 45537.9us
I20260709 12:23:11.960376 10899 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:23:11.961877 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 378860us
W20260709 12:23:11.962527 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 354169us
I20260709 12:23:11.931696 18300 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.964108 11625 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:11.962532 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 336792us
I20260709 12:23:11.962949 18559 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:11.971300 10899 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:11.962792 18441 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:11.954914 18573 consensus_queue.cc:1048] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 12:23:11.957295 18462 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:11.977669 18570 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:11.979943 18441 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:11.982893 18570 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:11.983376 18570 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:11.970352 18596 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:11.987819 18413 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.988425 18413 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:11.990340 18462 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:11.991319 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:11.994380 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:11.973697 18460 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:23:11.995190 11002 raft_consensus.cc:2393] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 26: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:12.004894 18570 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:11.975787 18479 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:11.979354 10899 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:12.009933 11005 raft_consensus.cc:1240] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 25. Current term is 26. Ops: []
I20260709 12:23:12.010131 18460 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:11.966005 17974 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:23:11.968422 18300 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.061179 18598 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:12.061965 18598 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:11.974852 18436 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:23:12.128437 10899 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:12.132191 18559 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:23:12.134683 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:12.136837 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:12.139276 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:12.140033 11077 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:23:12.137642 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 544653us
I20260709 12:23:12.142537 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:12.143083 11078 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 17.
I20260709 12:23:12.144748 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:12.144986 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:12.146056 11080 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:12.146858 11051 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:12.137265 10899 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:12.148180 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:12.148484 11079 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:23:12.151182 10899 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:12.104048 18460 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:23:12.153916 11083 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 17.
I20260709 12:23:12.188689 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:23:12.205631 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.132328 18516 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.210872 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:12.216382 18513 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:12.158151 18577 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:12.134814 18436 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.074s
I20260709 12:23:12.192193 18474 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:12.189114 18494 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:23:12.157249 18469 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:12.207175 18325 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.246543 11077 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 25.
I20260709 12:23:12.192009 18464 consensus_queue.cc:1059] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 12:23:12.234881 18494 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.235185 18474 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:23:12.282246 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 43853.6us
I20260709 12:23:12.221553 18516 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.156023 18441 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:12.148089 18400 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.151100 18517 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:12.281447 18561 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.068s	sys 0.107s
I20260709 12:23:12.252799 18575 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.233587 18513 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:12.249452 18289 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:12.275632 18567 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:23:12.302104 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 311120us
I20260709 12:23:12.287544 18474 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:12.278477 18559 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:12.283699 18494 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:12.147718 18556 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.145s
I20260709 12:23:12.296705 18441 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.248513 18325 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.289976 18544 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:23:12.240228 18469 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:12.314635 18561 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.068s	sys 0.107s
I20260709 12:23:12.299494 18462 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.328259 18516 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:12.326700 18598 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:12.360555 18544 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:12.305840 18400 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.409267 18462 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.328469 18570 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:12.411511 18462 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:12.314016 18517 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.325464 18513 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:12.357658 18441 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:23:12.362178 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 215382us
I20260709 12:23:12.368017 18609 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:12.407660 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 60317.9us
I20260709 12:23:12.411693 18570 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.418586 18570 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.420838 18570 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:12.421420 18441 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.412122 18462 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:12.423689 18441 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:12.423911 18462 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:12.427023 18462 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:12.414722 18609 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.427655 18462 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.428206 18462 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.429062 18609 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:12.415719 18513 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.415623 11051 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:12.433601 10899 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:12.354429 18289 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.350698 18559 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.437068 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:12.439633 10899 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:12.439779 11080 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:23:12.440675 11083 raft_consensus.cc:2393] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 26: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:12.351027 18567 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.444211 11622 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:23:12.329401 18575 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.444967 11084 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:23:12.451943 10901 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:12.454255 18360 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:12.445258 18460 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:23:12.457497 18460 raft_consensus.cc:697] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:12.458377 18460 consensus_queue.cc:237] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.460204 18566 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:23:12.461133 18602 log.cc:927] Time spent T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:23:12.459638 18340 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:23:12.462672 18340 consensus_queue.cc:1243] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:23:12.464071 18570 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:12.464735 18570 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.436553 18544 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:12.440449 18441 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:12.430660 18609 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:12.413780 18517 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:12.417906 18400 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:12.442912 18569 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:23:12.439957 18436 consensus_queue.cc:1059] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:23:12.430689 18462 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:12.477280 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:12.467151 18593 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:12.497710 18607 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:12.474685 18570 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:12.477402 18441 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:12.431308 18513 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:12.522215 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 69008.9us
I20260709 12:23:12.498839 18593 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:12.520396 18441 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:12.486268 18609 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.538878 10901 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:23:12.548198 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 58919.6us
I20260709 12:23:12.598507 18612 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:12.599226 18612 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:12.597913 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 69975.9us
I20260709 12:23:12.601049 10974 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:12.601596 18614 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:12.602144 11084 raft_consensus.cc:1240] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 22. Current term is 23. Ops: []
I20260709 12:23:12.602355 18613 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:12.602875 18613 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.603381 18325 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:12.604915 18609 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:12.544237 18593 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:12.592278 18436 consensus_queue.cc:1243] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 1abf4b385a2b493ab83f593a1f8c9cd1 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:23:12.705144 11050 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:23:12.750223 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 45155.1us
I20260709 12:23:12.601157 18605 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:12.784123 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 183134us
I20260709 12:23:12.674597 18609 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:12.794348 18612 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:12.798991 18569 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:12.802007 18479 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:12.803544 18300 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:12.673684 18570 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.113s
I20260709 12:23:12.807075 18570 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:23:12.807696 18570 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:12.808177 18570 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.809960 18289 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:12.812994 18567 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:12.813243 18514 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:12.816237 18575 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:12.770004 18619 raft_consensus.cc:3055] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:12.769102 18608 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:12.827989 18559 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:12.602180 18614 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:12.839418 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 301076us
I20260709 12:23:12.841423 10901 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:23:12.832719 18564 log.cc:927] Time spent T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.871s	user 0.008s	sys 0.007s
I20260709 12:23:12.846545 10901 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
W20260709 12:23:12.848351 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 299313us
I20260709 12:23:12.851372 10901 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:12.828815 18561 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:12.832283 18619 raft_consensus.cc:740] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:12.854635 18557 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:12.853849 18395 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:12.861022 18395 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.863170 18395 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:12.868219 18589 log.cc:927] Time spent T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.947s	user 0.005s	sys 0.018s
I20260709 12:23:12.868639 18557 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:12.869536 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3686) took 1534 ms. Trace:
I20260709 12:23:12.869930 10927 rpcz_store.cc:276] 0709 12:23:11.339543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:11.339671 (+   128us) service_pool.cc:224] Handling call
0709 12:23:11.340082 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:11.353529 (+ 13447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:11.353564 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:11.357635 (+  4071us) log.cc:844] Serialized 26 byte log entry
0709 12:23:11.786866 (+429231us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:11.796263 (+  9397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.796340 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:12.814805 (+1018465us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:23:12.869231 (+ 54426us) raft_consensus.cc:1685] finished
0709 12:23:12.869253 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:12.869474 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77843,"raft.queue_time_us":9810,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":16635,"spinlock_wait_cycles":61383936,"thread_start_us":340829,"threads_started":1,"wal-append.queue_time_us":488407}
I20260709 12:23:12.853345 18627 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:12.872150 18570 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:12.872804 18620 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:23:12.874807 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 89790.6us
I20260709 12:23:12.874034 10901 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:12.820716 18609 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.787458 18605 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.840116 18608 raft_consensus.cc:697] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:12.881644 18513 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:12.872383 18629 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.882472 18608 consensus_queue.cc:237] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.882834 18629 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.885159 18629 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:12.875975 18561 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:12.887430 18609 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:12.888393 18619 consensus_queue.cc:260] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.888633 18593 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:12.889734 18619 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:23:12.873584 18494 consensus_meta.cc:287] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
W20260709 12:23:12.898368 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.908219 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:12.908906 11003 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 15.
I20260709 12:23:12.908838 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:12.881645 18605 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:12.909598 11009 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 25. Current term is 26. Ops: []
I20260709 12:23:12.899703 18627 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:12.951787 11002 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:12.954649 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:12.959128 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:12.959733 11004 raft_consensus.cc:1275] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:12.959743 11003 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:12.961772 11006 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:23:12.904325 18494 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.964548 11011 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 18. Current term is 19. Ops: []
W20260709 12:23:12.964944 18474 consensus_meta.cc:287] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.607s	user 0.010s	sys 0.000s
I20260709 12:23:12.965314 18474 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.967363 18474 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:12.969892 18613 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:12.971101 11003 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23.
W20260709 12:23:12.972005 18580 log.cc:927] Time spent T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 1.182s	user 0.009s	sys 0.031s
I20260709 12:23:12.973342 11082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 4036) took 2034 ms. Trace:
I20260709 12:23:12.973726 11082 rpcz_store.cc:276] 0709 12:23:10.938599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.942684 (+  4085us) service_pool.cc:224] Handling call
0709 12:23:10.943036 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:10.979595 (+ 36559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:10.979632 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:10.994867 (+ 15235us) log.cc:844] Serialized 26 byte log entry
0709 12:23:11.154124 (+159257us) spinlock_profiling.cc:243] Waited 9.29 ms on lock 0x7b4800210cd8. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb5e89aa1 00007f9bb5e80b37 00007f9bb5e809ca 00007f9bb5f7826f 00007f9bb5f77f37 00007f9bb5f8c55c 00007f9bb5f8c508 00007f9bb5f8c488 00007f9bb5f8c443 00007f9bb5f8b6ec 00007f9bb4eb5a96
0709 12:23:11.389754 (+235630us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:11.389792 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.389869 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:12.971375 (+1581506us) spinlock_profiling.cc:243] Waited 54.2 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:23:12.973120 (+  1745us) raft_consensus.cc:1685] finished
0709 12:23:12.973144 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:12.973283 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4974,"raft.queue_time_us":11550,"raft.run_cpu_time_us":1937,"raft.run_wall_time_us":173694,"spinlock_wait_cycles":146061824,"thread_start_us":295922,"threads_started":1,"wal-append.queue_time_us":565517}
I20260709 12:23:12.975363 10935 consensus_queue.cc:260] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.976480 10935 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:12.978348 18413 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:12.980805 18544 consensus_meta.cc:287] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1: Time spent flushing consensus metadata: real 0.501s	user 0.002s	sys 0.007s
I20260709 12:23:12.981245 18544 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:12.983646 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:12.984985 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:12.957902 18436 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.988714 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:12.994086 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:12.994962 11003 raft_consensus.cc:2393] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 21: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:23:12.996631 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 46396.1us
I20260709 12:23:12.998066 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:12.998770 11003 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:12.987897 18544 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:13.001420 10935 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 12:23:12.988864 18608 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:13.006935 10935 pending_rounds.cc:85] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 12
I20260709 12:23:13.008560 10935 pending_rounds.cc:107] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 12:23:13.008898 10935 raft_consensus.cc:2889] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:13.010035 10935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3704) took 1442 ms. Trace:
I20260709 12:23:13.001122 18593 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:12.989964 18436 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:13.003132 18625 consensus_queue.cc:1059] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
W20260709 12:23:13.043663 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.043169 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:13.043233 11005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 4126) took 1472 ms. Trace:
I20260709 12:23:13.048844 11005 rpcz_store.cc:276] 0709 12:23:11.570838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:11.571837 (+   999us) service_pool.cc:224] Handling call
0709 12:23:11.572180 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:12.010477 (+438297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.020744 (+1010267us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b540029c2d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:13.043166 (+ 22422us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1006188800}
I20260709 12:23:13.010414 10935 rpcz_store.cc:276] 0709 12:23:11.567903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:11.606216 (+ 38313us) service_pool.cc:224] Handling call
0709 12:23:11.606539 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:12.975016 (+1368477us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b4c001f9340. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9baf22ca20 00007f9baf23da29 00007f9baf203644 00007f9baf22af2d 00007f9baf22ab93 00007f9bb0f5b18b 00007f9bb0f5bcb5 00007f9bb0f56f30 00007f9bb0f587de 00007f9bb0f62b49 00007f9bb0f63416
0709 12:23:13.009793 (+ 34777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.009981 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5345024}
I20260709 12:23:13.051967 18567 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:13.053243 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:23:13.067523 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 60394.8us
W20260709 12:23:13.062716 18645 log.cc:927] Time spent T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.057s	user 0.002s	sys 0.000s
I20260709 12:23:13.066191 11651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59384 (request call id 991) took 1079 ms. Trace:
I20260709 12:23:13.071601 11651 rpcz_store.cc:276] 0709 12:23:11.974490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:11.974635 (+   145us) service_pool.cc:224] Handling call
0709 12:23:13.018270 (+1043635us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b5800003998. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f260a0 00007f9bb5f25984 00007f9baf4a06d4 00007f9baf4a0662
0709 12:23:13.054166 (+ 35896us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3666304}
I20260709 12:23:13.052968 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.074453 10935 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 15.
W20260709 12:23:13.062662 18646 log.cc:927] Time spent T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.057s	user 0.000s	sys 0.002s
I20260709 12:23:13.080287 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:13.082974 18555 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.083534 18555 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:13.060066 18577 raft_consensus.cc:3055] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:23:13.085124 18577 raft_consensus.cc:740] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:13.085397 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:13.085764 18555 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:13.085999 18577 consensus_queue.cc:260] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:13.087103 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:13.069437 18567 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:13.088037 11080 raft_consensus.cc:2410] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 12:23:13.088912 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:13.089717 18567 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:13.091019 11080 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 23. Current term is 24. Ops: []
I20260709 12:23:13.091660 10933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 3211) took 2107 ms. Trace:
I20260709 12:23:13.092092 10933 rpcz_store.cc:276] 0709 12:23:10.984157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.984427 (+   270us) service_pool.cc:224] Handling call
0709 12:23:11.001484 (+ 17057us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:11.165710 (+164226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:11.165746 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:11.178096 (+ 12350us) log.cc:844] Serialized 52 byte log entry
0709 12:23:11.531659 (+353563us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:23:11.576600 (+ 44941us) log.cc:844] Serialized 14 byte log entry
0709 12:23:11.624537 (+ 47937us) log.cc:844] Serialized 14 byte log entry
0709 12:23:11.624713 (+   176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.624780 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:12.984330 (+1359550us) spinlock_profiling.cc:243] Waited 8.85 ms on lock 0x7b1800485140. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:23:13.057831 (+ 73501us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b1800485140. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade733f3 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:23:13.077695 (+ 19864us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b1800485140. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9baddedc0a 00007f9bb752d219 00007f9bb5e89328 00007f9bb5e80901 00007f9bb5e808a7 00007f9bb5f78288 00007f9bb5f77f37 00007f9bb5f8c55c 00007f9bb5f8c508
0709 12:23:13.091415 (+ 13720us) raft_consensus.cc:1685] finished
0709 12:23:13.091439 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:13.091579 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131099,"prepare.queue_time_us":313793,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":5508,"raft.queue_time_us":213921,"raft.run_cpu_time_us":42140,"raft.run_wall_time_us":1439682,"spinlock_wait_cycles":69431296,"thread_start_us":367793,"threads_started":2,"wal-append.queue_time_us":585042}
I20260709 12:23:13.094766 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:13.087149 18577 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:13.053524 18620 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:13.101543 18620 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:13.064137 18586 log.cc:927] Time spent T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca: Append to log took a long time: real 1.241s	user 0.010s	sys 0.025s
I20260709 12:23:13.079334 18613 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:13.083786 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:13.010488 18608 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:13.124712 18630 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:13.125344 18630 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:13.126295 18625 raft_consensus.cc:3055] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:23:13.126696 18625 raft_consensus.cc:740] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:23:13.127265 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 59049.9us
I20260709 12:23:13.127588 18630 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:13.076517 18561 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:13.132628 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:13.103785 18620 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:13.125792 11080 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:13.145805 11080 raft_consensus.cc:1275] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:13.146914 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:13.147639 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:13.148077 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:13.148666 11005 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 16.
I20260709 12:23:13.148765 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:13.149345 18573 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:13.149506 11004 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:23:13.150475 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:13.152980 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:23:13.152175 18441 consensus_meta.cc:287] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.000s
I20260709 12:23:13.127532 18625 consensus_queue.cc:260] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:13.156571 18441 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:13.157075 18625 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:13.158123 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:13.158643 18436 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:13.160075 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:13.164063 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:13.165974 11005 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:23:13.161494 11006 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:23:13.168540 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:13.129966 18613 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:13.169795 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:13.169297 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:13.170643 18469 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:13.170975 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:13.149921 18573 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:13.171775 11006 raft_consensus.cc:2410] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:23:13.161329 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:13.171672 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:13.176707 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:13.178644 11651 raft_consensus.cc:2393] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 18: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:23:13.190474 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:13.192927 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:13.193617 11080 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:13.198669 10899 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:13.178478 18494 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:13.179761 18441 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:13.210220 11051 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:13.216076 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:13.217834 11051 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:13.218535 11622 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:13.219352 18450 consensus_queue.cc:1048] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:23:13.226656 18587 log.cc:927] Time spent T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 1.330s	user 0.007s	sys 0.020s
W20260709 12:23:13.229139 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:13.226866 18588 log.cc:927] Time spent T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 1.330s	user 0.008s	sys 0.011s
I20260709 12:23:13.202814 18571 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:13.234714 10930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3677) took 1945 ms. Trace:
W20260709 12:23:13.216481 18644 log.cc:927] Time spent T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 12:23:13.250861 11051 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:13.235163 10930 rpcz_store.cc:276] 0709 12:23:11.289774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:11.289925 (+   151us) service_pool.cc:224] Handling call
0709 12:23:11.301247 (+ 11322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:11.389565 (+ 88318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:11.389595 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:11.390084 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 12:23:11.638223 (+248139us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:23:11.638262 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.638327 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:13.226018 (+1587691us) spinlock_profiling.cc:243] Waited 54.7 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:23:13.229400 (+  3382us) raft_consensus.cc:1685] finished
0709 12:23:13.229423 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:13.234646 (+  5223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":189557,"raft.queue_time_us":92346,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":40002,"spinlock_wait_cycles":125709696,"thread_start_us":234849,"threads_started":1,"wal-append.queue_time_us":492808}
I20260709 12:23:13.213622 18544 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:13.256366 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:13.261488 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:13.265364 11080 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23.
I20260709 12:23:13.236531 18494 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:23:13.232668 18573 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:13.270035 18597 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:13.267736 18494 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:13.269668 18610 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:13.268954 18637 consensus_queue.cc:1059] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 12:23:13.282614 11659 raft_consensus.cc:1240] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:13.283371 11659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59384 (request call id 990) took 1309 ms. Trace:
I20260709 12:23:13.267381 18544 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:13.286221 18651 log.cc:927] Time spent T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:23:13.283668 11659 rpcz_store.cc:276] 0709 12:23:11.973953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:11.974077 (+   124us) service_pool.cc:224] Handling call
0709 12:23:13.282239 (+1308162us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b5800003998. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f780ab 00007f9bb5f78131 00007f9bb5f39fc0 00007f9bb5f24929 00007f9bb5f243d2 00007f9baf49bbd4
0709 12:23:13.282440 (+   201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:13.283098 (+   658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.283291 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6110976}
I20260709 12:23:13.255993 18469 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:23:13.288933 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:13.289638 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:13.290380 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:13.290807 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:13.291074 11082 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:23:13.291651 11081 raft_consensus.cc:2410] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:23:13.296653 10932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43552 (request call id 3682) took 2005 ms. Trace:
I20260709 12:23:13.297245 10932 rpcz_store.cc:276] 0709 12:23:11.291322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:11.291432 (+   110us) service_pool.cc:224] Handling call
0709 12:23:11.291752 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:11.363591 (+ 71839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:11.363626 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:11.374064 (+ 10438us) log.cc:844] Serialized 26 byte log entry
0709 12:23:11.780488 (+406424us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:23:11.780533 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.780603 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:13.226343 (+1445740us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:23:13.296277 (+ 69934us) raft_consensus.cc:1685] finished
0709 12:23:13.296305 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:13.296589 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":160844,"raft.queue_time_us":100220,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":9640,"spinlock_wait_cycles":61203840,"thread_start_us":334586,"threads_started":1,"wal-append.queue_time_us":502621}
I20260709 12:23:13.286545 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:23:13.297647 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.267977 18516 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.281409 18494 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:23:13.305689 10899 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:23:13.308694 18590 log.cc:927] Time spent T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 1.408s	user 0.004s	sys 0.011s
I20260709 12:23:13.310874 11077 raft_consensus.cc:1240] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 25. Current term is 26. Ops: [25.15-25.15]
I20260709 12:23:13.312170 10899 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:13.316073 18436 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:13.317690 18441 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:23:13.311147 18516 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:13.335001 18585 log.cc:927] Time spent T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 1.532s	user 0.007s	sys 0.034s
I20260709 12:23:13.336161 11085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 4042) took 2022 ms. Trace:
I20260709 12:23:13.316053 18571 consensus_queue.cc:1059] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
W20260709 12:23:13.338328 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.336566 11085 rpcz_store.cc:276] 0709 12:23:11.313664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:11.315953 (+  2289us) service_pool.cc:224] Handling call
0709 12:23:11.316308 (+   355us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:11.318013 (+  1705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:11.318047 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:11.470672 (+152625us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b2c000040c8. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9baf859a11 00007f9baf869372 00007f9bb0f9ba01 00007f9bb0f6043a 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2
0709 12:23:11.472649 (+  1977us) log.cc:844] Serialized 52 byte log entry
0709 12:23:11.626896 (+154247us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:23:11.626932 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.626997 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:13.307845 (+1680848us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:23:13.335913 (+ 28068us) raft_consensus.cc:1685] finished
0709 12:23:13.335935 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:13.336099 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6239,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"spinlock_wait_cycles":77084928,"thread_start_us":153918,"threads_started":1,"wal-append.queue_time_us":427426}
I20260709 12:23:13.345146 11085 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 12:23:13.346870 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.348127 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.348395 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.348946 10934 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:23:13.347932 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:13.349774 11085 raft_consensus.cc:2368] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 22. Current term is 23.
I20260709 12:23:13.350692 10929 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:23:13.325134 18436 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:13.351593 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.352360 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:13.352850 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.352432 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:13.354660 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:13.360772 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:13.362722 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:13.367293 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.367686 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:13.369103 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.337462 18441 raft_consensus.cc:697] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:13.370280 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:13.368849 10936 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:23:13.371539 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:13.373790 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.359823 18436 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:13.374591 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:13.375766 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:13.376605 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.379698 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:13.384312 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.387223 11084 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 24. Current term is 25. Ops: []
I20260709 12:23:13.389058 10932 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:13.391816 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.395288 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.396484 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:13.397769 10927 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:13.397679 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:13.397903 10928 raft_consensus.cc:1240] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:13.400167 11624 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:13.400403 11076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60046 (request call id 3773) took 2150 ms. Trace:
I20260709 12:23:13.399778 11084 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:23:13.403465 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.404166 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.405673 10933 pending_rounds.cc:85] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 9
I20260709 12:23:13.406032 10933 pending_rounds.cc:107] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 12:23:13.406252 10933 raft_consensus.cc:2889] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:13.408013 18584 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:13.408269 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.400811 11076 rpcz_store.cc:276] 0709 12:23:11.240691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:11.240864 (+   173us) service_pool.cc:224] Handling call
0709 12:23:11.241272 (+   408us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:11.241645 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:11.241674 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:11.242364 (+   690us) log.cc:844] Serialized 52 byte log entry
0709 12:23:11.492338 (+249974us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:23:11.520404 (+ 28066us) log.cc:844] Serialized 14 byte log entry
0709 12:23:12.129285 (+608881us) spinlock_profiling.cc:243] Waited 8.34 ms on lock 0x7b18002c5660. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9baddedc0a 00007f9bb752d219 00007f9bade75a40 00007f9bade704e4 00007f9bade70455 00007f9bb0f58060 00007f9bb0f6a716 00007f9bb0f7b287 00007f9bb0f7b208
0709 12:23:12.298959 (+169674us) log.cc:844] Serialized 14 byte log entry
0709 12:23:12.403237 (+104278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:12.403306 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:13.256999 (+853693us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b18002c5660. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade73522 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:23:13.333244 (+ 76245us) spinlock_profiling.cc:243] Waited 57.3 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:23:13.390953 (+ 57709us) raft_consensus.cc:1685] finished
0709 12:23:13.390980 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:13.391139 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12332,"prepare.queue_time_us":293541,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":2104,"raft.queue_time_us":722246,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":5901,"spinlock_wait_cycles":156255744,"thread_start_us":496687,"threads_started":3,"wal-append.queue_time_us":370352}
I20260709 12:23:13.408862 10928 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:23:13.413090 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.413196 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.420677 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.423409 10927 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:23:13.425300 18573 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:13.437017 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.414611 18441 consensus_queue.cc:237] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:13.448153 18516 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:13.450245 18557 raft_consensus.cc:3055] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:23:13.450732 18557 raft_consensus.cc:740] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:13.451576 18557 consensus_queue.cc:260] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:13.452665 18557 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:13.456442 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.449594 18494 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:13.464571 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.468034 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.468842 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.468042 11083 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 26. Current term is 27. Ops: []
I20260709 12:23:13.459643 18608 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:13.479579 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:23:13.494823 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.523216 11079 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 4055) took 1085 ms. Trace:
I20260709 12:23:13.459777 18494 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:13.525331 11079 rpcz_store.cc:276] 0709 12:23:12.438194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.438500 (+   306us) service_pool.cc:224] Handling call
0709 12:23:12.438748 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:12.468487 (+ 29739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:12.468514 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:12.468551 (+    37us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:23:12.468578 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.522920 (+1054342us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b540044c0d4. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:13.522978 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:13.523144 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67972864}
I20260709 12:23:13.462029 18613 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:13.530232 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:13.589708 18544 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:13.550411 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.590947 10936 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:23:13.576236 18577 raft_consensus.cc:3055] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:13.592106 18577 raft_consensus.cc:740] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:13.593009 18577 consensus_queue.cc:260] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:13.568060 18639 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:13.595129 18639 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:13.548863 11050 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:23:13.597579 18639 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:13.600534 18577 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:13.605062 18544 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:13.605566 18544 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:13.605923 18544 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:23:13.606500 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 57617us
I20260709 12:23:13.616166 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.614739 11050 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:13.624830 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:13.629094 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:13.627702 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:13.630390 11009 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:13.637218 18614 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:13.637889 18516 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:13.638317 18516 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:13.638680 18516 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:13.642810 10977 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:13.644013 18640 consensus_queue.cc:1059] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:13.646158 18640 consensus_queue.cc:1059] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:13.647012 18472 raft_consensus.cc:3055] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:13.647430 18472 raft_consensus.cc:740] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:13.647835 18639 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:13.648253 18639 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:13.648849 18639 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:13.648273 18472 consensus_queue.cc:260] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:13.649724 18472 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:13.650317 18436 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:13.651356 10928 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
W20260709 12:23:13.626459 18580 log.cc:927] Time spent T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:23:13.651609 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.654253 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.655308 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.656769 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:13.665562 17883 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:23:13.665498 10977 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:13.668043 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:13.668340 18472 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:13.672156 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:13.672369 11078 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:23:13.673097 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:23:13.673074 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.681228 10935 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 24.
I20260709 12:23:13.686707 18639 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:13.687644 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:13.689621 11051 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.554s (SENT) [suppressed 12 similar messages]
I20260709 12:23:13.691783 10974 leader_election.cc:400] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 22. Current term is 23.
I20260709 12:23:13.692515 10974 leader_election.cc:403] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:23:13.692044 18514 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:13.716131 11083 raft_consensus.cc:2393] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 24: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:13.702368 10974 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:13.720767 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.647233 18640 raft_consensus.cc:3055] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:13.757599 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:13.751607 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 59598.8us
W20260709 12:23:13.754854 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 52565.6us
I20260709 12:23:13.763059 11050 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:13.763006 10974 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:13.766670 10974 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:13.759773 18637 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:13.723264 18360 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.716640 18566 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 22. Current term is 23.
I20260709 12:23:13.797925 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:13.839187 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 72582.1us
I20260709 12:23:13.756114 18640 raft_consensus.cc:740] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:23:13.804037 18664 log.cc:927] Time spent T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:23:13.805019 18436 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:13.755903 17883 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:13.807196 10936 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:23:13.808108 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.753266 18443 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:13.795629 18613 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:13.770196 18609 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:13.819744 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.823686 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:13.829497 11009 raft_consensus.cc:2410] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 24 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 12:23:13.854548 18609 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.864970 18609 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:13.866580 18640 consensus_queue.cc:260] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:13.840726 18637 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:13.854336 18443 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:13.869944 18637 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:13.870078 18443 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:13.843461 18360 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:13.840130 10974 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:13.842479 18625 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:13.886511 18625 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:23:13.886601 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 46565.2us
I20260709 12:23:13.887394 10974 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:13.888649 18572 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:13.889510 10974 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:13.890247 10936 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:23:13.890763 10974 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:13.891758 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:23:13.840301 10975 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.892383 11011 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 23. Current term is 24. Ops: []
I20260709 12:23:13.818073 18556 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:23:13.831670 10900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.897639 10974 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:13.872292 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:13.815789 18544 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:13.881017 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:13.881875 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:13.883433 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:13.884687 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:13.837704 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:13.895332 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 80644.4us
W20260709 12:23:13.895812 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 75669.3us
I20260709 12:23:13.905807 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:13.901930 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:13.902565 11005 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23.
I20260709 12:23:13.841080 18577 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 12:23:13.875909 18640 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:13.919739 11011 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:23:13.887611 18360 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:13.921756 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:23:13.923842 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 86233.2us
W20260709 12:23:13.925156 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.926656 10901 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:13.927098 11007 raft_consensus.cc:2393] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 21: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:13.906929 18613 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:13.949470 18441 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:13.947958 18614 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:13.959379 18544 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:13.939932 10901 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:13.962736 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:13.963676 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:13.928125 18472 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:13.971164 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 281553us
I20260709 12:23:13.926836 18639 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:13.955915 11008 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 19.
I20260709 12:23:13.906977 18443 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:23:13.950400 10977 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:13.892838 18608 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:23:13.956782 18408 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:13.976797 11051 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:13.908126 18556 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:13.928385 18625 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 12:23:13.928509 18470 consensus_queue.cc:1059] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 12:23:13.920506 18516 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:13.959304 18614 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:13.988344 11051 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:13.974850 18436 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:13.996731 18544 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:13.997166 18544 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:13.997553 18544 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:14.006995 17883 raft_consensus.cc:3055] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:23:14.007519 17883 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:14.009408 18544 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:13.978837 18637 consensus_queue.cc:1048] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:23:14.011574 18544 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:13.989698 18469 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:14.013612 18474 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:13.994210 18479 raft_consensus.cc:2764] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 12:23:14.022939 11051 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:14.055454 18544 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:14.057615 11051 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:14.011269 18609 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:14.060762 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 60762.2us
W20260709 12:23:14.058983 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 62942.9us
I20260709 12:23:14.070858 11051 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:14.019373 18516 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:14.007529 18614 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:14.060230 18494 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:14.100247 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:14.103528 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:14.112352 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 135105us
I20260709 12:23:14.075151 18469 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:14.116042 10901 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:14.121968 10901 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:14.087249 18608 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:23:14.125679 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 199637us
I20260709 12:23:14.135255 10901 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:14.112288 18614 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:14.138739 10901 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:14.128191 18460 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:14.139520 18577 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:14.099347 17883 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.152354 17883 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:14.134380 18619 consensus_queue.cc:1059] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:23:14.158515 18609 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:14.134243 18571 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:14.161624 18571 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:14.162039 18571 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:14.127836 18608 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:14.164584 18608 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:23:14.148497 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 73937.8us
I20260709 12:23:14.165421 11051 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:14.134265 18639 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.168179 11051 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:14.168226 18639 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.169057 18469 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:14.169726 18469 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:23:14.170469 18639 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:14.170697 18692 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:14.170936 10901 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:14.172043 18691 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:23:14.172533 18691 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:14.172905 18691 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:14.172224 10901 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:14.174373 18637 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:23:14.175096 18577 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:14.176810 18450 raft_consensus.cc:3055] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:23:14.177240 18450 raft_consensus.cc:740] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:14.178104 18450 consensus_queue.cc:260] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.179230 18450 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:14.181334 10901 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:14.182605 18460 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:14.182679 10901 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:14.181465 18556 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:14.184916 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:14.188274 11008 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:23:14.188668 11005 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:14.185424 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:14.147877 18614 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.191380 11051 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:14.155229 18680 log.cc:927] Time spent T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:23:14.195072 18436 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.201973 18614 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:14.196285 18577 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:14.203948 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:14.186154 18460 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:14.204593 10935 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:23:14.197075 10901 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:14.202026 18436 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.204736 18460 raft_consensus.cc:697] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:14.205998 18460 consensus_queue.cc:237] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.206701 18436 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:14.204756 18605 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:14.209633 11051 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:14.210469 18605 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:14.212805 11051 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:14.213696 18605 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:14.215086 11051 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:14.215904 18605 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:23:14.217402 11051 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:14.218295 18605 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:23:14.218741 18605 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:14.219188 18605 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:14.155905 10974 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:14.223078 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 67272.4us
I20260709 12:23:14.224123 18625 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:14.227442 18605 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.227767 18625 consensus_queue.cc:1059] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:23:14.228533 18691 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.229367 18577 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:14.235575 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:14.242178 18577 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.244364 11010 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:23:14.250063 11004 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 18.
I20260709 12:23:14.238653 11051 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:14.255827 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 68734.8us
I20260709 12:23:14.263738 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:14.264490 11003 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:14.242681 18577 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:14.269318 10901 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:14.274488 18640 raft_consensus.cc:3055] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:23:14.275884 18690 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:14.276360 18690 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.276681 18690 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:23:14.278488 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 49255.5us
I20260709 12:23:14.255673 18691 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:14.296523 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 48746.7us
I20260709 12:23:14.286110 11051 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:14.239256 18608 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.285120 18571 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.305258 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:14.306774 10977 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:14.308812 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:14.310971 11051 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:14.317061 11050 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:14.324735 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:14.317312 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:14.275842 18640 raft_consensus.cc:740] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:14.294744 18695 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:23:14.327983 11003 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 24.
I20260709 12:23:14.339464 10901 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:14.328399 18494 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:14.315431 18608 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:14.358561 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:14.360591 10901 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:14.363605 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:14.344854 18557 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:23:14.329082 18340 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:14.365463 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:14.370266 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:14.370625 11003 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:23:14.366864 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:14.371420 11006 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:14.371565 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:14.373317 11080 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 23. Current term is 24. Ops: []
I20260709 12:23:14.398777 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:14.398326 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:23:14.400287 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 89400.7us
I20260709 12:23:14.401633 11051 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:23:14.378295 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:14.356539 18571 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:14.404345 11051 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:14.382923 10974 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:14.374116 18360 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:14.379561 18469 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:23:14.401232 18681 log.cc:927] Time spent T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:23:14.412854 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:14.419394 11080 raft_consensus.cc:2368] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22.
I20260709 12:23:14.374303 18340 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.377106 18695 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:23:14.379263 18557 raft_consensus.cc:697] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:14.416690 18703 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:14.422849 11081 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:14.420194 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:14.425374 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:14.426769 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:14.428592 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:14.428761 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:14.413812 18516 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:14.415174 18610 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:23:14.431584 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:14.430480 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:14.465147 10928 raft_consensus.cc:3060] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:14.421072 18689 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:23:14.415290 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 98303.7us
I20260709 12:23:14.421470 18360 raft_consensus.cc:697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:14.428167 18703 consensus_queue.cc:1243] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:23:14.470697 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:14.472929 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:14.475231 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:14.477300 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:14.479315 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:14.479959 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:14.482614 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:14.484146 10899 leader_election.cc:400] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22.
I20260709 12:23:14.484509 10899 leader_election.cc:403] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:23:14.485311 10831 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 118) took 8821 ms. Trace:
I20260709 12:23:14.485724 10831 rpcz_store.cc:276] 0709 12:23:05.663775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.663976 (+   201us) service_pool.cc:224] Handling call
0709 12:23:14.485237 (+8821261us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:11.136299 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:11.137030 (+   731us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:11.137093 (+    63us) write_op.cc:435] Acquired schema lock
0709 12:23:11.137121 (+    28us) tablet.cc:662] Decoding operations
0709 12:23:11.138367 (+  1246us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:11.138469 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:11.138506 (+    37us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:23:11.139665 (+  1159us) tablet.cc:701] Row locks acquired
0709 12:23:11.139715 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:23:11.166943 (+ 27228us) write_op.cc:270] Start()
0709 12:23:11.204164 (+ 37221us) write_op.cc:276] Timestamp: P: 1783599791139828 usec, L: 0
0709 12:23:11.212126 (+  7962us) op_driver.cc:348] REPLICATION: starting
0709 12:23:11.303536 (+ 91410us) log.cc:844] Serialized 5118 byte log entry
0709 12:23:13.062683 (+1759147us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:23:13.260629 (+197946us) op_driver.cc:464] REPLICATION: finished
0709 12:23:13.331474 (+ 70845us) write_op.cc:301] APPLY: starting
0709 12:23:13.333231 (+  1757us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:13.770757 (+437526us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:13.770787 (+    30us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:14.149403 (+378616us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:14.149677 (+   274us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 12:23:14.149719 (+    42us) write_op.cc:312] APPLY: finished
0709 12:23:14.150019 (+   300us) log.cc:844] Serialized 121 byte log entry
0709 12:23:14.150173 (+   154us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:14.150327 (+   154us) write_op.cc:454] Released schema lock
0709 12:23:14.150378 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:14.150795 (+   417us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:14.150824 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1072534,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":59234,"apply.run_cpu_time_us":22429,"apply.run_wall_time_us":825496,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58389,"num_ops":13,"prepare.queue_time_us":224739,"prepare.run_cpu_time_us":23653,"prepare.run_wall_time_us":433902,"raft.queue_time_us":155421,"raft.run_cpu_time_us":26727,"raft.run_wall_time_us":54649,"replication_time_us":2048346,"spinlock_wait_cycles":85353856,"thread_start_us":471228,"threads_started":4,"wal-append.queue_time_us":487422}]]}
I20260709 12:23:14.519130 18640 consensus_queue.cc:260] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.520988 18640 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:23:14.529392 18360 consensus_queue.cc:237] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.533565 11081 raft_consensus.cc:1240] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:14.423823 18340 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:23:14.534047 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 50041.7us
I20260709 12:23:14.534924 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:14.536195 10899 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:14.543485 11079 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:23:14.434106 18516 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:23:14.556730 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 143288us
I20260709 12:23:14.526144 10832 catalog_manager.cc:5697] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 20 to 21, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 21 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:14.561795 18569 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:23:14.580729 18605 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:14.583834 18693 log.cc:927] Time spent T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
W20260709 12:23:14.584497 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.587117 18597 consensus_queue.cc:1059] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:14.588210 18597 raft_consensus.cc:3055] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:14.588593 18597 raft_consensus.cc:740] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:23:14.589795 18597 consensus_queue.cc:260] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:14.555212 18460 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:14.591428 18691 consensus_queue.cc:1059] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:14.598459 10974 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:14.556351 18516 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:14.611734 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 47710.9us
I20260709 12:23:14.604856 11050 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:14.617264 11050 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:14.616211 18557 consensus_queue.cc:237] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.618610 18436 raft_consensus.cc:3055] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:14.608363 10832 catalog_manager.cc:5697] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: config changed from index 9 to -1, term changed from 15 to 13, leader changed from <none> to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65), NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) evicted. New cstate: current_term: 13 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:14.600709 11051 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:14.621439 18469 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:23:14.626533 18613 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:23:14.637945 18695 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:14.638783 18689 consensus_queue.cc:1059] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:14.639456 18443 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.640008 18443 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.642747 18443 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:14.627418 18436 raft_consensus.cc:740] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:14.646543 18436 consensus_queue.cc:260] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.647958 18436 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:14.649071 18569 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:14.655370 10928 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:14.659304 11006 raft_consensus.cc:2468] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:14.668237 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:14.675211 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 74573.2us
I20260709 12:23:14.676319 11051 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:14.663394 18441 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22.
I20260709 12:23:14.696040 18708 raft_consensus.cc:3055] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:23:14.700724 18597 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:14.708432 18577 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.721732 18610 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:14.686604 11051 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:23:14.739202 18710 log.cc:927] Time spent T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:23:14.740655 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 80081.5us
W20260709 12:23:14.746135 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 79443.9us
I20260709 12:23:14.678447 18605 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:23:14.731750 18450 consensus_meta.cc:287] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697: Time spent flushing consensus metadata: real 0.552s	user 0.004s	sys 0.004s
I20260709 12:23:14.737699  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:14.759469 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 72939.3us
I20260709 12:23:14.771752 10935 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 22. Current term is 23. Ops: []
I20260709 12:23:14.774343 10936 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 12:23:14.746428 18708 raft_consensus.cc:740] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:23:14.759620 18678 log.cc:927] Time spent T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:23:14.796716 11050 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:14.798336 11050 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:14.799070 18712 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:23:14.799743 18712 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:14.800388 11080 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:14.758839 18690 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.803388 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:14.775314 18703 raft_consensus.cc:2804] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:14.804499 18703 raft_consensus.cc:697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:14.804960 18690 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:14.805769 10932 raft_consensus.cc:1217] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Deduplicated request from leader. Original: 15.10->[17.11-20.13]   Dedup: 17.11->[18.12-20.13]
I20260709 12:23:14.806296 10932 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: [17.11-20.13]
I20260709 12:23:14.799360 18610 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:14.805348 18703 consensus_queue.cc:237] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.804070 11085 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 23.
I20260709 12:23:14.809720 11079 raft_consensus.cc:1240] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 26. Current term is 27. Ops: []
I20260709 12:23:14.806461 11077 raft_consensus.cc:1240] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:14.815536 11006 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 22. Current term is 23. Ops: []
I20260709 12:23:14.816483 11007 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 23. Current term is 24. Ops: []
I20260709 12:23:14.816340 18443 consensus_queue.cc:1059] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:14.817250 18443 raft_consensus.cc:3055] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:14.817634 18443 raft_consensus.cc:740] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:14.818400 18443 consensus_queue.cc:260] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.819545 18443 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:23:14.819984 18613 consensus_queue.cc:1175] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9e8170bbe8244e40a2b2e5011e69b697" responder_term: 19 status { last_received { term: 19 index: 13 } last_committed_idx: 13 last_received_current_leader { term: 19 index: 13 } }
I20260709 12:23:14.834949 11004 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:23:14.821184 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:14.799743 11050 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:14.836958 18610 consensus_queue.cc:1059] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
W20260709 12:23:14.864276 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 64616us
I20260709 12:23:14.865065 11050 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:14.865861 18605 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:23:14.866603 18605 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:23:14.867826 11050 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:14.868472 18516 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:14.825798 18708 consensus_queue.cc:260] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.869717 11050 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:14.832629 18469 consensus_queue.cc:1059] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:23:14.870718 18469 raft_consensus.cc:3055] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:23:14.871069 18469 raft_consensus.cc:740] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:14.868777 18544 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:14.872294 18610 raft_consensus.cc:3055] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 12:23:14.823551 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.871872 18469 consensus_queue.cc:260] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.869855 18708 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:14.873908 18469 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:14.872709 18610 raft_consensus.cc:740] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:14.877957 18610 consensus_queue.cc:260] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.879189 18610 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:14.873030 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:14.880357 11659 raft_consensus.cc:2393] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 18: Already voted for candidate 0b171b6aaedc4f809f2753dcfadb14ce in this term.
I20260709 12:23:14.847436 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:14.882931 18605 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:14.831339 10974 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:14.846243 18577 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:14.834812 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:14.884538 11007 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:23:14.884567 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 53306.9us
I20260709 12:23:14.886538 18617 consensus_queue.cc:1059] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:14.839094 18695 consensus_queue.cc:1059] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:23:14.888208 18625 raft_consensus.cc:3055] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:14.888612 18625 raft_consensus.cc:740] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:14.889407 18625 consensus_queue.cc:260] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.890563 18625 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:14.872618 18441 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:23:14.894080 11007 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:23:14.750682 18340 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.900631 11009 raft_consensus.cc:1240] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 12:23:14.900905 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:14.884434 18613 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:23:14.898955 18695 consensus_queue.cc:1243] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer 9e8170bbe8244e40a2b2e5011e69b697 log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:23:14.903514 18340 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:14.905263 18544 raft_consensus.cc:3055] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:14.901016 11077 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:14.905648 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:14.831142 10832 catalog_manager.cc:5697] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 9 to 14, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 14 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:14.905689 18544 raft_consensus.cc:740] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:14.908802 18544 consensus_queue.cc:260] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.910058 18544 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:14.913899 18605 consensus_queue.cc:1059] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:14.915139 18695 raft_consensus.cc:3055] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:23:14.915544 18695 raft_consensus.cc:740] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:14.916352 18695 consensus_queue.cc:260] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.917757 18712 consensus_queue.cc:1059] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:14.918956 18609 raft_consensus.cc:3055] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:23:14.919370 18609 raft_consensus.cc:740] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:14.920210 18609 consensus_queue.cc:260] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.921933 18609 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:14.923095 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:14.923969 11079 raft_consensus.cc:2410] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 12:23:14.926681 10930 raft_consensus.cc:1240] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 23. Current term is 24. Ops: []
I20260709 12:23:14.942515 18613 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.943078 18613 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:14.943794 18516 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:14.948781 10901 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:14.948905 18557 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.959903 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:14.960970 11082 raft_consensus.cc:2410] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 12:23:14.951150 18441 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:14.965961 11007 raft_consensus.cc:1240] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: [18.12-20.13]
I20260709 12:23:14.973685 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:14.977152 18703 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:14.977753 18703 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.978713 18610 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.979233 18610 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.981209 18610 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:14.951629 18557 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.983562 10935 raft_consensus.cc:2393] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 23: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:23:14.984293 18703 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:14.984443 18557 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:14.986761 18441 raft_consensus.cc:697] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:14.987646 18441 consensus_queue.cc:237] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:14.988283 11077 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:23:14.994684 10932 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:23:15.004381 18695 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:15.005811 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:15.007253 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:15.011399 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:15.011720 11051 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:23:15.022394 11006 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 26.
I20260709 12:23:15.022513 10935 raft_consensus.cc:2410] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 27 because replica has last-logged OpId of term: 25 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 14.
I20260709 12:23:15.016614 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:15.019757 18569 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:15.026119 18569 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:15.023499 11009 raft_consensus.cc:2393] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 18: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:23:15.028266 18569 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:15.029618 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:15.030346 18703 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:15.030884 18703 raft_consensus.cc:697] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:15.031790 18703 consensus_queue.cc:237] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:15.024243 11050 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:15.038079 18469 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:23:15.038631 18469 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.039096 18469 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:23:15.040520 11051 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:15.024283 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:15.041219 11007 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 26.
I20260709 12:23:15.023849 10899 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:15.046444 18613 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:15.052527 11011 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 24.
I20260709 12:23:15.055460 18690 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:23:15.058175 10901 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:15.066286 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:15.070395 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:15.071684 11082 raft_consensus.cc:2393] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 23: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:15.062530 18609 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.076041 10977 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:15.062986 18544 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:15.072979 18557 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:23:15.086431 11006 raft_consensus.cc:2368] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 23. Current term is 24.
I20260709 12:23:15.068627 18569 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:23:15.089164 18443 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:23:15.092716 10932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:23:15.086745 18557 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.093489 18557 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:23:15.087440 18609 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:15.099546 18609 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:15.101140 10932 raft_consensus.cc:606] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:15.102571 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:15.118983 10932 raft_consensus.cc:614] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:15.111166 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:15.113052 10901 leader_election.cc:400] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 23. Current term is 24.
I20260709 12:23:15.120816 10901 leader_election.cc:403] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:15.121117 11050 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:15.121671 18567 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:23:15.122637 18609 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:23:15.123162 18609 raft_consensus.cc:697] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:15.124337 18609 consensus_queue.cc:237] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:15.125906 11051 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:15.126988 18695 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:15.128489 10929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:23:15.129241 10929 raft_consensus.cc:606] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:15.129590 10929 raft_consensus.cc:614] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:15.115096 11011 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:15.133040 18567 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 23. Current term is 24.
I20260709 12:23:15.139333 10932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:23:15.144748 18567 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:15.146790 10932 raft_consensus.cc:606] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:15.152758 10932 raft_consensus.cc:614] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:15.168093 11085 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:23:15.181984 18690 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:15.185984 11011 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:23:15.188403 18690 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:15.151760 18557 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:15.208441 18557 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 27 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:15.153420 18469 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:15.209672 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:15.211089 18469 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:15.160171 18567 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:15.216786 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:15.218231 11006 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:23:15.217363 11076 raft_consensus.cc:2393] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 27: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:15.221632 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:15.223616 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:15.224571 10932 raft_consensus.cc:2393] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 27: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:23:15.230108 10929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:23:15.230790 10929 raft_consensus.cc:606] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:15.237351 11051 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:15.242640 11006 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 27.
I20260709 12:23:15.243913 10901 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:15.240993 18712 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:23:15.220611 18567 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:15.258472 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:15.259120 11076 raft_consensus.cc:3060] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:15.260471 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:15.249481 18577 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:23:15.256863 18613 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:15.286967 11076 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 24.
I20260709 12:23:15.290594 10974 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:15.294924 10932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:23:15.295682 10932 raft_consensus.cc:606] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:15.292475 18577 raft_consensus.cc:697] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:15.300514 18577 consensus_queue.cc:237] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:15.313848 10929 raft_consensus.cc:2468] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 24.
I20260709 12:23:15.312470 18441 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.314879 18613 raft_consensus.cc:2804] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:23:15.327446 18613 raft_consensus.cc:697] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 24 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:15.324900 18441 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:15.338507 18613 consensus_queue.cc:237] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:15.344048 18441 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:15.344987 11009 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:23:15.336212 18544 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:15.354197 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:15.354974 11077 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 24.
I20260709 12:23:15.358928 10899 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:15.359508 11082 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:15.361765 18556 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:23:15.362236 18556 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.362576 18556 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:15.366662 18691 raft_consensus.cc:993] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:15.367242 18691 raft_consensus.cc:1081] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:15.353976 18516 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:23:15.408166 18567 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:15.407925 10831 catalog_manager.cc:5697] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index -1 to 12, term changed from 13 to 15, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67), VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 15 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:15.409643 10831 catalog_manager.cc:5697] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 13 to 15, leader changed from 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 15 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:15.414309 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:15.414976 11002 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 24.
I20260709 12:23:15.415217 11077 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60046
I20260709 12:23:15.415766 10936 raft_consensus.cc:1275] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:23:15.411042 10831 catalog_manager.cc:5697] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 11 to 12, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 12 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:15.415766 11077 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:15.417367 11077 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:15.419158 18556 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:15.421648 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:15.423717  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:15.424647 11079 raft_consensus.cc:2393] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 25: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:15.425845 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:15.426530 11009 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 25.
I20260709 12:23:15.426834 18556 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:15.430460 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:15.431059 11002 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:15.432067 18469 consensus_queue.cc:1048] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:15.437075  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:15.437776 10901 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:15.438089  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:15.442090 18567 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:23:15.442574 18567 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:15.442864 18714 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.443405 18714 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:15.444074 18567 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:15.446276 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:15.446951 11082 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:15.448719 18714 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:15.450014 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:15.450194 11077 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:15.438776 10831 catalog_manager.cc:5697] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:15.452823 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:15.453431 10929 raft_consensus.cc:3055] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:15.453861 10929 raft_consensus.cc:740] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:15.454677 10929 consensus_queue.cc:260] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:15.455782 10929 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:15.453415 10831 catalog_manager.cc:5697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 24 to 26, leader changed from 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 26 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:15.468637 18460 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:15.480044 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:15.480715 11659 raft_consensus.cc:3060] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:15.487095 11002 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 25.
I20260709 12:23:15.480086 18460 raft_consensus.cc:993] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:15.490783 18577 raft_consensus.cc:1081] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:15.491833 11656 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:23:15.488229 11659 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:23:15.493162 11006 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37586
I20260709 12:23:15.493255 18469 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:15.493965 11006 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:15.494419 11006 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:15.495285 11049 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:23:15.478981 11077 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:15.496321 18469 raft_consensus.cc:2804] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:15.497088 18469 raft_consensus.cc:697] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:15.495283 10929 raft_consensus.cc:2468] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:23:15.498464 10901 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:15.500774 18460 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:23:15.501451 18460 raft_consensus.cc:697] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:15.502367 18460 consensus_queue.cc:237] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:15.509790 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:15.510576 10929 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 18.
I20260709 12:23:15.530253 18613 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.530457 11649 tablet_service.cc:1558] Processing DeleteTablet for tablet 80db8b3fbfd046e8a5535ff4a7380107 with delete_type TABLET_DATA_TOMBSTONED (TS 0b171b6aaedc4f809f2753dcfadb14ce not found in new config with opid_index -1) from {username='slave'} at 127.0.0.1:55644
I20260709 12:23:15.530897 18613 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:15.534137 18613 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:15.535197 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:23:15.538823 10819 catalog_manager.cc:5002] TS 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): delete failed for tablet 80db8b3fbfd046e8a5535ff4a7380107 because of a CAS failure. No further retry: Illegal state: Request specified cas_config_opid_index_less_or_equal of 9 but the committed config has opid_index of 12
I20260709 12:23:15.538383 18567 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:15.549789 10929 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:23:15.553979 18544 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:15.523149 18469 consensus_queue.cc:237] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:15.557312 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:15.560138 11082 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 25.
I20260709 12:23:15.565552 11006 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:15.578603 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:15.579291 10929 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 26.
I20260709 12:23:15.581734 11002 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 25.
I20260709 12:23:15.586642 11625 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:15.591887 10901 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:15.595144 10977 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:15.598533 11006 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:15.601672 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:15.602340 11656 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:15.602393 18436 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 12:23:15.614876 10832 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35614 (request call id 248) took 32052 ms (client timeout 15000 ms). Trace:
W20260709 12:23:15.616798 10832 rpcz_store.cc:269] 0709 12:22:43.562779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.563052 (+   273us) service_pool.cc:224] Handling call
0709 12:23:15.614802 (+32051750us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:15.048647 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:15.049282 (+   635us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:15.049317 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:23:15.049334 (+    17us) tablet.cc:662] Decoding operations
0709 12:23:15.049869 (+   535us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:15.049929 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:15.049958 (+    29us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:23:15.050257 (+   299us) tablet.cc:701] Row locks acquired
0709 12:23:15.050273 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:23:15.050428 (+   155us) write_op.cc:270] Start()
0709 12:23:15.050534 (+   106us) write_op.cc:276] Timestamp: P: 1783599795050379 usec, L: 0
0709 12:23:15.050553 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:23:15.051200 (+   647us) log.cc:844] Serialized 1308 byte log entry
0709 12:23:15.194788 (+143588us) op_driver.cc:464] REPLICATION: finished
0709 12:23:15.331236 (+136448us) write_op.cc:301] APPLY: starting
0709 12:23:15.333507 (+  2271us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:15.359317 (+ 25810us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:15.362647 (+  3330us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:15.364639 (+  1992us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:15.364846 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 12:23:15.364890 (+    44us) write_op.cc:312] APPLY: finished
0709 12:23:15.365108 (+   218us) log.cc:844] Serialized 41 byte log entry
0709 12:23:15.365935 (+   827us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:15.366030 (+    95us) write_op.cc:454] Released schema lock
0709 12:23:15.366069 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:15.371226 (+  5157us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:15.371261 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":182605,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":132759,"apply.run_cpu_time_us":6138,"apply.run_wall_time_us":42508,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16649,"num_ops":3,"prepare.queue_time_us":63283,"prepare.run_cpu_time_us":2821,"prepare.run_wall_time_us":11371,"replication_time_us":144074,"thread_start_us":89749,"threads_started":2}]]}
I20260709 12:23:15.608210 17974 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:23:15.608424 18583 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:15.608248 18567 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:15.651118 11006 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:23:15.623346 17974 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.625342 18436 raft_consensus.cc:697] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:15.626394 18583 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:15.658926 17974 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:23:15.669275 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 65100us
I20260709 12:23:15.663784 18583 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:15.655546 18544 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.014s
I20260709 12:23:15.673980 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:15.676649 11076 raft_consensus.cc:2393] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 25: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:15.678879 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:15.679440 10929 raft_consensus.cc:3055] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:15.679721 10929 raft_consensus.cc:740] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:15.680431 10929 consensus_queue.cc:260] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:15.681680 10929 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:15.688320 10929 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:23:15.688433 18436 consensus_queue.cc:237] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:15.687770 17974 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:15.689618 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:15.690444 18708 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:15.690956 18708 raft_consensus.cc:697] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:15.691313 17974 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 27 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:15.691789 18708 consensus_queue.cc:237] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:15.696566 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:15.705884 11076 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 12:23:15.706274 11076 pending_rounds.cc:85] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 12
I20260709 12:23:15.706513 11076 pending_rounds.cc:107] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 12:23:15.706737 11076 raft_consensus.cc:2889] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:15.708107 11006 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:23:15.708537 18460 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:15.709080 18460 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:15.711203 18460 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:15.714584 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:15.706099 17883 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.714527 18557 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:23:15.716117 17883 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:15.718146 17883 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:15.719395 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:15.720268 11076 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 27.
I20260709 12:23:15.721050 11006 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 27.
I20260709 12:23:15.721258 10974 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:15.722666 11656 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:23:15.726686 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:15.727455 10936 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:23:15.732240 17883 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:23:15.732910 17883 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.733264 17883 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:23:15.736550 10901 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:15.741354 18743 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:23:15.750399 18743 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:15.750804 18743 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:23:15.767499 10931 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:15.767702 10936 raft_consensus.cc:2468] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 27.
I20260709 12:23:15.818222 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:15.748083 17974 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:15.820772 17974 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:15.823027 17974 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:15.825232 10834 catalog_manager.cc:5697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:15.833303 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:15.835652 17883 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:15.837405 11079 raft_consensus.cc:2393] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 20: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:15.840657 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:15.841459 11076 raft_consensus.cc:2393] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 27: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:15.858652 11006 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:23:15.851802 18583 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:15.882603 18583 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:15.884755 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 44645.3us
I20260709 12:23:15.885814 10931 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:23:15.886337 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:15.894335 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:15.894991 10932 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:23:15.894505 11076 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:23:15.896730 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:15.898295 11625 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:15.900220 17883 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:15.904740 10834 catalog_manager.cc:5697] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 15 to 16, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 16 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:15.902283 18742 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 12:23:15.897432 18469 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 12:23:15.901175 18577 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:23:15.931303 18577 consensus_queue.cc:1243] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer 1abf4b385a2b493ab83f593a1f8c9cd1 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:23:15.934691 10834 catalog_manager.cc:5697] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:15.903589 18583 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:23:15.955120 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 63528.1us
I20260709 12:23:15.957394 10834 catalog_manager.cc:5697] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 14 to 15, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 15 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:15.937371 18460 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.017s
W20260709 12:23:15.967505 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 128732us
I20260709 12:23:15.969425 10834 catalog_manager.cc:5697] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:15.971356 10834 catalog_manager.cc:5697] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 16 to 17, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 17 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:15.974447 10834 catalog_manager.cc:5697] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 13 to 12, leader changed from <none> to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 12 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:15.976493 10834 catalog_manager.cc:5697] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:15.978852 10834 catalog_manager.cc:5697] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 13 to 20, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 20 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:15.985715 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:15.985762 11078 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:23:15.990898 11082 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:23:15.991631 10834 catalog_manager.cc:5697] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 10 to 13, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 13 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:15.993328 10834 catalog_manager.cc:5697] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 21 to 22, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 22 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:15.995319 10834 catalog_manager.cc:5697] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 13 to 16, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 16 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:15.997998 11082 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 28.
I20260709 12:23:16.003322 10977 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:16.004357 11656 raft_consensus.cc:1240] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:16.010931 18755 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:16.012331 18640 raft_consensus.cc:2804] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:23:16.012550 10977 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:16.012918 18640 raft_consensus.cc:697] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 27 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:16.013499 17974 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:16.004464 18743 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:16.014881 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 112731us
I20260709 12:23:16.014520 10974 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:16.017069 11078 raft_consensus.cc:1217] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Deduplicated request from leader. Original: 15.10->[17.11-21.13]   Dedup: 17.11->[19.12-21.13]
I20260709 12:23:16.017589 11078 pending_rounds.cc:85] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting all ops after (but not including) 11
I20260709 12:23:16.017812 11078 pending_rounds.cc:107] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 12:23:16.018038 11078 raft_consensus.cc:2889] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:16.022595 10929 raft_consensus.cc:2468] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 27.
I20260709 12:23:16.014199 17974 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:16.067138 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:16.019243 18516 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:16.020428 18443 raft_consensus.cc:2804] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:23:16.072374 18516 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:16.017179 18712 consensus_queue.cc:1059] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.012s
I20260709 12:23:16.077359 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:16.079336 10932 raft_consensus.cc:2368] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 26. Current term is 27.
I20260709 12:23:16.082050 11051 leader_election.cc:400] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 26. Current term is 27.
I20260709 12:23:16.082384 11051 leader_election.cc:403] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:16.029017 17974 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:16.086825 18544 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.088593 18743 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 27 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:16.088739 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:16.083449 18443 raft_consensus.cc:697] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 28 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:16.093532 10936 raft_consensus.cc:1275] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:23:16.019588 18640 consensus_queue.cc:237] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:16.087442 18544 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:16.103950 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:16.081498 18516 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:16.104773 11082 raft_consensus.cc:2368] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 27. Current term is 28.
I20260709 12:23:16.112860 10899 leader_election.cc:400] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 27 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 27. Current term is 28.
I20260709 12:23:16.113250 10899 leader_election.cc:403] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 27 election: Cancelling election due to peer responding with higher term
I20260709 12:23:16.108879 18691 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.157217 11656 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:23:16.118831 18577 raft_consensus.cc:3060] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:23:16.191159 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:16.096208 18443 consensus_queue.cc:237] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:16.202395 17883 consensus_queue.cc:1048] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:16.181470 18691 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:16.211527 18712 raft_consensus.cc:3060] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Advancing to term 27
I20260709 12:23:16.195111 18613 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 12:23:16.235476 11656 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:23:16.223644 18769 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:16.242830 18769 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:16.245275 18769 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:16.249179 18757 log.cc:927] Time spent T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 12:23:16.250865 18753 log.cc:927] Time spent T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
W20260709 12:23:16.260538 18760 log.cc:927] Time spent T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:23:16.261827 18691 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:16.328207 11079 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:23:16.333925 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:16.340657 17974 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:16.354081 11079 raft_consensus.cc:2393] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 20: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:23:16.332844 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 95182.2us
I20260709 12:23:16.320457 18689 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.362502 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:16.381175 11079 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23.
I20260709 12:23:16.364163 11084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39448
I20260709 12:23:16.369299 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:16.382607 11007 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:23:16.369925 11011 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:23:16.370738 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:16.371739 11009 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:23:16.384443 11084 raft_consensus.cc:606] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Received request to transfer leadership
I20260709 12:23:16.377966 18775 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.379983 18569 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:16.379838 18766 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:16.413400 11084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39448
I20260709 12:23:16.414650 11084 raft_consensus.cc:606] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Received request to transfer leadership
I20260709 12:23:16.386454 18544 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:16.407354 18556 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:16.390411 18689 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:16.404382 18761 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 12:23:16.444063 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:16.406404 18775 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:16.444847 11009 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:23:16.433573 18741 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.415186 18569 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:16.418193 18766 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:16.498230 18782 log.cc:927] Time spent T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:23:16.499692 18766 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:16.500340 11010 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:16.500568 18775 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:16.503502 18712 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Leader pre-election lost for term 26. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 26. Current term is 27.
I20260709 12:23:16.494127 18741 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:16.510092 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:16.510767 11009 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 25.
I20260709 12:23:16.511026 18741 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:16.505230 18781 log.cc:927] Time spent T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:23:16.511735 18761 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.512823 18712 raft_consensus.cc:993] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 0b171b6aaedc4f809f2753dcfadb14ce to start an election
I20260709 12:23:16.513535 18771 raft_consensus.cc:1081] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Signalling peer 0b171b6aaedc4f809f2753dcfadb14ce to start an election
I20260709 12:23:16.515605 11659 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107"
dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
 from {username='slave'} at 127.0.0.1:59414
I20260709 12:23:16.516223 11659 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:16.512257 18761 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:16.516585 11659 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:16.519599 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:16.496165 18577 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 28 FOLLOWER]: Leader election lost for term 27. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 27. Current term is 28.
I20260709 12:23:16.520275 11009 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:23:16.521528 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:16.522202 11078 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 17.
I20260709 12:23:16.519757 18761 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:16.530442 11622 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:23:16.531243 18714 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:16.505362 18569 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:16.507390 18689 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:16.432793 18556 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:16.533893 18556 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:16.531629 18714 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.534706 18714 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:16.536356 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:16.537130 10935 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:16.546550 18770 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.547195 18770 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:16.549161 18714 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:16.550463 18770 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:16.550705 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:16.554955 11009 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:23:16.553047 11651 raft_consensus.cc:1240] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:16.556723 11659 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:16.559082 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:16.560061 11078 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:16.562968 18714 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:16.560104 18789 consensus_queue.cc:1059] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.004s
I20260709 12:23:16.570660 10935 raft_consensus.cc:1275] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:23:16.634809 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:16.592190 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:16.574150 11079 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:23:16.567673 11078 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 18.
I20260709 12:23:16.656271 18460 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:16.656477 10899 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:16.657406 18758 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:23:16.657809 18758 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.658130 18758 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:16.622609 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:16.665202 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:16.666072 10929 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:16.595273 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:16.667300 11083 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23.
I20260709 12:23:16.663699 11659 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:16.620728 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 47976.6us
I20260709 12:23:16.665745 10936 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:23:16.670385 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:16.673084 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:16.675786 10931 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:23:16.677160 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:16.677795 11083 raft_consensus.cc:3055] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:16.677158 11622 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:23:16.678269 11083 raft_consensus.cc:740] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:16.605798 18712 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.675478 10936 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:23:16.680184 11083 consensus_queue.cc:260] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:16.695350 10901 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:16.697881 10929 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 16.
I20260709 12:23:16.682462 18741 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:16.701141  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:16.700904 10899 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:16.708212 18767 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:16.710605 18767 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:16.711151 18767 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:16.717437 10977 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:16.719280 18786 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:16.719940 18786 raft_consensus.cc:697] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:23:16.711037 10818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 230723us
I20260709 12:23:16.709220 18436 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:16.699388 18691 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 12:23:16.730912 18741 raft_consensus.cc:697] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:23:16.701745 18712 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:16.809252 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 105553us
I20260709 12:23:16.720853 18786 consensus_queue.cc:237] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:16.814497 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:16.816339 11009 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:23:16.816804 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:16.791105 18436 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:16.816246 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:16.818310 11011 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:16.831037 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:16.832547 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:16.833254 10936 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:23:16.835881 10931 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:23:16.837563 10931 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 12:23:16.839286 11009 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 18.
I20260709 12:23:16.841162 11078 raft_consensus.cc:2393] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 20: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:16.845144 11084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39448
W20260709 12:23:16.849092 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 139840us
I20260709 12:23:16.810261 18557 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.035s
I20260709 12:23:16.819938 18436 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:16.855515 11051 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:16.856547 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:16.857429 11007 raft_consensus.cc:2393] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 23: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:16.840786 18617 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.858032 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:16.862039 11011 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 16.
I20260709 12:23:16.862526 11008 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
W20260709 12:23:16.863668 11048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:16.884907 18785 consensus_queue.cc:1048] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 12:23:16.864897 18764 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:23:16.907008 10901 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:23:16.886842 18799 log.cc:927] Time spent T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:23:16.903228 18758 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:16.853506 18460 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:23:16.917788 11051 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:16.918972 11051 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
W20260709 12:23:16.887408 18794 log.cc:927] Time spent T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:23:16.872450 18617 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:16.907744 18764 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.928493 10929 raft_consensus.cc:2368] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 23. Current term is 24.
I20260709 12:23:16.922616 18783 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:23:16.871251 18741 consensus_queue.cc:237] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:16.938023 17974 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:16.927883 18784 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:16.928207 18803 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:16.931725 18764 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:16.944614 11050 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:16.958382 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:16.958550 18785 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:23:16.959352 11077 raft_consensus.cc:2393] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 20: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:16.934859 18783 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.953346 18803 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:16.959440 18785 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.977279 18785 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:16.978519 18783 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:16.949807 18784 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.979509 18784 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:16.979164 18436 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:16.976979 18767 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:16.980456 18712 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:16.981791 18436 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:16.982889 18802 log.cc:927] Time spent T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:23:16.976912 18803 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:16.993399 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:16.994073 11008 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:23:16.997926 11050 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:17.001191 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:16.981925 18767 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:17.023108 18784 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:17.023141 18783 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:17.014477 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:17.029603 18803 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:17.005220 18761 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:23:17.046634 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 122790us
I20260709 12:23:17.061051 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:17.061429 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:17.062177 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:17.064165 11080 raft_consensus.cc:2368] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 20. Current term is 21.
I20260709 12:23:17.064935 11009 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:23:17.066649 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:17.076855 11006 raft_consensus.cc:2393] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 23: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:17.083279 11009 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 24.
I20260709 12:23:17.086905 10936 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:23:17.052933 18761 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.102051 10901 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:17.055217 18764 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:17.114447 11002 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:23:17.129395 11081 raft_consensus.cc:2368] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 23. Current term is 24.
I20260709 12:23:17.103154 18761 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:17.136116 18785 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:17.116696 18784 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:17.139303 10901 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:17.152377 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:17.153136 11078 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 23.
I20260709 12:23:17.153957 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:17.117799 18783 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:17.147789 18810 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.147043 18690 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:23:17.155381 18516 raft_consensus.cc:3055] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:17.157864 18516 raft_consensus.cc:740] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:17.158669 18516 consensus_queue.cc:260] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:17.148566 18556 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:17.159827 18556 raft_consensus.cc:697] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:17.161101 18785 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:17.157306 18810 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:17.163731 18810 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:17.159960 18516 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:17.164777 18764 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:17.160770 18556 consensus_queue.cc:237] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:17.157415 18690 raft_consensus.cc:697] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:17.168818 18690 consensus_queue.cc:237] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:17.169756 18761 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:17.170147 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:17.171877 18761 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:17.175297 11078 raft_consensus.cc:2393] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 21: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:17.182531 18617 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:17.168642 18803 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:17.200632 11002 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:23:17.202121 10901 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:17.205981 18567 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:17.206579 18567 raft_consensus.cc:697] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:17.207468 18567 consensus_queue.cc:237] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:17.216609 11078 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 12:23:17.217074 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:17.217760 11076 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:23:17.240656 11083 raft_consensus.cc:3060] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:17.242743 11656 raft_consensus.cc:1240] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:17.245915 18690 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:17.246621 18690 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:17.262910 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 234338us
I20260709 12:23:17.265034 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:17.266913 10974 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:17.270170 18793 raft_consensus.cc:2764] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 12:23:17.278522 11082 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 25. Current term is 26. Ops: [25.17-25.17]
I20260709 12:23:17.279287 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:17.280027 11080 raft_consensus.cc:2368] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 20. Current term is 21.
I20260709 12:23:17.282855 18758 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:17.289690 11011 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07467552f78d410bb9e5774f3340f134"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:17.290408 11011 raft_consensus.cc:606] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:17.295627 11624 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:17.296653 10977 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:17.297565 18741 raft_consensus.cc:2804] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:17.298125 18741 raft_consensus.cc:697] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:23:17.299283 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:17.299037 18741 consensus_queue.cc:237] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:17.299544 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:17.299698 18640 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:17.300119 10931 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:17.308678 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:17.310128 10935 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:17.300547 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:17.309116 18640 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.316344 18640 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:17.316660 10931 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 24.
I20260709 12:23:17.300547 18774 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:23:17.300953 18754 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:23:17.302111 10977 leader_election.cc:400] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 23. Current term is 24.
I20260709 12:23:17.302685 10831 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 120) took 1396 ms. Trace:
I20260709 12:23:17.325909 10831 rpcz_store.cc:276] 0709 12:23:15.906089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.910380 (+  4291us) service_pool.cc:224] Handling call
0709 12:23:17.302592 (+1392212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70845,"reported_tablets":1}
I20260709 12:23:17.328336 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:17.328979 10931 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:23:17.329850 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:17.330871 11007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:17.331264 10931 raft_consensus.cc:1240] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:17.331424 11007 raft_consensus.cc:606] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:17.334468 10974 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:23:17.335224 18793 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:17.336483 11007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:17.336922 18793 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:17.337432 18793 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.337785 18793 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:17.337090 11007 raft_consensus.cc:606] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:17.341166 11007 raft_consensus.cc:614] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:17.345088 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:17.346908 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:17.359347 11011 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:17.347163 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:17.348344 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:17.364305 11006 raft_consensus.cc:3060] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:17.348596 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:17.349555 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:17.351095 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:17.368722 11009 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:17.346585 11007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:17.375842 11006 raft_consensus.cc:2468] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 24.
I20260709 12:23:17.376585 11083 raft_consensus.cc:2468] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 16.
I20260709 12:23:17.409029 11084 raft_consensus.cc:606] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Received request to transfer leadership
I20260709 12:23:17.379437 11011 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:23:17.409549 11084 raft_consensus.cc:614] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:17.383507 11009 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 24.
I20260709 12:23:17.410198 18557 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.410674 18557 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:17.412784 18557 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:17.414484 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 58786.7us
I20260709 12:23:17.383939 11007 raft_consensus.cc:606] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Received request to transfer leadership to TS 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:23:17.391912 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:17.419478 11077 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:17.421679 10936 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:23:17.422290 10936 raft_consensus.cc:606] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:17.422606 10936 raft_consensus.cc:614] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:17.397011 11079 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:23:17.424196  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:17.426086  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:17.426985  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:17.438968 18443 raft_consensus.cc:993] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 0b171b6aaedc4f809f2753dcfadb14ce to start an election
I20260709 12:23:17.439517 18443 raft_consensus.cc:1081] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Signalling peer 0b171b6aaedc4f809f2753dcfadb14ce to start an election
I20260709 12:23:17.441361 11656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80"
dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
 from {username='slave'} at 127.0.0.1:59398
I20260709 12:23:17.398243 11080 raft_consensus.cc:1275] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 12:23:17.399284 10932 raft_consensus.cc:1275] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 28 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 12:23:17.441910 11656 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:17.443554 11656 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:17.388948 18640 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:17.445250 11008 raft_consensus.cc:2393] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 21: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:17.448912 18640 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:17.357522 10935 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 24.
I20260709 12:23:17.451711 11656 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:17.452546 18690 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:17.397521 11051 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:17.453889 11050 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:17.454063 18544 raft_consensus.cc:2804] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:23:17.454665 18544 raft_consensus.cc:697] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:17.454922 18779 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:23:17.455494 18544 consensus_queue.cc:237] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:17.463335 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:17.464044 11008 raft_consensus.cc:3055] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:23:17.464453 11008 raft_consensus.cc:740] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
W20260709 12:23:17.463981 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 66518.2us
I20260709 12:23:17.475050 11051 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:17.465240 11008 consensus_queue.cc:260] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:17.476511 11008 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:17.476850 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:17.477918 11656 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 24 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:17.482220 11050 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:17.484135 11050 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:17.484889 18779 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:17.485293 18779 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.485636 18779 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:17.487121 17883 raft_consensus.cc:993] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:17.487594 17883 raft_consensus.cc:1081] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:17.488080 18775 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:17.488618 18775 raft_consensus.cc:697] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:17.488754 18770 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:23:17.489308 18770 raft_consensus.cc:697] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:17.489545 18775 consensus_queue.cc:237] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:17.490437 18770 consensus_queue.cc:237] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:17.497008 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:17.501099 18779 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:17.517400 18597 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:23:17.520424 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:17.522404 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:17.523069 11079 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:17.520753 18779 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:17.525683 18443 consensus_queue.cc:1048] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:17.525743 11008 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 24.
I20260709 12:23:17.441857 11077 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 24.
I20260709 12:23:17.537410 11624 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:17.540234 11050 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:17.541478 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:17.542872 11077 raft_consensus.cc:2393] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 21: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:17.544229 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:17.544927 10929 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:17.546692 11076 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:23:17.547369 11076 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:17.547716 11076 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:17.550231 18597 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:23:17.550864 18597 raft_consensus.cc:697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:23:17.551689 18597 consensus_queue.cc:237] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:17.426209 18793 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:17.554848 18793 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:17.556042 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:17.558069 11009 raft_consensus.cc:1240] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:17.566345 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:17.566601 10929 raft_consensus.cc:2468] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:23:17.568509 11051 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:17.571359 11079 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 24.
I20260709 12:23:17.568085 11076 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:17.576535 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:17.567287 18775 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:23:17.595676 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:17.598501 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:23:17.600311 10882 auto_rebalancer.cc:893] Removing replace marker failed: Replica 1abf4b385a2b493ab83f593a1f8c9cd1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:17.600832 10882 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:23:17.601137 10882 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:23:17.575665 18770 raft_consensus.cc:2804] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:17.604727 18770 raft_consensus.cc:697] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:17.605742 18770 consensus_queue.cc:237] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:17.611603 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:17.612253 10929 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:17.619128 10929 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:17.620246 11051 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:17.574458 18741 consensus_queue.cc:1059] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 12:23:17.625543 18640 consensus_queue.cc:1048] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:23:17.632372 18741 raft_consensus.cc:3055] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:17.632803 18741 raft_consensus.cc:740] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:23:17.626317 10899 leader_election.cc:400] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 20. Current term is 21.
I20260709 12:23:17.633088 18779 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:17.634017 10899 leader_election.cc:400] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 23. Current term is 24.
I20260709 12:23:17.633677 18741 consensus_queue.cc:260] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:17.633690 18779 raft_consensus.cc:697] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:17.636071 18779 consensus_queue.cc:237] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:17.634323 10899 leader_election.cc:403] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 12:23:17.644620 18690 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 23. Current term is 24.
I20260709 12:23:17.634992 18741 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:17.655352 10974 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:17.656466 17883 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:23:17.659543 11009 raft_consensus.cc:1240] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:17.659060 11076 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:17.664754 18836 log.cc:927] Time spent T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
W20260709 12:23:17.710480 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 63842.9us
I20260709 12:23:17.714640 10899 leader_election.cc:400] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 20. Current term is 21.
I20260709 12:23:17.658931 10974 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:23:17.727474 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 68411.5us
I20260709 12:23:17.730739 10830 catalog_manager.cc:5697] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 19 to 20, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 20 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:17.745616 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:17.746850 11009 raft_consensus.cc:3055] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:23:17.757169 11080 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:17.747282 11009 raft_consensus.cc:740] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:17.761354 11009 consensus_queue.cc:260] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:17.772387 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 58143.7us
I20260709 12:23:17.787896 11009 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:17.742540 10830 catalog_manager.cc:5697] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 15 to 22. New cstate: current_term: 22 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:17.792932 10830 catalog_manager.cc:5697] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 11 to 17, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 17 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:17.795722 10830 catalog_manager.cc:5697] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 18 to 19, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 19 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:17.806820 10899 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:17.809799 10899 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:17.813585 17883 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:17.804661 10830 catalog_manager.cc:5697] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 16 to 21. New cstate: current_term: 21 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:17.830272 10830 catalog_manager.cc:5697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:17.819123 18441 consensus_queue.cc:1059] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:23:17.839243 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 64979.5us
I20260709 12:23:17.846453 18441 raft_consensus.cc:3055] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:23:17.847030 18441 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:17.848553 18803 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:17.848742 18441 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:17.851327 18441 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:17.827368 18690 consensus_queue.cc:1059] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 12:23:17.856621 18690 raft_consensus.cc:3055] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:17.857154 18690 raft_consensus.cc:740] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:17.858482 18690 consensus_queue.cc:260] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:17.876549 18742 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:23:17.882229 10834 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35620 (request call id 249) took 31453 ms (client timeout 15000 ms). Trace:
I20260709 12:23:17.903607 11009 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:17.840553 10830 catalog_manager.cc:5697] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:17.919274 17883 consensus_queue.cc:1059] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:17.925585 17883 consensus_queue.cc:1243] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 1abf4b385a2b493ab83f593a1f8c9cd1 log is divergent from this leader: its last log entry 21.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:23:17.939431 11084 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:23:17.935650 18845 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.944258 18708 raft_consensus.cc:3055] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:17.945580 10830 catalog_manager.cc:5697] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 15 to 18, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 18 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:17.956434 18708 raft_consensus.cc:740] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:17.963809 18708 consensus_queue.cc:260] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:17.965548 18708 raft_consensus.cc:3060] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:17.968479 10936 raft_consensus.cc:3055] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:17.968983 10936 raft_consensus.cc:740] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:17.970273 10936 consensus_queue.cc:260] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:17.971484 10936 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:17.974318 11085 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 12:23:17.977422 10932 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:23:17.991410 18845 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:17.994855 18845 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:17.993578 11085 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:17.987192 11011 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:23:17.998956 18846 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 12:23:18.004490 18779 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:18.012624 18690 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:23:17.882903 10834 rpcz_store.cc:269] 0709 12:22:46.428832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.432125 (+  3293us) service_pool.cc:224] Handling call
0709 12:22:46.583642 (+151517us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b5400096d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0eca090 00007f9bb0f68f3a 00007f9bb6d1ee9c 00007f9bb6e1d04e 00007f9bb52de2a4 00007f9bb52de232 00007f9bb52de161 00007f9bb52de0dc 00007f9bb52dd392 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:17.881866 (+31298224us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:16.508896 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:16.509462 (+   566us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:16.509495 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:23:16.509513 (+    18us) tablet.cc:662] Decoding operations
0709 12:23:16.510601 (+  1088us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:16.510659 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:16.510686 (+    27us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:23:16.511667 (+   981us) tablet.cc:701] Row locks acquired
0709 12:23:16.511681 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:23:16.511840 (+   159us) write_op.cc:270] Start()
0709 12:23:16.533766 (+ 21926us) write_op.cc:276] Timestamp: P: 1783599796511793 usec, L: 0
0709 12:23:16.533785 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:23:16.534464 (+   679us) log.cc:844] Serialized 4769 byte log entry
0709 12:23:16.546948 (+ 12484us) spinlock_profiling.cc:243] Waited 8.56 ms on lock 0x7b54000972a0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0eca090 00007f9bb0ed76b8 00007f9bb0ed72fa 00007f9bb0f5b965 00007f9bb0f5be09 00007f9bb4996581 00007f9bb4995d58 00007f9bb499a9f1 00007f9bb499a9a9 00007f9bb499a939 00007f9bb499a901
0709 12:23:16.880019 (+333071us) op_driver.cc:464] REPLICATION: finished
0709 12:23:17.024070 (+144051us) write_op.cc:301] APPLY: starting
0709 12:23:17.024173 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:17.120119 (+ 95946us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:17.120143 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:17.190445 (+ 70302us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:17.190720 (+   275us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=0,mrs_lookups=0
0709 12:23:17.190766 (+    46us) write_op.cc:312] APPLY: finished
0709 12:23:17.191073 (+   307us) log.cc:844] Serialized 113 byte log entry
0709 12:23:17.191254 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:17.191400 (+   146us) write_op.cc:454] Released schema lock
0709 12:23:17.191452 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:17.236487 (+ 45035us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:17.236526 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8526,"reported_tablets":54,"spinlock_wait_cycles":29858560,"child_traces":[["op",{"apply.queue_time_us":114529,"apply.run_cpu_time_us":16476,"apply.run_wall_time_us":224166,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54215,"num_ops":12,"prepare.queue_time_us":402988,"prepare.run_cpu_time_us":6462,"prepare.run_wall_time_us":38265,"replication_time_us":318919,"spinlock_wait_cycles":19693824,"thread_start_us":140929,"threads_started":2}]]}
I20260709 12:23:18.025627 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:18.026696 11083 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 19.
I20260709 12:23:18.032862 10929 raft_consensus.cc:1240] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:18.038192 11622 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:23:18.051254 11010 raft_consensus.cc:1275] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:23:18.051152 18846 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:18.052538 11008 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:23:18.051075 11011 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:23:18.060304 18790 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:18.062052 18790 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:18.062427 18790 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:18.046475 10830 catalog_manager.cc:5697] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.067790 10936 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 12:23:18.081434 10936 pending_rounds.cc:85] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 13
I20260709 12:23:18.094269 10931 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:23:18.078104 18544 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 12:23:18.067904 10830 catalog_manager.cc:5697] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 16 to 17, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 17 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:18.075219 18779 consensus_queue.cc:1048] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 12:23:18.076735 18775 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 12:23:18.104664 11011 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:23:18.105968 18775 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:18.098191 10830 catalog_manager.cc:5697] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 17 to 18, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 18 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:18.084851 10936 pending_rounds.cc:107] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 12:23:18.111454 10936 raft_consensus.cc:2889] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:18.114174 18741 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:23:18.121778 11006 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 12:23:18.124639 11005 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:18.137138 10932 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:23:18.144170 11083 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:23:18.149083 18846 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:23:18.149471 18769 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
W20260709 12:23:18.153066 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.168395 10830 catalog_manager.cc:5697] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:18.179831 10830 catalog_manager.cc:5697] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 16 to 21. New cstate: current_term: 21 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:18.214378 10830 catalog_manager.cc:5697] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.221827 10830 catalog_manager.cc:5697] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:18.142555 18790 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:18.232101 18761 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:23:18.243449 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:18.244493 10830 catalog_manager.cc:5697] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 7 to 21, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 21 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.188248 18690 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:23:18.228432 18544 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:23:18.247489 10830 catalog_manager.cc:5697] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:18.261117 10934 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:23:18.261545 10830 catalog_manager.cc:5697] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 17 to 20, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 20 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:18.263098 10830 catalog_manager.cc:5697] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 20 to 22, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 22 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:18.266156 10830 catalog_manager.cc:5697] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 18 to 22, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 22 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:18.257401 18790 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:18.270689 10830 catalog_manager.cc:5697] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 15 to 24, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 24 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:18.284057 18846 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:18.315156 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:18.329280 10830 catalog_manager.cc:5697] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 18 to 20, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 20 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:18.329914 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:18.338593 11076 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:23:18.357462 18859 log.cc:927] Time spent T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.220s	user 0.000s	sys 0.002s
I20260709 12:23:18.371661 10933 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:23:18.354425 10830 catalog_manager.cc:5697] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:18.386298 18544 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.014s
I20260709 12:23:18.410166 10830 catalog_manager.cc:5697] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 14 to 16, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 16 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
W20260709 12:23:18.425036 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 120769us
W20260709 12:23:18.453521 18856 log.cc:927] Time spent T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:23:18.473050 11076 raft_consensus.cc:2468] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 20.
I20260709 12:23:18.473430 11010 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
W20260709 12:23:18.479274 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 48967.7us
I20260709 12:23:18.490541 11006 raft_consensus.cc:1275] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 12:23:18.490978 11006 pending_rounds.cc:85] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 12
I20260709 12:23:18.503674 11006 pending_rounds.cc:107] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 12:23:18.503978 11006 raft_consensus.cc:2889] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:18.534133 18872 log.cc:927] Time spent T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:23:18.536335 11622 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:18.538280 18597 raft_consensus.cc:2804] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:18.538967 18597 raft_consensus.cc:697] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:23:18.539999 18597 consensus_queue.cc:237] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:18.581631 18567 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:18.582358 18567 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:18.568398 18544 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.016s
I20260709 12:23:18.588100 18567 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:23:18.627758 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 51200us
I20260709 12:23:18.629772 18761 consensus_queue.cc:1048] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
W20260709 12:23:18.645026 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 68902.8us
W20260709 12:23:18.653790 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 61160.6us
I20260709 12:23:18.668932 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:23:18.671947 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 45213.5us
W20260709 12:23:18.673391 18877 log.cc:927] Time spent T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 12:23:18.673771 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 65701.1us
I20260709 12:23:18.689057 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:18.700417 11083 raft_consensus.cc:2368] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20.
W20260709 12:23:18.738682 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 64934.5us
I20260709 12:23:18.871527 10899 leader_election.cc:400] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20.
I20260709 12:23:18.871838 10899 leader_election.cc:403] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:18.872612 18884 raft_consensus.cc:3060] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:23:18.891132 18884 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209) with higher term. Message: Invalid argument: T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20.
I20260709 12:23:18.951007 11076 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:23:18.952636 18845 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:18.986127 10934 raft_consensus.cc:1275] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:23:18.987655 18597 consensus_queue.cc:1048] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:19.012882 18797 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:19.013381 11006 consensus_queue.cc:237] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:19.013563 18797 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:19.023427 18797 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:19.026705 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:19.027604 11076 raft_consensus.cc:2393] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 26: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:19.033214 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:19.033952 10927 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 26.
W20260709 12:23:19.039029 10975 consensus_peers.cc:597] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83b4e206b7694af695234c0e758055e2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:19.039283 10977 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:19.039875 18779 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:19.040793 18754 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:23:19.041260 18754 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:19.041680 18754 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:19.040527 18779 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:19.049494 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:19.050158 11651 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:23:19.051029 18779 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:19.052596 11049 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:23:19.066649 11076 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:23:19.068503 18797 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:19.081071 18883 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:19.081542 18883 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:19.081878 18883 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:19.090718 18786 raft_consensus.cc:2955] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Committing config change with OpId 25.14: config changed from index -1 to 14, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:19.096351 11076 raft_consensus.cc:2955] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Committing config change with OpId 25.14: config changed from index -1 to 14, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:19.107800 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:19.111931 10927 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:23:19.117727 11006 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 19: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:19.164822 18883 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:19.171423 10831 catalog_manager.cc:5697] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 20 to 21, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 21 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:19.188752 18883 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:19.189342 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:19.189790 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:19.190081 11006 raft_consensus.cc:2393] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 19: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:19.198371 11651 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:23:19.199764 11049 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:19.206951 18754 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:19.205415 18779 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:23:19.208559 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 80038.4us
I20260709 12:23:19.210148 10831 catalog_manager.cc:5697] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 18 to 19, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 19 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:19.211385 17883 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:19.219198 10831 catalog_manager.cc:5697] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 12 to 18, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 18 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:19.211354 18779 raft_consensus.cc:697] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:19.224465 10831 catalog_manager.cc:5697] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 15 to 16, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 16 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:19.241475 10830 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35608 (request call id 266) took 14753 ms (client timeout 15000 ms). Trace:
I20260709 12:23:19.247424 10919 tablet_service.cc:1558] Processing DeleteTablet for tablet c1b75831227444d382e9c0fc5b367564 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 10)) from {username='slave'} at 127.0.0.1:46716
I20260709 12:23:19.253737 18779 consensus_queue.cc:237] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:19.241894 10830 rpcz_store.cc:269] 0709 12:23:04.584407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.588011 (+  3604us) service_pool.cc:224] Handling call
0709 12:23:19.241383 (+14653372us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:18.679509 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:18.680256 (+   747us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:18.680300 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:23:18.680318 (+    18us) tablet.cc:662] Decoding operations
0709 12:23:18.682069 (+  1751us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:18.682171 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:18.682197 (+    26us) tablet.cc:685] Acquiring locks for 24 operations
0709 12:23:18.723673 (+ 41476us) tablet.cc:701] Row locks acquired
0709 12:23:18.723726 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:23:18.723927 (+   201us) write_op.cc:270] Start()
0709 12:23:18.724094 (+   167us) write_op.cc:276] Timestamp: P: 1783599798723826 usec, L: 0
0709 12:23:18.724133 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 12:23:18.724924 (+   791us) log.cc:844] Serialized 9390 byte log entry
0709 12:23:18.900600 (+175676us) op_driver.cc:464] REPLICATION: finished
0709 12:23:18.930072 (+ 29472us) write_op.cc:301] APPLY: starting
0709 12:23:18.930169 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:19.029619 (+ 99450us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:19.029765 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:19.144026 (+114261us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:19.144444 (+   418us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=0,mrs_lookups=0
0709 12:23:19.144504 (+    60us) write_op.cc:312] APPLY: finished
0709 12:23:19.145125 (+   621us) log.cc:844] Serialized 212 byte log entry
0709 12:23:19.145323 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:19.145538 (+   215us) write_op.cc:454] Released schema lock
0709 12:23:19.145622 (+    84us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:19.146139 (+   517us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:19.146170 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":135183,"reported_tablets":54,"spinlock_wait_cycles":280960,"child_traces":[["op",{"apply.queue_time_us":29207,"apply.run_cpu_time_us":32968,"apply.run_wall_time_us":216060,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104303,"num_ops":24,"prepare.queue_time_us":93761,"prepare.run_cpu_time_us":43639,"prepare.run_wall_time_us":137988,"raft.queue_time_us":28719,"raft.run_cpu_time_us":3344,"raft.run_wall_time_us":29459,"replication_time_us":176288,"spinlock_wait_cycles":8491392,"thread_start_us":181425,"threads_started":4,"wal-append.queue_time_us":144585}]]}
I20260709 12:23:19.258786 18754 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:19.265090 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:19.265909 11084 raft_consensus.cc:2393] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 26: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:23:19.284734 10882 auto_rebalancer.cc:629] Failed to schedule move for tablet d88dec874a3240d69746dfb302cf057e: Illegal state: Replica 1abf4b385a2b493ab83f593a1f8c9cd1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 25 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:19.289338 10831 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 121) took 1751 ms. Trace:
W20260709 12:23:19.301261 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 64651.8us
I20260709 12:23:19.289783 10831 rpcz_store.cc:276] 0709 12:23:17.537970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:17.538121 (+   151us) service_pool.cc:224] Handling call
0709 12:23:17.727683 (+189562us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b5400096d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0eca090 00007f9bb0f68f3a 00007f9bb6d1ee9c 00007f9bb6e1d04e 00007f9bb52de2a4 00007f9bb52de232 00007f9bb52de161 00007f9bb52de0dc 00007f9bb52dd392 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:17.778596 (+ 50913us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x7b5400002490. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3c640 00007f9bb6d13846 00007f9bb6e1d90e 00007f9bb52de2a4 00007f9bb52de232 00007f9bb52de161 00007f9bb52de0dc 00007f9bb52dd392 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:19.289236 (+1510640us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:19.238455 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:19.240029 (+  1574us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:19.240069 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:23:19.240088 (+    19us) tablet.cc:662] Decoding operations
0709 12:23:19.240930 (+   842us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:19.241011 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:19.241045 (+    34us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:23:19.241482 (+   437us) tablet.cc:701] Row locks acquired
0709 12:23:19.241501 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:23:19.241675 (+   174us) write_op.cc:270] Start()
0709 12:23:19.241796 (+   121us) write_op.cc:276] Timestamp: P: 1783599799241621 usec, L: 0
0709 12:23:19.241817 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:23:19.242571 (+   754us) log.cc:844] Serialized 1736 byte log entry
0709 12:23:19.252118 (+  9547us) op_driver.cc:464] REPLICATION: finished
0709 12:23:19.252608 (+   490us) write_op.cc:301] APPLY: starting
0709 12:23:19.252689 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:19.255028 (+  2339us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:19.255150 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:19.283894 (+ 28744us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:19.284073 (+   179us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:23:19.284118 (+    45us) write_op.cc:312] APPLY: finished
0709 12:23:19.285277 (+  1159us) log.cc:844] Serialized 49 byte log entry
0709 12:23:19.286124 (+   847us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:19.286230 (+   106us) write_op.cc:454] Released schema lock
0709 12:23:19.286274 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:19.286681 (+   407us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:19.286709 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":45881,"reported_tablets":4,"spinlock_wait_cycles":509935872,"child_traces":[["op",{"apply.queue_time_us":249,"apply.run_cpu_time_us":6768,"apply.run_wall_time_us":34019,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16696,"num_ops":4,"prepare.queue_time_us":213,"prepare.run_cpu_time_us":3635,"prepare.run_wall_time_us":11365,"replication_time_us":8843}]]}
I20260709 12:23:19.307300 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:19.335022 11006 consensus_queue.cc:237] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:19.339895 10821 catalog_manager.cc:5028] TS 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): tablet c1b75831227444d382e9c0fc5b367564 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:23:19.340416 10930 raft_consensus.cc:2955] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Committing config change with OpId 25.14: config changed from index -1 to 14, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:19.348546 10828 catalog_manager.cc:5697] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 21 to 22, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 22 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:19.353586 10934 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 26.
I20260709 12:23:19.358836 10977 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:19.369381 18902 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:23:19.378170 18902 raft_consensus.cc:697] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:19.380661 18902 consensus_queue.cc:237] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:19.382256 10975 consensus_peers.cc:597] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4d1425ae0d743b7be813705b92d4e15. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:19.394841 11083 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:23:19.397756 18901 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:19.411700 10930 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:23:19.412254 10828 catalog_manager.cc:5697] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 17 to 18, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 18 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:19.421839 18567 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:19.421326 18906 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:23:19.424368 18567 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:19.414389 10828 catalog_manager.cc:5697] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 19 to 23, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 23 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:19.443555 18567 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:19.444779 10828 catalog_manager.cc:5697] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:19.445791 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:19.446565 11081 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:23:19.447412 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:19.448056 11009 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:23:19.450661 10901 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:19.451943 18884 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:19.452333 18884 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:19.452688 18884 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:19.449424 10828 catalog_manager.cc:5697] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 17 to 18, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 18 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:19.486304 18910 ts_tablet_manager.cc:933] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:19.486742 18884 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:19.463537 10828 catalog_manager.cc:5697] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:19.490053 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:19.490600 11009 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:19.489739 18797 raft_consensus.cc:2955] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:19.498106 10930 raft_consensus.cc:2955] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:19.500370  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:19.500622 11009 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:19.505772 10901 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:19.507787 18460 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:19.508376 18460 raft_consensus.cc:697] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:19.509248 18460 consensus_queue.cc:237] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:19.520943 11082 raft_consensus.cc:2955] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:19.534910 18910 tablet_copy_client.cc:323] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.66:41383
I20260709 12:23:19.556214 11021 tablet_copy_service.cc:140] P 2201bad9e18849b09cf82de29dd032d3: Received BeginTabletCopySession request for tablet 83b4e206b7694af695234c0e758055e2 from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:41098)
I20260709 12:23:19.556859 11021 tablet_copy_service.cc:161] P 2201bad9e18849b09cf82de29dd032d3: Beginning new tablet copy session on tablet 83b4e206b7694af695234c0e758055e2 from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:41098: session id = 0b171b6aaedc4f809f2753dcfadb14ce-83b4e206b7694af695234c0e758055e2
I20260709 12:23:19.563959 18884 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:19.567241 10882 auto_rebalancer.cc:629] Failed to schedule move for tablet 84ba0a33a7f74af5b5fd862bbb01e3cb: Illegal state: Replica 2201bad9e18849b09cf82de29dd032d3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:19.596113 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:19.596764 11082 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:19.611183 10831 catalog_manager.cc:5697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 23 to 24, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 24 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:19.614128 10831 catalog_manager.cc:5697] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 17 to 20, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 20 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:19.602471 11021 tablet_copy_source_session.cc:215] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:19.619835 11082 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:19.624239 18910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83b4e206b7694af695234c0e758055e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:19.616101 11006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07467552f78d410bb9e5774f3340f134"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:19.644335 11006 raft_consensus.cc:606] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:19.644802 11006 raft_consensus.cc:614] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:19.651901 11006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:19.652634 11006 raft_consensus.cc:606] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:19.681159 11006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:19.681782 11006 raft_consensus.cc:606] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:19.694099 11651 consensus_queue.cc:237] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:19.757754 18848 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:19.758994 18848 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:19.761266 18848 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:19.762195 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:19.784343 10934 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:23:19.784960 10934 raft_consensus.cc:606] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:19.787628 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:19.788566 11656 raft_consensus.cc:2410] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 12:23:19.811265 11656 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:23:19.810806 11006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d263972b0e844fa281354fac07ccef80"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:19.809273 10975 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:19.812707 11006 raft_consensus.cc:606] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:19.827332 18887 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 12:23:19.836318 11006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3625831778d468cb424c06fc474c323"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:19.836982 11006 raft_consensus.cc:606] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 24 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:19.839372  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:23:19.830013 18708 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:19.853899 11006 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:23:19.860356 18887 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:19.861035  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:19.861841 10833 catalog_manager.cc:5697] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 21 to 24. New cstate: current_term: 24 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:19.884922 11004 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:23:19.886521 18918 ts_tablet_manager.cc:933] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:19.883850 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 102661us
I20260709 12:23:19.890296  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:19.909106 18708 raft_consensus.cc:993] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:19.909467 18910 tablet_copy_client.cc:806] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:19.909653 18708 raft_consensus.cc:1081] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:19.910593 18910 tablet_copy_client.cc:670] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:19.911147 10930 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:23:19.915553 18473 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:23:19.915558 11076 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:23:19.916510 11076 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:19.916884 11076 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:19.928622 11076 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:19.934163 10833 catalog_manager.cc:5697] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 16 to 19, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 19 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:19.939558 10934 raft_consensus.cc:1275] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 12:23:19.931581 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 51246.2us
I20260709 12:23:19.941378 10833 catalog_manager.cc:5697] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 20 to 23, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 23 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:19.941957 18597 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:19.943107 18473 raft_consensus.cc:993] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:19.943593 18473 raft_consensus.cc:1081] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:19.945248 11082 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:23:19.952926 11082 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:19.954039 11082 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:23:19.955227 11009 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:23:19.956517 18910 tablet_copy_client.cc:538] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:19.966822 18790 consensus_queue.cc:1048] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:19.971385 18886 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:23:19.998073 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:20.009209 10929 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:20.008998 11076 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:20.012485 10833 catalog_manager.cc:5697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 15 to 19, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 19 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:20.012948 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:20.017576 11008 raft_consensus.cc:3055] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:23:20.017926 11008 raft_consensus.cc:740] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:20.047976 11083 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:23:20.036505 11008 consensus_queue.cc:260] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:20.038945 18918 tablet_copy_client.cc:323] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.66:41383
I20260709 12:23:20.058909 18926 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:20.067909 11021 tablet_copy_service.cc:140] P 2201bad9e18849b09cf82de29dd032d3: Received BeginTabletCopySession request for tablet e4d1425ae0d743b7be813705b92d4e15 from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:41098)
I20260709 12:23:20.068619 11021 tablet_copy_service.cc:161] P 2201bad9e18849b09cf82de29dd032d3: Beginning new tablet copy session on tablet e4d1425ae0d743b7be813705b92d4e15 from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:41098: session id = 0b171b6aaedc4f809f2753dcfadb14ce-e4d1425ae0d743b7be813705b92d4e15
W20260709 12:23:20.073998 10828 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35620 (request call id 250) took 12019 ms (client timeout 15000 ms). Trace:
I20260709 12:23:20.082232 11081 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:23:20.089390 11082 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:20.101512 11008 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:20.125698 11021 tablet_copy_source_session.cc:215] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:20.134783 11008 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:20.139845 18918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4d1425ae0d743b7be813705b92d4e15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:20.143275 10929 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:20.145385 11082 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:23:20.110746 18917 log.cc:927] Time spent T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:23:20.173527 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 136767us
W20260709 12:23:20.176142 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 59252us
I20260709 12:23:20.181712 11050 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:20.140828 18902 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 12:23:20.194386 18779 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:23:20.196530 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 43923.5us
I20260709 12:23:20.198948 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: true dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:20.208456 11659 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:23:20.074504 10828 rpcz_store.cc:269] 0709 12:23:08.054958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:08.055315 (+   357us) service_pool.cc:224] Handling call
0709 12:23:20.073924 (+12018609us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:19.536097 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:19.536593 (+   496us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:19.536628 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:23:19.536645 (+    17us) tablet.cc:662] Decoding operations
0709 12:23:19.537347 (+   702us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:19.537405 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:19.537430 (+    25us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:23:19.537911 (+   481us) tablet.cc:701] Row locks acquired
0709 12:23:19.537930 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:23:19.538075 (+   145us) write_op.cc:270] Start()
0709 12:23:19.538205 (+   130us) write_op.cc:276] Timestamp: P: 1783599799538036 usec, L: 0
0709 12:23:19.538227 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:23:19.538825 (+   598us) log.cc:844] Serialized 2464 byte log entry
0709 12:23:19.541044 (+  2219us) op_driver.cc:464] REPLICATION: finished
0709 12:23:19.541467 (+   423us) write_op.cc:301] APPLY: starting
0709 12:23:19.541551 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:19.546036 (+  4485us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:19.546132 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:19.552909 (+  6777us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:19.553094 (+   185us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 12:23:19.553135 (+    41us) write_op.cc:312] APPLY: finished
0709 12:23:19.553372 (+   237us) log.cc:844] Serialized 65 byte log entry
0709 12:23:19.553544 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:19.553650 (+   106us) write_op.cc:454] Released schema lock
0709 12:23:19.553692 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:19.554069 (+   377us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:19.554103 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2070,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":229,"apply.run_cpu_time_us":8483,"apply.run_wall_time_us":12550,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25044,"num_ops":6,"prepare.queue_time_us":6226,"prepare.run_cpu_time_us":3018,"prepare.run_wall_time_us":3018,"replication_time_us":2661}]]}
W20260709 12:23:20.243153 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 94139us
I20260709 12:23:20.241344 18910 tablet_bootstrap.cc:492] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:23:20.259939 18790 raft_consensus.cc:2955] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 LEADER]: Committing config change with OpId 16.14: config changed from index 12 to 14, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:20.278772 11659 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 27.
I20260709 12:23:20.279487 11651 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 26. Current term is 27. Ops: []
W20260709 12:23:20.293808 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 142156us
I20260709 12:23:20.309815 11049 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:23:20.310842 18943 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:23:20.311344 18943 raft_consensus.cc:697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:20.312147 18943 consensus_queue.cc:237] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 26.20, Last appended by leader: 20, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:20.318641 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:20.319186 11009 raft_consensus.cc:3055] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:23:20.319478 11009 raft_consensus.cc:740] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:20.320147 11009 consensus_queue.cc:260] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 26.20, Last appended by leader: 20, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:20.321005 11009 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:23:20.277870 18779 raft_consensus.cc:697] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:23:20.391556 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 65236.9us
I20260709 12:23:20.421129 18926 raft_consensus.cc:993] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:20.421686 18926 raft_consensus.cc:1081] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:20.427707 18779 consensus_queue.cc:237] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:20.464128 10819 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 80db8b3fbfd046e8a5535ff4a7380107 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:20.480379 11009 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 27.
W20260709 12:23:20.488104 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 50698us
I20260709 12:23:20.490124 10934 raft_consensus.cc:2955] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 12 to 14, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:20.499508 11008 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37586
I20260709 12:23:20.500155 11008 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:20.500505 11008 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:20.491504 11004 raft_consensus.cc:2955] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 12 to 14, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:20.508940 11008 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:20.556061 11008 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:20.560849 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 146851us
I20260709 12:23:20.565032 10831 catalog_manager.cc:5697] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 18 to 19, leader changed from 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 19 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:20.584772 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:20.585480 11083 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:23:20.601586 18949 log.cc:927] Time spent T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
W20260709 12:23:20.626919 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 65073.2us
I20260709 12:23:20.636842 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:20.637468 10930 raft_consensus.cc:3055] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:23:20.637768 10930 raft_consensus.cc:740] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:20.638530 10930 consensus_queue.cc:260] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:20.639667 10930 raft_consensus.cc:3060] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:20.654652 10930 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 24.
I20260709 12:23:20.661489 11083 raft_consensus.cc:2468] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 24.
I20260709 12:23:20.682771 18918 tablet_copy_client.cc:806] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:20.683382 18918 tablet_copy_client.cc:670] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
W20260709 12:23:20.693086 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 119897us
I20260709 12:23:20.701819 10977 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:20.702771 18902 raft_consensus.cc:2804] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:23:20.703272 18902 raft_consensus.cc:697] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 24 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:20.704214 18902 consensus_queue.cc:237] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:20.716863 11082 raft_consensus.cc:1240] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 23. Current term is 24. Ops: []
I20260709 12:23:20.717573 11651 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 26 index: 20. Preceding OpId from leader: term: 27 index: 21. (index mismatch)
I20260709 12:23:20.718235 18918 tablet_copy_client.cc:538] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:20.728698 18945 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.016s
I20260709 12:23:20.749030 18901 raft_consensus.cc:993] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:20.749563 18901 raft_consensus.cc:1081] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 24 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:20.768769 18786 raft_consensus.cc:993] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:20.781457 18786 raft_consensus.cc:1081] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:20.782112 10830 catalog_manager.cc:5697] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 23 to 27, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 27 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:20.785364 18918 tablet_bootstrap.cc:492] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:23:20.789084 10830 catalog_manager.cc:5697] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 19 to 22, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 22 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:20.793061 11083 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3625831778d468cb424c06fc474c323"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:23:20.797611 11083 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:20.798015 11083 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:20.794380 11082 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d263972b0e844fa281354fac07ccef80"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:23:20.801049 11082 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:20.801447 11082 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:20.804437 10830 catalog_manager.cc:5697] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 19 to 22, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 22 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:20.805804 10830 catalog_manager.cc:5697] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 20 to 24, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 24 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:20.807025 10830 catalog_manager.cc:5697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 20 to 25, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 25 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
W20260709 12:23:20.808259 10833 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35614 (request call id 249) took 15053 ms (client timeout 15000 ms). Trace:
I20260709 12:23:20.808796 10830 catalog_manager.cc:5697] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:20.810262 10830 catalog_manager.cc:5697] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 18 to 21, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 21 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:20.808678 10833 rpcz_store.cc:269] 0709 12:23:05.754738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.755341 (+   603us) service_pool.cc:224] Handling call
0709 12:23:05.948758 (+193417us) spinlock_profiling.cc:243] Waited 39.2 ms on lock 0x7b5400002490. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3c0b2 00007f9bb6db5759 00007f9bb6d4da76 00007f9bb6d1ed58 00007f9bb6e1d04e 00007f9bb52de2a4 00007f9bb52de232 00007f9bb52de161 00007f9bb52de0dc
0709 12:23:20.808183 (+14859425us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:20.072764 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:20.073276 (+   512us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:20.073308 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:23:20.073321 (+    13us) tablet.cc:662] Decoding operations
0709 12:23:20.073924 (+   603us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:20.073974 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:20.074004 (+    30us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:23:20.074394 (+   390us) tablet.cc:701] Row locks acquired
0709 12:23:20.074407 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:23:20.074560 (+   153us) write_op.cc:270] Start()
0709 12:23:20.074672 (+   112us) write_op.cc:276] Timestamp: P: 1783599800074512 usec, L: 0
0709 12:23:20.074689 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:23:20.075357 (+   668us) log.cc:844] Serialized 1694 byte log entry
0709 12:23:20.210829 (+135472us) op_driver.cc:464] REPLICATION: finished
0709 12:23:20.397516 (+186687us) write_op.cc:301] APPLY: starting
0709 12:23:20.398189 (+   673us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:20.509899 (+111710us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:20.510007 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:20.533719 (+ 23712us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:20.533951 (+   232us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:23:20.534001 (+    50us) write_op.cc:312] APPLY: finished
0709 12:23:20.534237 (+   236us) log.cc:844] Serialized 49 byte log entry
0709 12:23:20.535059 (+   822us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:20.535167 (+   108us) write_op.cc:454] Released schema lock
0709 12:23:20.535207 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:20.535611 (+   404us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:20.535639 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":151123,"reported_tablets":52,"spinlock_wait_cycles":90099840,"child_traces":[["op",{"apply.queue_time_us":128457,"apply.run_cpu_time_us":7764,"apply.run_wall_time_us":138081,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20823,"num_ops":4,"prepare.queue_time_us":136,"prepare.run_cpu_time_us":2967,"prepare.run_wall_time_us":41214,"replication_time_us":135962,"thread_start_us":59279,"threads_started":1}]]}
I20260709 12:23:20.841117 10830 catalog_manager.cc:5697] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 14 to 22. New cstate: current_term: 22 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:20.846421 10830 catalog_manager.cc:5697] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 24 to 28. New cstate: current_term: 28 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:20.847844 10830 catalog_manager.cc:5697] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:20.863770 11008 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 26 index: 20. Preceding OpId from leader: term: 27 index: 21. (index mismatch)
I20260709 12:23:20.853055 10830 catalog_manager.cc:5697] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 22 to 24, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 24 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:20.873974 10830 catalog_manager.cc:5697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 17 to 18, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 18 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:20.881664 10830 catalog_manager.cc:5697] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 15 to 16, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 16 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:20.889384 10830 catalog_manager.cc:5697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 16 to 21, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 21 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:20.897186 10830 catalog_manager.cc:5697] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 18 to 21, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 21 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:20.904636 10830 catalog_manager.cc:5697] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 23 to 24, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 24 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:20.912176 10830 catalog_manager.cc:5697] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 23 to 25, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 25 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:20.915210 10830 catalog_manager.cc:5697] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 17 to 21, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 21 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:20.920732 10830 catalog_manager.cc:5697] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:20.916632 11082 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:20.942448 11076 raft_consensus.cc:1240] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 21. Current term is 22. Ops: []
I20260709 12:23:20.950733 11082 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:20.951076 11083 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:20.951516 10830 catalog_manager.cc:5697] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 20 to 25, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 25 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:20.953387 10830 catalog_manager.cc:5697] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 18 to 24, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 24 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:20.960021 18945 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:20.976847 18945 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:20.979781 18945 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:23:20.972117 18910 log.cc:927] Time spent T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.086s	user 0.002s	sys 0.000s
I20260709 12:23:20.977301 10830 catalog_manager.cc:5697] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:20.982260 10830 catalog_manager.cc:5697] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 18 to 20, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 20 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:20.984253 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: true dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:20.980178 18956 consensus_queue.cc:1059] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
I20260709 12:23:20.989442 11656 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:20.990077 18754 raft_consensus.cc:3055] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:23:20.990729 18754 raft_consensus.cc:740] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:20.991634 18754 consensus_queue.cc:260] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:20.992910 18754 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:20.989346 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:21.000232 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:20.997556 18945 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.011s
I20260709 12:23:21.008002 10934 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:20.997639 11656 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:21.015273 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:21.015473 11049 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:23:21.006994 10830 catalog_manager.cc:5697] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 20 to 22, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 22 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:21.016274 18945 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:21.017400 18945 raft_consensus.cc:697] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:21.018421 18945 consensus_queue.cc:237] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:21.020922 10934 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 25.
I20260709 12:23:21.021031 10830 catalog_manager.cc:5697] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 18 to 25, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 25 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:20.990181 11083 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:21.024456 10830 catalog_manager.cc:5697] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 18 to 19, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 19 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.038170 10830 catalog_manager.cc:5697] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.042618 10830 catalog_manager.cc:5697] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 20 to 22, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 22 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.044528 10830 catalog_manager.cc:5697] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: config changed from index -1 to 14, term changed from 23 to 25, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 25 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:21.046113 10830 catalog_manager.cc:5697] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 14 to 19. New cstate: current_term: 19 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:21.047358 10830 catalog_manager.cc:5697] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:21.048698 10830 catalog_manager.cc:5697] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 22 to 25, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 25 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.057265 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:21.071677 11006 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:21.058247 10830 catalog_manager.cc:5697] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 20 to 22, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 22 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.076797 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:21.063499 11051 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:21.079121 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:21.079687 11008 raft_consensus.cc:3055] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:23:21.079960 11008 raft_consensus.cc:740] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:21.080647 18955 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:21.080860 11003 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:23:21.080788 11008 consensus_queue.cc:260] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:21.082028 10930 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:23:21.080140 11051 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:21.084234 11008 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:21.081943 10830 catalog_manager.cc:5697] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 13 to 16, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 16 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.093703 10830 catalog_manager.cc:5697] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 24 to 27, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 27 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.091586 11008 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 25.
I20260709 12:23:21.096338 11082 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 24. Current term is 25. Ops: []
I20260709 12:23:21.102804 10830 catalog_manager.cc:5697] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:21.111400  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:21.117202 18868 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:21.105410 18779 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:23:21.118003 18955 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:23:21.128970 18779 raft_consensus.cc:697] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:21.129935 18779 consensus_queue.cc:237] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:21.162184 18910 log.cc:927] Time spent T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:23:21.259680 11008 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07467552f78d410bb9e5774f3340f134"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:21.260332 11008 raft_consensus.cc:606] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:21.260684 11008 raft_consensus.cc:614] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:21.280577 11006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:21.281315 11006 raft_consensus.cc:606] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:21.289029 11084 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 12:23:21.297329 18950 log.cc:927] Time spent T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:23:21.303911 11006 raft_consensus.cc:614] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:21.323272 18910 tablet_bootstrap.cc:492] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=1 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:21.337473 11006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:21.341485 10935 raft_consensus.cc:1275] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:23:21.343542 11006 raft_consensus.cc:606] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:21.344141 11006 raft_consensus.cc:614] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:21.322887 18786 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:23:21.375124 18910 tablet_bootstrap.cc:492] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:23:21.376199 18910 ts_tablet_manager.cc:1403] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 1.136s	user 0.070s	sys 0.014s
I20260709 12:23:21.415114 18910 raft_consensus.cc:359] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:21.416208 18910 raft_consensus.cc:740] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:23:21.429531 11656 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:23:21.431577 18868 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:23:21.416950 18910 consensus_queue.cc:260] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:21.443753 18910 ts_tablet_manager.cc:1434] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.001s
I20260709 12:23:21.520128 11004 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:23:21.523191 11656 raft_consensus.cc:1217] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 LEARNER]: Deduplicated request from leader. Original: 25.13->[25.14-25.14]   Dedup: 25.14->[]
I20260709 12:23:21.526894 18943 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:21.529641 18786 consensus_queue.cc:1048] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:21.541152 11006 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:23:21.545395 18868 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:21.583966 11021 tablet_copy_service.cc:342] P 2201bad9e18849b09cf82de29dd032d3: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-83b4e206b7694af695234c0e758055e2 received from {username='slave'} at 127.0.0.1:41098
I20260709 12:23:21.584506 11021 tablet_copy_service.cc:434] P 2201bad9e18849b09cf82de29dd032d3: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-83b4e206b7694af695234c0e758055e2 on tablet 83b4e206b7694af695234c0e758055e2 with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:23:21.592877 10934 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:23:21.599586 11008 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:21.600260 11008 raft_consensus.cc:606] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:21.618925 18934 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
W20260709 12:23:21.672320 18980 log.cc:927] Time spent T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:23:21.673687 18918 tablet_bootstrap.cc:492] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:21.674664 18918 tablet_bootstrap.cc:492] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:23:21.675408 18918 ts_tablet_manager.cc:1403] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 0.890s	user 0.042s	sys 0.021s
I20260709 12:23:21.676862 11006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d263972b0e844fa281354fac07ccef80"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:21.686602 18918 raft_consensus.cc:359] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:21.695453 11006 raft_consensus.cc:606] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:21.695946 11006 raft_consensus.cc:614] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:21.687768 18918 raft_consensus.cc:740] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
W20260709 12:23:21.764106 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 59819.5us
I20260709 12:23:21.766052  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:21.767907  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:21.768733  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:21.776681 18918 consensus_queue.cc:260] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:21.779395 18918 ts_tablet_manager.cc:1434] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.104s	user 0.006s	sys 0.000s
I20260709 12:23:21.817845 11021 tablet_copy_service.cc:342] P 2201bad9e18849b09cf82de29dd032d3: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-e4d1425ae0d743b7be813705b92d4e15 received from {username='slave'} at 127.0.0.1:41098
I20260709 12:23:21.818327 11021 tablet_copy_service.cc:434] P 2201bad9e18849b09cf82de29dd032d3: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-e4d1425ae0d743b7be813705b92d4e15 on tablet e4d1425ae0d743b7be813705b92d4e15 with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:23:21.846487 18956 raft_consensus.cc:993] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:21.847012 18956 raft_consensus.cc:1081] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:21.848794 11076 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:23:21.849367 11076 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:21.849754 11076 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:21.857324 11076 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:21.865226 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:21.865864 10934 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:21.891489 10934 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:23:21.893662 11051 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:21.894630 18942 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:21.895169 18942 raft_consensus.cc:697] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:21.896044 18942 consensus_queue.cc:237] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:21.901324 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:21.901925 11004 raft_consensus.cc:3055] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:21.902073 18984 raft_consensus.cc:1064] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:23:21.902215 11004 raft_consensus.cc:740] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:21.903137 11004 consensus_queue.cc:260] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:21.904238 11004 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:21.906265 18984 consensus_queue.cc:237] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 12, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:21.911499 11004 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:23:21.918609 11076 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:21.927961 10831 catalog_manager.cc:5697] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 12 to 14, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New cstate: current_term: 16 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.973373 11076 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:23:21.976168 11651 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 LEARNER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:23:21.980746 18984 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:21.982539 10929 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:23:21.990636 18473 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:23:21.996316 18989 log.cc:927] Time spent T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:23:22.012727 10830 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35608 (request call id 267) took 2550 ms. Trace:
I20260709 12:23:22.026644 18848 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:22.013195 10830 rpcz_store.cc:276] 0709 12:23:19.462599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:19.462768 (+   169us) service_pool.cc:224] Handling call
0709 12:23:22.012632 (+2549864us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:21.180082 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:21.238640 (+ 58558us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:21.241072 (+  2432us) write_op.cc:435] Acquired schema lock
0709 12:23:21.242393 (+  1321us) tablet.cc:662] Decoding operations
0709 12:23:21.290708 (+ 48315us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:21.290766 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:21.290796 (+    30us) tablet.cc:685] Acquiring locks for 36 operations
0709 12:23:21.406737 (+115941us) tablet.cc:701] Row locks acquired
0709 12:23:21.406763 (+    26us) write_op.cc:260] PREPARE: finished
0709 12:23:21.406971 (+   208us) write_op.cc:270] Start()
0709 12:23:21.407142 (+   171us) write_op.cc:276] Timestamp: P: 1783599801406904 usec, L: 0
0709 12:23:21.407167 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:23:21.423894 (+ 16727us) log.cc:844] Serialized 14067 byte log entry
0709 12:23:21.542053 (+118159us) op_driver.cc:464] REPLICATION: finished
0709 12:23:21.613525 (+ 71472us) write_op.cc:301] APPLY: starting
0709 12:23:21.613635 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:21.815221 (+201586us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:21.815361 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:21.916494 (+101133us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:21.916948 (+   454us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=72,key_file_lookups=72,delta_file_lookups=0,mrs_lookups=0
0709 12:23:21.916997 (+    49us) write_op.cc:312] APPLY: finished
0709 12:23:21.917605 (+   608us) log.cc:844] Serialized 308 byte log entry
0709 12:23:21.919673 (+  2068us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:21.919970 (+   297us) write_op.cc:454] Released schema lock
0709 12:23:21.920050 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:21.920474 (+   424us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:21.920506 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":71198,"apply.run_cpu_time_us":45521,"apply.run_wall_time_us":306917,"cfile_cache_hit":146,"cfile_cache_hit_bytes":154391,"num_ops":36,"prepare.queue_time_us":2874,"prepare.run_cpu_time_us":9758,"prepare.run_wall_time_us":248920,"replication_time_us":134727,"thread_start_us":37428,"threads_started":1}]]}
I20260709 12:23:22.075695 10831 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 124) took 1331 ms. Trace:
I20260709 12:23:22.076663 11067 tablet_service.cc:1558] Processing DeleteTablet for tablet 80db8b3fbfd046e8a5535ff4a7380107 with delete_type TABLET_DATA_TOMBSTONED (TS 1abf4b385a2b493ab83f593a1f8c9cd1 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:39448
I20260709 12:23:22.076120 10831 rpcz_store.cc:276] 0709 12:23:20.743819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:20.750513 (+  6694us) service_pool.cc:224] Handling call
0709 12:23:20.773793 (+ 23280us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b5400002490. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3c640 00007f9bb6d13846 00007f9bb6e1d90e 00007f9bb52de2a4 00007f9bb52de232 00007f9bb52de161 00007f9bb52de0dc 00007f9bb52dd392 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:22.052244 (+1278451us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:22.052274 (+    30us) write_op.cc:454] Released schema lock
0709 12:23:22.075625 (+ 23351us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:22.030167 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:22.030709 (+   542us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:22.030751 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:23:22.030770 (+    19us) tablet.cc:662] Decoding operations
0709 12:23:22.031126 (+   356us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:22.031197 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:22.031222 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:23:22.031403 (+   181us) tablet.cc:701] Row locks acquired
0709 12:23:22.031421 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:23:22.031577 (+   156us) write_op.cc:270] Start()
0709 12:23:22.031686 (+   109us) write_op.cc:276] Timestamp: P: 1783599802031531 usec, L: 0
0709 12:23:22.031707 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:23:22.032393 (+   686us) log.cc:844] Serialized 533 byte log entry
0709 12:23:22.034165 (+  1772us) op_driver.cc:464] REPLICATION: finished
0709 12:23:22.034600 (+   435us) write_op.cc:301] APPLY: starting
0709 12:23:22.034683 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:22.035517 (+   834us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:22.035612 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:22.036367 (+   755us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:22.036525 (+   158us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:23:22.036569 (+    44us) write_op.cc:312] APPLY: finished
0709 12:23:22.036753 (+   184us) log.cc:844] Serialized 25 byte log entry
0709 12:23:22.036916 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:22.037011 (+    95us) write_op.cc:454] Released schema lock
0709 12:23:22.037051 (+    40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":364,"reported_tablets":2,"spinlock_wait_cycles":10672000,"child_traces":[["op",{"apply.queue_time_us":246,"apply.run_cpu_time_us":2742,"apply.run_wall_time_us":2745,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4174,"num_ops":1,"prepare.queue_time_us":88188,"prepare.run_cpu_time_us":2561,"prepare.run_wall_time_us":2561,"replication_time_us":2311,"spinlock_wait_cycles":2304,"thread_start_us":110260,"threads_started":1}]]}
I20260709 12:23:22.128297 11651 raft_consensus.cc:1217] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 LEARNER]: Deduplicated request from leader. Original: 19.11->[19.12-19.12]   Dedup: 19.12->[]
I20260709 12:23:22.120671 10828 catalog_manager.cc:5697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 26 to 27, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 27 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:22.142321 10828 catalog_manager.cc:5697] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 23 to 24, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 24 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:22.146072 10828 catalog_manager.cc:5697] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 18 to 22, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 22 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:22.101682 18984 raft_consensus.cc:2955] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Committing config change with OpId 25.15: config changed from index 14 to 15, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:22.173731 10934 raft_consensus.cc:2955] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Committing config change with OpId 25.15: config changed from index 14 to 15, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:22.148764 10828 catalog_manager.cc:5697] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: config changed from index -1 to 12, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 19 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
I20260709 12:23:22.226125 10828 catalog_manager.cc:5697] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 22 to 26. New cstate: current_term: 26 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:22.227985 18995 tablet_replica.cc:333] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:23:22.229219 18995 raft_consensus.cc:2243] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:22.239977 18995 raft_consensus.cc:2272] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:22.251893 11651 raft_consensus.cc:2955] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Committing config change with OpId 25.15: config changed from index 14 to 15, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:22.261168 11084 raft_consensus.cc:2955] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Committing config change with OpId 25.15: config changed from index 14 to 15, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:22.264431 18995 ts_tablet_manager.cc:1916] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:22.344480 10830 catalog_manager.cc:5697] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 21 to 22, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 22 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:22.346832 10830 catalog_manager.cc:5697] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 24 to 25, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 25 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:22.369385 10831 catalog_manager.cc:5697] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 21 to 22, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 22 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:22.400810 11004 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:23:22.417951 18945 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:22.424456 18995 ts_tablet_manager.cc:1929] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.13
I20260709 12:23:22.425038 18995 log.cc:1199] T 80db8b3fbfd046e8a5535ff4a7380107 P 1abf4b385a2b493ab83f593a1f8c9cd1: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-2-root/wals/80db8b3fbfd046e8a5535ff4a7380107
I20260709 12:23:22.427081 10818 catalog_manager.cc:5028] TS 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): tablet 80db8b3fbfd046e8a5535ff4a7380107 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:23:22.437553 10935 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:23:22.440246 18942 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:22.480044 10831 catalog_manager.cc:5697] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: config changed from index 14 to 15, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 25 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:22.492056 10828 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35614 (request call id 250) took 1217 ms. Trace:
I20260709 12:23:22.492453 10828 rpcz_store.cc:276] 0709 12:23:21.274653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.274816 (+   163us) service_pool.cc:224] Handling call
0709 12:23:22.491991 (+1217175us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:22.237368 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:22.237876 (+   508us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:22.237908 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:23:22.237925 (+    17us) tablet.cc:662] Decoding operations
0709 12:23:22.238552 (+   627us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:22.238604 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:22.238631 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:23:22.239118 (+   487us) tablet.cc:701] Row locks acquired
0709 12:23:22.239132 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:23:22.239291 (+   159us) write_op.cc:270] Start()
0709 12:23:22.239400 (+   109us) write_op.cc:276] Timestamp: P: 1783599802239248 usec, L: 0
0709 12:23:22.239417 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:23:22.240064 (+   647us) log.cc:844] Serialized 2131 byte log entry
0709 12:23:22.242210 (+  2146us) op_driver.cc:464] REPLICATION: finished
0709 12:23:22.242646 (+   436us) write_op.cc:301] APPLY: starting
0709 12:23:22.242723 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:22.245723 (+  3000us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:22.245815 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:22.249516 (+  3701us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:22.249713 (+   197us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 12:23:22.249759 (+    46us) write_op.cc:312] APPLY: finished
0709 12:23:22.249977 (+   218us) log.cc:844] Serialized 57 byte log entry
0709 12:23:22.256019 (+  6042us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:22.256126 (+   107us) write_op.cc:454] Released schema lock
0709 12:23:22.256172 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:22.256544 (+   372us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:22.256579 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10953,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":241,"apply.run_cpu_time_us":7061,"apply.run_wall_time_us":13876,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20870,"num_ops":5,"prepare.queue_time_us":1052,"prepare.run_cpu_time_us":2968,"prepare.run_wall_time_us":2963,"replication_time_us":2682}]]}
I20260709 12:23:22.552259 18987 raft_consensus.cc:1064] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:23:22.599447 10828 catalog_manager.cc:5697] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 18 to 19, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 19 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:22.620586 18987 consensus_queue.cc:237] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 10, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:22.656872 11067 tablet_service.cc:1558] Processing DeleteTablet for tablet 80db8b3fbfd046e8a5535ff4a7380107 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 12 (current committed config index is 14)) from {username='slave'} at 127.0.0.1:39448
I20260709 12:23:22.660398 10818 catalog_manager.cc:5028] TS 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): tablet 80db8b3fbfd046e8a5535ff4a7380107 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:23:22.684110 10833 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35620 (request call id 251) took 1557 ms. Trace:
I20260709 12:23:22.684546 10833 rpcz_store.cc:276] 0709 12:23:21.126583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.126770 (+   187us) service_pool.cc:224] Handling call
0709 12:23:22.684038 (+1557268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72036,"reported_tablets":45}
I20260709 12:23:22.740731 11651 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 LEARNER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:23:22.742285 18984 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:22.747575 11082 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:23:22.754845 18956 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:22.787585 11004 consensus_queue.cc:237] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:22.805698 10929 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:23:22.828214 18987 raft_consensus.cc:2955] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:22.851773 18986 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:22.878790 11076 raft_consensus.cc:2955] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:22.920300  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:22.926784 11651 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:23:22.928381 18473 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:23:22.948642 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 55738.5us
I20260709 12:23:22.953218 11656 raft_consensus.cc:2955] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:22.967042 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 72045.9us
I20260709 12:23:22.981345 10929 raft_consensus.cc:2955] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:23.016036 19011 raft_consensus.cc:2955] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Committing config change with OpId 25.16: config changed from index 15 to 16, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:23.020073 10828 catalog_manager.cc:5697] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: config changed from index 12 to 13, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:23.035151 10929 raft_consensus.cc:1275] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:23:23.038097 11651 raft_consensus.cc:2955] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index 15 to 16, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:23.144217 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 53880.9us
W20260709 12:23:23.165791 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 51650.9us
I20260709 12:23:23.133913 19008 consensus_queue.cc:1048] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
W20260709 12:23:23.251982 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 261015us
W20260709 12:23:23.254792 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 161698us
W20260709 12:23:23.328457 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 167076us
I20260709 12:23:23.359807 11008 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:23.360502 11008 raft_consensus.cc:606] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:23.361781 10820 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 83b4e206b7694af695234c0e758055e2 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:23.365696 10833 catalog_manager.cc:5697] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 15 to 16, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New cstate: current_term: 25 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:23.416522 10927 raft_consensus.cc:2955] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index 15 to 16, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:23.443324 10929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:23:23.443992 10929 raft_consensus.cc:606] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:23.445892 11067 tablet_service.cc:1558] Processing DeleteTablet for tablet 83b4e206b7694af695234c0e758055e2 with delete_type TABLET_DATA_TOMBSTONED (TS 1abf4b385a2b493ab83f593a1f8c9cd1 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:39448
I20260709 12:23:23.460139 18926 raft_consensus.cc:993] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:23.460709 18926 raft_consensus.cc:1081] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:23.463899 18956 raft_consensus.cc:993] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:23.464413 18956 raft_consensus.cc:1081] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:23.467123 11083 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60046
I20260709 12:23:23.467746 11083 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:23.468147 11083 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:23.474952 11083 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:23.482497 11003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:23.483719 11003 raft_consensus.cc:606] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:23.487354 11081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:23:23.488006 11081 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:23.488351 11081 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:23.495728 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:23.496410 10927 raft_consensus.cc:3055] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:23.496528 19031 tablet_replica.cc:333] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:23:23.496755 10927 raft_consensus.cc:740] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:23.497663 19031 raft_consensus.cc:2243] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:23.497480 10927 consensus_queue.cc:260] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:23.498538 10927 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:23.498586 19031 raft_consensus.cc:2272] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:23.529565 19031 ts_tablet_manager.cc:1916] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:23.532243 11083 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:23.533505 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:23.534114 11656 raft_consensus.cc:3060] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:23.542395 11656 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:23:23.543260 10927 raft_consensus.cc:2468] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:23:23.548166 10928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:23:23.548859 10928 raft_consensus.cc:606] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:23.549613 11049 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:23:23.550504 19012 raft_consensus.cc:2804] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:23.550994 19012 raft_consensus.cc:697] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:23.551839 19012 consensus_queue.cc:237] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:23.554487 11081 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:23.556591 11081 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:23.557320 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:23.557907 10928 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:23.564976 10928 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:23:23.566264 11051 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:23.568485 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:23.569087 11003 raft_consensus.cc:3055] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:23.569381 11003 raft_consensus.cc:740] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:23.573112 11011 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:23.573719 11011 raft_consensus.cc:606] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:23.571115 18942 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:23.575628 18942 raft_consensus.cc:697] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:23.576552 18942 consensus_queue.cc:237] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:23.587126 11003 consensus_queue.cc:260] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:23.588555 11003 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:23.599097  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:23.601068  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:23.601881  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:23.628449 11003 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:23:23.587399 10831 catalog_manager.cc:5697] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 17 to 18, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 18 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:23.687449 10831 catalog_manager.cc:5697] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 20 to 21, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 21 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:23.698681 19025 raft_consensus.cc:993] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:23.699234 19025 raft_consensus.cc:1081] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
W20260709 12:23:23.706548 10820 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leader transfer in progress [suppressed 2 similar messages]
I20260709 12:23:23.721429 11081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:23:23.721745 19024 raft_consensus.cc:993] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:23.722085 11081 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:23.722270 19024 raft_consensus.cc:1081] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:23.722529 11081 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:23.724016 19031 ts_tablet_manager.cc:1929] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 25.15
I20260709 12:23:23.724457 19031 log.cc:1199] T 83b4e206b7694af695234c0e758055e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-2-root/wals/83b4e206b7694af695234c0e758055e2
I20260709 12:23:23.726071 10818 catalog_manager.cc:5028] TS 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): tablet 83b4e206b7694af695234c0e758055e2 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:23:23.740144 19028 raft_consensus.cc:993] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:23:23.740742 18987 raft_consensus.cc:1081] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Signalling peer 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:23:23.747465 11004 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37586
I20260709 12:23:23.748068 11004 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:23.748431 11004 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:23.754014 11081 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:23.758546 10927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:43552
I20260709 12:23:23.759215 10927 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:23.759565 10927 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:23.766469 10927 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:23.770427 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:23.771064 10928 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:23.775781 11004 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:23.778543 10820 catalog_manager.cc:4755] TS 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): ChangeConfig:REMOVE_PEER RPC failed for tablet e4d1425ae0d743b7be813705b92d4e15: Remote error: Service unavailable: leader transfer in progress
I20260709 12:23:23.777945 10928 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:23:23.779258 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:23.779947 10934 raft_consensus.cc:3055] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:23:23.780228 10934 raft_consensus.cc:740] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:23.780925 10934 consensus_queue.cc:260] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:23.781459 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:23.782037 11011 raft_consensus.cc:3055] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:23.782349 11011 raft_consensus.cc:740] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:23.783083 11011 consensus_queue.cc:260] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:23.784175 11011 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:23.787478 10934 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:23.792457 11081 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:23.793550 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:23.794314 11656 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:23.799098 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:23.791623 11011 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:23:23.800776 10901 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:23.793617 10927 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 16 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:23.801964 11656 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:23:23.803750 11049 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:23.804921 19018 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:23.805455 19018 raft_consensus.cc:697] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:23.806329 19018 consensus_queue.cc:237] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:23.808308 18925 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:23.808878 18925 raft_consensus.cc:697] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:23.809760 18925 consensus_queue.cc:237] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:23.799901 11651 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:23.823153 11651 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
W20260709 12:23:23.835727 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 63667us
I20260709 12:23:23.836423 10833 catalog_manager.cc:5697] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 19 to 20, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 20 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:23.841099 10934 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 26.
I20260709 12:23:23.849767 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:23.850369 11011 raft_consensus.cc:3055] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:23.850653 11011 raft_consensus.cc:740] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:23.851384 11011 consensus_queue.cc:260] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:23.852768 10977 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:23.853014 11011 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:23.857841 11004 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:23.861491 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:23.862097 11081 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:23.860446 11011 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:23:23.865900 11084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39448
I20260709 12:23:23.866600 11084 raft_consensus.cc:606] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Received request to transfer leadership
I20260709 12:23:23.871785 10831 catalog_manager.cc:5697] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 15 to 16, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 16 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:23.875746 11084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39448
I20260709 12:23:23.876410 11084 raft_consensus.cc:606] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Received request to transfer leadership
I20260709 12:23:23.876492 18987 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:23:23.878358 18987 raft_consensus.cc:697] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:23.879218 18987 consensus_queue.cc:237] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:23.879551 11084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39448
I20260709 12:23:23.880169 11084 raft_consensus.cc:606] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Received request to transfer leadership
W20260709 12:23:23.888453 10882 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:23:23.888932 10882 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for e4d1425ae0d743b7be813705b92d4e15 already in progress
W20260709 12:23:23.889287 10882 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for e4d1425ae0d743b7be813705b92d4e15 already in progress
I20260709 12:23:23.892998 11081 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 26.
W20260709 12:23:23.917018 10820 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e4d1425ae0d743b7be813705b92d4e15 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER failed with leader 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2201bad9e18849b09cf82de29dd032d3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:23.968194 10831 catalog_manager.cc:5697] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 25 to 26, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 26 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:23.973562 11651 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:23:23.979192 19018 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:24.073235 11003 raft_consensus.cc:1275] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:23:24.077139 10934 raft_consensus.cc:1275] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:23:24.078097 19018 consensus_queue.cc:1048] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:24.079715 19018 consensus_queue.cc:1048] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
W20260709 12:23:24.141506 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 71478.5us
I20260709 12:23:24.212579 10927 raft_consensus.cc:1275] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:23:24.217495 19007 consensus_queue.cc:1048] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:24.318346 11651 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:23:24.324190 10934 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:23:24.324749 18925 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:24.325896 19007 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:24.388788 11004 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:23:24.393021 11659 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:23:24.396842 19040 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:24.399255 11084 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:23:24.401316 19028 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:23:24.423970 11004 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:23:24.425340 19007 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:24.455183 19007 raft_consensus.cc:993] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:23:24.455695 19007 raft_consensus.cc:1081] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Signalling peer 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:23:24.456735 19056 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:24.466388 10934 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:43556
I20260709 12:23:24.467028 10934 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:24.467355 10934 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:24.484684 10934 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:24.493494 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 111759us
I20260709 12:23:24.499204 10927 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:23:24.503374 10934 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:24.503669 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:24.504320 11004 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:24.504834 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:24.505415 11659 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:24.519788 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:24.515661 19025 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.010s
I20260709 12:23:24.538842 11004 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:23:24.548820 11076 raft_consensus.cc:3055] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:24.549247 11076 raft_consensus.cc:740] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:24.550011 11076 consensus_queue.cc:260] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:24.551482 11076 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:24.554678 11659 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:23:24.557060 11651 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: []
W20260709 12:23:24.564751 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 47582.5us
I20260709 12:23:24.566879 11076 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:23:24.576834 10899 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:24.578153 19052 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:24.578662 19052 raft_consensus.cc:697] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:23:24.580040 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 62688.8us
I20260709 12:23:24.579571 19052 consensus_queue.cc:237] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:24.589551 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 74297.3us
I20260709 12:23:24.602223 11006 raft_consensus.cc:1240] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:24.622195 10831 catalog_manager.cc:5697] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 20 to 21, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 21 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:24.725092 19063 log.cc:927] Time spent T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:23:24.864040  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:24.957032 10929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "015a67e38c364985be24b18358579506"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:23:24.957655 10929 raft_consensus.cc:606] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:24.966158 10929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:23:24.966756 10929 raft_consensus.cc:606] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:24.969560 11004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:24.970135 11004 raft_consensus.cc:606] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:24.973239 11076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:35562
I20260709 12:23:24.973810 11076 raft_consensus.cc:606] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:24.976508 11004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:24.977044 11004 raft_consensus.cc:606] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:24.978229  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:24.979938  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:24.980640  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:25.090426 10929 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
W20260709 12:23:25.124058 10900 consensus_peers.cc:597] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0cb303f7380c4693b70bda660f0f86a6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:25.127458 11076 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:23:25.128527 11004 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:23:25.131363 19053 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:25.133499 18925 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:25.136968 19060 raft_consensus.cc:993] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:23:25.140540 19060 raft_consensus.cc:1081] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Signalling peer 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:23:25.146715 10928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:43552
I20260709 12:23:25.147408 10928 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:25.147802 10928 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:25.147410 19022 raft_consensus.cc:993] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:25.152456 19022 raft_consensus.cc:1081] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:25.155705 11081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:23:25.156447 11081 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:25.156781 11081 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:23:25.160564 11651 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:23:25.165539 19062 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:25.165917 11011 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:23:25.181860 19053 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.003s
W20260709 12:23:25.200683 10821 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e4d1425ae0d743b7be813705b92d4e15 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER failed with leader 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:23:25.202215 11084 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:23:25.208227 11081 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:25.212669 18925 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:23:25.298015 11081 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:25.311097 19002 raft_consensus.cc:2955] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Committing config change with OpId 22.12: config changed from index -1 to 12, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:25.313571 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:25.314316 11011 raft_consensus.cc:3055] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:23:25.314658 11011 raft_consensus.cc:740] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:25.315385 11011 consensus_queue.cc:260] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:25.316691 11011 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:23:25.326313 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:25.327070 10934 raft_consensus.cc:3060] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:23:25.332612 11011 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 27.
I20260709 12:23:25.331359 10928 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:25.336685 11050 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:25.344120 19007 raft_consensus.cc:2804] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:23:25.348245 10934 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 27.
I20260709 12:23:25.351631 10928 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:25.352411 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:25.353185 11004 raft_consensus.cc:3055] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:25.353523 11004 raft_consensus.cc:740] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:25.354385 11004 consensus_queue.cc:260] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:25.355619 11004 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:25.356104 19077 raft_consensus.cc:993] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
W20260709 12:23:25.388389 19058 log.cc:927] Time spent T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.103s	user 0.007s	sys 0.001s
I20260709 12:23:25.390920 11004 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:23:25.391777 19046 raft_consensus.cc:1081] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:25.407284 11011 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37594
I20260709 12:23:25.407902 11011 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:25.408241 11011 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:25.415652 11011 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:25.423890 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:25.426020 11081 raft_consensus.cc:3055] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:25.426358 11081 raft_consensus.cc:740] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:25.425483 11011 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:25.427204 11081 consensus_queue.cc:260] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:25.428372 11081 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:25.434681 19056 raft_consensus.cc:993] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:25.435271 19056 raft_consensus.cc:1081] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:25.440289 19007 raft_consensus.cc:697] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:25.441434 19007 consensus_queue.cc:237] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:25.445580 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: true dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:25.446252 11651 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:23:25.446018 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 88170.8us
I20260709 12:23:25.456238 11651 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:23:25.454973 10828 catalog_manager.cc:5697] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: config changed from index -1 to 12, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 22 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:25.457425 11084 consensus_queue.cc:237] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:25.463500 10900 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:25.464511 19053 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:25.465013 19053 raft_consensus.cc:697] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:25.465843 19053 consensus_queue.cc:237] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:25.481392 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 153267us
I20260709 12:23:25.487301 11011 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "015a67e38c364985be24b18358579506"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37586
I20260709 12:23:25.487929 11011 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:25.488305 11011 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:25.489398 10831 catalog_manager.cc:5697] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 26 to 27, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 27 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:25.494885 11076 raft_consensus.cc:2955] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Committing config change with OpId 22.12: config changed from index -1 to 12, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:25.496670 11011 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:25.502753 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:25.503367 11083 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:23:25.504174 11049 consensus_peers.cc:597] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 49f51062a99d4696bd7480d6804e7d72. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:25.511982 11081 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:23:25.513301 10974 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:25.512291 11003 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:23:25.514199 19028 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:25.513953 11083 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 23.
I20260709 12:23:25.516017 19028 raft_consensus.cc:697] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:25.517040 19028 consensus_queue.cc:237] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:25.520470 19007 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:25.521643 10974 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:25.522198 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:25.522837 10928 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:25.522557 19074 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:23:25.530820 19075 raft_consensus.cc:993] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:25.531391 19075 raft_consensus.cc:1081] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:25.533746 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:25.534353 10934 raft_consensus.cc:3055] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:23:25.534617 10934 raft_consensus.cc:740] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:25.535254 10934 consensus_queue.cc:260] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:25.536020 19074 raft_consensus.cc:697] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:25.536284 10934 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:25.536939 19074 consensus_queue.cc:237] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:25.543730 10934 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 23.
I20260709 12:23:25.543426 11006 raft_consensus.cc:2955] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Committing config change with OpId 22.12: config changed from index -1 to 12, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:25.564486 11004 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37586
I20260709 12:23:25.565104 11004 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:25.565456 11004 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:25.571825 11004 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:25.577819 11004 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:25.552292 10928 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:23:25.579710 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:25.579979 11011 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:25.580312 11083 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:25.588167 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:25.588832 10928 raft_consensus.cc:3055] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:25.589176 10928 raft_consensus.cc:740] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:25.589860 10928 consensus_queue.cc:260] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:25.590915 10928 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:25.592077 11083 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:23:25.593532 10974 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:25.599061 18986 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:25.599624 18986 raft_consensus.cc:697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:25.601909 10927 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:23:25.600503 18986 consensus_queue.cc:237] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:25.610671 10928 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:23:25.645488 19007 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:25.646847 19093 ts_tablet_manager.cc:933] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109)
I20260709 12:23:25.652434 10833 catalog_manager.cc:5697] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 19 to 20, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 20 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:25.676240 19079 raft_consensus.cc:2955] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index -1 to 15, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:25.678956 11003 raft_consensus.cc:2955] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index -1 to 15, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:25.702414 10934 raft_consensus.cc:2955] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index -1 to 15, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:25.727267 10831 catalog_manager.cc:5697] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 19 to 20, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 20 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:25.736104 19093 tablet_copy_client.cc:323] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.65:46109
I20260709 12:23:25.738178 10946 tablet_copy_service.cc:140] P 9e8170bbe8244e40a2b2e5011e69b697: Received BeginTabletCopySession request for tablet 0cb303f7380c4693b70bda660f0f86a6 from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:53346)
I20260709 12:23:25.738759 10946 tablet_copy_service.cc:161] P 9e8170bbe8244e40a2b2e5011e69b697: Beginning new tablet copy session on tablet 0cb303f7380c4693b70bda660f0f86a6 from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:53346: session id = 0b171b6aaedc4f809f2753dcfadb14ce-0cb303f7380c4693b70bda660f0f86a6
I20260709 12:23:25.740790 11082 consensus_queue.cc:237] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:25.749977 10946 tablet_copy_source_session.cc:215] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:23:25.761745 11049 consensus_peers.cc:597] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8151fe64a0a84d44a837cc6abf316707. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:25.762080 11003 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:23:25.763592 19080 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:23:25.766973 19093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cb303f7380c4693b70bda660f0f86a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:25.774973 10928 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:23:25.776985 19080 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:25.812450 19080 raft_consensus.cc:2955] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Committing config change with OpId 24.16: config changed from index -1 to 16, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:25.828003 10833 catalog_manager.cc:5697] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 22 to 23, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 23 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:25.829807 10833 catalog_manager.cc:5697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 18 to 19, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 19 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:25.831278 10833 catalog_manager.cc:5697] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: config changed from index -1 to 15, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 21 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:25.846486 10928 raft_consensus.cc:2955] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index -1 to 16, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:25.850658 11004 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 12:23:25.852596 19078 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:23:25.853253 19093 tablet_copy_client.cc:806] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:25.856670 19093 tablet_copy_client.cc:670] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:25.867947 19093 tablet_copy_client.cc:538] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:25.876308 11003 raft_consensus.cc:2955] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index -1 to 16, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:25.879644 11011 consensus_queue.cc:237] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:25.902055 10833 catalog_manager.cc:5697] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: config changed from index -1 to 16, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 24 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:25.908476 10928 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
W20260709 12:23:25.912099 10975 consensus_peers.cc:597] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 90e76c15ad9c49ab9b98a5d216125beb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:25.918253 19077 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:23:25.923408 10934 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:23:25.924510 19093 tablet_bootstrap.cc:492] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:23:25.925076 11076 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:23:25.926232 19028 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:25.928295 18986 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:25.997236 10927 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:23:26.005739 11011 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:23:26.015640 19075 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.021s
I20260709 12:23:26.008754 19022 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:23:26.048724 10929 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:23:26.063658 19109 ts_tablet_manager.cc:933] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:26.072814 10929 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:23:26.052601 19028 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 12:23:26.104799  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:26.108440 11651 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:23:26.108377 19111 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.085s
I20260709 12:23:26.182618 18986 raft_consensus.cc:2955] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:26.230506 11082 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:23:26.240177 11076 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:23:26.229362 19109 tablet_copy_client.cc:323] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.67:40209
I20260709 12:23:26.265931 19121 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:23:26.266568 19093 log.cc:927] Time spent T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:23:26.267549 19121 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:26.273196 11081 raft_consensus.cc:2955] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:26.296949 11082 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:23:26.321894 11004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:26.322548 11004 raft_consensus.cc:606] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:26.325028 10934 raft_consensus.cc:2955] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:26.378655 11081 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:35562
I20260709 12:23:26.379364 11081 raft_consensus.cc:606] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:26.316004 19022 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:23:26.381368 10830 catalog_manager.cc:5697] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: config changed from index -1 to 13, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 19 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
W20260709 12:23:26.462420 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 138107us
I20260709 12:23:26.462559 10934 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:23:26.464761 10934 raft_consensus.cc:606] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:26.423082 19123 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.048s
I20260709 12:23:26.487344 10930 consensus_queue.cc:237] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:26.510767 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 80740.9us
I20260709 12:23:26.528376 11095 tablet_copy_service.cc:140] P 1abf4b385a2b493ab83f593a1f8c9cd1: Received BeginTabletCopySession request for tablet 49f51062a99d4696bd7480d6804e7d72 from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:40200)
I20260709 12:23:26.529177 11095 tablet_copy_service.cc:161] P 1abf4b385a2b493ab83f593a1f8c9cd1: Beginning new tablet copy session on tablet 49f51062a99d4696bd7480d6804e7d72 from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:40200: session id = 0b171b6aaedc4f809f2753dcfadb14ce-49f51062a99d4696bd7480d6804e7d72
W20260709 12:23:26.612474 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 191422us
I20260709 12:23:26.696024 11006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9432c125c17431e881ba1329e02a201"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:26.696656 11006 raft_consensus.cc:606] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 24 LEADER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:26.696836 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 93998.3us
I20260709 12:23:26.728484  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:23:26.730366  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:26.735668  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:26.747946 19012 raft_consensus.cc:993] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:23:26.749363 19012 raft_consensus.cc:1081] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Signalling peer 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:23:26.750365 11095 tablet_copy_source_session.cc:215] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:23:26.723214 19113 log.cc:927] Time spent T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:23:26.781322 11659 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:23:26.783888 19120 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:23:26.785844 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 50784.7us
I20260709 12:23:26.965840 10930 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:43556
I20260709 12:23:26.966502 10930 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:26.966917 10930 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:26.974931 19109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f51062a99d4696bd7480d6804e7d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.218806 19173 ts_tablet_manager.cc:933] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:27.224198 19138 raft_consensus.cc:993] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:27.224786 19138 raft_consensus.cc:1081] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:27.243711 19109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59414 (request call id 650) took 1250 ms. Trace:
I20260709 12:23:27.269384 11003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37586
I20260709 12:23:27.270150 11003 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:27.277532 11003 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:27.266392 19109 rpcz_store.cc:276] 0709 12:23:25.992840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.993135 (+   295us) service_pool.cc:224] Handling call
0709 12:23:26.073123 (+ 79988us) ts_tablet_manager.cc:934] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
0709 12:23:26.973508 (+900385us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:23:27.215401 (+241893us) tablet_metadata.cc:665] Metadata flushed
0709 12:23:27.215539 (+   138us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:23:27.242899 (+ 27360us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:23:27.243209 (+   310us) tablet_replica.cc:206] Creating consensus instance
0709 12:23:27.243551 (+   342us) ts_tablet_manager.cc:989] Replica registered.
0709 12:23:27.243611 (+    60us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":42532,"tablet-copy.queue_time_us":70026,"thread_start_us":143441,"threads_started":2}
I20260709 12:23:27.278403 10930 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:27.295181 10931 raft_consensus.cc:1240] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 21. Current term is 22. Ops: []
I20260709 12:23:27.299327 10930 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:27.304889 11003 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:27.305742 11004 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:27.284726 19109 tablet_copy_client.cc:806] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:27.309635 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:27.318449 11005 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:27.321146 11003 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:27.355507 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:27.356287 11082 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:27.350418 19109 tablet_copy_client.cc:670] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:27.377135 11082 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:23:27.377748 19079 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:27.389605 19079 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:27.392443 19175 ts_tablet_manager.cc:933] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:27.394999 11659 raft_consensus.cc:2955] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 13 to 16, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:27.399143 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:27.392149 19138 raft_consensus.cc:2955] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Committing config change with OpId 21.16: config changed from index 13 to 16, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:27.463516 19079 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:27.468567 11005 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:27.647917 19158 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:27.648643 19158 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:27.652920 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:23:27.656042 19171 log.cc:927] Time spent T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:23:27.620250 19177 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:27.657269 19177 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:27.595315 19141 log.cc:927] Time spent T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
W20260709 12:23:27.620039 19133 log.cc:927] Time spent T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
W20260709 12:23:27.664067 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 287215us
I20260709 12:23:27.665527 10974 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:27.666793 19111 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:27.667300 19111 raft_consensus.cc:697] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:27.668169 19111 consensus_queue.cc:237] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:27.664285 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:27.701730 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46716 (request call id 4) took 1395 ms. Trace:
I20260709 12:23:27.713219 19158 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:27.715727 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 50266.3us
I20260709 12:23:27.725772 19074 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:27.726475 19074 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:27.834496 19074 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:27.846395 19075 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:27.992599 11078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60030 (request call id 4566) took 1252 ms. Trace:
I20260709 12:23:27.982249 11624 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:27.915190 19053 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:27.915402 19022 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:28.015118 19144 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:28.015908 19144 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:27.994472 11078 rpcz_store.cc:276] 0709 12:23:26.689033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.691050 (+  2017us) service_pool.cc:224] Handling call
0709 12:23:26.691416 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:26.786891 (+ 95475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.786920 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:26.787330 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 12:23:27.221990 (+434660us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:23:27.322168 (+100178us) log.cc:844] Serialized 14 byte log entry
0709 12:23:27.411075 (+ 88907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:27.411153 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:27.411192 (+    39us) raft_consensus.cc:1685] finished
0709 12:23:27.411204 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:27.940959 (+529755us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":141902,"prepare.queue_time_us":150884,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":1534,"raft.queue_time_us":151033,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":8427,"spinlock_wait_cycles":9951488,"thread_start_us":510288,"threads_started":3,"wal-append.queue_time_us":526475}
I20260709 12:23:28.024348 19175 tablet_copy_client.cc:323] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.66:41383
I20260709 12:23:28.036922 19158 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:23:28.041847 19177 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:28.001287 19075 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.026382 19053 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:28.025539 19022 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:28.162372 19183 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:28.163568 19183 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:28.164558 19181 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:28.165628 19181 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.167142 19183 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:28.061908 18947 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:28.154130 19053 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:27.702346 19138 rpcz_store.cc:276] 0709 12:23:26.306109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.306248 (+   139us) service_pool.cc:224] Handling call
0709 12:23:26.486409 (+180161us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b58000bd5d0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0ebc0aa 00007f9bb0f3e447 00007f9bb0f5b70a 00007f9bb0f5c76a 00007f9bb0f5b91b 00007f9bb0f6703c 00007f9bb0f666b3 00007f9bb0f5e9fa 00007f9bb5f264c9 00007f9baf4a2c54
0709 12:23:26.493593 (+  7184us) log.cc:844] Serialized 494 byte log entry
0709 12:23:27.701636 (+1208043us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38995,"raft.run_cpu_time_us":894,"raft.run_wall_time_us":113346,"spinlock_wait_cycles":63677056,"thread_start_us":160989,"threads_started":1,"wal-append.queue_time_us":287707}
I20260709 12:23:28.063134 19144 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:28.223551 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:28.225199 18947 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:28.154130 19075 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.227619 19158 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:28.167779 19183 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:28.251657 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:28.260016 19193 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:28.261178 18947 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:28.260866 19193 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:28.266098 19192 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:28.267253 19192 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:28.259900 19158 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:28.267625 19193 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:28.271167 19191 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:28.271615 19183 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.279122 19191 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.281610 19183 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:28.271629 19142 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:23:28.283036 19164 log.cc:927] Time spent T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 1.069s	user 0.004s	sys 0.029s
I20260709 12:23:28.283252 19142 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.284775 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:23:28.285696 19168 log.cc:927] Time spent T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 1.073s	user 0.013s	sys 0.039s
I20260709 12:23:28.270262 19192 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:28.245437 19053 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:28.287308 19142 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:28.287950 19169 log.cc:927] Time spent T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 1.075s	user 0.000s	sys 0.018s
I20260709 12:23:28.288444 19053 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:28.288990 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.289985 11082 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:23:28.298674 19188 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:28.291332 19053 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:28.291548 19191 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:28.278973 19181 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:28.270860 19158 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:28.299770 19022 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.307349 19195 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:28.270646 19186 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:28.267810 19198 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:28.304899 19053 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:28.316403 11651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59384 (request call id 1098) took 1576 ms. Trace:
I20260709 12:23:28.316294 19198 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.316764 19195 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.317078 11651 rpcz_store.cc:276] 0709 12:23:26.739620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.793418 (+ 53798us) service_pool.cc:224] Handling call
0709 12:23:26.793702 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:26.797802 (+  4100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.797833 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:26.798438 (+   605us) log.cc:844] Serialized 26 byte log entry
0709 12:23:26.958833 (+160395us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:23:26.958873 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.958941 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:28.281934 (+1322993us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bb0afb86e 00007f9bb0afabb6 00007f9bb0afa7d8 00007f9bb0b04221 00007f9bb0b041d9 00007f9bb0b04169
0709 12:23:28.315707 (+ 33773us) raft_consensus.cc:1685] finished
0709 12:23:28.315739 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:28.316187 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4632,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":5103,"spinlock_wait_cycles":28586880,"thread_start_us":144137,"threads_started":1,"wal-append.queue_time_us":407389}
I20260709 12:23:28.319831 19195 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.292083 19075 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:28.319418 19198 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.316445 19053 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.308073 19194 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:28.312911 19196 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:28.302985 19193 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:28.329754 19186 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.333371 19075 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.299762 19188 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:28.342139 19149 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:28.336138 19193 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:28.344242 19196 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.342374 19188 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:28.355268 19197 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:28.355934 19142 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:28.356169 19181 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:28.357606 19192 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:28.343179 19149 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:28.343258 19194 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:28.358771 19121 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:28.359906 19135 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:28.342535 19075 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.347191 19196 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.429064 19186 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.430397 19121 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.367085 19112 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:28.435292 19110 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:28.436091 19195 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:28.438048 19131 raft_consensus.cc:993] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
W20260709 12:23:28.440097 19093 log.cc:927] Time spent T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.069s	user 0.000s	sys 0.002s
I20260709 12:23:28.439599 19197 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.428442 19201 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:23:28.380671 11050 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.011s	user 0.015s	sys 0.011s
I20260709 12:23:28.440469 11004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37586 (request call id 4552) took 1171 ms. Trace:
I20260709 12:23:28.454614 10828 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35614 (request call id 270) took 1813 ms. Trace:
I20260709 12:23:28.455049 10828 rpcz_store.cc:276] 0709 12:23:26.641256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.641384 (+   128us) service_pool.cc:224] Handling call
0709 12:23:28.454382 (+1812998us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:23:28.456400 19110 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:28.458619 19093 tablet_bootstrap.cc:492] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=2 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:28.459008 19110 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.460093 19093 tablet_bootstrap.cc:492] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:23:28.362597 19193 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.452903 11004 rpcz_store.cc:276] 0709 12:23:27.268677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.270463 (+  1786us) service_pool.cc:224] Handling call
0709 12:23:27.270793 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:27.316232 (+ 45439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:28.439943 (+1123711us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b540044ff54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:28.440262 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79977216}
I20260709 12:23:28.462855 19093 ts_tablet_manager.cc:1403] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 2.539s	user 0.067s	sys 0.039s
W20260709 12:23:28.462251 11050 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.093s	user 0.016s	sys 0.016s
I20260709 12:23:28.441923 19053 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.476769 19167 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:28.477663 19167 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.481547 19197 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:28.364295 19109 tablet_copy_client.cc:538] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:28.465663 19191 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:28.469894 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:28.482858 19191 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.485618 19191 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:28.471021 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:28.454499 19195 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:28.487987 19181 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.488381 10821 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e4d1425ae0d743b7be813705b92d4e15 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 8)
I20260709 12:23:28.488873 19195 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:28.464888 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.490054 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:28.473330 10931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43556 (request call id 3535) took 1501 ms. Trace:
I20260709 12:23:28.493512 10931 rpcz_store.cc:276] 0709 12:23:26.971742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.971884 (+   142us) service_pool.cc:224] Handling call
0709 12:23:26.972174 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:27.295613 (+323439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:28.472728 (+1177115us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b540024ac54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0f60e01 00007f9bb0f5f83e 00007f9bb5f24419 00007f9baf49bbd4 00007f9baf49bb62 00007f9baf49ba91 00007f9baf49ba0c 00007f9baf49acc2 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:28.473061 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742456576}
I20260709 12:23:28.494535 19138 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:28.495430 19138 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.495747 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:28.496181 19028 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:28.497514 19166 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:28.497738 19165 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:28.498220 19131 raft_consensus.cc:1081] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
W20260709 12:23:28.466856 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 1.11498e+06us
I20260709 12:23:28.498150 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:28.500247 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.504256 19181 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:28.477551 19201 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.505797 11049 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:28.508046 19112 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.508854 19142 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.510684 19135 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.515254 19028 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.518013 19166 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.518569 19165 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.517294 19195 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:28.520560 19112 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.525017 19195 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:28.526188 19028 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.519707 19138 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.527886 19165 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.526219 19166 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.528658 19195 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:28.529386 19198 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:28.530134 19198 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.533423 11011 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:23:28.533813 19198 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.529264 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:28.534507 19148 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:28.535390 19177 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:28.535717 19120 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:28.536231 19177 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:28.536438 19120 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.538640 19177 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:28.539098 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:28.539242 19177 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:28.539443 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:28.540226 19177 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.542197 19201 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.542680 19181 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:28.538635 19120 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.628109 19120 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:28.628958 19120 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:28.630635 19142 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:28.631466 19120 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.535305 19148 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:28.547920 19173 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 1.245s	user 0.015s	sys 0.022s
W20260709 12:23:28.636770 19173 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 1.417s	user 0.016s	sys 0.022s
I20260709 12:23:28.519709 19167 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.542711 19177 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.618922 19195 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:28.641484 19195 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:28.642503 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 96526.4us
I20260709 12:23:28.645185 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:28.645874 11656 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:23:28.621959 19194 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.647439 10975 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:28.648604 19167 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:28.648993 19167 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:28.649384 19167 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:28.534453 19138 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:23:28.549696 19162 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.293s	user 0.026s	sys 0.013s
I20260709 12:23:28.522917 19192 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.543556 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:28.632807 19149 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.624675 11659 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 15.
I20260709 12:23:28.638218 19173 tablet_copy_client.cc:323] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.67:40209
I20260709 12:23:28.639422 19148 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:28.653262 19195 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:28.654634 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:28.656070 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:28.651458 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:28.528728 19121 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.666680 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:28.666894 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:28.667038 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:28.668974 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.669265 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:28.669950 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:28.633518 19053 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:28.652216 19198 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:28.679291 19198 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.687417 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:28.688913 19198 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.689123 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:28.691188 11080 raft_consensus.cc:3055] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:23:28.691540 11080 raft_consensus.cc:740] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:28.692723 10830 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35620 (request call id 269) took 2361 ms. Trace:
I20260709 12:23:28.692592 11080 consensus_queue.cc:260] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.661685 19177 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:28.694645 19177 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:28.697618 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.699113 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.700472 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.701205 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.701347 11085 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
W20260709 12:23:28.662189 19162 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.441s	user 0.029s	sys 0.017s
I20260709 12:23:28.700552 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.736363 11080 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:28.708799 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:28.732729 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.731940 11095 tablet_copy_service.cc:140] P 1abf4b385a2b493ab83f593a1f8c9cd1: Received BeginTabletCopySession request for tablet 8151fe64a0a84d44a837cc6abf316707 from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:40200)
I20260709 12:23:28.742679 11095 tablet_copy_service.cc:161] P 1abf4b385a2b493ab83f593a1f8c9cd1: Beginning new tablet copy session on tablet 8151fe64a0a84d44a837cc6abf316707 from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:40200: session id = 0b171b6aaedc4f809f2753dcfadb14ce-8151fe64a0a84d44a837cc6abf316707
I20260709 12:23:28.737465 19177 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:28.693145 10830 rpcz_store.cc:276] 0709 12:23:26.331238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.331359 (+   121us) service_pool.cc:224] Handling call
0709 12:23:28.692507 (+2361148us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:26.782456 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:26.782987 (+   531us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:26.783031 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:23:26.783047 (+    16us) tablet.cc:662] Decoding operations
0709 12:23:26.783361 (+   314us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:26.783423 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:26.783449 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:23:26.783631 (+   182us) tablet.cc:701] Row locks acquired
0709 12:23:26.783643 (+    12us) write_op.cc:260] PREPARE: finished
0709 12:23:26.783830 (+   187us) write_op.cc:270] Start()
0709 12:23:26.783965 (+   135us) write_op.cc:276] Timestamp: P: 1783599806783726 usec, L: 0
0709 12:23:26.783983 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:23:26.784648 (+   665us) log.cc:844] Serialized 595 byte log entry
0709 12:23:27.038396 (+253748us) op_driver.cc:464] REPLICATION: finished
0709 12:23:28.384686 (+1346290us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bade560ac 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb4996ef0
0709 12:23:28.623796 (+239110us) write_op.cc:301] APPLY: starting
0709 12:23:28.623977 (+   181us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:28.627298 (+  3321us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:28.627352 (+    54us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:28.630116 (+  2764us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:28.630413 (+   297us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:23:28.630455 (+    42us) write_op.cc:312] APPLY: finished
0709 12:23:28.630780 (+   325us) log.cc:844] Serialized 25 byte log entry
0709 12:23:28.689654 (+ 58874us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:28.689818 (+   164us) write_op.cc:454] Released schema lock
0709 12:23:28.689871 (+    53us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":1402294,"apply.run_cpu_time_us":11184,"apply.run_wall_time_us":66658,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8301,"num_ops":1,"prepare.queue_time_us":357616,"prepare.run_cpu_time_us":2503,"prepare.run_wall_time_us":2504,"replication_time_us":221156,"spinlock_wait_cycles":5878144,"thread_start_us":1743932,"threads_started":3}]]}
I20260709 12:23:28.752599 19093 raft_consensus.cc:359] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:28.753782 19093 raft_consensus.cc:740] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:23:28.754578 19093 consensus_queue.cc:260] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:28.760360 10975 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:28.764528 19195 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:28.765007 19195 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:28.765470 19195 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:28.767923 11021 tablet_copy_service.cc:140] P 2201bad9e18849b09cf82de29dd032d3: Received BeginTabletCopySession request for tablet 90e76c15ad9c49ab9b98a5d216125beb from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:41098)
I20260709 12:23:28.769026 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.769585 11085 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 25.
I20260709 12:23:28.765444 19192 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:28.773890 19112 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:28.774533 19112 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:28.776912 19112 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:28.777745 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:28.778573 10935 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:23:28.758847 19138 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.780068 11021 tablet_copy_service.cc:161] P 2201bad9e18849b09cf82de29dd032d3: Beginning new tablet copy session on tablet 90e76c15ad9c49ab9b98a5d216125beb from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:41098: session id = 0b171b6aaedc4f809f2753dcfadb14ce-90e76c15ad9c49ab9b98a5d216125beb
I20260709 12:23:28.781754 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.781992 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.783519 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.784579 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.785887 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.788895 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:28.789209 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:28.788151 19053 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.790424 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:28.791038 11003 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 22.
I20260709 12:23:28.791818 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:28.794059 19053 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.798019 19138 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.798678 19138 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:28.799255 19138 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:28.801044 11084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:23:28.801581 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.802731 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.803387 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.804237 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.803364 19167 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:28.820196 11009 raft_consensus.cc:2393] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 17: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:28.820266 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.820721 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.821442 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.804188 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.805460 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.822561 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.823113 11078 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:23:28.824813 19167 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:28.809640 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:28.813987 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.828715 10930 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 25.
I20260709 12:23:28.783756 10833 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35608 (request call id 290) took 1381 ms. Trace:
I20260709 12:23:28.818449 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:28.819101 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.821811 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.819551 11624 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:28.831033 19149 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:28.831485 19149 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:28.831848 19149 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:28.830494 10833 rpcz_store.cc:276] 0709 12:23:27.402618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.402759 (+   141us) service_pool.cc:224] Handling call
0709 12:23:28.749632 (+1346873us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400096d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0eca090 00007f9bb0f68f3a 00007f9bb6d1ee9c 00007f9bb6e1d04e 00007f9bb52de2a4 00007f9bb52de232 00007f9bb52de161 00007f9bb52de0dc 00007f9bb52dd392 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:28.783597 (+ 33965us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":3092615040}
I20260709 12:23:28.824815 11084 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:28.836134 11084 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:28.837718 19093 ts_tablet_manager.cc:1434] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.324s	user 0.008s	sys 0.004s
I20260709 12:23:28.844213 19135 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.848883 11080 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:28.831970 19109 tablet_bootstrap.cc:492] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:23:28.853909 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:28.854998 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:28.855175 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:28.855932 10931 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:23:28.856246 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:28.804894 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:28.852111 19138 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:28.825521 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:28.860148 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:28.852628 11021 tablet_copy_source_session.cc:215] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:28.856464 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:28.859637 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:28.861830 11625 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.131.65:46109 timed out after 1.568s (SENT) [suppressed 4 similar messages]
I20260709 12:23:28.865258 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:28.865921 11009 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:23:28.866179 19194 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:28.866878 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:28.866786 19194 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.868247 19198 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:28.868835 19198 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.871105 19198 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.872225 11095 tablet_copy_source_session.cc:215] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:28.875154 11084 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.876437 19201 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:28.877357 11084 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:28.877115 19201 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.876756 19053 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:28.878801 19053 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:28.881003 19053 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.883347 10828 catalog_manager.cc:5697] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 13 to 16, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New cstate: current_term: 21 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:28.888052 19194 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.888324 11655 raft_consensus.cc:1217] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 LEARNER]: Deduplicated request from leader. Original: 22.11->[22.12-22.12]   Dedup: 22.12->[]
I20260709 12:23:28.879259 19201 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.896709 19166 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:28.897320 19166 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:28.903373 10901 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:28.908676 19166 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:23:28.913408 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 57564.3us
I20260709 12:23:28.921358 19201 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:28.921079 19149 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:28.921954 19201 raft_consensus.cc:697] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:28.922879 10901 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:28.923046 19201 consensus_queue.cc:237] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:28.923518 19149 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:28.921156 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:28.929687 19173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8151fe64a0a84d44a837cc6abf316707. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:28.956027 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 94329.5us
I20260709 12:23:28.911969 19195 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:28.960430 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:28.964828 11004 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:28.928915 19198 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:28.927073 19132 consensus_queue.cc:1059] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:23:28.948982 19150 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:28.955914 19192 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:28.998389 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:29.007248 10901 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:29.007282 19053 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:23:29.008953 19138 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:29.012809 19154 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.013450 19154 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:29.019064 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.023629 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:29.024345 10931 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:29.019914 10930 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 24.
I20260709 12:23:29.039408 19135 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:29.040040 19135 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:29.042536 19135 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:29.057163 11051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.066313 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.069162 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:28.992847 19150 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:29.069756 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.069865 11005 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:29.073298 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.023630 19192 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:29.111685 10901 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:29.101572 11656 raft_consensus.cc:1240] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 22. Current term is 23. Ops: []
I20260709 12:23:29.125010 11004 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 23.
I20260709 12:23:29.078122 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:23:29.135090 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 63699.4us
I20260709 12:23:29.109412 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.108002 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.137825 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.108256 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.142267 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.104709 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.108788 19154 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:29.100907 19150 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:29.151576 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.156733 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.155689 10901 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:29.152174 11002 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 24.
I20260709 12:23:29.137167 19132 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:29.164019 19132 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:29.164487 19132 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:29.158733 19197 consensus_queue.cc:1059] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.010s
I20260709 12:23:29.161257 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.169003 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.170785 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.167342 19175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90e76c15ad9c49ab9b98a5d216125beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.178236 10901 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:29.180284 19195 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:29.179080 19053 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:23:29.180922 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.182338 10927 raft_consensus.cc:3055] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:29.196161 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.197072 10927 raft_consensus.cc:740] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:29.197575 10901 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:29.202664 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.204341 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:29.202097 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.205833 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.204694 19198 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:29.212930 11051 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:29.214537 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.218150 11005 raft_consensus.cc:1240] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:29.220269 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.220860 11051 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:29.223315 10927 consensus_queue.cc:260] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:29.222860 19154 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:29.225225 19195 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.226033 19191 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:29.238680 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.240131 11051 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:29.244035 19123 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:23:29.244571 19123 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:29.244920 19123 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:29.227609 19053 consensus_queue.cc:1059] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 12:23:29.237697 19191 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:29.256868 19191 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:29.258867 19053 raft_consensus.cc:3055] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:29.259289 19053 raft_consensus.cc:740] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:29.260248 19053 consensus_queue.cc:260] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:29.261818 19053 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:29.254563 10931 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 26.
I20260709 12:23:29.260159 10927 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:29.254212 11051 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:29.267295 11624 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:29.272328 19183 raft_consensus.cc:3055] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:23:29.272783 19183 raft_consensus.cc:740] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:29.273692 19183 consensus_queue.cc:260] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:29.274991 19183 raft_consensus.cc:3060] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:29.266491 19192 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:29.278147 11006 raft_consensus.cc:1240] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:29.278594 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.253152 19154 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:23:29.237669 19195 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:29.276057 19193 raft_consensus.cc:2804] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:23:29.279495 19185 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:29.291576 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.287353 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.282474 19154 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:29.296527 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.293252 19185 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:23:29.305521 19214 log.cc:927] Time spent T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:23:29.294147 19193 raft_consensus.cc:697] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:23:29.306671 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.300896 19120 consensus_queue.cc:1059] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 12:23:29.312827 19120 raft_consensus.cc:3055] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:29.313274 19120 raft_consensus.cc:740] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:29.314487 10927 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
W20260709 12:23:29.315007 19177 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 12:23:29.314157 19120 consensus_queue.cc:260] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:29.300259 19154 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:29.308594 19132 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:29.315606 19195 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:29.306293 19185 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:29.323973 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:23:29.325598 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.328032 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.339452 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:29.312727 19193 consensus_queue.cc:237] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:29.341639 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.343469 11011 raft_consensus.cc:1240] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 22. Current term is 23. Ops: []
I20260709 12:23:29.340145 11010 raft_consensus.cc:3055] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:23:29.345286 11010 raft_consensus.cc:740] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:29.346127 11010 consensus_queue.cc:260] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:29.347054 11010 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:29.341779 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.340072 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.353845 11084 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 25. Current term is 26. Ops: []
I20260709 12:23:29.354969 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.357692 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:29.359886 11010 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 26.
I20260709 12:23:29.360387 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:29.369410 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:29.369433 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:29.377270 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:29.376600 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 76419us
I20260709 12:23:29.379077 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:29.382103 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:29.371424 11009 raft_consensus.cc:2955] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 13 to 16, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:29.385257 10901 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.390697 10974 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:29.394093 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.399523 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:29.397662 11051 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:29.399549 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.400506 11085 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:23:29.392591 19120 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:29.403452 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:29.411371 19132 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:29.396905 19022 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:29.420744 19022 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:29.421154 19022 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:29.437608 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.442075 11006 raft_consensus.cc:1275] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:23:29.440065 19150 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:23:29.443770 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:29.460098 19150 raft_consensus.cc:697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:29.463397 19177 consensus_queue.cc:1048] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:29.466595 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.470046 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.463143 19150 consensus_queue.cc:237] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:29.470705 10933 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 20.
I20260709 12:23:29.471552 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.474509 10931 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:23:29.475421 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:29.476608 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.476892 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.478055 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:29.484138 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.484938 19123 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:29.485423 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.487967 19198 raft_consensus.cc:1064] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:23:29.488369 10936 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:23:29.489691 10936 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 25. Current term is 26. Ops: []
W20260709 12:23:29.508443 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 82643.6us
I20260709 12:23:29.510583 11067 tablet_service.cc:1558] Processing DeleteTablet for tablet e4d1425ae0d743b7be813705b92d4e15 with delete_type TABLET_DATA_TOMBSTONED (TS 1abf4b385a2b493ab83f593a1f8c9cd1 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:39448
I20260709 12:23:29.426086 19154 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:29.522284 10929 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:23:29.522936 10831 catalog_manager.cc:5697] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 19 to 20, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 20 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:29.490482 19198 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 10, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:29.540074 19022 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:29.542733 19022 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:29.545126 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.556665 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.546427 10946 tablet_copy_service.cc:342] P 9e8170bbe8244e40a2b2e5011e69b697: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-0cb303f7380c4693b70bda660f0f86a6 received from {username='slave'} at 127.0.0.1:53346
I20260709 12:23:29.547320 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.549240 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.552201 10931 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:23:29.558028 10946 tablet_copy_service.cc:434] P 9e8170bbe8244e40a2b2e5011e69b697: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-0cb303f7380c4693b70bda660f0f86a6 on tablet 0cb303f7380c4693b70bda660f0f86a6 with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:23:29.563838 19154 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:29.564790 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.567047 11009 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 22. Current term is 23. Ops: []
W20260709 12:23:29.570227 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 70930.2us
I20260709 12:23:29.570026 19191 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:29.573199 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:29.573999 10930 raft_consensus.cc:2393] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 16: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:29.543416 19185 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:29.578943 19185 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:29.580408 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:29.585574 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 124106us
I20260709 12:23:29.581137 10934 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 17.
I20260709 12:23:29.590649 19191 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:29.591096 11084 raft_consensus.cc:2468] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 23.
I20260709 12:23:29.594403 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:29.595512 10974 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:23:29.600301 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 61986.9us
I20260709 12:23:29.603052 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
W20260709 12:23:29.604985 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 94659.3us
I20260709 12:23:29.608505 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:29.609535 10934 raft_consensus.cc:1240] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 22. Current term is 23. Ops: []
I20260709 12:23:29.612560 19226 tablet_replica.cc:333] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:23:29.617069 10899 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:29.604216 19166 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:23:29.606074 11051 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:29.606438 11050 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:29.622550 11050 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:29.623276 19227 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:29.624150 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:29.625769 19191 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:29.626220 19123 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:29.626226 19191 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.627013 19191 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:29.629314 11050 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:29.633771 10899 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:29.619721 19166 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:29.636472 19138 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:23:29.655078 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 53059.4us
I20260709 12:23:29.654565 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:29.646380 19142 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:29.642277 19173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59414 (request call id 658) took 2642 ms. Trace:
I20260709 12:23:29.650965 19166 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:29.647310 19175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59398 (request call id 865) took 2389 ms. Trace:
I20260709 12:23:29.660842 10974 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
W20260709 12:23:29.664152 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.662544 19173 rpcz_store.cc:276] 0709 12:23:26.979429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.979591 (+   162us) service_pool.cc:224] Handling call
0709 12:23:27.219339 (+239748us) ts_tablet_manager.cc:934] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
0709 12:23:28.322063 (+1102724us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bade560ac 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade6fcaa 00007f9bade6fbd2 00007f9bb5ed4131
0709 12:23:28.927976 (+605913us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:23:29.360174 (+432198us) tablet_metadata.cc:665] Metadata flushed
0709 12:23:29.360315 (+   141us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:23:29.543212 (+182897us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:23:29.543521 (+   309us) tablet_replica.cc:206] Creating consensus instance
0709 12:23:29.543816 (+   295us) ts_tablet_manager.cc:989] Replica registered.
0709 12:23:29.619952 (+ 76136us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":973,"spinlock_wait_cycles":28567296,"tablet-copy.queue_time_us":238626,"thread_start_us":1539595,"threads_started":2}
I20260709 12:23:29.650893 19220 consensus_queue.cc:1059] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 12:23:29.652042 19185 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:23:29.673702 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.654058 19053 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:23:29.675203 10899 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:29.678896 11050 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:29.673848 19201 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:29.685622 19135 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:29.672645 19022 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:23:29.706033 10834 catalog_manager.cc:5697] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 22 to 23, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 23 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:29.707299 10899 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:29.674357 19175 rpcz_store.cc:276] 0709 12:23:27.246827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.246988 (+   161us) service_pool.cc:224] Handling call
0709 12:23:27.392862 (+145874us) ts_tablet_manager.cc:934] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
0709 12:23:28.972950 (+1580088us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:23:29.388708 (+415758us) tablet_metadata.cc:665] Metadata flushed
0709 12:23:29.388826 (+   118us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:23:29.551285 (+162459us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:23:29.551579 (+   294us) tablet_replica.cc:206] Creating consensus instance
0709 12:23:29.618326 (+ 66747us) ts_tablet_manager.cc:989] Replica registered.
0709 12:23:29.630734 (+ 12408us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":157471,"tablet-copy.queue_time_us":131879,"thread_start_us":581283,"threads_started":2}
I20260709 12:23:29.712877 19123 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:29.714387 19123 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:29.718778 19175 tablet_copy_client.cc:806] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:29.719424 19175 tablet_copy_client.cc:670] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:29.731973 19175 tablet_copy_client.cc:538] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:29.717901 19191 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:29.734573 19191 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:29.739126 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 60329.1us
I20260709 12:23:29.745079 11050 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:29.749719 19150 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:23:29.750780 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 64884.1us
I20260709 12:23:29.697305 19173 tablet_copy_client.cc:806] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:29.752557 10974 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:29.749574 19226 raft_consensus.cc:2243] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:29.756312 19173 tablet_copy_client.cc:670] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:29.756754 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:29.780315 19226 raft_consensus.cc:2272] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:29.780474 10933 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:23:29.781803 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 82097.5us
I20260709 12:23:29.765480 10834 catalog_manager.cc:5697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 25 to 26, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 26 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:29.784214 19226 ts_tablet_manager.cc:1916] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:29.768357 19166 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:29.773496 11050 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:29.776923 19192 raft_consensus.cc:3055] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:23:29.779587 19175 tablet_bootstrap.cc:492] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:23:29.799490 10974 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:29.787801 19166 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:29.792250 19192 raft_consensus.cc:740] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:29.796236 10831 catalog_manager.cc:5697] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 21 to 22, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 22 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:29.796125 19116 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:23:29.800297 19154 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:23:29.793224 19191 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:29.817279 19192 consensus_queue.cc:260] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:29.818464 10928 raft_consensus.cc:1240] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 24. Current term is 25. Ops: []
I20260709 12:23:29.818734 19192 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:29.821921 10933 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:23:29.820925 19173 tablet_copy_client.cc:538] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:29.823665 19166 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:29.824162 19166 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:29.824539 19166 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:29.825024 11051 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:29.826623 19154 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:29.827150 19154 raft_consensus.cc:697] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:29.828141 19154 consensus_queue.cc:237] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:29.833953 11659 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 LEARNER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:23:29.841390 10974 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:23:29.823235 19150 consensus_queue.cc:1059] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.024s
I20260709 12:23:29.847918 19191 raft_consensus.cc:3055] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:23:29.844182 19235 raft_consensus.cc:2764] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 12:23:29.848744 19120 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:23:29.848744 19191 raft_consensus.cc:740] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:29.855086 19191 consensus_queue.cc:260] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:29.889099 11050 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:29.889995 19150 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:29.890447 11050 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:29.891177 19150 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:29.892059 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:29.892642 11080 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:29.890220 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:29.893872 11085 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:29.889319 11084 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:29.893011 11050 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:29.901476 19191 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:29.901695 11006 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 22. Current term is 23. Ops: []
I20260709 12:23:29.903728 11082 raft_consensus.cc:1240] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 21. Current term is 22. Ops: []
I20260709 12:23:29.904788 19053 consensus_queue.cc:1059] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:29.907689 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:29.909277 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:29.911146 19053 raft_consensus.cc:3055] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:23:29.911557 19053 raft_consensus.cc:740] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:29.847991 19226 ts_tablet_manager.cc:1929] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.15
I20260709 12:23:29.916256 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:29.912544 19150 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:29.921967 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:29.918022 11080 raft_consensus.cc:2468] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 26.
I20260709 12:23:29.918481 11085 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 23.
I20260709 12:23:29.912535 19053 consensus_queue.cc:260] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:29.924440 19226 log.cc:1199] T e4d1425ae0d743b7be813705b92d4e15 P 1abf4b385a2b493ab83f593a1f8c9cd1: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-2-root/wals/e4d1425ae0d743b7be813705b92d4e15
I20260709 12:23:29.924124 19022 consensus_queue.cc:1059] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:29.927354 11050 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:29.928361 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 221129us
I20260709 12:23:29.930058 10899 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:29.932224 11077 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:23:29.937366 10933 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:23:29.942778 10899 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:29.936250 19022 consensus_queue.cc:1059] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 12:23:29.959928 19198 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:29.961444 10899 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:29.933310 19135 raft_consensus.cc:3055] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:29.962931 19135 raft_consensus.cc:740] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:29.963891 19135 consensus_queue.cc:260] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:29.953864 19120 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:29.965251 19135 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:29.966500 19198 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:29.967796 10899 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:29.969571 10899 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:29.935825 19225 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:23:29.970738 19224 raft_consensus.cc:3055] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:23:29.971225 19224 raft_consensus.cc:740] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:29.956157 19053 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:29.972916 10818 catalog_manager.cc:5028] TS 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): tablet e4d1425ae0d743b7be813705b92d4e15 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:23:29.973551 19138 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:29.973301 19224 consensus_queue.cc:260] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:29.974110 19239 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:23:29.970727 10899 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:29.979122 10899 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:29.981038 19166 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:29.983291 19206 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:29.984161 19206 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:23:29.986949 10899 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:29.988884 11005 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:23:29.988683 19206 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:23:29.990608 18947 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:23:29.997231 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:29.999569 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:30.003795 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:30.007454 19150 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:23:30.007943 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:30.004209 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:30.016007 10977 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:30.016216 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:30.017164 19231 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:30.019691 10977 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:30.022127 19231 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:30.022198 11080 raft_consensus.cc:1275] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:23:30.028872 19193 consensus_queue.cc:1048] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:23:30.033939 10977 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:30.035611 19235 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:30.040743 10977 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:30.041574 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:30.042068 10977 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:30.042850 19116 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:30.043277 10977 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:30.043936 19116 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:30.044098 19231 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:23:30.045401 10977 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:30.050302 19231 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:30.056129 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:30.055644 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:30.052228 10828 catalog_manager.cc:5697] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 20 to 21, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 21 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:30.060613 10899 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:30.061653 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:30.062413 10934 raft_consensus.cc:2368] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 20. Current term is 21.
I20260709 12:23:30.062603 10935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:30.063200 10935 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 17.
I20260709 12:23:30.065856 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:30.067458 11079 raft_consensus.cc:1275] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:23:30.068759 10936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:30.070013 11078 raft_consensus.cc:1240] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 22. Current term is 23. Ops: []
I20260709 12:23:30.062009 10977 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:30.063337 11625 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:30.072819 10977 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:30.073073 11625 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:30.074445 11625 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:30.079480 11625 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:30.079595 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:30.081236 10933 raft_consensus.cc:2410] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 12:23:30.078727 10899 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:30.082660 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:30.085006 19116 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:30.085408 10977 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:30.086774 10977 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:30.087455 11081 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23.
I20260709 12:23:30.097612 10899 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:30.078832 18947 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:30.079101 19231 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:30.079190 19239 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:30.085817 19116 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:30.083925 19149 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:30.084270 19234 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:23:30.112524 19237 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:30.100468 19235 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:30.121935 19245 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:23:30.113888 19198 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:30.119426 11081 raft_consensus.cc:1240] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 25. Current term is 26. Ops: []
I20260709 12:23:30.120730 19166 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:30.121634 11625 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:30.111829 10899 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:30.123791  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:30.124711 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 195696us
I20260709 12:23:30.147652 10899 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:30.127578 19146 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:30.155019 10899 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:30.162786 11081 raft_consensus.cc:1240] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 25. Current term is 26. Ops: []
I20260709 12:23:30.161237 11050 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:30.153664 19120 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:30.162061 19239 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:30.169341 19138 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:23:30.170151 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:30.171066 11078 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:30.173596 19192 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:23:30.167948 11050 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:30.184742 10899 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:30.188544 11078 raft_consensus.cc:2468] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 23.
I20260709 12:23:30.192286 19132 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:23:30.193713 19192 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:23:30.194875 19132 raft_consensus.cc:697] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:30.167538 19177 consensus_queue.cc:1048] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:23:30.195920 19132 consensus_queue.cc:237] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:30.198549 19173 tablet_bootstrap.cc:492] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:23:30.184334 19234 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:30.212304 19234 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:30.212711 19234 raft_consensus.cc:3060] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:30.214090 19109 tablet_bootstrap.cc:492] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:30.214654 19239 consensus_queue.cc:1059] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:30.215081 19109 tablet_bootstrap.cc:492] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:23:30.215734 19201 raft_consensus.cc:3055] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:23:30.215929 19109 ts_tablet_manager.cc:1403] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 1.460s	user 0.048s	sys 0.027s
I20260709 12:23:30.211437 11084 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 25.
I20260709 12:23:30.216266 19201 raft_consensus.cc:740] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
W20260709 12:23:30.242159 10976 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.257712 19234 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:30.260874 11078 raft_consensus.cc:1240] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
W20260709 12:23:30.286180 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 135027us
I20260709 12:23:30.287295 10974 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:30.297051 10974 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:30.302457 19245 raft_consensus.cc:2804] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:23:30.303082 19245 raft_consensus.cc:697] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:30.304107 19245 consensus_queue.cc:237] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:30.305755 19227 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:30.306309 19227 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:30.301486 19116 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:23:30.286155 19239 consensus_queue.cc:1059] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
W20260709 12:23:30.334640 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 215913us
I20260709 12:23:30.335623 10974 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:30.368027 19234 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:30.315315 19243 consensus_queue.cc:1059] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:23:30.368435 19227 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:30.372896 10933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:30.377810 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:30.368741 19224 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:30.341394 19135 consensus_queue.cc:1059] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.034s
I20260709 12:23:30.315143 19201 consensus_queue.cc:260] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:30.393292 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.389917 19116 raft_consensus.cc:697] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:30.357031 19109 raft_consensus.cc:359] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
W20260709 12:23:30.401527 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.394906 19195 raft_consensus.cc:2804] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:23:30.389580 19243 consensus_queue.cc:1243] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer 1abf4b385a2b493ab83f593a1f8c9cd1 log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:23:30.411638 10933 raft_consensus.cc:2468] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 17.
I20260709 12:23:30.413354 11625 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:30.417877 19146 raft_consensus.cc:2804] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:30.420706 19146 raft_consensus.cc:697] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:23:30.421751 19146 consensus_queue.cc:237] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:30.404126 18947 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:30.403319 19109 raft_consensus.cc:740] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:23:30.433923 19201 raft_consensus.cc:3060] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:30.416393 19231 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:23:30.429453 19116 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:30.512111 19173 tablet_bootstrap.cc:700] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent opening tablet: real 0.137s	user 0.004s	sys 0.002s
I20260709 12:23:30.462352 18947 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:30.505034 19255 raft_consensus.cc:3055] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:23:30.526893 19255 raft_consensus.cc:740] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:30.547011 11009 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:23:30.532887 19183 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:30.550312 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:30.554209 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 196669us
I20260709 12:23:30.558120 10977 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:30.560444 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:30.550582 19183 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:30.583428 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:23:30.512471 19109 consensus_queue.cc:260] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:30.584708 11005 raft_consensus.cc:3055] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:30.594533 11005 raft_consensus.cc:740] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:30.601089 10977 leader_election.cc:400] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 20. Current term is 21.
I20260709 12:23:30.596338 11005 consensus_queue.cc:260] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:30.602427 11005 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:30.581619 19224 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:30.597854 19253 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:30.592831 19195 raft_consensus.cc:697] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:30.618204 19195 consensus_queue.cc:237] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:30.550221 19255 consensus_queue.cc:260] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:30.620639 19109 ts_tablet_manager.cc:1434] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.404s	user 0.012s	sys 0.002s
I20260709 12:23:30.634884 11005 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 12:23:30.593974 19185 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:23:30.637930 11005 pending_rounds.cc:85] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3: Aborting all ops after (but not including) 11
I20260709 12:23:30.639235 11655 raft_consensus.cc:1217] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 LEARNER]: Deduplicated request from leader. Original: 21.14->[21.15-21.15]   Dedup: 21.15->[]
W20260709 12:23:30.653894 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 60328.2us
I20260709 12:23:30.641788 11005 pending_rounds.cc:107] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 12:23:30.655146 11005 raft_consensus.cc:2889] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:30.664180 19237 raft_consensus.cc:3055] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:23:30.668602 19237 raft_consensus.cc:740] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:30.669683 19237 consensus_queue.cc:260] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:30.672102 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 77643.3us
I20260709 12:23:30.673967 10977 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:30.676172 19116 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:23:30.689235 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.691565 11095 tablet_copy_service.cc:342] P 1abf4b385a2b493ab83f593a1f8c9cd1: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-49f51062a99d4696bd7480d6804e7d72 received from {username='slave'} at 127.0.0.1:40200
I20260709 12:23:30.692263 11095 tablet_copy_service.cc:434] P 1abf4b385a2b493ab83f593a1f8c9cd1: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-49f51062a99d4696bd7480d6804e7d72 on tablet 49f51062a99d4696bd7480d6804e7d72 with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:23:30.694985 18947 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:30.657899 19253 raft_consensus.cc:697] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:30.698482 19253 consensus_queue.cc:237] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:30.702790 19183 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:30.710865 10899 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:23:30.716707 19268 log.cc:927] Time spent T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.172s	user 0.003s	sys 0.000s
W20260709 12:23:30.726547 10977 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.734019 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:30.725795 19201 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:23:30.753561 19201 raft_consensus.cc:697] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:30.755565 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:30.754586 19201 consensus_queue.cc:237] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:30.815478 11006 raft_consensus.cc:2393] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 17: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
W20260709 12:23:30.830899 19175 log.cc:927] Time spent T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:23:30.860291 10936 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:23:30.886615 10933 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:23:30.901124 10928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:23:30.917661 19192 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:30.920500 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:30.921396 11051 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:30.938048 11010 raft_consensus.cc:1240] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 22. Current term is 23. Ops: []
I20260709 12:23:30.940404 19192 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:23:30.941465 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.945701 10931 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:23:30.949344 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
W20260709 12:23:30.952174 19135 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260709 12:23:30.959390 19237 raft_consensus.cc:3060] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:30.964088 11625 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:30.966164 19255 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:30.973507 19247 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:23:30.980906 10974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.001380 10831 catalog_manager.cc:5697] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 22 to 23, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 23 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.003079 10831 catalog_manager.cc:5697] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 24 to 25, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 25 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.024156 11084 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:23:31.025151 10928 raft_consensus.cc:606] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:31.025565 10928 raft_consensus.cc:614] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:31.025063 19261 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:31.039294 11010 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:31.033766 10828 catalog_manager.cc:5697] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 16 to 17, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 17 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.051447 11076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:35562
I20260709 12:23:31.053939 11076 raft_consensus.cc:606] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:31.057571 19185 raft_consensus.cc:1064] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:23:31.061414 11010 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 12:23:31.067122 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 47478.6us
I20260709 12:23:31.094274 19166 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:23:31.099845 11006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:31.100503 11006 raft_consensus.cc:606] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:31.071879 19277 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:23:31.104013 19257 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:23:31.060988 19185 consensus_queue.cc:237] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 13, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:31.104966 19177 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:23:31.118697 11006 raft_consensus.cc:1275] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:23:31.123745  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:31.128790  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:31.131264 11051 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:31.129647 19201 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:31.133948 19192 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:23:31.133778 19267 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:31.135557 19267 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:31.137835 19267 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:31.145993 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:31.147387 11081 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:23:31.126492 19247 consensus_queue.cc:1048] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 12:23:31.150095  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:31.146705 11008 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:31.151755 11076 raft_consensus.cc:1275] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:23:31.158118 10901 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:31.165246 19251 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:31.133898 19201 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:31.194135 19201 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:31.195263 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:31.190397 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:31.195998 11010 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:23:31.199441 11659 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:31.197314 10901 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:31.202670 11076 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 22: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:31.177491 19237 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:31.215663 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:31.216569 11084 raft_consensus.cc:2393] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 21: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:31.183471 19255 consensus_queue.cc:1048] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 12:23:31.207026 19267 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:31.208024 19237 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:31.226761 10933 raft_consensus.cc:1275] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:23:31.238219 19237 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:31.243690 19264 consensus_queue.cc:1048] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:31.251092 11078 raft_consensus.cc:1275] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:23:31.255059 19264 consensus_queue.cc:1048] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:31.235479 19267 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:31.264901 19267 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:31.297395 10934 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 12:23:31.297853 10934 pending_rounds.cc:85] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 12
I20260709 12:23:31.298067 10934 pending_rounds.cc:107] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 22.13
I20260709 12:23:31.298307 10934 raft_consensus.cc:2917] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Aborting config change with OpId 22.13: Aborted: Op aborted by new leader
I20260709 12:23:31.298648 10934 raft_consensus.cc:2889] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:31.331404 11655 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:31.331573 19173 log.cc:927] Time spent T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 12:23:31.435993 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 82982.8us
W20260709 12:23:31.437078 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 85308us
W20260709 12:23:31.433353 19292 log.cc:927] Time spent T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:23:31.334672 19267 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:31.345237 19235 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.106s
I20260709 12:23:31.460561 19239 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:31.490306 10900 consensus_peers.cc:597] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:31.507917 19239 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:31.526520 10934 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:23:31.527546 19239 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:31.528244 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:31.523958 11656 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 LEARNER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:23:31.499753 19237 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:31.532399 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:31.525861 11659 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 12:23:31.535537 11659 pending_rounds.cc:85] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce: Aborting all ops after (but not including) 12
I20260709 12:23:31.535770 11659 pending_rounds.cc:107] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 22.13
I20260709 12:23:31.536034 11659 raft_consensus.cc:2917] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Aborting config change with OpId 22.13: Aborted: Op aborted by new leader
I20260709 12:23:31.536397 11659 raft_consensus.cc:2889] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:31.522444 11655 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:23:31.541733 11010 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
W20260709 12:23:31.544672 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 60811us
I20260709 12:23:31.543216 10901 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:31.531579 19237 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:31.550236 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:31.550907 11659 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 16.
I20260709 12:23:31.548418 19191 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.004s
I20260709 12:23:31.559054 19120 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:31.559283 19267 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:31.559747 19120 raft_consensus.cc:697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:31.567459 10900 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:31.568668 11010 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:23:31.559579 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 96038.1us
I20260709 12:23:31.578043 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:31.574139 19237 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:31.574496 19227 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.584236 11010 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:23:31.593557 19237 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.549676 19231 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:23:31.560714 19120 consensus_queue.cc:237] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:31.618475 11078 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:23:31.622393 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:31.623329 11081 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 22: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:31.583112 19252 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:23:31.624366 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:31.625128 11076 raft_consensus.cc:2393] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8170bbe8244e40a2b2e5011e69b697 in current term 21: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:31.633625 19277 raft_consensus.cc:993] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:23:31.635162 19191 raft_consensus.cc:1081] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Signalling peer 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:23:31.647265 19175 tablet_bootstrap.cc:492] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:31.655755 11008 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 21.
I20260709 12:23:31.667454 10934 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:23:31.673303 10934 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:43556
I20260709 12:23:31.603175 19237 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:31.681449 10901 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:31.691234 10934 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:31.691800 10934 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:31.692904 19191 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:31.697234 19175 tablet_bootstrap.cc:492] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:23:31.698093 19175 ts_tablet_manager.cc:1403] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 1.919s	user 0.067s	sys 0.030s
I20260709 12:23:31.600234 19227 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:31.603643 19239 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.084s
I20260709 12:23:31.694171 19177 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:31.708510 19177 raft_consensus.cc:697] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:31.708643 19303 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:23:31.659731 19256 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
W20260709 12:23:31.714776 19280 raft_consensus.cc:670] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } [suppressed 1 similar messages]
I20260709 12:23:31.725103 19175 raft_consensus.cc:359] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:31.709494 19177 consensus_queue.cc:237] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:31.757567 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:31.729494 19255 raft_consensus.cc:993] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:31.705127 19227 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:31.756150 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 58911us
I20260709 12:23:31.755599 11005 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:23:31.758255 11009 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 26.
I20260709 12:23:31.761741 10934 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:31.791580 10934 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:31.757351 19175 raft_consensus.cc:740] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:23:31.794312 19175 consensus_queue.cc:260] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:31.796418 19175 ts_tablet_manager.cc:1434] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.098s	user 0.007s	sys 0.000s
I20260709 12:23:31.801851 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:31.803462 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:31.828157 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:31.828820 11008 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:31.832429 11021 tablet_copy_service.cc:342] P 2201bad9e18849b09cf82de29dd032d3: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-90e76c15ad9c49ab9b98a5d216125beb received from {username='slave'} at 127.0.0.1:41098
I20260709 12:23:31.832996 11021 tablet_copy_service.cc:434] P 2201bad9e18849b09cf82de29dd032d3: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-90e76c15ad9c49ab9b98a5d216125beb on tablet 90e76c15ad9c49ab9b98a5d216125beb with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:23:31.784013 19253 raft_consensus.cc:1081] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:31.807629 19173 tablet_bootstrap.cc:492] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=18 overwritten=2 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:31.844245 11076 raft_consensus.cc:3055] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:23:31.844656 11076 raft_consensus.cc:740] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:31.845423 11076 consensus_queue.cc:260] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:31.846877 11076 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:31.813834 19237 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:31.851274 10927 raft_consensus.cc:1240] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:23:31.852145 11008 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
I20260709 12:23:31.856083 11084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:23:31.856652 11084 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:31.857031 11084 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:23:31.860129 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:31.852309 19237 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:23:31.908031 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 100796us
W20260709 12:23:31.917343 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 98845us
I20260709 12:23:31.908097 19173 tablet_bootstrap.cc:492] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
W20260709 12:23:31.927728 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 70032.1us
W20260709 12:23:31.909375 19317 log.cc:927] Time spent T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:23:31.972541 11084 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:31.931165 11076 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 22.
W20260709 12:23:31.963205 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 53939.3us
I20260709 12:23:31.964461 10901 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:31.985519 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:31.993587 11659 raft_consensus.cc:1217] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 LEARNER]: Deduplicated request from leader. Original: 19.12->[19.13-19.13]   Dedup: 19.13->[]
I20260709 12:23:31.995846 19053 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:31.996488 19053 raft_consensus.cc:697] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:31.995807 10901 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:31.997319 19053 consensus_queue.cc:237] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:32.018074 19315 consensus_queue.cc:1059] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:32.017354 19177 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:32.001006 19173 ts_tablet_manager.cc:1403] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 1.849s	user 0.062s	sys 0.022s
W20260709 12:23:32.024307 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 47997.2us
I20260709 12:23:32.022393 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:32.029976 10934 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:23:32.014396 19154 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.034693 11050 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:32.035499 19231 raft_consensus.cc:3055] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:32.038411 11084 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:32.062291 10934 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 27.
I20260709 12:23:32.048147 19277 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:23:32.063968 19277 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:32.064267 19321 log.cc:927] Time spent T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:23:32.043537 19304 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 12:23:32.059240 19231 raft_consensus.cc:740] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:32.077953 19231 consensus_queue.cc:260] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:32.079154 19231 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:32.079362 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:32.080030 11004 raft_consensus.cc:3055] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:23:32.080365 11004 raft_consensus.cc:740] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:32.081156 11004 consensus_queue.cc:260] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:32.082265 11004 raft_consensus.cc:3060] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:23:32.093920 11076 raft_consensus.cc:1240] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 26. Current term is 27. Ops: []
I20260709 12:23:32.039950 19154 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:32.064373 19277 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:23:32.109500 11004 raft_consensus.cc:2468] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 27.
I20260709 12:23:32.112154 19265 raft_consensus.cc:1064] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:23:32.114997 19265 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 12, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:32.107187 19227 raft_consensus.cc:2955] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Committing config change with OpId 21.16: config changed from index 15 to 16, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:32.116072 19154 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:32.098542 11051 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:32.075488 19173 raft_consensus.cc:359] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:32.133278 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:32.134189 10934 raft_consensus.cc:2955] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:32.146250 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 47709.6us
W20260709 12:23:32.152908 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 104639us
I20260709 12:23:32.141139 19220 raft_consensus.cc:2804] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:23:32.136811 19173 raft_consensus.cc:740] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:23:32.190477 19173 consensus_queue.cc:260] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
W20260709 12:23:32.208300 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 46841.7us
I20260709 12:23:32.211506 19173 ts_tablet_manager.cc:1434] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.180s	user 0.007s	sys 0.000s
I20260709 12:23:32.226456 19220 raft_consensus.cc:697] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:32.227453 19220 consensus_queue.cc:237] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:32.230257 10831 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35608 (request call id 295) took 1233 ms. Trace:
I20260709 12:23:32.230767 10831 rpcz_store.cc:276] 0709 12:23:30.996732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.996881 (+   149us) service_pool.cc:224] Handling call
0709 12:23:32.230181 (+1233300us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:31.209494 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:31.244126 (+ 34632us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:31.244165 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:23:31.244183 (+    18us) tablet.cc:662] Decoding operations
0709 12:23:31.244683 (+   500us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:31.244735 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:31.244764 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:23:31.245012 (+   248us) tablet.cc:701] Row locks acquired
0709 12:23:31.245030 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:23:31.245174 (+   144us) write_op.cc:270] Start()
0709 12:23:31.254203 (+  9029us) write_op.cc:276] Timestamp: P: 1783599811245129 usec, L: 0
0709 12:23:31.273748 (+ 19545us) op_driver.cc:348] REPLICATION: starting
0709 12:23:31.288613 (+ 14865us) log.cc:844] Serialized 980 byte log entry
0709 12:23:31.458874 (+170261us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bade560ac 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb0afa20b
0709 12:23:31.963481 (+504607us) spinlock_profiling.cc:243] Waited 60.8 ms on lock 0x7b54000972a0. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0ec9571 00007f9bb0ede343 00007f9bb0ee1d75 00007f9bb0ee1d09 00007f9bb0ee1c99 00007f9bb0ee1c61 00007f9bb0ee0f5d 0000000000388634 0000000000388479 00007f9bade73475 00007f9bade757c1
0709 12:23:31.963799 (+   318us) op_driver.cc:464] REPLICATION: finished
0709 12:23:31.986090 (+ 22291us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b4400022b4c. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9badd99c85 00007f9badd9a6a2 00007f9bb0b0c1db 00007f9bb0b07aaf 00007f9bade560ac 00007f9bb6cb09a9 00007f9bade7269b 00007f9bade7093f 00007f9bade72c02 00007f9bb4996ef0
0709 12:23:32.139967 (+153877us) write_op.cc:301] APPLY: starting
0709 12:23:32.144535 (+  4568us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:32.223678 (+ 79143us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:32.223705 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:32.225018 (+  1313us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:32.225207 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:23:32.225254 (+    47us) write_op.cc:312] APPLY: finished
0709 12:23:32.225456 (+   202us) log.cc:844] Serialized 33 byte log entry
0709 12:23:32.225624 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:32.225703 (+    79us) write_op.cc:454] Released schema lock
0709 12:23:32.225743 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:32.226190 (+   447us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:32.226220 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":133564,"apply.run_cpu_time_us":4686,"apply.run_wall_time_us":95021,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12475,"num_ops":2,"prepare.queue_time_us":155425,"prepare.run_cpu_time_us":20809,"prepare.run_wall_time_us":389503,"raft.queue_time_us":307727,"raft.run_cpu_time_us":44529,"raft.run_wall_time_us":328760,"replication_time_us":689885,"spinlock_wait_cycles":177379712,"thread_start_us":503597,"threads_started":4,"wal-append.queue_time_us":407797}]]}
I20260709 12:23:32.232293 11095 tablet_copy_service.cc:342] P 1abf4b385a2b493ab83f593a1f8c9cd1: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-8151fe64a0a84d44a837cc6abf316707 received from {username='slave'} at 127.0.0.1:40200
I20260709 12:23:32.238759 11095 tablet_copy_service.cc:434] P 1abf4b385a2b493ab83f593a1f8c9cd1: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-8151fe64a0a84d44a837cc6abf316707 on tablet 8151fe64a0a84d44a837cc6abf316707 with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:23:32.245713 11655 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 LEARNER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:23:32.268270 11659 raft_consensus.cc:2955] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:32.272373 11078 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:23:32.272997 11008 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:23:32.295027 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:32.268687 19116 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 12:23:32.295737 11010 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:23:32.299299 19267 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:32.318364 10934 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:23:32.336477 11078 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:23:32.338901 11050 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:32.347894 19228 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:32.348351 19228 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.348687 19228 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:32.353019 10828 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36824 (request call id 142) took 1377 ms. Trace:
I20260709 12:23:32.203680 19277 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:32.321522 19224 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 12:23:32.353438 10828 rpcz_store.cc:276] 0709 12:23:30.976102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.984276 (+  8174us) service_pool.cc:224] Handling call
0709 12:23:32.352957 (+1368681us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:31.615021 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:31.615573 (+   552us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:31.615605 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:23:31.615623 (+    18us) tablet.cc:662] Decoding operations
0709 12:23:31.615958 (+   335us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:31.616007 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:31.616034 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:23:31.616223 (+   189us) tablet.cc:701] Row locks acquired
0709 12:23:31.616241 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:23:31.616383 (+   142us) write_op.cc:270] Start()
0709 12:23:31.616495 (+   112us) write_op.cc:276] Timestamp: P: 1783599811616333 usec, L: 0
0709 12:23:31.616516 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:23:31.617134 (+   618us) log.cc:844] Serialized 533 byte log entry
0709 12:23:32.054417 (+437283us) op_driver.cc:464] REPLICATION: finished
0709 12:23:32.226704 (+172287us) write_op.cc:301] APPLY: starting
0709 12:23:32.226782 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:32.227720 (+   938us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:32.227808 (+    88us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:32.228536 (+   728us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:32.228711 (+   175us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:23:32.228758 (+    47us) write_op.cc:312] APPLY: finished
0709 12:23:32.228976 (+   218us) log.cc:844] Serialized 25 byte log entry
0709 12:23:32.285935 (+ 56959us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:32.292754 (+  6819us) write_op.cc:454] Released schema lock
0709 12:23:32.295239 (+  2485us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":2027,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":168164,"apply.run_cpu_time_us":3130,"apply.run_wall_time_us":109285,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4174,"num_ops":1,"prepare.queue_time_us":559158,"prepare.run_cpu_time_us":2381,"prepare.run_wall_time_us":2380,"replication_time_us":437749,"spinlock_wait_cycles":9353472,"thread_start_us":39469,"threads_started":1}]]}
I20260709 12:23:32.383351 19183 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.388979 19183 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:32.392078 10834 catalog_manager.cc:5697] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 22 to 23, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 23 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.394052 10834 catalog_manager.cc:5697] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 22 to 23, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 23 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.381260 19255 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 12:23:32.399677 10834 catalog_manager.cc:5697] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 25 to 26, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 26 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.405563 10834 catalog_manager.cc:5697] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 15 to 16, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 16 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.408907 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:32.409744 11010 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:32.410468 19183 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:32.362726 19267 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 12:23:32.433898 11050 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:32.435119 19311 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:32.435566 19311 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.435930 19311 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:32.441258 19277 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:32.457757 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:32.458568 11010 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:23:32.462091 19228 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:32.465173 11659 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 LEARNER]: Advancing to term 25
I20260709 12:23:32.467170 19228 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:32.468413 11078 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22. Ops: []
I20260709 12:23:32.473905 19177 consensus_queue.cc:1059] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:32.475003 19201 raft_consensus.cc:3055] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:23:32.475409 19201 raft_consensus.cc:740] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:32.476243 19201 consensus_queue.cc:260] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:32.477234 19201 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:32.484771 19022 raft_consensus.cc:2955] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Committing config change with OpId 23.14: config changed from index 12 to 14, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:32.486941 10928 raft_consensus.cc:2955] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index 12 to 14, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:32.496256 11078 raft_consensus.cc:2955] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index 12 to 14, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:32.503113 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:32.503806 11008 raft_consensus.cc:3060] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:32.511729 19255 raft_consensus.cc:1064] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
W20260709 12:23:32.512050 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 213392us
I20260709 12:23:32.529896 19255 consensus_queue.cc:237] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:32.534525 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:32.545663 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:32.546276 10934 raft_consensus.cc:3060] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Advancing to term 27
I20260709 12:23:32.547080 11083 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:23:32.554190 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:32.556123 10934 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 27.
I20260709 12:23:32.559036 11005 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:23:32.553401 19333 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 12:23:32.562858 11008 raft_consensus.cc:2468] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:32.564953 11009 raft_consensus.cc:1240] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 21. Current term is 22. Ops: []
I20260709 12:23:32.530239 11004 raft_consensus.cc:2955] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:32.573091 11010 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 27.
I20260709 12:23:32.582427 11051 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:32.583380 19150 raft_consensus.cc:2804] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:23:32.583930 19150 raft_consensus.cc:697] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:32.584852 19150 consensus_queue.cc:237] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:32.574613 11050 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:32.588804 19192 raft_consensus.cc:2804] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:32.589385 19192 raft_consensus.cc:697] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:32.590251 19192 consensus_queue.cc:237] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:32.568357 19053 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:23:32.636677 10930 raft_consensus.cc:2410] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 12:23:32.558403 19311 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:32.667240 11076 raft_consensus.cc:1240] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 12:23:32.678933 19333 consensus_queue.cc:1059] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
W20260709 12:23:32.729606 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 49090.9us
I20260709 12:23:32.732592 10930 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:23:32.727952 11656 raft_consensus.cc:2955] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index 12 to 14, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:32.748878 19304 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:23:32.755125 19201 raft_consensus.cc:3055] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:23:32.755601 19201 raft_consensus.cc:740] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:32.756471 19201 consensus_queue.cc:260] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:32.768826 19311 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:32.781795 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:32.784713 11006 raft_consensus.cc:1275] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:23:32.760433 19201 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:32.792873 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:32.845814 11659 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 LEARNER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:23:32.825884 19304 consensus_queue.cc:1048] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.026s
W20260709 12:23:32.944753 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 111276us
I20260709 12:23:33.035607 10934 raft_consensus.cc:2410] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 for term 23 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 12:23:32.864001 19116 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.133s
W20260709 12:23:33.137072 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 262479us
I20260709 12:23:33.166363 19237 raft_consensus.cc:1064] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:23:33.168586 19237 consensus_queue.cc:237] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 16, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:33.199236 11656 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 LEARNER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:23:33.220846 19120 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:23:33.275805 10936 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:23:33.282971 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 53657.6us
I20260709 12:23:33.277006 19278 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.285806 19278 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:33.288355 11010 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:23:33.290498 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:33.291155 10928 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
I20260709 12:23:33.292547 11082 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:23:33.293040 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:33.295064 19022 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:33.295485 19022 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.295938 19022 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:33.299227 11010 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:23:33.303213 11005 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:23:33.295583 19237 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.012s
I20260709 12:23:33.282357 19234 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:33.309351 19234 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:33.310659 19183 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:23:33.312531 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:33.313069 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:33.313863 10928 raft_consensus.cc:2393] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 17: Already voted for candidate 9e8170bbe8244e40a2b2e5011e69b697 in this term.
I20260709 12:23:33.287739 19278 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:33.311599 19234 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:33.329722 10929 raft_consensus.cc:1275] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 12:23:33.332509 10929 pending_rounds.cc:85] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697: Aborting all ops after (but not including) 13
I20260709 12:23:33.332789 10929 pending_rounds.cc:107] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 12:23:33.333025 10929 raft_consensus.cc:2889] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:33.321142 10936 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:23:33.336985 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:33.337718 11656 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:23:33.297883 19353 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 12:23:33.352202 19304 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:33.360915 19251 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 12:23:33.376163  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:33.429266 10834 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35614 (request call id 273) took 2333 ms. Trace:
I20260709 12:23:33.429775 10834 rpcz_store.cc:276] 0709 12:23:31.096291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.096462 (+   171us) service_pool.cc:224] Handling call
0709 12:23:31.101676 (+  5214us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b5400096d54. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb0eca090 00007f9bb0f68f3a 00007f9bb6d1ee9c 00007f9bb6e1d04e 00007f9bb52de2a4 00007f9bb52de232 00007f9bb52de161 00007f9bb52de0dc 00007f9bb52dd392 00007f9baf29b48c 00007f9baf29a8c6
0709 12:23:33.429188 (+2327512us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:32.803089 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:33.030535 (+227446us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:33.030580 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:23:33.030599 (+    19us) tablet.cc:662] Decoding operations
0709 12:23:33.031330 (+   731us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:33.031410 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:33.031439 (+    29us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:23:33.031831 (+   392us) tablet.cc:701] Row locks acquired
0709 12:23:33.031850 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:23:33.054338 (+ 22488us) write_op.cc:270] Start()
0709 12:23:33.054480 (+   142us) write_op.cc:276] Timestamp: P: 1783599813054284 usec, L: 0
0709 12:23:33.054504 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:23:33.055261 (+   757us) log.cc:844] Serialized 1746 byte log entry
0709 12:23:33.285386 (+230125us) op_driver.cc:464] REPLICATION: finished
0709 12:23:33.343092 (+ 57706us) write_op.cc:301] APPLY: starting
0709 12:23:33.343182 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:33.345841 (+  2659us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:33.345935 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:33.402235 (+ 56300us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:33.402443 (+   208us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:23:33.402484 (+    41us) write_op.cc:312] APPLY: finished
0709 12:23:33.402697 (+   213us) log.cc:844] Serialized 49 byte log entry
0709 12:23:33.402868 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:33.402965 (+    97us) write_op.cc:454] Released schema lock
0709 12:23:33.403005 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:33.420057 (+ 17052us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:33.420096 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":39821,"reported_tablets":6,"spinlock_wait_cycles":6374272,"child_traces":[["op",{"apply.queue_time_us":57448,"apply.run_cpu_time_us":7157,"apply.run_wall_time_us":67407,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20823,"num_ops":4,"prepare.queue_time_us":216070,"prepare.run_cpu_time_us":7453,"prepare.run_wall_time_us":343304,"replication_time_us":230727,"thread_start_us":189613,"threads_started":2}]]}
I20260709 12:23:33.430689 10830 catalog_manager.cc:5697] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 15 to 16, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:33.436239 19120 raft_consensus.cc:2955] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 LEADER]: Committing config change with OpId 25.18: config changed from index 16 to 18, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:33.437404 11004 raft_consensus.cc:2955] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Committing config change with OpId 25.18: config changed from index 16 to 18, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:33.445261 11078 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:23:33.423396 19022 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:33.456423 19353 raft_consensus.cc:2955] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:33.459352 10934 raft_consensus.cc:2955] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:33.461373 10831 catalog_manager.cc:5697] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 21 to 22, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 22 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:33.476545 10831 catalog_manager.cc:5697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 21 to 22, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 22 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:33.478505 10831 catalog_manager.cc:5697] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 20 to 21, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 21 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:33.485031 11008 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50260
I20260709 12:23:33.485790 11008 raft_consensus.cc:606] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Received request to transfer leadership
I20260709 12:23:33.501217 11051 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:33.504668 11011 raft_consensus.cc:2368] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 17. Current term is 18.
I20260709 12:23:33.507174 11007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50260
I20260709 12:23:33.507900 11007 raft_consensus.cc:606] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Received request to transfer leadership
I20260709 12:23:33.519510 11006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "015a67e38c364985be24b18358579506"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:33.520336 11006 raft_consensus.cc:606] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:33.528625 11624 leader_election.cc:400] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 pre-election: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 17. Current term is 18.
I20260709 12:23:33.529019 11624 leader_election.cc:403] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:33.507311 19150 consensus_queue.cc:1048] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 12:23:33.579033 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
W20260709 12:23:33.592118 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 63697.6us
I20260709 12:23:33.595440 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:33.596062 10929 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:33.525276 19192 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:23:33.601940 19343 raft_consensus.cc:993] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:23:33.602490 19343 raft_consensus.cc:1081] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Signalling peer 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:23:33.531368 19234 raft_consensus.cc:3060] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:23:33.615684 11007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:33.616379 10929 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:23:33.577975 19022 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:33.623689 11655 raft_consensus.cc:2955] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Committing config change with OpId 25.18: config changed from index 16 to 18, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:33.614650 19192 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.024s
I20260709 12:23:33.647224 10831 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35608 (request call id 296) took 1353 ms. Trace:
I20260709 12:23:33.617686 11007 raft_consensus.cc:606] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:33.649463 11656 raft_consensus.cc:2955] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:33.651080 10828 catalog_manager.cc:5697] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: config changed from index 12 to 14, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:33.653959 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 60045.8us
I20260709 12:23:33.655284 19234 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) with higher term. Message: Invalid argument: T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 17. Current term is 18.
W20260709 12:23:33.658336 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.663236 10928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:43552
I20260709 12:23:33.663851 10928 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:33.664256 10928 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:33.664552 19022 raft_consensus.cc:993] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:33.665069 19278 raft_consensus.cc:1081] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:33.667040 10828 catalog_manager.cc:5697] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 26 to 27, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 27 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:33.677146 11082 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60030
I20260709 12:23:33.677770 11082 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:33.678135 11082 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:33.686244 11078 raft_consensus.cc:2955] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:33.647662 10831 rpcz_store.cc:276] 0709 12:23:32.294330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.294489 (+   159us) service_pool.cc:224] Handling call
0709 12:23:33.647159 (+1352670us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:33.509784 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:33.564694 (+ 54910us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:33.564735 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:23:33.564754 (+    19us) tablet.cc:662] Decoding operations
0709 12:23:33.565345 (+   591us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:33.565407 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:33.565435 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:23:33.565765 (+   330us) tablet.cc:701] Row locks acquired
0709 12:23:33.565782 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:23:33.565936 (+   154us) write_op.cc:270] Start()
0709 12:23:33.566049 (+   113us) write_op.cc:276] Timestamp: P: 1783599813565885 usec, L: 0
0709 12:23:33.566070 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:23:33.568298 (+  2228us) log.cc:844] Serialized 1308 byte log entry
0709 12:23:33.570348 (+  2050us) op_driver.cc:464] REPLICATION: finished
0709 12:23:33.570793 (+   445us) write_op.cc:301] APPLY: starting
0709 12:23:33.570876 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:33.572913 (+  2037us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:33.573025 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:33.574849 (+  1824us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:33.575025 (+   176us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 12:23:33.575073 (+    48us) write_op.cc:312] APPLY: finished
0709 12:23:33.575289 (+   216us) log.cc:844] Serialized 41 byte log entry
0709 12:23:33.576898 (+  1609us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:33.577029 (+   131us) write_op.cc:454] Released schema lock
0709 12:23:33.577066 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:33.585267 (+  8201us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:33.585303 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":244,"apply.run_cpu_time_us":5273,"apply.run_wall_time_us":7292,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12522,"num_ops":3,"prepare.queue_time_us":342,"prepare.run_cpu_time_us":3537,"prepare.run_wall_time_us":71632,"replication_time_us":4160}]]}
I20260709 12:23:33.692384 10977 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:33.693998 10928 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:33.696591 11007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:33.697140 11007 raft_consensus.cc:606] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:33.700140 19264 raft_consensus.cc:993] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:23:33.700645 19264 raft_consensus.cc:1081] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Signalling peer 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:23:33.703558 11659 raft_consensus.cc:2468] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 18.
I20260709 12:23:33.697734 19278 raft_consensus.cc:2804] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:33.713308 19278 raft_consensus.cc:697] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:33.714221 19278 consensus_queue.cc:237] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:33.717324 11007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
new_leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:38698
I20260709 12:23:33.718014 11007 raft_consensus.cc:606] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Received request to transfer leadership to TS 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:33.728061 10928 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:33.725078 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:33.728893 11011 raft_consensus.cc:3055] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:23:33.731184 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:33.731820 11659 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:33.729194 11011 raft_consensus.cc:740] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:33.743680 11659 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 24.
I20260709 12:23:33.766099 11006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50260
I20260709 12:23:33.788620 11011 consensus_queue.cc:260] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:33.791738 11011 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:33.798867 10831 catalog_manager.cc:5697] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 16 to 18, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 25 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:33.802495 10831 catalog_manager.cc:5697] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 13 to 14, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:33.804122 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 79546us
I20260709 12:23:33.805042  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:23:33.806838  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:23:33.810494 11622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 79034.4us
I20260709 12:23:33.807677  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:33.822234 11082 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:33.829253 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:33.829903 11007 raft_consensus.cc:3055] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:23:33.830190 11007 raft_consensus.cc:740] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:33.831029 11007 consensus_queue.cc:260] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:33.848626 11011 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 24.
I20260709 12:23:33.848068 10828 catalog_manager.cc:5697] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 25 to 27, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 27 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:33.849042 11007 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:33.868903 11006 raft_consensus.cc:606] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Received request to transfer leadership
I20260709 12:23:33.869339 11006 raft_consensus.cc:614] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:33.870296 10828 catalog_manager.cc:5697] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 21 to 22, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 22 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } }
I20260709 12:23:33.849946 11082 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:33.877077 10882 auto_rebalancer.cc:893] Removing replace marker failed: Replica 2201bad9e18849b09cf82de29dd032d3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 24 committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:33.877571 10882 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:23:33.877854 10882 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:23:33.882339 11007 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:23:33.885203 10901 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:33.886874 19367 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:23:33.850868 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:33.887580 19367 raft_consensus.cc:697] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:33.887742 10927 raft_consensus.cc:3060] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:33.888650 19367 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:33.857975 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 53203us
I20260709 12:23:33.893616 11050 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:33.893970 19201 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:23:33.894610 19314 raft_consensus.cc:2804] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:23:33.895153 19314 raft_consensus.cc:697] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:33.896030 19314 consensus_queue.cc:237] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:33.911365 10927 raft_consensus.cc:2468] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:23:33.916631 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:33.919481 11082 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:33.926503 11082 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 24.
I20260709 12:23:33.948678 10927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "015a67e38c364985be24b18358579506"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:43552
I20260709 12:23:33.949458 10927 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:33.949944 10927 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:33.956382 11082 consensus_queue.cc:237] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:33.955972 11078 raft_consensus.cc:2955] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Committing config change with OpId 25.18: config changed from index 16 to 18, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:33.961306 10927 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:33.964581 10927 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:33.965231 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:33.965873 11011 raft_consensus.cc:3055] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:23:33.966225 11011 raft_consensus.cc:740] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:33.966982 11011 consensus_queue.cc:260] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:33.968109 11011 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:33.971946 11659 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:23:33.973493 19314 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:23:33.982770 11011 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 24.
I20260709 12:23:33.982793 11007 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:23:33.983985 10901 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:33.984607 19154 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:23:33.985504 19369 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:23:33.986059 19369 raft_consensus.cc:697] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:33.987008 19369 consensus_queue.cc:237] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:33.994509 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:33.995132 11082 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:34.002225 11082 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 24.
I20260709 12:23:34.007499 19154 raft_consensus.cc:2955] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Committing config change with OpId 21.17: config changed from index 16 to 17, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:34.011220 10834 catalog_manager.cc:5697] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 22 to 23, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 23 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:34.014678 19377 log.cc:927] Time spent T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:23:34.018695 11659 raft_consensus.cc:2955] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Committing config change with OpId 21.17: config changed from index 16 to 17, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:34.031795 10820 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leader transfer in progress [suppressed 5 similar messages]
W20260709 12:23:34.034907 10820 catalog_manager.cc:4755] TS 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): ChangeConfig:REMOVE_PEER RPC failed for tablet 90e76c15ad9c49ab9b98a5d216125beb: Remote error: Service unavailable: leader transfer in progress
I20260709 12:23:34.039255 10818 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 49f51062a99d4696bd7480d6804e7d72 with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:34.050755 11007 raft_consensus.cc:2955] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Committing config change with OpId 21.17: config changed from index 16 to 17, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:34.064744 10831 catalog_manager.cc:5697] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 16 to 17, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New cstate: current_term: 21 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:34.094923 19353 raft_consensus.cc:993] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:23:34.095453 19353 raft_consensus.cc:1081] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Signalling peer 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:23:34.100430 19264 raft_consensus.cc:993] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: : Instructing follower 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:23:34.100930 19264 raft_consensus.cc:1081] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Signalling peer 9e8170bbe8244e40a2b2e5011e69b697 to start an election
I20260709 12:23:34.124068 10830 catalog_manager.cc:5697] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 23 to 24, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 24 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:34.126961 10919 tablet_service.cc:1558] Processing DeleteTablet for tablet 49f51062a99d4696bd7480d6804e7d72 with delete_type TABLET_DATA_TOMBSTONED (TS 9e8170bbe8244e40a2b2e5011e69b697 not found in new config with opid_index 17) from {username='slave'} at 127.0.0.1:46716
I20260709 12:23:34.132180 10828 catalog_manager.cc:5697] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:34.153836 10936 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:43552
I20260709 12:23:34.154495 10936 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:34.154855 10936 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:34.159101 10934 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
 from {username='slave'} at 127.0.0.1:43552
I20260709 12:23:34.159783 10934 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:34.160171 10934 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:34.198623 10936 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:34.223129 19384 tablet_replica.cc:333] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:34.224344 19384 raft_consensus.cc:2243] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:34.225728 19384 raft_consensus.cc:2272] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:34.231652 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:34.232324 11656 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:34.232342 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:34.233886 11011 raft_consensus.cc:3055] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:34.234258 11011 raft_consensus.cc:740] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:34.235044 11011 consensus_queue.cc:260] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:34.233037 10830 catalog_manager.cc:5697] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 23 to 24, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 24 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:34.238838 11011 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:34.243105 10936 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:34.245647 10932 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:23:34.248085 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:34.248678 11078 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:34.260139 19248 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 12:23:34.263832 19264 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:34.266458 10934 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:34.270704 11011 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:23:34.273015 11656 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:23:34.276999 10901 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:34.280503 10934 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:34.281618 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:34.282238 11082 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:34.282857 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:34.283670 11078 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:23:34.264482 19264 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:34.293236 19369 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.296744 11082 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:23:34.286374 19237 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:34.299189 11011 raft_consensus.cc:3055] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:34.299620 11011 raft_consensus.cc:740] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:34.301241 11011 consensus_queue.cc:260] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:34.299203 10899 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:34.304004 19350 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:34.304566 19350 raft_consensus.cc:697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:34.305473 19350 consensus_queue.cc:237] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:34.311375 11082 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:23:34.314057 11079 raft_consensus.cc:1240] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:34.319911 19237 raft_consensus.cc:697] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:34.320942 19264 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:34.320974 19237 consensus_queue.cc:237] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:34.331022 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:34.332371 19367 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:23:34.336403 11011 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:34.339679 10930 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:23:34.342590 19304 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:34.315187 19369 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:34.343951 10934 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 23.
I20260709 12:23:34.345373 19369 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:34.349620 11656 raft_consensus.cc:1275] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:23:34.350059 10820 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 90e76c15ad9c49ab9b98a5d216125beb with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER failed with leader 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2201bad9e18849b09cf82de29dd032d3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:34.351233 19384 ts_tablet_manager.cc:1916] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:34.352030 10977 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:34.352921 19264 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:34.353300 19264 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:34.353650 19264 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:34.356706 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:34.357836 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:34.358496 11079 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23.
I20260709 12:23:34.360190 11659 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:23:34.360996 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:34.361711 11078 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 23: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:34.362984 11007 raft_consensus.cc:1275] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:23:34.363137 19264 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:34.364766 10899 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:34.365955 19367 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:34.368021 19314 consensus_queue.cc:1048] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:34.371554 19264 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:34.372085 11004 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 23.
I20260709 12:23:34.377123 19248 consensus_queue.cc:1048] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:34.383881 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:34.368268 19367 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:23:34.386010 19367 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.397277 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:34.397584 11011 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 20.
I20260709 12:23:34.398267 11079 raft_consensus.cc:2393] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 23: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:34.405364 11078 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:23:34.391645 19367 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:34.440208 10936 raft_consensus.cc:1240] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:34.440289 19350 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
W20260709 12:23:34.471477 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 55464.8us
W20260709 12:23:34.554992 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 78773.3us
W20260709 12:23:34.626524 19387 log.cc:927] Time spent T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:23:34.633747 19385 log.cc:927] Time spent T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:23:34.672374 11011 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:23:34.719693 19395 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:23:34.819795 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 136510us
I20260709 12:23:34.929847 19367 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:34.933647 19367 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:34.935242 10929 raft_consensus.cc:2368] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 23. Current term is 24.
W20260709 12:23:34.942809 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 122305us
I20260709 12:23:34.946720 10831 catalog_manager.cc:5697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 19 to 20, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 20 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:34.961414 19384 ts_tablet_manager.cc:1929] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.16
I20260709 12:23:34.961936 19384 log.cc:1199] T 49f51062a99d4696bd7480d6804e7d72 P 9e8170bbe8244e40a2b2e5011e69b697: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-0-root/wals/49f51062a99d4696bd7480d6804e7d72
I20260709 12:23:34.967990 10831 catalog_manager.cc:5697] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 19 to 20, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65). New cstate: current_term: 20 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:34.989064 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 103910us
I20260709 12:23:34.994808 10977 leader_election.cc:400] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 23. Current term is 24.
I20260709 12:23:34.995210 10977 leader_election.cc:403] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 12:23:34.999883 11081 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:23:35.007392 19248 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:35.016000 11655 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:23:35.028488 19418 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 12:23:35.057649 10821 catalog_manager.cc:5028] TS 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): tablet 49f51062a99d4696bd7480d6804e7d72 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:23:35.076730 11007 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:23:35.078909 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:35.084939 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:35.085611 11082 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:35.086784 11005 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:23:35.106554 11082 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 24.
I20260709 12:23:35.113643 19248 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109) with higher term. Message: Invalid argument: T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 for earlier term 23. Current term is 24.
I20260709 12:23:35.114118 11082 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:23:35.156201 11011 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:23:35.154749 11007 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8170bbe8244e40a2b2e5011e69b697 in term 24.
I20260709 12:23:35.172719 19418 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:35.177441 10899 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697; no voters: 
I20260709 12:23:35.179078 19369 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:23:35.179749 19369 raft_consensus.cc:697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 LEADER]: Becoming Leader. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:35.180601 19369 consensus_queue.cc:237] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:35.194205 19198 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:35.196177 19399 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:35.198662 19412 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:35.199156 19402 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:35.244694  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:35.339754 10834 catalog_manager.cc:5697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:35.510766 10929 consensus_queue.cc:237] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:35.530097 11081 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:35562
I20260709 12:23:35.530714 11081 raft_consensus.cc:606] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:35.531738 10928 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:35.541568 11659 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 12:23:35.560005 19418 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:23:35.565362 11656 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:23:35.573393 11081 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:35562
I20260709 12:23:35.574031 11084 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 12:23:35.574167 11081 raft_consensus.cc:606] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:35.577728 19369 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:23:35.586783 10928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:23:35.587536 10928 raft_consensus.cc:606] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:35.596139 10928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839"
dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
mode: GRACEFUL
new_leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:57884
I20260709 12:23:35.596768 10928 raft_consensus.cc:606] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Received request to transfer leadership to TS 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:35.599486 11006 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:23:35.601259 11084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3625831778d468cb424c06fc474c323"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
new_leader_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:35562
I20260709 12:23:35.601864 11084 raft_consensus.cc:606] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 LEADER]: Received request to transfer leadership to TS 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:35.603354  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:35.604007 19418 raft_consensus.cc:2955] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 LEADER]: Committing config change with OpId 24.16: config changed from index 14 to 16, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:35.605189  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:35.606057  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:35.608047 11659 raft_consensus.cc:2955] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 14 to 16, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:35.612063 19392 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:35.620775 11081 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:23:35.635356 19198 raft_consensus.cc:2955] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 LEADER]: Committing config change with OpId 25.19: config changed from index 18 to 19, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:35.645388 19369 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:23:35.645252 11655 raft_consensus.cc:2955] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Committing config change with OpId 25.19: config changed from index 18 to 19, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:35.654456 19413 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:35.670948 11084 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:23:35.672467 10821 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8151fe64a0a84d44a837cc6abf316707 with cas_config_opid_index 18: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:35.766831 10834 catalog_manager.cc:5697] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 14 to 16, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New cstate: current_term: 24 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:35.768453 10834 catalog_manager.cc:5697] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 18 to 19, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New cstate: current_term: 25 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:35.819060 10995 tablet_service.cc:1558] Processing DeleteTablet for tablet 0cb303f7380c4693b70bda660f0f86a6 with delete_type TABLET_DATA_TOMBSTONED (TS 2201bad9e18849b09cf82de29dd032d3 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:50260
I20260709 12:23:35.844785 10996 tablet_service.cc:1558] Processing DeleteTablet for tablet 8151fe64a0a84d44a837cc6abf316707 with delete_type TABLET_DATA_TOMBSTONED (TS 2201bad9e18849b09cf82de29dd032d3 not found in new config with opid_index 19) from {username='slave'} at 127.0.0.1:50260
I20260709 12:23:35.850585 10821 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0cb303f7380c4693b70bda660f0f86a6 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:35.861429 11084 raft_consensus.cc:2955] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 14 to 16, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:35.884070 19418 raft_consensus.cc:993] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:35.884611 19198 raft_consensus.cc:1081] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:35.886966 11006 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37586
I20260709 12:23:35.887637 11006 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:35.888091 11006 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:35.903204 19150 raft_consensus.cc:993] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:35.904068 19150 raft_consensus.cc:1081] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:35.903846 11006 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:35.905802 11081 raft_consensus.cc:2955] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Committing config change with OpId 25.19: config changed from index 18 to 19, VOTER 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:35.909108 19192 raft_consensus.cc:993] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:35.909608 19192 raft_consensus.cc:1081] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:35.915839 19441 tablet_replica.cc:333] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:35.928107 19415 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:35.930295 11006 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:35.931589 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 73187us
I20260709 12:23:35.932190 19441 raft_consensus.cc:2243] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:35.935240 19441 raft_consensus.cc:2272] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.944985 11004 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3625831778d468cb424c06fc474c323"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37594
I20260709 12:23:35.945643 11004 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:35.946015 11004 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:35.958345 19441 ts_tablet_manager.cc:1916] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:35.972366 11006 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37594
I20260709 12:23:35.973074 11006 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:35.973456 11006 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:23:35.983790 11006 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:35.992388 11006 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 27 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:36.048019 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:36.048664 11084 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:36.057565 11084 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 25.
I20260709 12:23:36.059121 19441 ts_tablet_manager.cc:1929] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 24.15
I20260709 12:23:36.062824 19441 log.cc:1199] T 0cb303f7380c4693b70bda660f0f86a6 P 2201bad9e18849b09cf82de29dd032d3: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-1-root/wals/0cb303f7380c4693b70bda660f0f86a6
I20260709 12:23:36.064949 19441 tablet_replica.cc:333] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:36.065622 10820 catalog_manager.cc:5028] TS 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): tablet 0cb303f7380c4693b70bda660f0f86a6 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:23:36.070947 19407 raft_consensus.cc:993] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:36.073346 19407 raft_consensus.cc:1081] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:36.078089 10974 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:36.088769 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:36.090056 10928 raft_consensus.cc:3055] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:23:36.090366 10928 raft_consensus.cc:740] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:36.099567 10928 consensus_queue.cc:260] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:36.100828 10928 raft_consensus.cc:3060] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:36.106536 11004 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:36.109431 11004 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:36.130595 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:36.131295 10929 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:23:36.140605 10929 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 27.
I20260709 12:23:36.143433 19248 raft_consensus.cc:2804] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:23:36.144073 19248 raft_consensus.cc:697] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:36.145012 19248 consensus_queue.cc:237] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:36.205518 10932 raft_consensus.cc:1240] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 26. Current term is 27. Ops: []
I20260709 12:23:36.207517 19407 consensus_queue.cc:1059] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:23:36.208813 19150 raft_consensus.cc:3055] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:23:36.209226 19150 raft_consensus.cc:740] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:36.210078 19150 consensus_queue.cc:260] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:36.211054 19150 raft_consensus.cc:3060] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:23:36.229357 11050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.270926 10928 raft_consensus.cc:2468] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 25.
I20260709 12:23:36.288201 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:36.288910 10934 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:36.309618 10934 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 26.
I20260709 12:23:36.315416 19441 raft_consensus.cc:2243] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.316638 19441 raft_consensus.cc:2272] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:36.316587 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 238564us
I20260709 12:23:36.322479 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:36.330138 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:36.330835 11079 raft_consensus.cc:3055] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:23:36.331131 11079 raft_consensus.cc:740] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:36.341815 10830 catalog_manager.cc:5697] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 24 to 25, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 25 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:36.345099 11006 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37594
I20260709 12:23:36.345765 11006 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:36.346104 11006 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:36.349922 11081 raft_consensus.cc:2468] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 27.
I20260709 12:23:36.334671 11079 consensus_queue.cc:260] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:36.353087 11079 raft_consensus.cc:3060] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:36.367445 11007 raft_consensus.cc:1240] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 25. Current term is 26. Ops: []
I20260709 12:23:36.375356 11006 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:36.387800 10928 consensus_queue.cc:237] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:36.395020 19441 ts_tablet_manager.cc:1916] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:36.404707 10974 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:36.408162 19022 raft_consensus.cc:2804] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:23:36.439399 11006 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:36.441107 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 49316.8us
I20260709 12:23:36.445984 11079 raft_consensus.cc:2468] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 26.
I20260709 12:23:36.448846 10974 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:36.459901 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:36.460515 11078 raft_consensus.cc:3055] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:23:36.460835 11078 raft_consensus.cc:740] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:36.461542 11078 consensus_queue.cc:260] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:36.461884 19256 raft_consensus.cc:2804] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:23:36.462410 19256 raft_consensus.cc:697] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:36.462646 11078 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:36.469409 19256 consensus_queue.cc:237] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:36.480470 11078 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 23.
I20260709 12:23:36.508579 10974 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:23:36.509222 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 96796.8us
I20260709 12:23:36.519655 19248 raft_consensus.cc:2804] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:23:36.520300 19248 raft_consensus.cc:697] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:36.521210 19248 consensus_queue.cc:237] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:36.526793 10902 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.538913 19022 raft_consensus.cc:697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 27 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:36.542610 19022 consensus_queue.cc:237] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:36.599074 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 53721.5us
W20260709 12:23:36.600914 10900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 180300us
W20260709 12:23:36.625533 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 180891us
I20260709 12:23:36.637199 19449 raft_consensus.cc:993] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697: : Instructing follower 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:36.637768 19449 raft_consensus.cc:1081] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Signalling peer 1abf4b385a2b493ab83f593a1f8c9cd1 to start an election
I20260709 12:23:36.642127 11078 raft_consensus.cc:1240] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 24. Current term is 25. Ops: []
I20260709 12:23:36.662204 11078 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
 from {username='slave'} at 127.0.0.1:60046
I20260709 12:23:36.662791 11078 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:36.663147 11078 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:36.675661 11078 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:36.679957 11006 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 12:23:36.681563 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 77242.2us
I20260709 12:23:36.683347 11655 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Refusing update from remote peer 9e8170bbe8244e40a2b2e5011e69b697: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:23:36.691027 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:36.693538 11007 raft_consensus.cc:1240] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 22. Current term is 23. Ops: []
I20260709 12:23:36.697368 11078 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:36.700404 10928 raft_consensus.cc:3055] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:23:36.700809 10928 raft_consensus.cc:740] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9e8170bbe8244e40a2b2e5011e69b697, State: Running, Role: LEADER
I20260709 12:23:36.699908 19461 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 12:23:36.723973 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:36.724640 11007 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:36.701509 10928 consensus_queue.cc:260] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:36.735988 19402 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:23:36.741482 11007 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:23:36.750059 11050 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:36.756222 10927 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
W20260709 12:23:36.778620 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 170502us
I20260709 12:23:36.782893 19192 raft_consensus.cc:2804] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:23:36.799183 19256 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 12:23:36.813321 10934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: true dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697"
I20260709 12:23:36.833050 10934 raft_consensus.cc:3060] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:36.840919 11078 raft_consensus.cc:1275] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 12:23:36.855155 10934 raft_consensus.cc:2468] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 23.
I20260709 12:23:36.856169  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:36.951385 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 166379us
W20260709 12:23:36.975337 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 180560us
W20260709 12:23:36.955034 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 106059us
I20260709 12:23:36.948552 19192 raft_consensus.cc:697] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:36.935946 19454 consensus_queue.cc:1048] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
W20260709 12:23:37.055311 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 77828.6us
W20260709 12:23:37.060075 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 56166.1us
I20260709 12:23:37.052204 19441 ts_tablet_manager.cc:1929] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 25.18
I20260709 12:23:37.096680 19441 log.cc:1199] T 8151fe64a0a84d44a837cc6abf316707 P 2201bad9e18849b09cf82de29dd032d3: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-1-root/wals/8151fe64a0a84d44a837cc6abf316707
I20260709 12:23:37.109992 19441 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50260 (request call id 18) took 1265 ms. Trace:
I20260709 12:23:37.110395 19441 rpcz_store.cc:276] 0709 12:23:35.844241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.844478 (+   237us) service_pool.cc:224] Handling call
0709 12:23:36.064604 (+220126us) ts_tablet_manager.cc:1151] Deleting tablet 8151fe64a0a84d44a837cc6abf316707
0709 12:23:36.064660 (+    56us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:23:36.725579 (+660919us) tablet_metadata.cc:665] Metadata flushed
0709 12:23:36.993351 (+267772us) tablet_metadata.cc:665] Metadata flushed
0709 12:23:37.109916 (+116565us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":253910,"tablet-delete.queue_time_us":219148}
I20260709 12:23:37.114842 10830 catalog_manager.cc:5697] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 26 to 27, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 27 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:37.116671 10830 catalog_manager.cc:5697] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 25 to 26, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 26 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:37.116968 19192 consensus_queue.cc:237] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:37.126479 19470 log.cc:927] Time spent T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:23:37.136420 10830 catalog_manager.cc:5697] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 22 to 23, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 23 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:37.145301 10928 raft_consensus.cc:3060] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:37.152653 19406 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:37.153311 19406 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:37.166436 10928 raft_consensus.cc:2468] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:23:37.164894 19406 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:23:37.170533 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 182285us
W20260709 12:23:37.176102 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 125448us
W20260709 12:23:37.200173 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 222074us
I20260709 12:23:37.213308 10820 catalog_manager.cc:5028] TS 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): tablet 8151fe64a0a84d44a837cc6abf316707 (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
W20260709 12:23:37.237582 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:37.238144 10899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.240470 10927 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:23:37.250218 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:23:37.258597 10820 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 45306.1us
I20260709 12:23:37.265810 10927 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 12:23:37.276216 11010 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 22. Current term is 23. Ops: []
I20260709 12:23:37.282716 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:37.288848 19022 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:23:37.307302 11049 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:37.321046 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9e8170bbe8244e40a2b2e5011e69b697" is_pre_election: true
I20260709 12:23:37.329134 11081 raft_consensus.cc:1275] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:23:37.330926 11082 raft_consensus.cc:1275] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:23:37.333338 19396 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:37.339133 11079 raft_consensus.cc:1275] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 12:23:37.354380 19451 consensus_queue.cc:1048] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:37.354053 19457 raft_consensus.cc:2955] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Committing config change with OpId 20.16: config changed from index 14 to 16, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:37.360491 19447 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:23:37.368157 11656 raft_consensus.cc:2955] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 14 to 16, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:37.360232 19445 consensus_queue.cc:1048] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.016s
I20260709 12:23:37.378033 11084 raft_consensus.cc:1240] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Rejecting Update request from peer 9e8170bbe8244e40a2b2e5011e69b697 for earlier term 22. Current term is 23. Ops: []
I20260709 12:23:37.403013 10828 catalog_manager.cc:5697] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 22 to 23, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 23 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:37.423532 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 136040us
I20260709 12:23:37.423908 11004 raft_consensus.cc:2955] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 14 to 16, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:37.464509 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 44365.5us
I20260709 12:23:37.464428 10834 catalog_manager.cc:5697] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 14 to 16, VOTER 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) evicted. New cstate: current_term: 20 leader_uuid: "9e8170bbe8244e40a2b2e5011e69b697" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:37.467237 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 48014.9us
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:461: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
I20260709 12:23:37.531001  9741 tablet_server.cc:179] TabletServer@127.9.131.65:0 shutting down...
W20260709 12:23:37.614328 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 47498.4us
W20260709 12:23:37.619232 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 143044us
W20260709 12:23:37.624985 11051 consensus_peers.cc:597] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:37.625002 19454 consensus_queue.cc:1048] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
W20260709 12:23:37.625792 11051 consensus_peers.cc:597] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.626348 11051 consensus_peers.cc:597] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:37.600801 19457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46716 (request call id 9) took 1212 ms. Trace:
W20260709 12:23:37.707931 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 50314us
W20260709 12:23:37.740082 11051 consensus_peers.cc:597] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:37.629210 19457 rpcz_store.cc:276] 0709 12:23:36.385596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.385726 (+   130us) service_pool.cc:224] Handling call
0709 12:23:36.427165 (+ 41439us) log.cc:844] Serialized 494 byte log entry
0709 12:23:37.597499 (+1170334us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27536,"raft.run_cpu_time_us":1817,"raft.run_wall_time_us":147219,"spinlock_wait_cycles":1756544,"thread_start_us":148750,"threads_started":1,"wal-append.queue_time_us":208796}
W20260709 12:23:37.850234 10977 consensus_peers.cc:597] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.850967 10977 consensus_peers.cc:597] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.851666 10977 consensus_peers.cc:597] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.852587 10977 consensus_peers.cc:597] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.853169 10977 consensus_peers.cc:597] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.853683 10977 consensus_peers.cc:597] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.854224 10977 consensus_peers.cc:597] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.854784 10977 consensus_peers.cc:597] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.855370 10977 consensus_peers.cc:597] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:37.887398 10821 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 90e76c15ad9c49ab9b98a5d216125beb with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 8)
I20260709 12:23:37.889329 19198 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.889892 19198 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:37.892105 19198 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:37.916334 10977 consensus_peers.cc:597] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.918641 10977 consensus_peers.cc:597] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.924877 10977 consensus_peers.cc:597] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.934515 10901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 44289.8us
I20260709 12:23:37.938668 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:23:37.945761 10977 consensus_peers.cc:597] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.970186 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 293730us
W20260709 12:23:37.970036 11625 consensus_peers.cc:597] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.972498 11625 consensus_peers.cc:597] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.975137 11625 consensus_peers.cc:597] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.975603 11051 consensus_peers.cc:597] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:37.992288 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:23:37.989857 11625 consensus_peers.cc:597] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:37.996752 11006 raft_consensus.cc:1275] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 12:23:38.001551 11625 consensus_peers.cc:597] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:38.033196 10977 consensus_peers.cc:597] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:38.038450 11051 consensus_peers.cc:597] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:38.040505 10899 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:38.046787 19491 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:23:38.046756 19192 consensus_queue.cc:1048] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
W20260709 12:23:38.055812 11625 consensus_peers.cc:597] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:38.058936 11625 consensus_peers.cc:597] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:38.080420 11051 consensus_peers.cc:597] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:38.110855 19491 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.125895 19491 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:38.129071 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:23:38.131789 11051 consensus_peers.cc:597] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:38.132339 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 47847us
W20260709 12:23:38.132992 11051 consensus_peers.cc:597] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:38.133579 11051 consensus_peers.cc:597] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:38.138398 10977 consensus_peers.cc:597] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:38.140029 11051 consensus_peers.cc:597] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:38.141209 10830 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35614 (request call id 285) took 1196 ms. Trace:
I20260709 12:23:38.141573 10830 rpcz_store.cc:276] 0709 12:23:36.944391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.944598 (+   207us) service_pool.cc:224] Handling call
0709 12:23:38.141161 (+1196563us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:37.586415 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:37.586963 (+   548us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:37.586998 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:23:37.587015 (+    17us) tablet.cc:662] Decoding operations
0709 12:23:37.587552 (+   537us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:37.587605 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:37.587631 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:23:37.587977 (+   346us) tablet.cc:701] Row locks acquired
0709 12:23:37.587994 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:23:37.588150 (+   156us) write_op.cc:270] Start()
0709 12:23:37.588262 (+   112us) write_op.cc:276] Timestamp: P: 1783599817588104 usec, L: 0
0709 12:23:37.588286 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:23:37.588945 (+   659us) log.cc:844] Serialized 1308 byte log entry
0709 12:23:37.832107 (+243162us) op_driver.cc:464] REPLICATION: finished
0709 12:23:38.072900 (+240793us) write_op.cc:301] APPLY: starting
0709 12:23:38.073008 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:38.075340 (+  2332us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:38.075444 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:38.077711 (+  2267us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:38.077927 (+   216us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 12:23:38.077969 (+    42us) write_op.cc:312] APPLY: finished
0709 12:23:38.078173 (+   204us) log.cc:844] Serialized 41 byte log entry
0709 12:23:38.078361 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:38.078446 (+    85us) write_op.cc:454] Released schema lock
0709 12:23:38.078487 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:38.111899 (+ 33412us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:38.113402 (+  1503us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":38153,"reported_tablets":3,"spinlock_wait_cycles":294784,"child_traces":[["op",{"apply.queue_time_us":239610,"apply.run_cpu_time_us":6105,"apply.run_wall_time_us":21050,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16649,"num_ops":3,"prepare.queue_time_us":444653,"prepare.run_cpu_time_us":2828,"prepare.run_wall_time_us":2827,"replication_time_us":238879,"thread_start_us":546391,"threads_started":2}]]}
W20260709 12:23:38.173416 11051 consensus_peers.cc:597] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:38.171492 19491 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:38.190006 11051 consensus_peers.cc:597] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:38.205031 11067 tablet_service.cc:1558] Processing DeleteTablet for tablet 90e76c15ad9c49ab9b98a5d216125beb with delete_type TABLET_DATA_TOMBSTONED (TS 1abf4b385a2b493ab83f593a1f8c9cd1 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:39448
I20260709 12:23:38.218863 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.228565 10899 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:38.244100 19487 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:23:38.261009 19487 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:38.261601 19487 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:38.264393 19487 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:38.272637 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.279637 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:38.285367 10901 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:38.287087 19488 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:23:38.270771 19477 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:38.267784 19475 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:38.296275 19477 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:38.296849 19475 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:38.308236 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:38.310372 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:38.282644 19487 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:38.321470 10901 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:38.324048 19487 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:38.312760 19475 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:38.331070 19461 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:38.337390 19477 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:38.343680 19487 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:38.338306 19518 tablet_replica.cc:333] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:23:38.345249 19518 raft_consensus.cc:2243] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.346213 19518 raft_consensus.cc:2272] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.349527 19518 ts_tablet_manager.cc:1916] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:38.403054 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.424922 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.459663 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:38.460213 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:38.473436  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:38.487033 10901 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:38.491194  9741 tablet_replica.cc:333] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:38.506233  9741 raft_consensus.cc:2243] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:23:38.506784 19488 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:38.507647 19488 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:38.515843 19488 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:38.522943 19491 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:38.525275 10901 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:38.540299 19477 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:38.549014  9741 raft_consensus.cc:2272] T e6f7148e567a4f6da2aa56002e55b027 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.563805 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:38.570721 19491 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:38.571096  9741 tablet_replica.cc:333] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:38.572093 19491 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:38.598606 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:38.600625 19491 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:38.608754 19477 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:38.610153 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.609457 19477 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:38.591039  9741 raft_consensus.cc:2243] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.630216  9741 raft_consensus.cc:2272] T c4e2dd59ef5642098b4166c9da8d596d P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.633576  9741 tablet_replica.cc:333] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:38.636451 19477 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:38.637336 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:38.636756 19491 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:38.639988 19491 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:38.642601 19491 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:38.644802 10899 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:38.646059 19491 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:23:38.644717 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:38.659407  9741 raft_consensus.cc:2243] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:23:38.661240 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.661924 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.662622 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.661157  9741 raft_consensus.cc:2272] T 8151fe64a0a84d44a837cc6abf316707 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.677352 10899 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:38.681403 10899 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:38.683387 10899 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:38.684329 19491 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:38.688906 19461 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:23:38.682842 19477 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:38.705688 19518 ts_tablet_manager.cc:1929] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.15
I20260709 12:23:38.706318 19518 log.cc:1199] T 90e76c15ad9c49ab9b98a5d216125beb P 1abf4b385a2b493ab83f593a1f8c9cd1: Deleting WAL directory at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0/minicluster-data/ts-2-root/wals/90e76c15ad9c49ab9b98a5d216125beb
I20260709 12:23:38.704960  9741 tablet_replica.cc:333] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:38.712410  9741 raft_consensus.cc:2243] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:23:38.715981  9741 raft_consensus.cc:2272] T e4d1425ae0d743b7be813705b92d4e15 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.720067  9741 tablet_replica.cc:333] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:38.721098  9741 raft_consensus.cc:2243] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.722416  9741 raft_consensus.cc:2272] T f56f49dc9fb94be0bc1eba5a2b97049c P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.726222  9741 tablet_replica.cc:333] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:38.727361  9741 raft_consensus.cc:2243] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.729821  9741 raft_consensus.cc:2272] T 80db8b3fbfd046e8a5535ff4a7380107 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.741648 19491 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:38.742661 19491 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:38.747009  9741 tablet_replica.cc:333] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:38.746768 10818 catalog_manager.cc:5028] TS 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): tablet 90e76c15ad9c49ab9b98a5d216125beb (table test-workload [id=906672b2a77d42dfa752d2a0c0e57a27]) successfully deleted
I20260709 12:23:38.749516 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:38.748319  9741 raft_consensus.cc:2243] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.752019 19491 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:38.753301  9741 raft_consensus.cc:2272] T c88db1b2c7304a19a16c4f9b17c02e8e P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.755254 19491 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:38.756035 19491 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:38.756273 19461 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:38.758956 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:38.763734 10901 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:38.765936 19477 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:38.765746 19461 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:38.766866 19488 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:38.767485 19488 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:38.768374 19453 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:38.768587 19198 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:38.769169 19453 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:38.769809 19461 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:38.770170 19488 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:38.771503 19453 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:38.771775 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:38.771776 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:38.783841 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:38.786429 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:38.772526 19491 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:38.769194 19198 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:38.789947 19198 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:38.777524 19487 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:38.779276 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:38.791049 19487 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:38.793577 19487 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:38.794296  9741 tablet_replica.cc:333] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:38.797699 19453 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:38.798570 19453 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:38.798668 19477 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:38.799513 19477 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:38.794219 19487 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:38.801963 19487 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:38.804620 19198 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.805301 19198 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:38.807478 19198 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:38.808718 19477 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:38.809301 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:38.809754 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:38.810612 19487 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:38.809005 19491 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:38.811619 19491 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:38.812999 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:38.813913 19491 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:38.816882 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.817418 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.818799 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.820127 19453 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:38.821157 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:38.822703 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.824476 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:38.825738 19453 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:38.826403 19453 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:38.828279 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:38.830260 10901 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:38.830874 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.831138 19473 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:38.831524 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:38.831768 19473 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:38.832294 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:38.832960 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:38.833981 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.836397 10901 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:38.836042 19473 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:38.837422 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.838482 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.835346 19491 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:23:38.840217 10899 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:38.821429 19198 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:38.846164 10899 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:38.847223  9741 raft_consensus.cc:2243] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.847934 10899 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:38.848834 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.849656 10899 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:38.851104  9741 raft_consensus.cc:2272] T 6aa58b8bde194f658aced897744b4d35 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.851516 19461 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:38.845750 19491 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:38.849196 19488 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:23:38.848085 19473 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:38.854735 19198 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:38.857074 19198 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:38.845314 19487 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:38.859573  9741 tablet_replica.cc:333] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:38.860737  9741 raft_consensus.cc:2243] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:23:38.868276  9741 raft_consensus.cc:2272] T 015a67e38c364985be24b18358579506 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.869429 19453 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:38.877345 10901 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:38.880571 19521 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:23:38.883934 10901 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:38.886677 19521 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:38.878906  9741 tablet_replica.cc:333] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
W20260709 12:23:38.901757 10899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 52188.2us
I20260709 12:23:38.902889 10899 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:38.894425  9741 raft_consensus.cc:2243] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.903782 19461 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:38.908587  9741 pending_rounds.cc:70] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697: Trying to abort 1 pending ops.
I20260709 12:23:38.908959  9741 pending_rounds.cc:77] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697: Aborting op as it isn't in flight: id { term: 25 index: 13 } timestamp: 7305624846939422720 op_type: NO_OP noop_request { }
I20260709 12:23:38.905254 10899 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:38.909508  9741 raft_consensus.cc:2889] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:23:38.909196 10901 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:38.910398 19461 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:23:38.912683 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:38.912776 19521 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:38.913545 19521 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:38.909950  9741 raft_consensus.cc:2272] T 9a101fb991414a5f840476aaa2d8e5b3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.915894 19521 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:38.916373 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:38.916566 19521 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:38.918994  9741 tablet_replica.cc:333] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:38.918699 19521 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:38.917371 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:38.920306  9741 raft_consensus.cc:2243] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.921300 19520 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:38.921905 19520 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:38.923614 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:38.925588 19520 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:38.925357 19521 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:38.928112 19453 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:38.928763 19453 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:38.930863 19453 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:38.931797  9741 raft_consensus.cc:2272] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.944850 19461 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:38.946293 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.947280 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.948191 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.948587 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.947610 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.950215  9741 tablet_replica.cc:333] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:38.951318  9741 raft_consensus.cc:2243] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.948452 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.954726 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:38.957901 19453 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:38.958660 19453 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:38.961002 19453 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:38.962157 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:38.968372 10899 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:38.976927 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:38.980963 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:38.983479 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "9e8170bbe8244e40a2b2e5011e69b697" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:38.985782  9741 raft_consensus.cc:2272] T 9b6c427f0a234dbab806dced4d3ba0fb P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.994861 19453 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:39.008963  9741 tablet_replica.cc:333] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.010083  9741 raft_consensus.cc:2243] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.010700  9741 raft_consensus.cc:2272] T f0bf4b65018642ba928b62c815b01489 P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.012073 10899 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:39.012964 19520 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:39.014299  9741 tablet_replica.cc:333] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.010891 10901 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:39.016820 10901 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:39.017657 19521 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:39.016655 19520 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:39.018955 10901 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:39.019742 19521 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:39.020967 10901 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:39.016714  9741 raft_consensus.cc:2243] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.025774 10901 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:39.026712  9741 raft_consensus.cc:2272] T bda5e552d0f54d1daafad75449fbb509 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.030767 19520 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:39.025492 19521 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:39.039644 10901 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8170bbe8244e40a2b2e5011e69b697; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:39.041527  9741 tablet_replica.cc:333] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.042513  9741 raft_consensus.cc:2243] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:23:39.043635 19520 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:23:39.051534 11625 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 107 similar messages]
I20260709 12:23:39.066107  9741 raft_consensus.cc:2272] T dc9fc876e22f4072a34df693254c2f5e P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.075850  9741 tablet_replica.cc:333] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.076776  9741 raft_consensus.cc:2243] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.077581  9741 raft_consensus.cc:2272] T 83b4e206b7694af695234c0e758055e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.137494  9741 tablet_replica.cc:333] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.214754  9741 raft_consensus.cc:2243] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.220022  9741 raft_consensus.cc:2272] T 62cfdf78af4046beba4a418e904e80b1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.231452  9741 tablet_replica.cc:333] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.232764  9741 raft_consensus.cc:2243] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.233529  9741 raft_consensus.cc:2272] T b1c7453ea4954ac4ad9465233dd1e839 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.238258  9741 tablet_replica.cc:333] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.239351  9741 raft_consensus.cc:2243] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.256206  9741 raft_consensus.cc:2272] T 38e2bba2f11943899027eb26325e2b6a P 9e8170bbe8244e40a2b2e5011e69b697 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.259583  9741 tablet_replica.cc:333] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.260643  9741 raft_consensus.cc:2243] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:23:39.268208  9741 raft_consensus.cc:2272] T 0774d95f5c1b4bdb990e50f5d858b600 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.281188  9741 tablet_replica.cc:333] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.282300  9741 raft_consensus.cc:2243] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.283192  9741 raft_consensus.cc:2272] T c9432c125c17431e881ba1329e02a201 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.294589  9741 tablet_replica.cc:333] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.295466  9741 raft_consensus.cc:2243] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.304177  9741 raft_consensus.cc:2272] T d3426d7ccdd943b882b65c3977a20040 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.307281  9741 tablet_replica.cc:333] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.308245  9741 raft_consensus.cc:2243] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.309039  9741 raft_consensus.cc:2272] T c486c31e8ba74d8a9b17989a20d141bf P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.340056  9741 tablet_replica.cc:333] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.342170  9741 raft_consensus.cc:2243] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.342905  9741 raft_consensus.cc:2272] T d88dec874a3240d69746dfb302cf057e P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.350241  9741 tablet_replica.cc:333] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.351058  9741 raft_consensus.cc:2243] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.351985  9741 raft_consensus.cc:2272] T 660a349ad34749648cae6a025708c84d P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.362620  9741 tablet_replica.cc:333] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.363547  9741 raft_consensus.cc:2243] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:23:39.364936  9741 raft_consensus.cc:2272] T d9b41c3859494dab9f6f8bc6bccc8062 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.368458  9741 tablet_replica.cc:333] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.369701  9741 raft_consensus.cc:2243] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.370592  9741 raft_consensus.cc:2272] T e76df1b7dc3b4bada7c1112da8ce327b P 9e8170bbe8244e40a2b2e5011e69b697 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.376600  9741 tablet_replica.cc:333] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.377533  9741 raft_consensus.cc:2243] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.378428  9741 raft_consensus.cc:2272] T 11f1b75a0edb45d493bb20e8a0f34156 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.391588  9741 tablet_replica.cc:333] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.393832  9741 raft_consensus.cc:2243] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.394438  9741 raft_consensus.cc:2272] T a8c81137a7dc49c9953309b2d9d22d7e P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.402123  9741 tablet_replica.cc:333] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.403028  9741 raft_consensus.cc:2243] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.403733  9741 raft_consensus.cc:2272] T b156bebcd53a4b6ea1f83c42906a5a03 P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.407078  9741 tablet_replica.cc:333] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.407927  9741 raft_consensus.cc:2243] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.408540  9741 raft_consensus.cc:2272] T 5b7e00767e0a443fab6f928812d5f6e2 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.411448  9741 tablet_replica.cc:333] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.412261  9741 raft_consensus.cc:2243] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.412952  9741 raft_consensus.cc:2272] T 07467552f78d410bb9e5774f3340f134 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.418092  9741 tablet_replica.cc:333] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.418999  9741 raft_consensus.cc:2243] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:23:39.420174  9741 raft_consensus.cc:2272] T 9b668506e6eb4a57aa83a9e45c3eb356 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.435410  9741 tablet_replica.cc:333] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.436483  9741 raft_consensus.cc:2243] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:23:39.437680  9741 raft_consensus.cc:2272] T f1b28a94627d4cbd8f41c75a4ef23953 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.440820  9741 tablet_replica.cc:333] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.441641  9741 raft_consensus.cc:2243] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:23:39.442763  9741 raft_consensus.cc:2272] T 597a004d154c4012ba8a1037b80c0109 P 9e8170bbe8244e40a2b2e5011e69b697 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.449473  9741 tablet_replica.cc:333] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.450310  9741 raft_consensus.cc:2243] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.451028  9741 raft_consensus.cc:2272] T 661c79d4d9c74a30911ec88c18ba8229 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.487335  9741 tablet_replica.cc:333] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.488479  9741 raft_consensus.cc:2243] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:23:39.489852  9741 raft_consensus.cc:2272] T ba629b94057b4c4e9085289ea50b42f1 P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.493275  9741 tablet_replica.cc:333] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.494122  9741 raft_consensus.cc:2243] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.495191  9741 raft_consensus.cc:2272] T d3625831778d468cb424c06fc474c323 P 9e8170bbe8244e40a2b2e5011e69b697 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.498432  9741 tablet_replica.cc:333] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.499260  9741 raft_consensus.cc:2243] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.500067  9741 raft_consensus.cc:2272] T 78fb947776bd4e70b1f04a0af3390ae3 P 9e8170bbe8244e40a2b2e5011e69b697 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.508714  9741 tablet_replica.cc:333] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.509527  9741 raft_consensus.cc:2243] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.510232  9741 raft_consensus.cc:2272] T f850953ee221438f81da7fc8c8b44f9b P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.513520  9741 tablet_replica.cc:333] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.514490  9741 raft_consensus.cc:2243] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.515612  9741 raft_consensus.cc:2272] T 02ce8649e6b64336a3064cc1da978105 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.530186  9741 tablet_replica.cc:333] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.531157  9741 raft_consensus.cc:2243] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.532151  9741 raft_consensus.cc:2272] T 2f281b53af584a8bab9bb1d343d005f8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.535305  9741 tablet_replica.cc:333] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.536195  9741 raft_consensus.cc:2243] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.536926  9741 raft_consensus.cc:2272] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.557051  9741 tablet_replica.cc:333] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.557934  9741 raft_consensus.cc:2243] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:23:39.559108  9741 raft_consensus.cc:2272] T 90e76c15ad9c49ab9b98a5d216125beb P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.562135  9741 tablet_replica.cc:333] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.567840  9741 raft_consensus.cc:2243] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:23:39.569367 19522 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:39.570104 19522 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:39.572126 19522 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:39.574985 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:23:39.582378 11051 leader_election.cc:336] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:39.582937 11051 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:39.583750 19522 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:39.660727 19522 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:39.661512 19522 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:39.665787 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:39.671672 19522 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:39.684218  9741 raft_consensus.cc:2272] T 970339bba6a8454e8c722b4367924db8 P 9e8170bbe8244e40a2b2e5011e69b697 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.690258  9741 tablet_replica.cc:333] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.691188  9741 raft_consensus.cc:2243] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:23:39.692252  9741 raft_consensus.cc:2272] T 32589fba10354b9588f7cb0a69c6e92d P 9e8170bbe8244e40a2b2e5011e69b697 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.695618  9741 tablet_replica.cc:333] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.697299  9741 raft_consensus.cc:2243] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 LEADER]: Raft consensus shutting down.
W20260709 12:23:39.719566 11051 leader_election.cc:336] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:39.720256 11051 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:39.702004  9741 raft_consensus.cc:2272] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 9e8170bbe8244e40a2b2e5011e69b697 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.727458 19522 raft_consensus.cc:2749] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:23:39.785708  9741 tablet_replica.cc:333] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.797384  9741 raft_consensus.cc:2243] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.799728  9741 raft_consensus.cc:2272] T 33ccd4bc26b14304b81583bf6a6d3efb P 9e8170bbe8244e40a2b2e5011e69b697 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.803741  9741 tablet_replica.cc:333] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.804606  9741 raft_consensus.cc:2243] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.805351  9741 raft_consensus.cc:2272] T 0ccace425f6c4d5ea9588504233ffee0 P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.810532  9741 tablet_replica.cc:333] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.811375  9741 raft_consensus.cc:2243] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:23:39.812536  9741 raft_consensus.cc:2272] T 0cb303f7380c4693b70bda660f0f86a6 P 9e8170bbe8244e40a2b2e5011e69b697 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.815929  9741 tablet_replica.cc:333] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.817528  9741 raft_consensus.cc:2243] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.818912  9741 raft_consensus.cc:2272] T f1f6166d836f41229df11ee42cd8e4c7 P 9e8170bbe8244e40a2b2e5011e69b697 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.823307  9741 tablet_replica.cc:333] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697: stopping tablet replica
I20260709 12:23:39.824005  9741 raft_consensus.cc:2243] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:23:39.825348  9741 raft_consensus.cc:2272] T 74d2f9dca08d41e7a77146322049c40c P 9e8170bbe8244e40a2b2e5011e69b697 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:40.062486 19526 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.065071 19526 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:40.067292 19526 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:40.157929 19447 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.158768 19447 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:40.161065 19447 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:40.279726 11625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.016s	sys 0.041s
W20260709 12:23:40.280833 11625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.016s	sys 0.041s
W20260709 12:23:40.281708 10977 consensus_peers.cc:597] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.287777 11080 consensus_queue.cc:237] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:39.723534 19456 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.294768 19456 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:40.297389 19456 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:40.304152 11622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.015s	sys 0.015s
W20260709 12:23:40.304560 11622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.015s	sys 0.015s
I20260709 12:23:40.306850 19525 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.307415 19525 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:40.309549 19525 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:40.311690 11051 leader_election.cc:336] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:40.313905 19500 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.314546 19500 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:40.317248 19500 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:40.318984 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:40.319537 19447 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.320362 19447 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:40.319610 11659 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
W20260709 12:23:40.321777 11051 consensus_peers.cc:597] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.322276 10975 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:40.322451 19447 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:40.323292 19494 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:40.323741 19494 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.324220 19494 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:23:40.353871 11051 consensus_peers.cc:597] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:40.356714 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 46124.1us
I20260709 12:23:40.335659 19494 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:40.360540 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:40.361207 11659 raft_consensus.cc:3060] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:40.367660 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:40.367971 19494 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:40.368419 11005 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 24.
W20260709 12:23:40.386186 11049 consensus_peers.cc:597] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 660a349ad34749648cae6a025708c84d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:40.388616 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:40.390538 11078 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 25.
I20260709 12:23:40.390930 11659 raft_consensus.cc:2468] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:23:40.392378 10975 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:40.393195 19534 raft_consensus.cc:2804] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:40.395555 19534 raft_consensus.cc:697] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:40.398408 19534 consensus_queue.cc:237] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:40.393379 11005 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260709 12:23:40.402859 11051 consensus_peers.cc:597] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:40.404601 11051 consensus_peers.cc:597] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.403731 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:40.408015 11622 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:23:40.408092 11079 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 24.
I20260709 12:23:40.409034 19532 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:23:40.409487 19532 raft_consensus.cc:493] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.409897 19532 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:40.415503 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:40.416646 11050 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:40.422049 11625 consensus_peers.cc:597] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:40.422674 11625 leader_election.cc:336] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:40.423132 11625 consensus_peers.cc:597] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.424062 19478 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:23:40.424522 19478 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.424896 19478 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:40.426389 19532 raft_consensus.cc:515] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Starting leader election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:40.429932 19532 leader_election.cc:290] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:40.430131 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8151fe64a0a84d44a837cc6abf316707" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:40.430721 11079 raft_consensus.cc:3060] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:40.438282 19532 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.438916 19532 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:40.440968 11079 raft_consensus.cc:2468] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 26.
I20260709 12:23:40.441852 19532 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:40.442643 11622 leader_election.cc:304] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:23:40.443779 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:40.444717 19532 raft_consensus.cc:2804] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:23:40.445273 19532 raft_consensus.cc:697] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:23:40.446930 19532 consensus_queue.cc:237] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:40.418349 19447 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.448522 19447 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:40.450587 19447 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:40.453799 19478 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:40.459363 19474 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.460076 19474 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:40.455631 11625 leader_election.cc:336] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:40.466344 11625 leader_election.cc:336] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:40.468041 11625 leader_election.cc:336] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:40.468492 11625 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:40.466038 19474 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:40.470748 19529 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:40.473410 19478 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:40.475603 11051 leader_election.cc:336] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:40.479290 11051 leader_election.cc:336] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:40.482254 19478 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.482892 19478 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:40.485507 19478 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:40.487957 11051 leader_election.cc:336] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:40.501056 10974 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:40.501972 19538 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:23:40.502415 19538 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.502769 19538 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:40.511080 19538 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:40.513458 19538 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:40.519182 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:40.521055 11081 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:23:40.524156 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:40.526808 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:40.527694 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:40.528421 11080 raft_consensus.cc:2393] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 25: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:40.529088 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:40.525475 19526 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.004s
I20260709 12:23:40.529415 11006 raft_consensus.cc:2393] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in current term 25: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:40.529829 11007 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:40.531948 10974 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:40.532922 19535 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:40.533322 19535 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.532111 19527 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.534122 19527 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:40.536557 19527 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:40.540123 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:23:40.541652 11051 leader_election.cc:336] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:40.533672 19535 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:40.544202 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:40.539646 11050 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:40.547127 11050 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:40.548386 19474 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:40.551189 11624 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:40.552737 19532 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:40.560735 19534 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.561932 10828 catalog_manager.cc:5697] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 25 to 26, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 26 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:40.562892 19534 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:40.566323 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:40.568001 19534 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:40.568672 11050 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:40.569885 11050 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:40.573014 10977 consensus_peers.cc:597] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:40.573633 10977 consensus_peers.cc:597] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:40.574359 10977 leader_election.cc:336] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:40.575400 10977 consensus_peers.cc:597] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:40.576023 10977 consensus_peers.cc:597] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.575229 10830 catalog_manager.cc:5697] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 21 to 22, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 22 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:40.576540 10977 consensus_peers.cc:597] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:40.577113 10977 leader_election.cc:336] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:40.577760 10977 leader_election.cc:336] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:40.578056 10977 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:40.578687 19534 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:23:40.579023 10977 leader_election.cc:336] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:40.580302 19534 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:23:40.581211 10977 consensus_peers.cc:597] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.580937 19534 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:40.582036 10977 leader_election.cc:336] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:40.582459 19478 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:23:40.583217 19478 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:40.583590 19478 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.583953 19478 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:40.584583 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:40.586773 19534 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:40.590045 19474 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:40.590515 10977 connection.cc:769] client connection to 127.9.131.65:46109 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:23:40.594431 10977 consensus_peers.cc:597] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:40.597477 11051 consensus_peers.cc:597] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:40.609860 11051 consensus_peers.cc:597] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.608729 19535 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:40.617862 19478 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:40.623997 10977 leader_election.cc:336] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:40.626451 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:40.628953 19534 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:23:40.629873 10977 consensus_peers.cc:597] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.629832 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:40.630511 11006 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:40.627579 19478 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:40.632781 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:40.633445 11080 raft_consensus.cc:3060] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:23:40.635429 10977 leader_election.cc:336] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:40.635934 10977 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:40.636883 19534 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 12:23:40.637132 10977 consensus_peers.cc:597] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.636591 19535 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:40.642426 11080 raft_consensus.cc:2468] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:23:40.643105 19535 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.643692 10974 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:23:40.644232 10977 leader_election.cc:336] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:40.644721 10977 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:40.647710 19534 raft_consensus.cc:2804] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:40.648392 19534 raft_consensus.cc:697] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:40.649335 19534 consensus_queue.cc:237] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:40.651575 11006 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:23:40.653817 19478 raft_consensus.cc:2955] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Committing config change with OpId 24.17: config changed from index -1 to 17, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:40.655913 11007 raft_consensus.cc:2955] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index -1 to 17, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:40.656819 11050 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:40.657563 19474 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:23:40.658058 19474 raft_consensus.cc:697] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:40.643682 19535 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:40.658943 19474 consensus_queue.cc:237] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:40.662091 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:40.665661 19538 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:40.666097 19535 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:40.673272 10977 leader_election.cc:336] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:40.696713 19538 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.697383 19538 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:40.697748 19456 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.698374 19456 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:40.700536 19456 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:40.703231 10977 leader_election.cc:336] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:40.704582 10977 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:40.705986 19447 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:40.708175 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:23:40.714893 10977 leader_election.cc:336] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:40.716534 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:40.717272 11007 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 20.
I20260709 12:23:40.703413 19538 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:40.715593 10977 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:40.724531 10977 consensus_peers.cc:597] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.727720 11624 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:40.730417 19529 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:40.730809 19529 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.731163 19529 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:40.725703 19538 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:40.743614 19529 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:40.750603 19526 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.751113 19528 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.755044 19522 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.758191 19528 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:40.760635 19528 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:40.758350 19522 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:40.762535 19522 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:40.757650 19526 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:40.764504 19526 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:40.765988 10831 catalog_manager.cc:5697] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 22 to 23, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 23 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:40.769579 19529 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:40.753685 19474 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.771066 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:40.771778 11010 raft_consensus.cc:3060] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:40.771157 19474 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:40.781183 19474 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:40.786156 10977 consensus_peers.cc:597] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.787288 19474 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.787835 19474 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:40.789599 11010 raft_consensus.cc:2468] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 21.
W20260709 12:23:40.789958 10882 auto_rebalancer.cc:629] Failed to schedule move for tablet 32589fba10354b9588f7cb0a69c6e92d: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:40.790732 19474 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:40.793941 10957 debug-util.cc:398] Leaking SignalData structure 0x7b080017fae0 after lost signal to thread 9744
W20260709 12:23:40.809751 10957 debug-util.cc:398] Leaking SignalData structure 0x7b08002bc200 after lost signal to thread 10868
W20260709 12:23:40.810322 11625 leader_election.cc:336] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:40.811337 10957 debug-util.cc:398] Leaking SignalData structure 0x7b08001ad8c0 after lost signal to thread 11035
W20260709 12:23:40.812589 10957 debug-util.cc:398] Leaking SignalData structure 0x7b08002ec140 after lost signal to thread 11109
W20260709 12:23:40.813884 10957 debug-util.cc:398] Leaking SignalData structure 0x7b0800343740 after lost signal to thread 11683
W20260709 12:23:40.814359 10957 debug-util.cc:398] Leaking SignalData structure 0x7b0800386da0 after lost signal to thread 19521
I20260709 12:23:40.812505 11624 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:23:40.811237 11625 consensus_peers.cc:597] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.819757 19525 raft_consensus.cc:2804] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:40.820380 19525 raft_consensus.cc:697] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:23:40.821290 19525 consensus_queue.cc:237] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:40.832827 11051 leader_election.cc:336] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:40.833734 11051 consensus_peers.cc:597] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.844637 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:40.845252 11655 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 17.
I20260709 12:23:40.847168 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:40.847474 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:40.848066 11010 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 21.
I20260709 12:23:40.851441 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:40.851956 11006 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 24.
I20260709 12:23:40.849607 11050 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:23:40.859980 11625 leader_election.cc:336] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:40.864156 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:40.867736 19528 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:40.868281 19528 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.868661 19528 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:40.848101 19447 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.873041 19447 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:40.875352 19447 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:40.880084 10977 consensus_peers.cc:597] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:40.889154 10977 consensus_peers.cc:597] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.889780 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:23:40.894789 11051 leader_election.cc:336] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:40.899560 19494 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:23:40.900370 11051 leader_election.cc:336] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:40.900286 19494 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:40.900879 11051 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:40.901712 19551 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:23:40.901805 11051 leader_election.cc:336] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:40.902434 11051 consensus_peers.cc:597] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:40.902595 10977 leader_election.cc:336] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:40.902905 11051 consensus_peers.cc:597] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.902983 19494 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:40.903432 11051 consensus_peers.cc:597] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:40.903889 11051 leader_election.cc:336] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:40.905561 11051 leader_election.cc:336] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:40.906531 10974 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:40.906862 19534 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.908934 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:40.918998 11078 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 16.
I20260709 12:23:40.918859 19534 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:40.910379 11656 raft_consensus.cc:1275] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:23:40.913435 11081 raft_consensus.cc:1275] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 12:23:40.921336 19534 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:40.922102 19534 consensus_queue.cc:1048] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 12:23:40.916000 11625 consensus_peers.cc:597] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.928426 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:40.929204 11080 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 24.
W20260709 12:23:40.924029 11625 consensus_peers.cc:597] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.931485 10974 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:40.934192 10974 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:40.938002 19447 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:40.933200 19494 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:40.934757 19554 ts_tablet_manager.cc:933] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:40.938427 19447 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.947053 11050 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:40.941833 19538 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:23:40.941620 19478 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.959290 19526 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:23:40.965939 19526 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.966315 19526 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:40.963502 19538 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.970023 19538 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:40.936439 19456 consensus_queue.cc:1048] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.026s
W20260709 12:23:40.973306 11625 consensus_peers.cc:597] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:40.977555 10977 leader_election.cc:336] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:40.980494 10977 leader_election.cc:336] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:40.949880 19447 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:23:40.979592 11625 consensus_peers.cc:597] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.962939 19527 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.942637 19532 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.984066 19478 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:40.998461 19534 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:40.996037 19527 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:41.040870 19526 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:41.041468 19527 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:41.042995 19526 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:40.996840 19532 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:41.047989 19532 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:41.050381 19538 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:41.051967 19528 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:41.053385 19538 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:41.054147 19528 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:41.028227 19478 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:41.034126 11006 consensus_queue.cc:237] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
W20260709 12:23:41.056808 11625 consensus_peers.cc:597] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:41.034644 19535 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:41.064576 19535 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:41.066769 19535 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:41.022419 19534 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:41.061101 11051 consensus_peers.cc:597] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:41.091426 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:41.092151 11007 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:23:41.093039 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:41.093698 11010 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:23:41.102630 11050 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:41.097930 11049 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:41.103699 11050 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:41.104467 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:41.106266 11010 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 20.
I20260709 12:23:41.105509 11049 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:41.107069 11624 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:41.108073 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:41.108655 11008 raft_consensus.cc:3060] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:41.109817 19557 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:23:41.110249 19557 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:41.110471 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:41.111079 11084 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
I20260709 12:23:41.103494 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:41.097394 19528 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:23:41.111845 11051 leader_election.cc:336] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:41.112253 11082 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:41.117623 19534 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:41.117954 19561 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:23:41.118407 19561 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:41.118772 19561 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:23:41.120436 11051 leader_election.cc:336] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:41.121161 11051 leader_election.cc:336] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:41.121619 11051 leader_election.cc:336] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:41.122392 11008 raft_consensus.cc:2468] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 25.
I20260709 12:23:41.111806 19551 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:41.113262 19557 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:41.134903 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:41.132328 19551 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:41.135934 19551 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:41.137643 11625 leader_election.cc:336] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:41.125066 19478 raft_consensus.cc:2749] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:41.139274 10974 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:41.141499 19538 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:41.135564 11002 raft_consensus.cc:3060] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:41.141896 19538 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:41.142493 19538 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:41.119490 19528 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:41.145555 19528 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:41.146351 19447 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:41.148833 19447 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:41.153723 19551 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:41.157670 19554 tablet_copy_client.cc:323] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.67:40209
I20260709 12:23:41.162495 11002 raft_consensus.cc:2468] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:41.114296 19560 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:41.171223 11082 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 25.
I20260709 12:23:41.156116 19551 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:41.177294 19557 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:41.174192 19560 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:23:41.193315 10977 consensus_peers.cc:597] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:41.200340 10977 consensus_peers.cc:597] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:41.201997 10977 leader_election.cc:336] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:41.200804 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 81783.2us
I20260709 12:23:41.204221 11095 tablet_copy_service.cc:140] P 1abf4b385a2b493ab83f593a1f8c9cd1: Received BeginTabletCopySession request for tablet 660a349ad34749648cae6a025708c84d from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:40200)
I20260709 12:23:41.204989 11095 tablet_copy_service.cc:161] P 1abf4b385a2b493ab83f593a1f8c9cd1: Beginning new tablet copy session on tablet 660a349ad34749648cae6a025708c84d from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:40200: session id = 0b171b6aaedc4f809f2753dcfadb14ce-660a349ad34749648cae6a025708c84d
I20260709 12:23:41.201231 19560 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:41.208161 19525 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:41.208349 19557 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:41.208796 19525 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:41.210227 19538 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:41.211087 10977 leader_election.cc:336] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:41.212339 19538 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:41.212962 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:41.210994 19525 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:41.213554 11659 raft_consensus.cc:3060] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:41.216300 11051 consensus_peers.cc:597] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:41.220105 11625 leader_election.cc:336] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:41.227001 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 96794.4us
I20260709 12:23:41.226928 11659 raft_consensus.cc:2468] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
W20260709 12:23:41.227494 10977 leader_election.cc:336] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:41.230275 10977 consensus_peers.cc:597] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:41.232376 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:41.232172 19561 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:41.233968 11079 raft_consensus.cc:2393] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 24: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
I20260709 12:23:41.235692 11050 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:41.240873 19561 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:41.241735 10975 consensus_peers.cc:597] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c486c31e8ba74d8a9b17989a20d141bf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:41.242646 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:41.243191 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ba0a33a7f74af5b5fd862bbb01e3cb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:41.243319 11079 raft_consensus.cc:3060] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:41.243813 11078 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:23:41.244652 10974 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:41.245440 19538 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:23:41.245950 19538 raft_consensus.cc:697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:41.246781 10974 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:41.246783 19538 consensus_queue.cc:237] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:41.243848 11083 raft_consensus.cc:3060] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:41.249106 19494 raft_consensus.cc:3060] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:41.257560 19494 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:41.263505 11083 raft_consensus.cc:2468] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:23:41.274194 11095 tablet_copy_source_session.cc:215] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:41.284655 10831 catalog_manager.cc:5697] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 20 to 21, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 21 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.286288 10831 catalog_manager.cc:5697] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: config changed from index -1 to 17, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 24 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:41.287617 11079 raft_consensus.cc:2468] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 17.
W20260709 12:23:41.292433 11051 leader_election.cc:336] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:41.294663 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 56538.3us
W20260709 12:23:41.294196 11051 leader_election.cc:336] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:41.298849 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 63257.6us
I20260709 12:23:41.299610 11050 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:41.302250 19561 raft_consensus.cc:2804] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:23:41.302578 19566 raft_consensus.cc:2804] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:41.302824 19561 raft_consensus.cc:697] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:41.303849 19561 consensus_queue.cc:237] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:41.306715 11049 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:41.315387 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:41.316560 11082 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 24.
I20260709 12:23:41.317948 19528 raft_consensus.cc:2804] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:41.318519 19528 raft_consensus.cc:697] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:41.318765 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:41.319398 11002 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 27.
I20260709 12:23:41.319432 19528 consensus_queue.cc:237] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:41.320431 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:41.320960 11008 raft_consensus.cc:3060] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:41.320166 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:23:41.296715 11051 consensus_peers.cc:597] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:41.331508 19534 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:41.334368 10974 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:41.335278 10974 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:41.322718 19447 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
W20260709 12:23:41.335525 11051 leader_election.cc:336] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:41.335270 19537 raft_consensus.cc:2804] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:41.304646 19566 raft_consensus.cc:697] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
W20260709 12:23:41.336366 11051 leader_election.cc:336] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:41.337054 19566 consensus_queue.cc:237] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:41.337661 11050 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:41.339787 19522 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:23:41.340073 19560 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:41.340530 19534 raft_consensus.cc:2804] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:41.341419 19522 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:41.336467 19537 raft_consensus.cc:697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:41.341900 19522 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:23:41.342559 19537 consensus_queue.cc:237] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:41.352072 11008 raft_consensus.cc:2468] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 24.
I20260709 12:23:41.352957 11079 raft_consensus.cc:1275] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:23:41.354245 11010 raft_consensus.cc:2468] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 24.
I20260709 12:23:41.359675 11050 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:41.364909 11050 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:41.370350 11622 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:41.371515 19456 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:23:41.371956 19456 raft_consensus.cc:493] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Starting leader election (detected failure of leader 9e8170bbe8244e40a2b2e5011e69b697)
I20260709 12:23:41.372345 19456 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:41.377880 19560 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:41.341361 19534 raft_consensus.cc:697] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:41.336118 19447 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:41.382476 19534 consensus_queue.cc:237] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:41.386833 10831 catalog_manager.cc:5697] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 20 to 21, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 21 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:41.389704 10977 leader_election.cc:336] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:41.394065 19568 raft_consensus.cc:2804] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:23:41.368553 19527 raft_consensus.cc:2804] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:23:41.395592 19554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 660a349ad34749648cae6a025708c84d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:41.397037 11625 consensus_peers.cc:597] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:41.397524 11625 leader_election.cc:336] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:41.399406 11051 consensus_peers.cc:597] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:41.407531 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:41.409387 11006 raft_consensus.cc:3060] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:41.404592 19447 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:41.412663 19500 consensus_queue.cc:1048] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:41.412127 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:41.415226 11010 raft_consensus.cc:1275] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:23:41.418736 11006 raft_consensus.cc:2468] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 21.
W20260709 12:23:41.422932 10977 leader_election.cc:336] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:41.421420 19527 raft_consensus.cc:697] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:41.424621 19527 consensus_queue.cc:237] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:41.430603 19568 raft_consensus.cc:697] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:41.433528 11010 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:23:41.440519 19526 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:41.441521 19456 raft_consensus.cc:515] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:41.444303 19456 leader_election.cc:290] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:41.445449 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb303f7380c4693b70bda660f0f86a6" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:41.446135 11084 raft_consensus.cc:3060] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:41.431722 19568 consensus_queue.cc:237] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:41.462002 10977 consensus_peers.cc:597] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:41.463804 19500 raft_consensus.cc:2955] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Committing config change with OpId 22.13: config changed from index -1 to 13, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:41.470786 19456 consensus_queue.cc:1048] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:23:41.474963 11624 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:41.476728 19558 raft_consensus.cc:2804] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:41.477355 19558 raft_consensus.cc:697] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:23:41.476822 11078 raft_consensus.cc:2955] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Committing config change with OpId 22.13: config changed from index -1 to 13, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:41.478232 19558 consensus_queue.cc:237] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:41.495801 10977 leader_election.cc:336] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:41.403851 19522 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:41.543841 11083 raft_consensus.cc:2393] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2201bad9e18849b09cf82de29dd032d3 in current term 28: Already voted for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in this term.
W20260709 12:23:41.561233 11625 leader_election.cc:336] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:41.574163 10830 catalog_manager.cc:5697] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 21 to 22, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 22 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:41.575394 19522 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:41.578426 10974 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:41.581028 19572 raft_consensus.cc:3060] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:23:41.578570 11084 raft_consensus.cc:2468] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 25.
W20260709 12:23:41.616765 11051 leader_election.cc:336] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:41.617882 11622 leader_election.cc:304] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:41.605535 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:41.603005 11083 consensus_queue.cc:237] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:41.628638 19558 raft_consensus.cc:2804] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:23:41.629457 19558 raft_consensus.cc:697] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:23:41.619318 10830 catalog_manager.cc:5697] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 24 to 25, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 25 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:41.630379 19558 consensus_queue.cc:237] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:41.643550  9741 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 10957)
I20260709 12:23:41.646564 19572 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:23:41.654582 10828 catalog_manager.cc:5697] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 20 to 21, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 21 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:41.672776 10831 catalog_manager.cc:5697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 24 to 25, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 25 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.674858 10831 catalog_manager.cc:5697] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 20 to 21, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 21 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.680421 19554 tablet_copy_client.cc:806] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:41.720319 19554 tablet_copy_client.cc:670] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
W20260709 12:23:41.684350 11049 consensus_peers.cc:597] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dc9fc876e22f4072a34df693254c2f5e. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:41.697113 11051 consensus_peers.cc:597] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:41.720614 10831 catalog_manager.cc:5697] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 16 to 17, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 17 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.699092 11006 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:23:41.714190 10834 catalog_manager.cc:5697] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 24 to 25, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 25 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:41.724584 11656 raft_consensus.cc:1275] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:23:41.730885 19568 consensus_queue.cc:1048] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:41.734954 11010 raft_consensus.cc:2468] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 28.
I20260709 12:23:41.730032 19522 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
W20260709 12:23:41.744858 11051 consensus_peers.cc:597] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:41.748235 19554 tablet_copy_client.cc:538] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:41.752939 11005 raft_consensus.cc:1275] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:23:41.632824 10830 catalog_manager.cc:5697] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 17 to 18, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 18 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.718201 11079 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:23:41.753463 11050 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:41.755126 19522 raft_consensus.cc:2804] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:23:41.755616 19522 raft_consensus.cc:697] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:41.756536 19522 consensus_queue.cc:237] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:41.759822 19568 consensus_queue.cc:1048] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:23:41.759315 19572 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:23:41.778770 19528 raft_consensus.cc:2955] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Committing config change with OpId 23.15: config changed from index -1 to 15, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:41.785218 19554 tablet_bootstrap.cc:492] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
W20260709 12:23:41.799975 10977 consensus_peers.cc:597] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:41.782300 11010 raft_consensus.cc:2955] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index -1 to 15, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
W20260709 12:23:41.830560 11051 consensus_peers.cc:597] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:41.833012 11051 consensus_peers.cc:597] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:41.877246 11008 raft_consensus.cc:1275] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:23:41.879956 19596 ts_tablet_manager.cc:933] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:41.889547 19527 consensus_queue.cc:1048] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:41.894311 11079 raft_consensus.cc:1275] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:23:41.895948 19572 consensus_queue.cc:1048] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:41.943717 10834 catalog_manager.cc:5697] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: config changed from index -1 to 15, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 23 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:41.945894 10834 catalog_manager.cc:5697] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: config changed from index -1 to 13, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 22 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.965174 11008 raft_consensus.cc:1275] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:23:41.971539 19528 consensus_queue.cc:1048] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:41.981624 19596 tablet_copy_client.cc:323] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.66:41383
I20260709 12:23:41.992169 10831 catalog_manager.cc:5697] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 23 to 24, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 24 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:41.994431 10831 catalog_manager.cc:5697] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 23 to 24, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 24 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:41.996240 10831 catalog_manager.cc:5697] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 27 to 28, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 28 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:42.006564 11010 raft_consensus.cc:1275] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:23:42.008356 11008 raft_consensus.cc:1275] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:23:42.008080 11079 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39448
I20260709 12:23:42.012123 11079 raft_consensus.cc:606] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Received request to transfer leadership
I20260709 12:23:42.012382 19573 consensus_queue.cc:1048] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:42.017585 11079 raft_consensus.cc:1275] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:23:42.021911 19537 consensus_queue.cc:1048] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:23:42.027582 11051 consensus_peers.cc:597] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:42.030350 11078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39448
I20260709 12:23:42.031227 11078 raft_consensus.cc:606] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Received request to transfer leadership
I20260709 12:23:42.042311 11021 tablet_copy_service.cc:140] P 2201bad9e18849b09cf82de29dd032d3: Received BeginTabletCopySession request for tablet c486c31e8ba74d8a9b17989a20d141bf from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:41098)
I20260709 12:23:42.043042 11021 tablet_copy_service.cc:161] P 2201bad9e18849b09cf82de29dd032d3: Beginning new tablet copy session on tablet c486c31e8ba74d8a9b17989a20d141bf from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:41098: session id = 0b171b6aaedc4f809f2753dcfadb14ce-c486c31e8ba74d8a9b17989a20d141bf
I20260709 12:23:42.051203 19558 consensus_queue.cc:1048] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:23:42.055612 11079 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e"
dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39448
I20260709 12:23:42.056349 11079 raft_consensus.cc:606] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Received request to transfer leadership
I20260709 12:23:42.063423 11021 tablet_copy_source_session.cc:215] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:42.065568 11078 raft_consensus.cc:1275] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
W20260709 12:23:42.069914 11625 consensus_peers.cc:597] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:42.067976 10882 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:23:42.070864 10882 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for dc9fc876e22f4072a34df693254c2f5e already in progress
W20260709 12:23:42.071226 10882 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for dc9fc876e22f4072a34df693254c2f5e already in progress
I20260709 12:23:42.071331 19558 consensus_queue.cc:1048] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:23:42.092873 11051 consensus_peers.cc:597] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:42.124300 11625 consensus_peers.cc:597] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:42.125138 10977 consensus_peers.cc:597] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:42.126164 10977 consensus_peers.cc:597] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:42.134600 19596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c486c31e8ba74d8a9b17989a20d141bf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:42.318408 10977 consensus_peers.cc:597] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:42.303725 19612 ts_tablet_manager.cc:933] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:42.336848 11007 raft_consensus.cc:1275] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 28 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 12:23:42.367599 19596 tablet_copy_client.cc:806] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:42.368783 19557 raft_consensus.cc:993] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1: : Instructing follower 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:42.372274 19557 raft_consensus.cc:1081] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Signalling peer 2201bad9e18849b09cf82de29dd032d3 to start an election
I20260709 12:23:42.369446 19612 tablet_copy_client.cc:323] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.67:40209
I20260709 12:23:42.375615 19596 tablet_copy_client.cc:670] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:42.376966 19566 consensus_queue.cc:1048] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:23:42.395920 11002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e"
dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
 from {username='slave'} at 127.0.0.1:37594
I20260709 12:23:42.396581 11002 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:42.396917 11002 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:42.402070 19596 tablet_copy_client.cc:538] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:42.407392 11002 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:42.408504 11095 tablet_copy_service.cc:140] P 1abf4b385a2b493ab83f593a1f8c9cd1: Received BeginTabletCopySession request for tablet dc9fc876e22f4072a34df693254c2f5e from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:40200)
I20260709 12:23:42.415436 11095 tablet_copy_service.cc:161] P 1abf4b385a2b493ab83f593a1f8c9cd1: Beginning new tablet copy session on tablet dc9fc876e22f4072a34df693254c2f5e from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:40200: session id = 0b171b6aaedc4f809f2753dcfadb14ce-dc9fc876e22f4072a34df693254c2f5e
I20260709 12:23:42.424482 11095 tablet_copy_source_session.cc:215] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:23:42.438977 11051 consensus_peers.cc:597] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:42.440650 11002 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:42.468554 10977 leader_election.cc:336] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:42.475301 19612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc9fc876e22f4072a34df693254c2f5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.490470 19596 tablet_bootstrap.cc:492] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:23:42.496637 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: true dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:42.510617 11083 raft_consensus.cc:3055] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:23:42.510954 11083 raft_consensus.cc:740] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:42.511751 11083 consensus_queue.cc:260] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:42.513198 11083 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:42.521360 11083 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 24.
I20260709 12:23:42.545024 19500 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.545578 19500 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:42.547720 19500 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:42.570641 10974 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:42.573275 19535 raft_consensus.cc:2804] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:23:42.573776 19612 tablet_copy_client.cc:806] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:42.574790 19535 raft_consensus.cc:697] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 24 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:42.588781 19535 consensus_queue.cc:237] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:42.582336 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:42.592698 11083 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 25.
W20260709 12:23:42.594161 11051 consensus_peers.cc:597] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:42.585125 19554 tablet_bootstrap.cc:492] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=18 overwritten=1 applied=17 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:42.606523 19554 tablet_bootstrap.cc:492] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:23:42.595018 19612 tablet_copy_client.cc:670] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:42.607425 19554 ts_tablet_manager.cc:1403] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 0.823s	user 0.068s	sys 0.055s
I20260709 12:23:42.603646 10974 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:23:42.608788 10977 leader_election.cc:336] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:42.609643 19535 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:23:42.610056 19535 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.610397 19535 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:42.623158 19612 tablet_copy_client.cc:538] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:42.626992 10834 catalog_manager.cc:5697] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 23 to 24, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 24 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:42.630324 19554 raft_consensus.cc:359] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:42.636993 19612 tablet_bootstrap.cc:492] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
W20260709 12:23:42.644110  9741 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 10957)
I20260709 12:23:42.646299 19554 raft_consensus.cc:740] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:23:42.647082 19554 consensus_queue.cc:260] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:42.664314 19554 ts_tablet_manager.cc:1434] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 12:23:42.680752 19535 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:42.683010 11095 tablet_copy_service.cc:342] P 1abf4b385a2b493ab83f593a1f8c9cd1: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-660a349ad34749648cae6a025708c84d received from {username='slave'} at 127.0.0.1:40200
I20260709 12:23:42.685886 11095 tablet_copy_service.cc:434] P 1abf4b385a2b493ab83f593a1f8c9cd1: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-660a349ad34749648cae6a025708c84d on tablet 660a349ad34749648cae6a025708c84d with peer 0b171b6aaedc4f809f2753dcfadb14ce
W20260709 12:23:42.693349 11625 consensus_peers.cc:597] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:42.683218 10977 consensus_peers.cc:597] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:42.700724 19535 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 election: Requested vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:42.711787 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:42.712440 11083 raft_consensus.cc:3060] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:42.723605 11083 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 26.
I20260709 12:23:42.730757 10974 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:42.772483 19500 raft_consensus.cc:2804] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:23:42.773142 19500 raft_consensus.cc:697] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:42.774053 19500 consensus_queue.cc:237] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:42.793272 11051 consensus_peers.cc:597] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:42.802804 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 72132.1us
W20260709 12:23:42.830567 10977 leader_election.cc:336] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:42.838022 11625 consensus_peers.cc:597] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:42.881281 10977 consensus_peers.cc:597] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:42.882069 10977 consensus_peers.cc:597] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:42.887547 19621 log.cc:927] Time spent T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: Append to log took a long time: real 0.104s	user 0.004s	sys 0.005s
I20260709 12:23:42.887339 10834 catalog_manager.cc:5697] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 24 to 26, leader changed from 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 26 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:42.868542 19612 log.cc:927] Time spent T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.085s	user 0.006s	sys 0.003s
W20260709 12:23:42.868710 19596 log.cc:927] Time spent T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.117s	user 0.007s	sys 0.013s
W20260709 12:23:42.917966 11051 consensus_peers.cc:597] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:42.946972 10977 consensus_peers.cc:597] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:42.972361 10977 consensus_peers.cc:597] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:42.995433 19612 log.cc:927] Time spent T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce: Append to log took a long time: real 0.052s	user 0.001s	sys 0.003s
I20260709 12:23:43.030865 19612 tablet_bootstrap.cc:492] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=2 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:43.035808 11659 raft_consensus.cc:1217] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 LEARNER]: Deduplicated request from leader. Original: 24.16->[24.17-24.17]   Dedup: 24.17->[]
I20260709 12:23:43.018177 19596 tablet_bootstrap.cc:492] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:43.038173 19612 tablet_bootstrap.cc:492] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:23:43.039896 19612 ts_tablet_manager.cc:1403] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 0.403s	user 0.066s	sys 0.029s
I20260709 12:23:43.039002 19596 tablet_bootstrap.cc:492] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:23:43.051692 19596 ts_tablet_manager.cc:1403] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 0.553s	user 0.057s	sys 0.020s
W20260709 12:23:43.058508 11051 consensus_peers.cc:597] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:43.068533 19612 raft_consensus.cc:359] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
W20260709 12:23:43.070750 10977 consensus_peers.cc:597] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:43.085865 19612 raft_consensus.cc:740] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:23:43.087328 19612 consensus_queue.cc:260] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
W20260709 12:23:43.098498 10977 consensus_peers.cc:597] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:43.119174 19596 raft_consensus.cc:359] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:43.120112 19596 raft_consensus.cc:740] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:23:43.120805 19596 consensus_queue.cc:260] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:43.123620 19612 ts_tablet_manager.cc:1434] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.002s
I20260709 12:23:43.124437 11083 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:23:43.125545 11095 tablet_copy_service.cc:342] P 1abf4b385a2b493ab83f593a1f8c9cd1: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-dc9fc876e22f4072a34df693254c2f5e received from {username='slave'} at 127.0.0.1:40200
I20260709 12:23:43.125978 11095 tablet_copy_service.cc:434] P 1abf4b385a2b493ab83f593a1f8c9cd1: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-dc9fc876e22f4072a34df693254c2f5e on tablet dc9fc876e22f4072a34df693254c2f5e with peer 0b171b6aaedc4f809f2753dcfadb14ce
W20260709 12:23:43.122004 11625 consensus_peers.cc:597] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:43.130869 10977 consensus_peers.cc:597] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:43.131259 19500 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:43.132939 11659 raft_consensus.cc:3060] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 LEARNER]: Advancing to term 24
I20260709 12:23:43.137382 19596 ts_tablet_manager.cc:1434] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.000s
I20260709 12:23:43.140352 11021 tablet_copy_service.cc:342] P 2201bad9e18849b09cf82de29dd032d3: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-c486c31e8ba74d8a9b17989a20d141bf received from {username='slave'} at 127.0.0.1:41098
I20260709 12:23:43.140990 11659 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 LEARNER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:23:43.143556 11021 tablet_copy_service.cc:434] P 2201bad9e18849b09cf82de29dd032d3: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-c486c31e8ba74d8a9b17989a20d141bf on tablet c486c31e8ba74d8a9b17989a20d141bf with peer 0b171b6aaedc4f809f2753dcfadb14ce
W20260709 12:23:43.150584 11051 consensus_peers.cc:597] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:43.146426 19500 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:23:43.173700 10977 consensus_peers.cc:597] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:43.199111 10977 consensus_peers.cc:597] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:43.201387 11051 consensus_peers.cc:597] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:43.205505 11078 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:23:43.207373 19500 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:43.214869 11656 raft_consensus.cc:1217] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 LEARNER]: Deduplicated request from leader. Original: 22.12->[22.13-22.13]   Dedup: 22.13->[]
W20260709 12:23:43.245667 10977 consensus_peers.cc:597] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:43.251533 11625 consensus_peers.cc:597] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:43.266074 19500 raft_consensus.cc:1064] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
W20260709 12:23:43.288782 10977 consensus_peers.cc:597] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:43.315640 10977 consensus_peers.cc:597] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:43.317308 11051 consensus_peers.cc:597] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:43.319420 11051 consensus_peers.cc:597] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:43.320008 11051 consensus_peers.cc:597] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:43.336642 19500 consensus_queue.cc:237] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 15, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:43.357154 11659 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 LEARNER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:23:43.357440 11083 raft_consensus.cc:1275] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:23:43.358780 19534 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:23:43.359470 19631 consensus_queue.cc:1048] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:23:43.368342 19537 raft_consensus.cc:2955] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 24 LEADER]: Committing config change with OpId 24.17: config changed from index 15 to 17, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:43.377524 11659 raft_consensus.cc:2955] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index 15 to 17, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:43.383401 11625 consensus_peers.cc:597] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:43.394192 11051 consensus_peers.cc:597] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:43.396265 10977 consensus_peers.cc:597] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:43.409303 10830 catalog_manager.cc:5697] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 15 to 17, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:43.416249 10977 consensus_peers.cc:597] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:43.417384 10977 consensus_peers.cc:597] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:43.415325 11083 raft_consensus.cc:2955] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index 15 to 17, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:43.447247 19522 raft_consensus.cc:1064] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
W20260709 12:23:43.460150 11051 consensus_peers.cc:597] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:43.472771 11625 consensus_peers.cc:597] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:43.467953 19522 consensus_queue.cc:237] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 15, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:43.507437 11002 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:23:43.509636 19568 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:23:43.516556 11656 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 LEARNER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
W20260709 12:23:43.517587 11051 consensus_peers.cc:597] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:43.526810 19557 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:23:43.570585 19522 raft_consensus.cc:2955] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Committing config change with OpId 24.18: config changed from index 17 to 18, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:43.576534 11659 raft_consensus.cc:2955] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Committing config change with OpId 24.18: config changed from index 17 to 18, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:43.586925 11051 consensus_peers.cc:597] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:43.597009 11002 raft_consensus.cc:2955] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Committing config change with OpId 24.18: config changed from index 17 to 18, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:43.601553 10831 catalog_manager.cc:5697] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 17 to 18, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:43.651369 10977 consensus_peers.cc:597] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:43.654215  9741 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 10957)
I20260709 12:23:43.661605 11083 consensus_queue.cc:237] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:43.669683 11625 consensus_peers.cc:597] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:43.690030 11659 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 12:23:43.691995 19557 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:23:43.715973 11002 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 12:23:43.717912 19557 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:23:43.724526 19568 raft_consensus.cc:2955] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Committing config change with OpId 24.19: config changed from index 18 to 19, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:43.738544 11625 consensus_peers.cc:597] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:43.743117 11656 raft_consensus.cc:2955] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Committing config change with OpId 24.19: config changed from index 18 to 19, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:43.756659 10977 consensus_peers.cc:597] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:43.782944 19631 raft_consensus.cc:1064] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:23:43.785637 19631 consensus_queue.cc:237] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 11, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:43.790481 11002 raft_consensus.cc:2955] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Committing config change with OpId 24.19: config changed from index 18 to 19, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:43.818298 10834 catalog_manager.cc:5697] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 18 to 19, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New cstate: current_term: 24 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:43.870294 10818 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 660a349ad34749648cae6a025708c84d with cas_config_opid_index 18: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:23:43.880167 11051 consensus_peers.cc:597] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:43.883812 10821 catalog_manager.cc:4755] TS 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 660a349ad34749648cae6a025708c84d: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:43.900686 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 61217.8us
W20260709 12:23:43.910636 10977 consensus_peers.cc:597] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:43.965543 11656 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 LEARNER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:23:43.967144 19535 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:23:43.976619 11625 consensus_peers.cc:597] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:43.987380 11083 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 12:23:43.991179 10977 consensus_peers.cc:597] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:43.992805 19534 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:44.020423 19537 raft_consensus.cc:2955] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:44.038795 11659 raft_consensus.cc:2955] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:44.053010 10977 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111) [suppressed 470 similar messages]
I20260709 12:23:44.071623 11083 raft_consensus.cc:2955] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:44.071897 10830 catalog_manager.cc:5697] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 13 to 14, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:44.103714 11011 consensus_queue.cc:237] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:44.110461 11659 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:23:44.117491 19537 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:44.130820 19535 raft_consensus.cc:2955] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:44.134681 11079 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:23:44.152519 11655 raft_consensus.cc:2955] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:44.168829 19631 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:23:44.175813 10977 consensus_peers.cc:597] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:44.175944 10820 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c486c31e8ba74d8a9b17989a20d141bf with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:44.205761 11079 raft_consensus.cc:2955] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:44.247659 10830 catalog_manager.cc:5697] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: config changed from index 14 to 15, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New cstate: current_term: 22 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:44.367352 11051 consensus_peers.cc:597] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:44.406545 11051 consensus_peers.cc:597] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:44.457381 11625 consensus_peers.cc:597] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:44.507359 11051 consensus_peers.cc:597] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:44.528241 11625 consensus_peers.cc:597] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:44.654719  9741 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 10957)
W20260709 12:23:44.664004 10977 consensus_peers.cc:597] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:44.664366 11051 consensus_peers.cc:597] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:44.727452 10977 consensus_peers.cc:597] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:44.738325 10977 consensus_peers.cc:597] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:44.875186 11051 consensus_peers.cc:597] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:44.879817 11051 consensus_peers.cc:597] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:44.895660 11051 consensus_peers.cc:597] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:44.926573 10821 catalog_manager.cc:4755] TS 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c486c31e8ba74d8a9b17989a20d141bf: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:45.070490 10977 consensus_peers.cc:597] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:45.138283 11625 consensus_peers.cc:597] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:45.169042 10977 consensus_peers.cc:597] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:45.208804 10977 consensus_peers.cc:597] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:45.321426 10977 consensus_peers.cc:597] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:45.327539 10977 consensus_peers.cc:597] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:45.372762 10977 consensus_peers.cc:597] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:45.373224 11051 consensus_peers.cc:597] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:45.445204 11079 consensus_queue.cc:237] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
W20260709 12:23:45.446605 11051 consensus_peers.cc:597] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:45.495280 10977 consensus_peers.cc:597] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:45.536337 11049 consensus_peers.cc:597] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d88dec874a3240d69746dfb302cf057e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:45.537976 11010 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:23:45.539608 19641 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.005s
W20260709 12:23:45.553977 11051 consensus_peers.cc:597] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:45.568562 19650 raft_consensus.cc:2955] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 LEADER]: Committing config change with OpId 27.19: config changed from index -1 to 19, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
W20260709 12:23:45.576689 11051 consensus_peers.cc:597] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:45.588320 11010 raft_consensus.cc:2955] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Committing config change with OpId 27.19: config changed from index -1 to 19, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:45.590982 10834 catalog_manager.cc:5697] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: config changed from index -1 to 19, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 27 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:45.597985 11079 consensus_queue.cc:237] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
W20260709 12:23:45.598718 11625 consensus_peers.cc:597] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:45.608431 10977 consensus_peers.cc:597] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:45.612294 11049 consensus_peers.cc:597] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 62cfdf78af4046beba4a418e904e80b1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:45.618360 11010 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
W20260709 12:23:45.619925 11625 consensus_peers.cc:597] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:45.620935 19650 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 12:23:45.623673 10977 consensus_peers.cc:597] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:45.630249 11051 consensus_peers.cc:597] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:45.655244  9741 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 10957)
I20260709 12:23:45.676466 19638 raft_consensus.cc:2955] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 LEADER]: Committing config change with OpId 27.18: config changed from index -1 to 18, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:45.684625 11002 raft_consensus.cc:2955] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Committing config change with OpId 27.18: config changed from index -1 to 18, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
W20260709 12:23:45.700866 11625 consensus_peers.cc:597] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:45.719553 10977 consensus_peers.cc:597] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:45.747584 11002 consensus_queue.cc:237] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
W20260709 12:23:45.755227 11051 consensus_peers.cc:597] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:45.756156 11051 consensus_peers.cc:597] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:45.764335 11051 consensus_peers.cc:597] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:45.770478 10830 catalog_manager.cc:5697] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: config changed from index -1 to 18, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 27 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:45.782709 10977 consensus_peers.cc:597] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:45.802489 10975 consensus_peers.cc:597] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 015a67e38c364985be24b18358579506. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:45.809332 11079 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:23:45.811597 19537 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 12:23:45.813745 10977 consensus_peers.cc:597] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:45.851675 10977 consensus_peers.cc:597] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:45.864130 11625 consensus_peers.cc:597] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:45.925163 19537 raft_consensus.cc:2955] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Committing config change with OpId 26.17: config changed from index -1 to 17, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:45.945138 11079 raft_consensus.cc:2955] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Committing config change with OpId 26.17: config changed from index -1 to 17, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
W20260709 12:23:45.984913 10977 consensus_peers.cc:597] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:46.005353 19666 ts_tablet_manager.cc:933] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:46.024827 10830 catalog_manager.cc:5697] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: config changed from index -1 to 17, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 26 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
W20260709 12:23:46.036348 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 54993.3us
W20260709 12:23:46.054239 11625 consensus_peers.cc:597] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:46.058632 11051 consensus_peers.cc:597] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:46.059188 11051 consensus_peers.cc:597] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:46.066393 11010 consensus_queue.cc:237] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
W20260709 12:23:46.082995 10977 consensus_peers.cc:597] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:46.084055 10977 consensus_peers.cc:597] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:46.087216 19666 tablet_copy_client.cc:323] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.67:40209
I20260709 12:23:46.093403 11095 tablet_copy_service.cc:140] P 1abf4b385a2b493ab83f593a1f8c9cd1: Received BeginTabletCopySession request for tablet d88dec874a3240d69746dfb302cf057e from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:40200)
I20260709 12:23:46.094018 11095 tablet_copy_service.cc:161] P 1abf4b385a2b493ab83f593a1f8c9cd1: Beginning new tablet copy session on tablet d88dec874a3240d69746dfb302cf057e from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:40200: session id = 0b171b6aaedc4f809f2753dcfadb14ce-d88dec874a3240d69746dfb302cf057e
W20260709 12:23:46.097283 11051 consensus_peers.cc:597] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:46.102219 11079 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
W20260709 12:23:46.105667 10975 consensus_peers.cc:597] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955): Couldn't send request to peer 0b171b6aaedc4f809f2753dcfadb14ce. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b668506e6eb4a57aa83a9e45c3eb356. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:46.112267 19672 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 12:23:46.119340 10977 consensus_peers.cc:597] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:46.125784 10977 consensus_peers.cc:597] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:46.131362 19674 ts_tablet_manager.cc:933] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:46.131291 11095 tablet_copy_source_session.cc:215] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:46.140067 19666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88dec874a3240d69746dfb302cf057e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:46.162575 19674 tablet_copy_client.cc:323] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.67:40209
I20260709 12:23:46.164893 11095 tablet_copy_service.cc:140] P 1abf4b385a2b493ab83f593a1f8c9cd1: Received BeginTabletCopySession request for tablet 62cfdf78af4046beba4a418e904e80b1 from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:40200)
I20260709 12:23:46.165567 11095 tablet_copy_service.cc:161] P 1abf4b385a2b493ab83f593a1f8c9cd1: Beginning new tablet copy session on tablet 62cfdf78af4046beba4a418e904e80b1 from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:40200: session id = 0b171b6aaedc4f809f2753dcfadb14ce-62cfdf78af4046beba4a418e904e80b1
I20260709 12:23:46.172461 11095 tablet_copy_source_session.cc:215] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:46.174364 19669 raft_consensus.cc:2955] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Committing config change with OpId 25.18: config changed from index -1 to 18, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:46.177496 11084 raft_consensus.cc:2955] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Committing config change with OpId 25.18: config changed from index -1 to 18, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
I20260709 12:23:46.191746 19674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62cfdf78af4046beba4a418e904e80b1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:46.212092 11625 consensus_peers.cc:597] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:46.224738 19674 tablet_copy_client.cc:806] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:46.231583 19674 tablet_copy_client.cc:670] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
W20260709 12:23:46.252307 11625 consensus_peers.cc:597] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:46.257484 11625 consensus_peers.cc:597] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:46.257615 19666 tablet_copy_client.cc:806] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:46.269361 19674 tablet_copy_client.cc:538] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:46.279470 19666 tablet_copy_client.cc:670] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:46.282418 19674 tablet_bootstrap.cc:492] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:23:46.301751 10830 catalog_manager.cc:5697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: config changed from index -1 to 18, NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) added. New cstate: current_term: 25 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } } }
W20260709 12:23:46.339901 11051 consensus_peers.cc:597] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:46.343150 19666 tablet_copy_client.cc:538] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:23:46.368006 10821 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 206491us
W20260709 12:23:46.372668 10821 catalog_manager.cc:4755] TS 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 660a349ad34749648cae6a025708c84d: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:46.471550 19666 tablet_bootstrap.cc:492] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:23:46.473037 19681 ts_tablet_manager.cc:933] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:46.483274 19681 tablet_copy_client.cc:323] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.66:41383
I20260709 12:23:46.485131 11021 tablet_copy_service.cc:140] P 2201bad9e18849b09cf82de29dd032d3: Received BeginTabletCopySession request for tablet 015a67e38c364985be24b18358579506 from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:41098)
I20260709 12:23:46.485754 11021 tablet_copy_service.cc:161] P 2201bad9e18849b09cf82de29dd032d3: Beginning new tablet copy session on tablet 015a67e38c364985be24b18358579506 from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:41098: session id = 0b171b6aaedc4f809f2753dcfadb14ce-015a67e38c364985be24b18358579506
I20260709 12:23:46.495095 11021 tablet_copy_source_session.cc:215] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:46.506258 19674 tablet_bootstrap.cc:492] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=18 overwritten=0 applied=18 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:46.508318 19681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 015a67e38c364985be24b18358579506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:46.528913 19674 tablet_bootstrap.cc:492] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:23:46.529682 19674 ts_tablet_manager.cc:1403] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 0.248s	user 0.046s	sys 0.012s
W20260709 12:23:46.524811 10977 consensus_peers.cc:597] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:46.542164 19674 raft_consensus.cc:359] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:46.552377 19674 raft_consensus.cc:740] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:23:46.591444 19674 consensus_queue.cc:260] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:46.610045 19674 ts_tablet_manager.cc:1434] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 12:23:46.630710 11095 tablet_copy_service.cc:342] P 1abf4b385a2b493ab83f593a1f8c9cd1: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-62cfdf78af4046beba4a418e904e80b1 received from {username='slave'} at 127.0.0.1:40200
I20260709 12:23:46.631178 11095 tablet_copy_service.cc:434] P 1abf4b385a2b493ab83f593a1f8c9cd1: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-62cfdf78af4046beba4a418e904e80b1 on tablet 62cfdf78af4046beba4a418e904e80b1 with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:23:46.632304 19681 tablet_copy_client.cc:806] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:46.639683 19681 tablet_copy_client.cc:670] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
W20260709 12:23:46.655743  9741 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 10957)
I20260709 12:23:46.657080 19681 tablet_copy_client.cc:538] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:23:46.658186 11051 consensus_peers.cc:597] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:46.693310 19674 ts_tablet_manager.cc:933] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce: Initiating tablet copy from peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:46.706934 19681 tablet_bootstrap.cc:492] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:23:46.782613 19666 tablet_bootstrap.cc:492] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=21 overwritten=2 applied=19 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:46.800722 19666 tablet_bootstrap.cc:492] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:23:46.801725 19666 ts_tablet_manager.cc:1403] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 0.330s	user 0.055s	sys 0.021s
I20260709 12:23:46.841678 19674 tablet_copy_client.cc:323] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Beginning tablet copy session from remote peer at address 127.9.131.66:41383
W20260709 12:23:46.868754 11625 consensus_peers.cc:597] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:46.863494 11021 tablet_copy_service.cc:140] P 2201bad9e18849b09cf82de29dd032d3: Received BeginTabletCopySession request for tablet 9b668506e6eb4a57aa83a9e45c3eb356 from peer 0b171b6aaedc4f809f2753dcfadb14ce ({username='slave'} at 127.0.0.1:41098)
I20260709 12:23:46.871156 11021 tablet_copy_service.cc:161] P 2201bad9e18849b09cf82de29dd032d3: Beginning new tablet copy session on tablet 9b668506e6eb4a57aa83a9e45c3eb356 from peer 0b171b6aaedc4f809f2753dcfadb14ce at {username='slave'} at 127.0.0.1:41098: session id = 0b171b6aaedc4f809f2753dcfadb14ce-9b668506e6eb4a57aa83a9e45c3eb356
I20260709 12:23:46.869807 19666 raft_consensus.cc:359] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:46.872999 19666 raft_consensus.cc:740] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:23:46.873718 19666 consensus_queue.cc:260] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:46.877116 19666 ts_tablet_manager.cc:1434] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.002s
I20260709 12:23:46.898353 11021 tablet_copy_source_session.cc:215] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:46.901044 11095 tablet_copy_service.cc:342] P 1abf4b385a2b493ab83f593a1f8c9cd1: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-d88dec874a3240d69746dfb302cf057e received from {username='slave'} at 127.0.0.1:40200
I20260709 12:23:46.901567 11095 tablet_copy_service.cc:434] P 1abf4b385a2b493ab83f593a1f8c9cd1: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-d88dec874a3240d69746dfb302cf057e on tablet d88dec874a3240d69746dfb302cf057e with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:23:46.914383 19674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b668506e6eb4a57aa83a9e45c3eb356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:46.938858 19681 tablet_bootstrap.cc:492] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=18 overwritten=1 applied=17 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:46.941949 19681 tablet_bootstrap.cc:492] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:23:46.944216 11659 raft_consensus.cc:1217] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 LEARNER]: Deduplicated request from leader. Original: 27.17->[27.18-27.18]   Dedup: 27.18->[]
I20260709 12:23:46.946404 19681 ts_tablet_manager.cc:1403] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 0.240s	user 0.051s	sys 0.022s
I20260709 12:23:46.954339 19681 raft_consensus.cc:359] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:46.955782 19681 raft_consensus.cc:740] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:23:46.957046 19681 consensus_queue.cc:260] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:46.959445 19681 ts_tablet_manager.cc:1434] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.003s
I20260709 12:23:46.977300 11021 tablet_copy_service.cc:342] P 2201bad9e18849b09cf82de29dd032d3: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-015a67e38c364985be24b18358579506 received from {username='slave'} at 127.0.0.1:41098
I20260709 12:23:46.977768 11021 tablet_copy_service.cc:434] P 2201bad9e18849b09cf82de29dd032d3: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-015a67e38c364985be24b18358579506 on tablet 015a67e38c364985be24b18358579506 with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:23:46.991964 19674 tablet_copy_client.cc:806] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:46.992888 19674 tablet_copy_client.cc:670] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Starting download of 1 WAL segments...
W20260709 12:23:46.999233 11051 consensus_peers.cc:597] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:46.999995 19674 tablet_copy_client.cc:538] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:47.031909 19674 tablet_bootstrap.cc:492] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap starting.
I20260709 12:23:47.040026 11655 raft_consensus.cc:1217] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 LEARNER]: Deduplicated request from leader. Original: 27.18->[27.19-27.19]   Dedup: 27.19->[]
W20260709 12:23:47.093624 10977 consensus_peers.cc:597] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:47.115829 10977 consensus_peers.cc:597] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:47.133504 11051 consensus_peers.cc:597] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:47.139081 10977 consensus_peers.cc:597] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:47.150092 11051 consensus_peers.cc:597] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:47.167603 11625 consensus_peers.cc:597] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:47.203825 19674 tablet_bootstrap.cc:492] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=18 overwritten=0 applied=18 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:47.204790 19674 tablet_bootstrap.cc:492] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce: Bootstrap complete.
I20260709 12:23:47.205458 19674 ts_tablet_manager.cc:1403] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent bootstrapping tablet: real 0.174s	user 0.061s	sys 0.012s
I20260709 12:23:47.208432 19674 raft_consensus.cc:359] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:47.209254 19674 raft_consensus.cc:740] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 LEARNER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Initialized, Role: LEARNER
I20260709 12:23:47.209895 19674 consensus_queue.cc:260] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: NON_VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: true } }
I20260709 12:23:47.218076 19674 ts_tablet_manager.cc:1434] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:23:47.249112 11021 tablet_copy_service.cc:342] P 2201bad9e18849b09cf82de29dd032d3: Request end of tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-9b668506e6eb4a57aa83a9e45c3eb356 received from {username='slave'} at 127.0.0.1:41098
I20260709 12:23:47.249609 11021 tablet_copy_service.cc:434] P 2201bad9e18849b09cf82de29dd032d3: ending tablet copy session 0b171b6aaedc4f809f2753dcfadb14ce-9b668506e6eb4a57aa83a9e45c3eb356 on tablet 9b668506e6eb4a57aa83a9e45c3eb356 with peer 0b171b6aaedc4f809f2753dcfadb14ce
I20260709 12:23:47.342474 19638 raft_consensus.cc:1064] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:23:47.353826 19638 consensus_queue.cc:237] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 16, Current term: 27, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:47.377064 11655 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 LEARNER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:23:47.380362 19667 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:23:47.391412 11010 raft_consensus.cc:1275] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:23:47.396996 19650 consensus_queue.cc:1048] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:23:47.421434 19660 raft_consensus.cc:1064] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
I20260709 12:23:47.425201 19660 consensus_queue.cc:237] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 17, Current term: 27, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:47.428984 11051 consensus_peers.cc:597] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:47.457860 11051 consensus_peers.cc:597] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:47.497581 11659 raft_consensus.cc:1217] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 LEARNER]: Deduplicated request from leader. Original: 26.16->[26.17-26.17]   Dedup: 26.17->[]
I20260709 12:23:47.508984 11002 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 12:23:47.510851 11656 raft_consensus.cc:1275] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 LEARNER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 12:23:47.511832 19667 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
W20260709 12:23:47.514974 11051 consensus_peers.cc:597] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:47.520021 19650 consensus_queue.cc:1048] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:23:47.542866 11659 raft_consensus.cc:1217] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 LEARNER]: Deduplicated request from leader. Original: 25.17->[25.18-25.18]   Dedup: 25.18->[]
I20260709 12:23:47.575044 19650 raft_consensus.cc:2955] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 LEADER]: Committing config change with OpId 27.19: config changed from index 18 to 19, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:47.578123 19638 raft_consensus.cc:2955] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 LEADER]: Committing config change with OpId 27.20: config changed from index 19 to 20, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:47.582685 11002 raft_consensus.cc:2955] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Committing config change with OpId 27.20: config changed from index 19 to 20, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:47.584575 11656 raft_consensus.cc:2955] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Committing config change with OpId 27.19: config changed from index 18 to 19, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:47.592232 11008 raft_consensus.cc:2955] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Committing config change with OpId 27.19: config changed from index 18 to 19, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:47.602943 11051 consensus_peers.cc:597] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:47.609069 10831 catalog_manager.cc:5697] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: config changed from index 18 to 19, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 27 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:47.616883 11656 raft_consensus.cc:2955] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Committing config change with OpId 27.20: config changed from index 19 to 20, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:47.656257  9741 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 10957)
W20260709 12:23:47.660141 10977 consensus_peers.cc:597] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:47.663908 11051 consensus_peers.cc:597] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:47.695127 11625 consensus_peers.cc:597] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:23:47.764014 10831 catalog_manager.cc:5697] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: config changed from index 19 to 20, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 27 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:47.926342 10977 consensus_peers.cc:597] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:47.958119 10977 consensus_peers.cc:597] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:23:47.965356 19669 raft_consensus.cc:1064] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
W20260709 12:23:47.996727 11051 consensus_peers.cc:597] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:48.017724 10977 consensus_peers.cc:597] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:48.033759 10977 consensus_peers.cc:597] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:48.037384 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 73523.9us
W20260709 12:23:48.038389 11051 consensus_peers.cc:597] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:23:48.044209 19669 consensus_queue.cc:237] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 15, Current term: 26, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:48.070971 10977 consensus_peers.cc:597] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:48.078687 11625 consensus_peers.cc:597] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:23:48.089221 11083 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:23:48.089944 11656 raft_consensus.cc:1275] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 LEARNER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:23:48.092290 19671 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:23:48.094187 19671 consensus_queue.cc:1048] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 12:23:48.115760 10977 consensus_peers.cc:597] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:48.125177 11051 consensus_peers.cc:597] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:23:48.133103 19669 raft_consensus.cc:1064] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3: attempting to promote NON_VOTER 0b171b6aaedc4f809f2753dcfadb14ce to VOTER
W20260709 12:23:48.142318 10977 consensus_peers.cc:597] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:23:48.145798 19688 raft_consensus.cc:2955] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Committing config change with OpId 26.18: config changed from index 17 to 18, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:48.147153 19669 consensus_queue.cc:237] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 16, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:48.154692 11083 raft_consensus.cc:2955] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Committing config change with OpId 26.18: config changed from index 17 to 18, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:48.183791 10977 consensus_peers.cc:597] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:23:48.195423 11655 raft_consensus.cc:2955] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Committing config change with OpId 26.18: config changed from index 17 to 18, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:48.203200 11625 consensus_peers.cc:597] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:23:48.206182 10830 catalog_manager.cc:5697] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: config changed from index 17 to 18, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 26 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:48.219811 11078 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 12:23:48.221565 11655 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 LEARNER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
W20260709 12:23:48.223291 10977 consensus_peers.cc:597] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:48.224895 19688 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:23:48.229516 19700 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 12:23:48.238327 10977 consensus_peers.cc:597] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:48.269420 19669 raft_consensus.cc:2955] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Committing config change with OpId 25.19: config changed from index 18 to 19, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:48.279578 11078 raft_consensus.cc:2955] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Committing config change with OpId 25.19: config changed from index 18 to 19, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:48.290562 11659 raft_consensus.cc:2955] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Committing config change with OpId 25.19: config changed from index 18 to 19, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:48.293098 10977 consensus_peers.cc:597] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:48.312105 10977 consensus_peers.cc:597] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:23:48.325317 10830 catalog_manager.cc:5697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: config changed from index 18 to 19, 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68) changed from NON_VOTER to VOTER. New cstate: current_term: 25 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } attrs { replace: true } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:48.339315 11625 consensus_peers.cc:597] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:48.367332 10977 consensus_peers.cc:597] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:48.407958 11625 consensus_peers.cc:597] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:23:48.411475 11002 consensus_queue.cc:237] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:48.413134 11051 consensus_peers.cc:597] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:48.420060 11051 consensus_peers.cc:597] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:23:48.421228 11659 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 12:23:48.423012 11078 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 12:23:48.422942 19700 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:23:48.427582 19700 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:23:48.437932 19670 raft_consensus.cc:2955] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Committing config change with OpId 25.20: config changed from index 19 to 20, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:48.439049 11078 raft_consensus.cc:2955] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Committing config change with OpId 25.20: config changed from index 19 to 20, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:48.444504 11051 consensus_peers.cc:597] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:23:48.453357 11659 raft_consensus.cc:2955] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Committing config change with OpId 25.20: config changed from index 19 to 20, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:48.470817 10977 consensus_peers.cc:597] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:48.482203 10977 consensus_peers.cc:597] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:23:48.531222 10820 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9b668506e6eb4a57aa83a9e45c3eb356 with cas_config_opid_index 19: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:48.546674 10831 catalog_manager.cc:5697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: config changed from index 19 to 20, VOTER 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65) evicted. New cstate: current_term: 25 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:48.657292  9741 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 10957)
W20260709 12:23:48.720168 10821 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 148151us
W20260709 12:23:48.724802 11051 consensus_peers.cc:597] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:48.732365 10821 catalog_manager.cc:4755] TS 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 660a349ad34749648cae6a025708c84d: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:48.732787 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 88462.4us
W20260709 12:23:48.758293 11625 consensus_peers.cc:597] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:48.782492 11051 consensus_peers.cc:597] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:48.791997 11625 consensus_peers.cc:597] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:48.876600 11625 consensus_peers.cc:597] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:48.882718 11051 consensus_peers.cc:597] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:48.903599 11625 consensus_peers.cc:597] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:48.906262 10977 consensus_peers.cc:597] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:48.928076 11051 consensus_peers.cc:597] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:49.064209 10977 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111) [suppressed 514 similar messages]
W20260709 12:23:49.076066 10977 consensus_peers.cc:597] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:49.555964 11625 consensus_peers.cc:597] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:49.559432 11051 consensus_peers.cc:597] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:49.605777 11051 consensus_peers.cc:597] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:49.624358 10977 consensus_peers.cc:597] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:49.630373 10977 consensus_peers.cc:597] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:49.657970  9741 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 10957)
W20260709 12:23:49.665838 11625 consensus_peers.cc:597] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:49.720803 11051 consensus_peers.cc:597] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:49.784667 11051 consensus_peers.cc:597] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:50.075390 11051 consensus_peers.cc:597] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:50.148353 11051 consensus_peers.cc:597] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:50.259596 10821 catalog_manager.cc:4755] TS 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9b668506e6eb4a57aa83a9e45c3eb356: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:50.395036 11032 debug-util.cc:398] Leaking SignalData structure 0x7b0800345ac0 after lost signal to thread 9744
W20260709 12:23:50.396274 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7ca0 after lost signal to thread 10868
W20260709 12:23:50.397611 11032 debug-util.cc:398] Leaking SignalData structure 0x7b080033c160 after lost signal to thread 11035
W20260709 12:23:50.398212 11051 consensus_peers.cc:597] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:50.398777 11032 debug-util.cc:398] Leaking SignalData structure 0x7b08001b6f00 after lost signal to thread 11109
W20260709 12:23:50.402333 11625 consensus_peers.cc:597] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:50.407809 11051 consensus_peers.cc:597] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:50.428243 11032 debug-util.cc:398] Leaking SignalData structure 0x7b0800063040 after lost signal to thread 11683
W20260709 12:23:50.482267 11051 consensus_peers.cc:597] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:50.584165 11625 consensus_peers.cc:597] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:50.658473  9741 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 10957)
W20260709 12:23:50.662971 11625 consensus_peers.cc:597] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:50.758880 11625 consensus_peers.cc:597] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:50.799877 11051 consensus_peers.cc:597] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:50.830739 11051 consensus_peers.cc:597] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:50.879367 11625 consensus_peers.cc:597] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:50.902633 11051 consensus_peers.cc:597] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:50.903172 11051 consensus_peers.cc:597] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:50.989337 11625 consensus_peers.cc:597] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:51.064328 10977 consensus_peers.cc:597] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:51.065416 10977 consensus_peers.cc:597] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:51.068324 10977 consensus_peers.cc:597] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:51.080891 10977 consensus_peers.cc:597] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:51.122419 10977 consensus_peers.cc:597] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:51.137920 10977 consensus_peers.cc:597] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:51.157783 11051 consensus_peers.cc:597] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:51.158342 10977 consensus_peers.cc:597] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:51.173344 10977 consensus_peers.cc:597] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:51.189632 11051 consensus_peers.cc:597] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:51.252823 11051 consensus_peers.cc:597] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:51.257233 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 82510.9us
W20260709 12:23:51.310452 11625 consensus_peers.cc:597] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:51.409720 10977 consensus_peers.cc:597] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:51.425310 11051 consensus_peers.cc:597] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:51.431063 10821 catalog_manager.cc:4755] TS 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9b668506e6eb4a57aa83a9e45c3eb356: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:51.536211 11625 consensus_peers.cc:597] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:51.536624 10977 consensus_peers.cc:597] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:51.553646 10977 consensus_peers.cc:597] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:51.595444 11051 consensus_peers.cc:597] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:51.596601 11625 consensus_peers.cc:597] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:51.618451 10977 consensus_peers.cc:597] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:51.619114 10977 consensus_peers.cc:597] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:51.659164  9741 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 10957)
W20260709 12:23:51.688306 10977 consensus_peers.cc:597] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:51.825675 10977 consensus_peers.cc:597] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:51.835232 10977 consensus_peers.cc:597] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:51.882266 11625 consensus_peers.cc:597] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:52.034786 10977 consensus_peers.cc:597] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:52.117600 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 53426.8us
W20260709 12:23:52.172501 11051 consensus_peers.cc:597] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:52.334579 11051 consensus_peers.cc:597] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:52.408016 11051 consensus_peers.cc:597] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:52.408998 11625 consensus_peers.cc:597] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:52.431751 11051 consensus_peers.cc:597] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:52.472466 11051 consensus_peers.cc:597] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:52.489264 10977 consensus_peers.cc:597] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:52.863339 10821 catalog_manager.cc:4755] TS 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 660a349ad34749648cae6a025708c84d: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:53.695813  9746 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5800 after lost signal to thread 10974
W20260709 12:23:53.696501  9746 kernel_stack_watchdog.cc:198] Thread 10974 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 111ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260709 12:23:54.025931 10975 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.435s	user 0.014s	sys 0.000s
W20260709 12:23:54.026571 10975 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.436s	user 0.015s	sys 0.000s
I20260709 12:23:54.034693 19744 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.253219 19744 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.256034 19744 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:54.051834 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 1.4685e+06us
W20260709 12:23:54.259960 10976 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.656s	user 0.004s	sys 0.034s
W20260709 12:23:54.260566 10976 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.656s	user 0.005s	sys 0.034s
W20260709 12:23:54.211458 11050 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.602s	user 0.006s	sys 0.022s
W20260709 12:23:54.264261 11050 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.655s	user 0.006s	sys 0.023s
I20260709 12:23:54.273001 19743 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.273761 19743 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.273133 19748 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.292400 19748 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.294787 19748 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.296293 19743 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:54.296818 10865 debug-util.cc:398] Leaking SignalData structure 0x7b0800175a60 after lost signal to thread 9744
I20260709 12:23:54.301728 19728 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.302445 19728 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:54.304594 10865 debug-util.cc:398] Leaking SignalData structure 0x7b0800372560 after lost signal to thread 10868
W20260709 12:23:54.307415 11625 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111) [suppressed 316 similar messages]
I20260709 12:23:54.263778 19731 raft_consensus.cc:493] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:23:54.319263 10865 debug-util.cc:398] Leaking SignalData structure 0x7b080027a940 after lost signal to thread 11035
W20260709 12:23:54.320621 10865 debug-util.cc:398] Leaking SignalData structure 0x7b08000c6f80 after lost signal to thread 11109
I20260709 12:23:54.325770 19749 raft_consensus.cc:493] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:23:54.327459 10865 debug-util.cc:398] Leaking SignalData structure 0x7b080034dd80 after lost signal to thread 11683
I20260709 12:23:54.326457 19745 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.333177 19743 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.334008 19735 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.335270 19728 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.328336 19731 raft_consensus.cc:515] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.343715 19743 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.350771 19731 leader_election.cc:290] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.351482 19751 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.352054 19743 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.344242 19758 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.353511 19760 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.344502 19752 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.354107 19760 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.354490 19752 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.356379 19759 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.344200 19744 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.352080 19751 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.357864 19744 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.353240 19758 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.334268 19749 raft_consensus.cc:515] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.349984 19735 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.391753 19735 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.357033 19759 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.394035 19759 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.394343 19744 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:54.342917 19745 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.359804 19751 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:54.396924 19760 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.357028 19752 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.399318 19749 leader_election.cc:290] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.401304 19758 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:54.417759 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 110355us
I20260709 12:23:54.397341 19745 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.425871 19752 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.430269 19723 raft_consensus.cc:493] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.434046 19723 raft_consensus.cc:515] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.432210 19728 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.435262 19728 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.436189 19723 leader_election.cc:290] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.437803 19746 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.437858 19728 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.431154 19745 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.442620 19769 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.442575 19745 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.443912 19761 raft_consensus.cc:493] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.443346 19769 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.444437 19761 raft_consensus.cc:515] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.445526 19764 raft_consensus.cc:493] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.446084 19764 raft_consensus.cc:515] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.430979 19743 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.446897 19769 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.447043 19743 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.441430 19749 raft_consensus.cc:493] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.448310 19749 raft_consensus.cc:515] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.448675 19764 leader_election.cc:290] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.450265 19749 leader_election.cc:290] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.444954 19745 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.438620 19752 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.456255 19774 raft_consensus.cc:493] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:54.456840 19774 raft_consensus.cc:515] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.458091 19752 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:54.459007 19774 leader_election.cc:290] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.459546 19774 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.460057 19774 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.460563 19743 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.443554 19746 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.468578 19772 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.468829 19753 raft_consensus.cc:493] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.469218 19772 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.469334 19753 raft_consensus.cc:515] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.469702 19731 raft_consensus.cc:493] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:54.470408 19731 raft_consensus.cc:515] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.471496 19753 leader_election.cc:290] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.468600 19736 raft_consensus.cc:493] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:54.472499 19731 leader_election.cc:290] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.473007 19746 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.471546 19772 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.472442 19736 raft_consensus.cc:515] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.476187 19736 leader_election.cc:290] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.477584 19748 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.478143 19748 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.446557 19761 leader_election.cc:290] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.480000 19758 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:23:54.467561 11625 leader_election.cc:336] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:54.483973 19748 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:54.498107 19767 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.498764 19758 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.502583 19767 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.504621 19758 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.504745 19767 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:54.506433 19774 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:54.485582 19723 raft_consensus.cc:493] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:54.512156 19773 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.512341 19723 raft_consensus.cc:515] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.512842 19773 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.514236 19771 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.514659 19723 leader_election.cc:290] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.514951 19773 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.485740 19764 raft_consensus.cc:493] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:54.485641 19735 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.492637 19751 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.515106 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:54.515453 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3426d7ccdd943b882b65c3977a20040" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:54.512431 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:54.515179 19760 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:54.528524 11655 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 24.
I20260709 12:23:54.532502 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba629b94057b4c4e9085289ea50b42f1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:54.533994 19747 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:54.534644 19747 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.536352 19760 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.537062 19747 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.537709 19751 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.538399 19760 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.530771 11659 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 27.
I20260709 12:23:54.528344 19764 raft_consensus.cc:515] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.543401 19751 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:54.539412 19773 raft_consensus.cc:493] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
W20260709 12:23:54.544236 11625 leader_election.cc:336] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:54.544637 19773 raft_consensus.cc:515] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:54.545053 11625 leader_election.cc:336] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:54.546420 11625 leader_election.cc:336] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:54.514782 19771 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.547169 19764 leader_election.cc:290] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.548836 19771 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:54.529826 19735 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.552942 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:54.552680 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa58b8bde194f658aced897744b4d35" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:54.554420 19735 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:54.556807 19780 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.526703 19774 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.551609 10975 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
W20260709 12:23:54.555058 11051 consensus_peers.cc:597] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:54.547052 19773 leader_election.cc:290] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.567881 19771 raft_consensus.cc:493] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:54.569679 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b156bebcd53a4b6ea1f83c42906a5a03" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.570573 19723 raft_consensus.cc:493] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:54.571154 19723 raft_consensus.cc:515] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.573838 19723 leader_election.cc:290] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.574321 19753 raft_consensus.cc:493] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:54.559199 19774 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.568519 19771 raft_consensus.cc:515] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.587941 19775 raft_consensus.cc:493] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.588497 19775 raft_consensus.cc:515] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.589498 19774 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:54.590687 19775 leader_election.cc:290] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.585750 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.586221 19761 raft_consensus.cc:493] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:54.586809 19757 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.586663 19753 raft_consensus.cc:515] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.587312 19736 raft_consensus.cc:493] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.563666 19780 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.589758 19771 leader_election.cc:290] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.592000 19768 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:54.592247 10975 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:54.592973 19754 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.584612 19777 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.595724 11082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.625977 11082 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 26.
I20260709 12:23:54.597945 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.599367 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.599898 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b6c427f0a234dbab806dced4d3ba0fb" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.600351 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0774d95f5c1b4bdb990e50f5d858b600" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.601256 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:23:54.603351 11625 leader_election.cc:336] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:54.616743 11083 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 22.
I20260709 12:23:54.622047 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e76c15ad9c49ab9b98a5d216125beb" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:23:54.625022 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 70314.5us
W20260709 12:23:54.627507 11625 leader_election.cc:336] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:54.624644 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:23:54.672124 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 44647.7us
W20260709 12:23:54.672684 11625 leader_election.cc:336] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:54.630375 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.630823 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.631114 19776 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:23:54.631616 19780 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:54.625425 19736 raft_consensus.cc:515] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.680588 19776 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.681113 19776 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:23:54.681325 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88db1b2c7304a19a16c4f9b17c02e8e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.632652 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.682413 19736 leader_election.cc:290] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.622784 19757 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.631551 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.683912 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32589fba10354b9588f7cb0a69c6e92d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.685050 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a004d154c4012ba8a1037b80c0109" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.685146 19757 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.686115 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ce8649e6b64336a3064cc1da978105" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.687116 11077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56f49dc9fb94be0bc1eba5a2b97049c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.636583 19723 raft_consensus.cc:493] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
W20260709 12:23:54.637266 10975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:41955, user_credentials={real_user=slave}} blocked reactor thread for 45116.2us
I20260709 12:23:54.637585 19775 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.688143 19723 raft_consensus.cc:515] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.688334 19775 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.690289 19723 leader_election.cc:290] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.637092 19764 raft_consensus.cc:493] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.691164 19775 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.691337 19764 raft_consensus.cc:515] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.693832 19764 leader_election.cc:290] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.637773 19746 raft_consensus.cc:493] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.640038 19773 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.640595 19750 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.641013 19751 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.694736 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7e00767e0a443fab6f928812d5f6e2" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.644440 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.694936 19751 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.696338 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9432c125c17431e881ba1329e02a201" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.641426 19760 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.647126 19735 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.637527 19749 raft_consensus.cc:493] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.649883 19779 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:54.697199 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.654466 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.654917 19753 leader_election.cc:290] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.628273 19777 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.697819 19735 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.698764 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f281b53af584a8bab9bb1d343d005f8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.655642 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d263972b0e844fa281354fac07ccef80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.699837 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661c79d4d9c74a30911ec88c18ba8229" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.625475 19768 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.700976 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a101fb991414a5f840476aaa2d8e5b3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.701838 19768 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.631511 19754 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.702723 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.694599 19773 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.704751 19754 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.682760 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b41c3859494dab9f6f8bc6bccc8062" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.705173 19773 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:54.706182 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d2f9dca08d41e7a77146322049c40c" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.658145 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab5cd1b86b54cb89fdd3eef419ac66a" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.697443 19760 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.697494 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c81137a7dc49c9953309b2d9d22d7e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.709029 19760 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:54.710206 19749 raft_consensus.cc:515] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.637334 19772 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.669291 11004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7148e567a4f6da2aa56002e55b027" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.629791 11083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.711436 19772 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.697901 19779 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.712329 19749 leader_election.cc:290] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.712886 11011 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 24.
W20260709 12:23:54.659375 11051 consensus_peers.cc:597] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:54.699995 19735 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:54.714788 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 55475.9us
W20260709 12:23:54.715260 11051 leader_election.cc:336] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:54.697201 19751 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:54.679987 11625 leader_election.cc:336] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:54.719010 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 45815.5us
W20260709 12:23:54.719652 11625 consensus_peers.cc:597] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:54.624626 19761 raft_consensus.cc:515] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.682752 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e2dd59ef5642098b4166c9da8d596d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.722223 19761 leader_election.cc:290] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.681349 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.722514 11622 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:54.638350 19731 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:23:54.723654 19743 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:54.723989 19731 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.653270 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b768aea2bd34049a2aa54e4f4f19bf6" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.699975 19777 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:54.724457 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:54.724495 19731 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:54.725091 11659 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 21.
I20260709 12:23:54.702029 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.726300 11009 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:23:54.657514 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.702482 19750 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:54.694572 19746 raft_consensus.cc:515] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:54.697345  9746 debug-util.cc:398] Leaking SignalData structure 0x7b08003c1aa0 after lost signal to thread 10974
I20260709 12:23:54.728667 10975 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:54.729861 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:54.730114 19746 leader_election.cc:290] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.729875 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:54.730674 11651 raft_consensus.cc:2468] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 27.
I20260709 12:23:54.731123 19736 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:54.729401 11655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:54.714207 19779 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.731607 19736 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.731067 11652 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 19.
I20260709 12:23:54.732228 19736 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:54.731550 19750 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:54.729455 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:54.733996 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:54.723594 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e2bba2f11943899027eb26325e2b6a" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:54.734630 11659 raft_consensus.cc:2468] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 27.
I20260709 12:23:54.713537 19772 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.730278 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80db8b3fbfd046e8a5535ff4a7380107" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:54.743999 10975 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:54.744961 11622 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:23:54.752576 11622 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:54.753676 19779 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:54.754181 19779 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:23:54.754289 19743 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:54.754632 19779 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:54.753521 19758 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:23:54.755069 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 65920.6us
I20260709 12:23:54.755611 19758 raft_consensus.cc:493] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.756047 19758 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:54.763016 19779 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:54.720494 11625 leader_election.cc:336] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:54.765951 11625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 45482.6us
I20260709 12:23:54.748579 19731 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.741426 19736 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.769047 19779 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.770408 19731 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.771425 11003 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 24. Current term is 25. Ops: []
I20260709 12:23:54.771982 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:54.772470 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:54.767524 10974 leader_election.cc:304] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:54.770408 19736 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.680255 11081 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 25.
I20260709 12:23:54.772614 11656 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:54.773342 11658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:54.774091 11658 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:23:54.779956 11625 leader_election.cc:336] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:54.773579 19731 raft_consensus.cc:2749] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:54.773066 11659 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:54.785636 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.787882 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:54.787902 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c7453ea4954ac4ad9465233dd1e839" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.789563 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07467552f78d410bb9e5774f3340f134" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.789764 11656 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 22.
I20260709 12:23:54.790490 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.793887 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:54.795297 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f1b75a0edb45d493bb20e8a0f34156" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:54.768399 11622 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:54.799160 11622 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:54.800113 19748 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:54.800777 10975 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:54.800932 19748 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:54.801658 19723 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:54.801926 11622 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:54.802219 19723 raft_consensus.cc:697] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:54.802708 19748 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:23:54.803246 19723 consensus_queue.cc:237] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.804577 11653 raft_consensus.cc:1240] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 21. Current term is 22. Ops: []
I20260709 12:23:54.806530 11659 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 25.
I20260709 12:23:54.806897 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.807197 11658 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2201bad9e18849b09cf82de29dd032d3 in term 20.
W20260709 12:23:54.748522 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 55155.4us
I20260709 12:23:54.807607 10975 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:54.808526 10975 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:54.809430 19731 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:54.808454 19779 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:23:54.809985 19731 raft_consensus.cc:697] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:54.811329 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.811044 19731 consensus_queue.cc:237] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.810266 19779 raft_consensus.cc:697] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Becoming Leader. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:54.816344 19779 consensus_queue.cc:237] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.818678 11050 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:54.819991 19750 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:23:54.824558 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:54.826423 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:54.830112 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:54.829790 19758 raft_consensus.cc:515] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.833611 11659 raft_consensus.cc:1240] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 22. Current term is 23. Ops: []
I20260709 12:23:54.835187 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.836650 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ccace425f6c4d5ea9588504233ffee0" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.837473 11622 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:54.838299 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:54.839460 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ccd4bc26b14304b81583bf6a6d3efb" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:54.838810 11050 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:54.841616 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.841988 11076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:54.841899 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fb947776bd4e70b1f04a0af3390ae3" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.843325 19723 consensus_queue.cc:1059] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:54.843681 19751 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:23:54.844177 19751 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:54.844319 19723 raft_consensus.cc:3055] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:23:54.844717 19723 raft_consensus.cc:740] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:54.845475 19758 leader_election.cc:290] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:54.845423 19723 consensus_queue.cc:260] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.846153 11084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:54.848874 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b28a94627d4cbd8f41c75a4ef23953" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:54.846287 19751 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:54.852145 11652 raft_consensus.cc:1240] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:54.846597 11050 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:54.853384 11658 raft_consensus.cc:1240] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 24. Current term is 25. Ops: []
I20260709 12:23:54.848874 19723 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:54.852236 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f6166d836f41229df11ee42cd8e4c7" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:23:54.857378 11051 leader_election.cc:336] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:54.858088 11051 leader_election.cc:336] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:54.858513 11051 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:54.860319 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76df1b7dc3b4bada7c1112da8ce327b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
W20260709 12:23:54.861469 11051 leader_election.cc:336] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:54.861950 11051 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:54.863848 11051 leader_election.cc:336] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:54.864727 11051 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:54.870257 10974 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:54.861194 19735 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:54.871608 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f850953ee221438f81da7fc8c8b44f9b" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.871927 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3625831778d468cb424c06fc474c323" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.872707 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0bf4b65018642ba928b62c815b01489" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.873180 11049 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:54.873888 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970339bba6a8454e8c722b4367924db8" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.861297 19760 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:54.875171 11049 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:54.862083 19752 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:23:54.871618 19735 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0b171b6aaedc4f809f2753dcfadb14ce)
I20260709 12:23:54.876506 19780 raft_consensus.cc:2749] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:54.873744 19778 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:54.875092 19760 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:54.861092 19777 consensus_queue.cc:1059] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 24.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.019s
I20260709 12:23:54.880470 19777 raft_consensus.cc:3055] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:23:54.880836 19777 raft_consensus.cc:740] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:54.876856 19735 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:54.878098 11049 leader_election.cc:304] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:54.882733 11051 leader_election.cc:336] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:54.883342 11051 leader_election.cc:336] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:54.883795 11051 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:54.884600 19773 raft_consensus.cc:2749] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:54.881670 19777 consensus_queue.cc:260] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.885824 19777 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:54.886543 19778 consensus_queue.cc:1059] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:23:54.888593 19750 raft_consensus.cc:3055] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:23:54.888923 19750 raft_consensus.cc:740] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:54.889672 19750 consensus_queue.cc:260] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.887610 19760 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:54.891311 11049 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:54.892519 19776 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.896463 11002 raft_consensus.cc:1240] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 28 FOLLOWER]: Rejecting Update request from peer 1abf4b385a2b493ab83f593a1f8c9cd1 for earlier term 27. Current term is 28. Ops: []
I20260709 12:23:54.897125 11049 leader_election.cc:304] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:54.898056 19776 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 election: Requested vote from peers 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.898916 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:54.894995 19750 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:54.905602 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.906637 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.906881 11008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.907426 11009 raft_consensus.cc:2393] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b171b6aaedc4f809f2753dcfadb14ce in current term 28: Already voted for candidate 2201bad9e18849b09cf82de29dd032d3 in this term.
I20260709 12:23:54.908417 19760 raft_consensus.cc:2749] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:23:54.909094 19760 raft_consensus.cc:2749] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:54.909857 19778 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:54.910825 11051 leader_election.cc:336] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:54.910995 11008 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 23.
I20260709 12:23:54.914237 11051 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:54.913506 11010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.914077 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.912415 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.914889 19778 consensus_queue.cc:1059] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:23:54.914219 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda5e552d0f54d1daafad75449fbb509" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.917586 19778 raft_consensus.cc:3055] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:54.918020 19778 raft_consensus.cc:740] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:54.918341 19735 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.918978 19778 consensus_queue.cc:260] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.920051 19760 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:23:54.920261 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40209, user_credentials={real_user=slave}} blocked reactor thread for 50069.4us
I20260709 12:23:54.920778 19776 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:54.921932 11011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.932372 10974 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:54.933137 19776 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:54.933272 19735 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.925132 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cfdf78af4046beba4a418e904e80b1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.923035 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.912421 19751 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.928335 19778 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:54.938037 19751 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:54.966764 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:54.966943 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "2201bad9e18849b09cf82de29dd032d3" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:54.968365 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:54.968961 19751 consensus_queue.cc:1059] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: INVALID_TERM, Last received: 27.21, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260709 12:23:54.970014 19751 raft_consensus.cc:3055] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:23:54.970331 19751 raft_consensus.cc:740] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:54.971124 19751 consensus_queue.cc:260] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 27.21, Last appended by leader: 21, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:54.972018 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d1425ae0d743b7be813705b92d4e15" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.972486 19751 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:23:54.973590 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88dec874a3240d69746dfb302cf057e" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.974990 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b4e206b7694af695234c0e758055e2" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.976329 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3" is_pre_election: true
I20260709 12:23:54.977686 11005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
I20260709 12:23:54.990687 11005 raft_consensus.cc:2468] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 23.
I20260709 12:23:54.996831 11622 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:23:54.997808 19766 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:23:54.998215 19766 raft_consensus.cc:493] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:54.998539 19766 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:55.005345 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:55.008565 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
W20260709 12:23:55.019059 11625 consensus_peers.cc:597] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:55.020011 11625 consensus_peers.cc:597] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:55.022105 11625 consensus_peers.cc:597] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:55.028863 11625 consensus_peers.cc:597] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:55.024163 19766 raft_consensus.cc:515] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Starting leader election with config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:55.033492 11658 raft_consensus.cc:1240] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Rejecting Update request from peer 2201bad9e18849b09cf82de29dd032d3 for earlier term 25. Current term is 26. Ops: []
I20260709 12:23:55.021483 10974 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:55.035077 19731 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:23:55.035575 19723 consensus_queue.cc:1059] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 12:23:55.036653 19723 raft_consensus.cc:3055] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:23:55.036999 19723 raft_consensus.cc:740] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 2201bad9e18849b09cf82de29dd032d3, State: Running, Role: LEADER
I20260709 12:23:55.037668 19723 consensus_queue.cc:260] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 25.20, Last appended by leader: 20, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:55.038892 19723 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:55.046458 11049 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:55.047636 19778 raft_consensus.cc:2749] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:55.051208 11081 raft_consensus.cc:1240] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 24. Current term is 25. Ops: []
I20260709 12:23:55.051841 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c486c31e8ba74d8a9b17989a20d141bf" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:55.053409 11080 raft_consensus.cc:1240] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Rejecting Update request from peer 0b171b6aaedc4f809f2753dcfadb14ce for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:55.054579 11049 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:55.055927 19778 raft_consensus.cc:2749] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:23:55.057013 19766 leader_election.cc:290] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:55.079532 11051 leader_election.cc:336] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.080084 11051 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.080822 19778 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:23:55.105535 11051 leader_election.cc:336] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.109000 11051 leader_election.cc:304] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:55.106269 11625 consensus_peers.cc:597] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:55.111507 19735 raft_consensus.cc:2749] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:23:55.111886 11051 consensus_peers.cc:597] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:55.112389 11051 leader_election.cc:336] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.115715 11051 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.117741 11624 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.122201 11624 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:55.123307 19758 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:23:55.124042 19758 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:23:55.134438 19758 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:23:55.144932 19735 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:55.148211 11624 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:55.149741 19758 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:55.153167 11624 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:55.154973 19766 raft_consensus.cc:2749] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:55.158622 11624 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.159958 19766 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:55.167012 11624 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:55.173218 11624 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.173862 19758 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:23:55.169023 11051 leader_election.cc:336] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.183521 11051 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.184340 19735 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:23:55.190966 11051 leader_election.cc:336] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.191823 11051 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.192442 19766 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:55.195988 11624 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.204352 19735 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:23:55.205386 11051 leader_election.cc:336] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.205902 19766 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:23:55.207971 11051 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.206862 11624 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:55.209054 19766 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:55.210551 19735 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:23:55.211709 11051 leader_election.cc:336] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.215107 11051 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.214579 11624 leader_election.cc:304] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 
I20260709 12:23:55.216152 19735 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:23:55.220786 19766 raft_consensus.cc:2804] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:23:55.221709 19766 raft_consensus.cc:697] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:23:55.224354 19766 consensus_queue.cc:237] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:55.231503 11009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "2201bad9e18849b09cf82de29dd032d3"
W20260709 12:23:55.217247 11051 leader_election.cc:336] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:55.234264 10977 consensus_peers.cc:597] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:55.239146 10977 leader_election.cc:336] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.241016 10977 leader_election.cc:304] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.241899 19785 raft_consensus.cc:2749] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:23:55.243067 10977 leader_election.cc:336] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.243534 10977 leader_election.cc:304] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.244546 19785 raft_consensus.cc:2749] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:23:55.246981 10977 consensus_peers.cc:597] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:55.247510 10977 leader_election.cc:336] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.248018 10977 leader_election.cc:304] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.248780 19785 raft_consensus.cc:2749] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:55.234373 11051 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.260846 19735 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:55.261710 11084 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 12:23:55.264699 10830 catalog_manager.cc:5697] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 22 to 23, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 23 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:55.247211 11009 raft_consensus.cc:2468] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 26.
W20260709 12:23:55.268536 11625 consensus_peers.cc:597] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:23:55.280992 19758 consensus_queue.cc:1059] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:23:55.282202 19758 raft_consensus.cc:3055] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:23:55.282732 19758 raft_consensus.cc:740] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:23:55.283715 19758 consensus_queue.cc:260] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:55.285157 19749 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:23:55.285130 19758 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:23:55.286688 10977 leader_election.cc:336] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.287184 10977 leader_election.cc:304] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.287957 19753 raft_consensus.cc:2749] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:55.291363 11084 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:23:55.301196 19766 consensus_queue.cc:1059] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:55.301946 19749 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:23:55.302595 19752 raft_consensus.cc:3055] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:55.303051 19752 raft_consensus.cc:740] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:23:55.304052 19752 consensus_queue.cc:260] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:55.305362 19752 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:55.307497 11051 leader_election.cc:336] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.308087 11051 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.312430 19735 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:23:55.315347 11051 consensus_peers.cc:597] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:55.316593  9741 tablet_server.cc:196] TabletServer@127.9.131.65:0 shutdown complete.
W20260709 12:23:55.316588 10977 leader_election.cc:336] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.318872 10977 leader_election.cc:304] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.319770 19749 raft_consensus.cc:2749] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:23:55.320959 10977 leader_election.cc:336] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.321435 10977 leader_election.cc:304] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.322216 19749 raft_consensus.cc:2749] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:23:55.323652 10977 leader_election.cc:336] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.324198 10977 leader_election.cc:304] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.324995 19749 raft_consensus.cc:2749] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:23:55.327564 10977 leader_election.cc:336] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.328017 10977 leader_election.cc:304] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:55.335103 10977 leader_election.cc:336] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.335510 10977 leader_election.cc:304] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.335891 19749 raft_consensus.cc:2749] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:55.336272 19753 raft_consensus.cc:2749] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:23:55.336404 10977 leader_election.cc:336] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.343771 10977 leader_election.cc:304] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.344647 19749 raft_consensus.cc:2749] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:23:55.344862 10977 consensus_peers.cc:597] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:55.345374 10977 leader_election.cc:336] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.345772 10977 leader_election.cc:304] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.346468 19753 raft_consensus.cc:2749] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:23:55.348354 11625 consensus_peers.cc:597] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:55.350591 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b668506e6eb4a57aa83a9e45c3eb356" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
W20260709 12:23:55.349653 10977 leader_election.cc:336] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.353260 10977 leader_election.cc:304] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.353993 19753 raft_consensus.cc:2749] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:23:55.354928 10977 leader_election.cc:336] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.355391 10977 leader_election.cc:304] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:55.356760 11051 consensus_peers.cc:597] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:55.357658 10977 leader_election.cc:336] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:55.357645 11051 consensus_peers.cc:597] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:55.358253 10977 leader_election.cc:304] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:55.358578 11051 consensus_peers.cc:597] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:55.361047 19775 raft_consensus.cc:2749] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:55.361001 19749 raft_consensus.cc:2749] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:55.366560 10977 leader_election.cc:336] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.367061 10834 catalog_manager.cc:5697] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 24 to 25, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 25 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
I20260709 12:23:55.369589 11656 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:23:55.371111 19749 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:23:55.375875 10977 leader_election.cc:304] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.377460 19749 raft_consensus.cc:2749] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:23:55.378855 10977 leader_election.cc:336] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.379385 10977 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:55.386950 10977 leader_election.cc:336] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.387446 10977 leader_election.cc:304] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.388482 19749 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:23:55.418311 19775 raft_consensus.cc:2749] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:23:55.419652 10977 leader_election.cc:336] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.420171 10977 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:55.401780 11051 consensus_peers.cc:597] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:55.421101 19775 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:23:55.421841 11656 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
W20260709 12:23:55.422147 10977 leader_election.cc:336] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.422641 10977 leader_election.cc:304] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.423365 19775 raft_consensus.cc:2749] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:55.423595 10834 catalog_manager.cc:5697] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 19 to 20, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 20 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } } }
W20260709 12:23:55.424468 10977 leader_election.cc:336] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.424943 10977 leader_election.cc:304] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 0b171b6aaedc4f809f2753dcfadb14ce, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:55.426066 10977 leader_election.cc:336] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:55.426498 10977 leader_election.cc:304] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:55.426162 19775 raft_consensus.cc:2749] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:55.428226 19749 raft_consensus.cc:2749] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:55.428686 11080 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:23:55.431231 19749 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:23:55.432144 19775 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:23:55.442924 11624 leader_election.cc:304] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 2201bad9e18849b09cf82de29dd032d3; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1
I20260709 12:23:55.444118 19758 raft_consensus.cc:2804] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:23:55.444628 19758 raft_consensus.cc:697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:23:55.445552 19758 consensus_queue.cc:237] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 25.20, Last appended by leader: 20, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:55.454106 11659 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Refusing update from remote peer 2201bad9e18849b09cf82de29dd032d3: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
W20260709 12:23:55.454499 10977 consensus_peers.cc:597] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:55.450431 10830 catalog_manager.cc:5697] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 reported cstate change: term changed from 21 to 22, leader changed from 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67) to 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66). New cstate: current_term: 22 leader_uuid: "2201bad9e18849b09cf82de29dd032d3" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:55.459659 19753 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 12:23:55.469658 10977 consensus_peers.cc:597] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:55.520726 11624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 63992.6us
W20260709 12:23:55.605394 11051 consensus_peers.cc:597] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:23:55.615022 10830 catalog_manager.cc:5697] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 25 to 26, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 26 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:55.624251 11051 consensus_peers.cc:597] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:55.652674 10977 consensus_peers.cc:597] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:55.653456 10977 consensus_peers.cc:597] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:55.670109 11084 raft_consensus.cc:3060] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:23:55.681500 10977 consensus_peers.cc:597] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:55.688961 11051 consensus_peers.cc:597] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:55.690815 11084 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:23:55.693050 19804 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:23:55.704069 11050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:41383, user_credentials={real_user=slave}} blocked reactor thread for 105915us
W20260709 12:23:55.736085 11625 consensus_peers.cc:597] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:55.761735 10977 consensus_peers.cc:597] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:55.772279 11008 raft_consensus.cc:1275] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 12:23:55.772611 11051 consensus_peers.cc:597] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:55.774163 19810 consensus_queue.cc:1048] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:23:55.881352 11625 consensus_peers.cc:597] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:23:55.905066 11008 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 25 index: 20. Preceding OpId from leader: term: 26 index: 21. (index mismatch)
I20260709 12:23:55.909173 19748 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 12:23:55.936545 11084 raft_consensus.cc:3060] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:55.944613 11084 raft_consensus.cc:1275] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 25 index: 20. Preceding OpId from leader: term: 26 index: 21. (index mismatch)
I20260709 12:23:55.950834 19748 consensus_queue.cc:1048] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
W20260709 12:23:55.960273 11051 consensus_peers.cc:597] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:55.967171 10977 consensus_peers.cc:597] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:56.003804  9741 tablet_server.cc:179] TabletServer@127.9.131.66:0 shutting down...
W20260709 12:23:56.035166 11050 consensus_peers.cc:597] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:56.044862 11050 consensus_peers.cc:597] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:56.073474 11050 consensus_peers.cc:597] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.119364  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:56.120437  9741 tablet_replica.cc:333] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.121266  9741 raft_consensus.cc:2243] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:23:56.122485  9741 raft_consensus.cc:2272] T e4d1425ae0d743b7be813705b92d4e15 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.125424  9741 tablet_replica.cc:333] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.126271  9741 raft_consensus.cc:2243] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Raft consensus shutting down.
W20260709 12:23:56.128661 11050 consensus_peers.cc:597] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:56.135149 11050 consensus_peers.cc:597] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.135603  9741 raft_consensus.cc:2272] T e6f7148e567a4f6da2aa56002e55b027 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.138525  9741 tablet_replica.cc:333] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.139322  9741 raft_consensus.cc:2243] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.139961  9741 raft_consensus.cc:2272] T c4e2dd59ef5642098b4166c9da8d596d P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.154663  9741 tablet_replica.cc:333] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.156136  9741 raft_consensus.cc:2243] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:56.156574 11050 consensus_peers.cc:597] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.156847  9741 raft_consensus.cc:2272] T c88db1b2c7304a19a16c4f9b17c02e8e P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.159931  9741 tablet_replica.cc:333] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.160858  9741 raft_consensus.cc:2243] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.161701  9741 raft_consensus.cc:2272] T f56f49dc9fb94be0bc1eba5a2b97049c P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.202289  9741 tablet_replica.cc:333] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.215301  9741 raft_consensus.cc:2243] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.221194  9741 raft_consensus.cc:2272] T 6aa58b8bde194f658aced897744b4d35 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:56.227795 11050 consensus_peers.cc:597] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:56.228521 11050 consensus_peers.cc:597] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.230623  9741 tablet_replica.cc:333] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.238711  9741 raft_consensus.cc:2243] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:23:56.240491  9741 raft_consensus.cc:2272] T 015a67e38c364985be24b18358579506 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:56.236696 10977 consensus_peers.cc:597] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:56.244722  9741 tablet_replica.cc:333] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.248477  9741 raft_consensus.cc:2243] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:23:56.260712  9741 raft_consensus.cc:2272] T c1b75831227444d382e9c0fc5b367564 P 2201bad9e18849b09cf82de29dd032d3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.264650  9741 tablet_replica.cc:333] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.265553  9741 raft_consensus.cc:2243] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.266381  9741 raft_consensus.cc:2272] T 80db8b3fbfd046e8a5535ff4a7380107 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.269277  9741 tablet_replica.cc:333] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.270082  9741 raft_consensus.cc:2243] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:23:56.271894  9741 raft_consensus.cc:2272] T 097e40d4693b49118b91e7a4fd8e8eb1 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.282466  9741 tablet_replica.cc:333] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
W20260709 12:23:56.283138 11624 consensus_peers.cc:597] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.283368  9741 raft_consensus.cc:2243] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:23:56.284632  9741 raft_consensus.cc:2272] T 9a101fb991414a5f840476aaa2d8e5b3 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.287629  9741 tablet_replica.cc:333] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.288448  9741 raft_consensus.cc:2243] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.289148  9741 raft_consensus.cc:2272] T edeb14680d6b4c7b95eed2b196750242 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.291643  9741 tablet_replica.cc:333] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
W20260709 12:23:56.293694 11624 consensus_peers.cc:597] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.302457  9741 raft_consensus.cc:2243] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.303212  9741 raft_consensus.cc:2272] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 2201bad9e18849b09cf82de29dd032d3 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.306064  9741 tablet_replica.cc:333] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.306919  9741 raft_consensus.cc:2243] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.312753  9741 raft_consensus.cc:2272] T 62cfdf78af4046beba4a418e904e80b1 P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:56.313158 11050 consensus_peers.cc:597] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.315593  9741 tablet_replica.cc:333] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.316572  9741 raft_consensus.cc:2243] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:56.325495 11050 consensus_peers.cc:597] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.331625  9741 raft_consensus.cc:2272] T b1c7453ea4954ac4ad9465233dd1e839 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:56.338806 11050 consensus_peers.cc:597] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:56.346065 11624 consensus_peers.cc:597] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:56.346873 11624 consensus_peers.cc:597] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.350365  9741 tablet_replica.cc:333] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
W20260709 12:23:56.352195 11624 consensus_peers.cc:597] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.353225  9741 raft_consensus.cc:2243] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:23:56.354899  9741 raft_consensus.cc:2272] T dc9fc876e22f4072a34df693254c2f5e P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.357656  9741 tablet_replica.cc:333] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.358739  9741 raft_consensus.cc:2243] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:23:56.365964  9741 raft_consensus.cc:2272] T 83b4e206b7694af695234c0e758055e2 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.368824  9741 tablet_replica.cc:333] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.369688  9741 raft_consensus.cc:2243] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:23:56.372102 19778 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.372706 19778 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:56.374794 19778 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:56.375933  9741 raft_consensus.cc:2272] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.377043 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 29 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:56.377689 11659 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 28.
I20260709 12:23:56.378690  9741 tablet_replica.cc:333] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.379573  9741 raft_consensus.cc:2243] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:23:56.394013  9741 raft_consensus.cc:2272] T f0bf4b65018642ba928b62c815b01489 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.380086 11049 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
W20260709 12:23:56.392791 11624 consensus_peers.cc:597] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.396910  9741 tablet_replica.cc:333] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
W20260709 12:23:56.397306 11050 leader_election.cc:336] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:56.397796  9741 raft_consensus.cc:2243] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:23:56.398120 19760 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:23:56.398545 19760 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.398881  9741 raft_consensus.cc:2272] T bda5e552d0f54d1daafad75449fbb509 P 2201bad9e18849b09cf82de29dd032d3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.398878 19760 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:23:56.402671  9741 tablet_replica.cc:333] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.403501  9741 raft_consensus.cc:2243] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:23:56.404551  9741 raft_consensus.cc:2272] T c9432c125c17431e881ba1329e02a201 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.412698  9741 tablet_replica.cc:333] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.413595  9741 raft_consensus.cc:2243] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.416628  9741 raft_consensus.cc:2272] T d3426d7ccdd943b882b65c3977a20040 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:56.420356 11624 consensus_peers.cc:597] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.422207 19760 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:56.423182  9741 tablet_replica.cc:333] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.436792  9741 raft_consensus.cc:2243] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.437610  9741 raft_consensus.cc:2272] T 38e2bba2f11943899027eb26325e2b6a P 2201bad9e18849b09cf82de29dd032d3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.439814 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59db2d2bb22c41aebd0d2073e2ba7d52" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 29 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:56.440439 11659 raft_consensus.cc:3060] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:23:56.444918 11624 consensus_peers.cc:597] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.445981  9741 tablet_replica.cc:333] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.446877  9741 raft_consensus.cc:2243] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.447489  9741 raft_consensus.cc:2272] T c486c31e8ba74d8a9b17989a20d141bf P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.448221 11659 raft_consensus.cc:2468] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 29.
I20260709 12:23:56.436631 19760 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 29 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:56.449823 11049 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:23:56.450944  9741 tablet_replica.cc:333] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.451885  9741 raft_consensus.cc:2243] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.453019 19748 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.453488 19748 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:56.455574 19748 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:56.459308 11624 leader_election.cc:336] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:56.452701  9741 raft_consensus.cc:2272] T d88dec874a3240d69746dfb302cf057e P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.463166  9741 tablet_replica.cc:333] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
W20260709 12:23:56.464814 11050 consensus_peers.cc:597] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:56.471541 11050 leader_election.cc:336] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:56.473356  9741 raft_consensus.cc:2243] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:23:56.474478  9741 raft_consensus.cc:2272] T 660a349ad34749648cae6a025708c84d P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.483572  9741 tablet_replica.cc:333] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
W20260709 12:23:56.486244 11050 consensus_peers.cc:597] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.466677 19816 raft_consensus.cc:2804] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:23:56.490056 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:56.500113 11085 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 19.
W20260709 12:23:56.491313 11624 consensus_peers.cc:597] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.501678  9741 raft_consensus.cc:2243] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.502436  9741 raft_consensus.cc:2272] T d9b41c3859494dab9f6f8bc6bccc8062 P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.503059 19816 raft_consensus.cc:697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 29 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:56.518528 19816 consensus_queue.cc:237] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 27.21, Last appended by leader: 21, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:56.506562 11050 consensus_peers.cc:597] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.531219  9741 tablet_replica.cc:333] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.544855 10831 catalog_manager.cc:5697] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 27 to 29. New cstate: current_term: 29 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:56.537163 11050 consensus_peers.cc:597] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.549700 11622 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:56.550526 19804 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:56.550907 19804 raft_consensus.cc:493] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.551251 19804 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:23:56.561995 11051 consensus_peers.cc:597] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:23:56.546064  9741 raft_consensus.cc:2243] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:23:56.575997  9741 raft_consensus.cc:2272] T e76df1b7dc3b4bada7c1112da8ce327b P 2201bad9e18849b09cf82de29dd032d3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.566840 19804 raft_consensus.cc:515] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:56.534140 10977 consensus_peers.cc:597] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:56.579365 10977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 45280.7us
I20260709 12:23:56.582122 19804 leader_election.cc:290] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 20 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:56.584079 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeb14680d6b4c7b95eed2b196750242" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:56.584676 11085 raft_consensus.cc:3060] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:23:56.585105 10977 consensus_peers.cc:597] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:56.588244 11624 leader_election.cc:336] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:56.591804 11085 raft_consensus.cc:2468] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 20.
I20260709 12:23:56.598140 11622 leader_election.cc:304] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:56.599449 19818 raft_consensus.cc:2804] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:56.603331 19818 raft_consensus.cc:697] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:23:56.604686 19818 consensus_queue.cc:237] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:56.589237  9741 tablet_replica.cc:333] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.608245  9741 raft_consensus.cc:2243] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:23:56.610821  9741 raft_consensus.cc:2272] T a8c81137a7dc49c9953309b2d9d22d7e P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.613870  9741 tablet_replica.cc:333] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.616917  9741 raft_consensus.cc:2243] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:23:56.620179  9741 raft_consensus.cc:2272] T 5b7e00767e0a443fab6f928812d5f6e2 P 2201bad9e18849b09cf82de29dd032d3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.623322  9741 tablet_replica.cc:333] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.624336  9741 raft_consensus.cc:2243] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.625006  9741 raft_consensus.cc:2272] T 07467552f78d410bb9e5774f3340f134 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.628334  9741 tablet_replica.cc:333] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.629210  9741 raft_consensus.cc:2243] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.630573  9741 raft_consensus.cc:2272] T 9b668506e6eb4a57aa83a9e45c3eb356 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.636044  9741 tablet_replica.cc:333] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.629182 10834 catalog_manager.cc:5697] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.639282  9741 raft_consensus.cc:2243] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.640267  9741 raft_consensus.cc:2272] T f1b28a94627d4cbd8f41c75a4ef23953 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.643424  9741 tablet_replica.cc:333] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.644477  9741 raft_consensus.cc:2243] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.645838  9741 raft_consensus.cc:2272] T 597a004d154c4012ba8a1037b80c0109 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:56.675164 10977 consensus_peers.cc:597] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:56.683838  9741 tablet_replica.cc:333] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.684921  9741 raft_consensus.cc:2243] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.685580  9741 raft_consensus.cc:2272] T d263972b0e844fa281354fac07ccef80 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:56.691355 11051 consensus_peers.cc:597] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:56.694451 11051 consensus_peers.cc:597] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:23:56.700881  9741 tablet_replica.cc:333] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
W20260709 12:23:56.732447 11625 consensus_peers.cc:597] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:56.735231 11051 consensus_peers.cc:597] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:23:56.719182  9741 raft_consensus.cc:2243] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:23:56.736220 19804 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.736732 19804 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:56.742201 11624 leader_election.cc:336] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:56.744287 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:56.744930 11085 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 25.
I20260709 12:23:56.747400 11622 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:56.748260 19818 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:23:56.748620 19818 raft_consensus.cc:493] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.748957 19818 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:56.743710 19804 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:56.763046 19818 raft_consensus.cc:515] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:56.772580 11624 leader_election.cc:336] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:56.764561  9741 raft_consensus.cc:2272] T 661c79d4d9c74a30911ec88c18ba8229 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.796490 19818 leader_election.cc:290] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:56.796773 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9e7be3e0bf4a1fa43f868eaf3e2c80" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:56.797448 11085 raft_consensus.cc:3060] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:56.797935  9741 tablet_replica.cc:333] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.798815  9741 raft_consensus.cc:2243] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.799414  9741 raft_consensus.cc:2272] T ba629b94057b4c4e9085289ea50b42f1 P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.807161  9741 tablet_replica.cc:333] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.808048  9741 raft_consensus.cc:2243] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:23:56.809296  9741 raft_consensus.cc:2272] T d3625831778d468cb424c06fc474c323 P 2201bad9e18849b09cf82de29dd032d3 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.811257 11085 raft_consensus.cc:2468] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 26.
I20260709 12:23:56.813258 11622 leader_election.cc:304] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:56.815472 19818 raft_consensus.cc:2804] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:23:56.816025 19818 raft_consensus.cc:697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:23:56.816855 19818 consensus_queue.cc:237] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:56.826973  9741 tablet_replica.cc:333] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.829530  9741 raft_consensus.cc:2243] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:23:56.832113  9741 raft_consensus.cc:2272] T 78fb947776bd4e70b1f04a0af3390ae3 P 2201bad9e18849b09cf82de29dd032d3 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.839136  9741 tablet_replica.cc:333] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.858538  9741 raft_consensus.cc:2243] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.859406  9741 raft_consensus.cc:2272] T 02ce8649e6b64336a3064cc1da978105 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.862247  9741 tablet_replica.cc:333] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.863023  9741 raft_consensus.cc:2243] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:23:56.862490 10831 catalog_manager.cc:5697] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.864298  9741 raft_consensus.cc:2272] T 2f281b53af584a8bab9bb1d343d005f8 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.867326  9741 tablet_replica.cc:333] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.868155  9741 raft_consensus.cc:2243] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:23:56.869185  9741 raft_consensus.cc:2272] T f850953ee221438f81da7fc8c8b44f9b P 2201bad9e18849b09cf82de29dd032d3 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.871987  9741 tablet_replica.cc:333] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.872908  9741 raft_consensus.cc:2243] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.873519  9741 raft_consensus.cc:2272] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.876163  9741 tablet_replica.cc:333] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.876999  9741 raft_consensus.cc:2243] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.877787  9741 raft_consensus.cc:2272] T 90e76c15ad9c49ab9b98a5d216125beb P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.888921  9741 tablet_replica.cc:333] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
W20260709 12:23:56.897475 11051 consensus_peers.cc:597] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:56.903755  9741 raft_consensus.cc:2243] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:23:56.905148  9741 raft_consensus.cc:2272] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 2201bad9e18849b09cf82de29dd032d3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.907899  9741 tablet_replica.cc:333] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.908671  9741 raft_consensus.cc:2243] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:23:56.916927  9741 raft_consensus.cc:2272] T 49f51062a99d4696bd7480d6804e7d72 P 2201bad9e18849b09cf82de29dd032d3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.919786  9741 tablet_replica.cc:333] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.920583  9741 raft_consensus.cc:2243] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:23:56.921835  9741 raft_consensus.cc:2272] T 970339bba6a8454e8c722b4367924db8 P 2201bad9e18849b09cf82de29dd032d3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.928627  9741 tablet_replica.cc:333] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.929641  9741 raft_consensus.cc:2243] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.930397  9741 raft_consensus.cc:2272] T 32589fba10354b9588f7cb0a69c6e92d P 2201bad9e18849b09cf82de29dd032d3 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.933092  9741 tablet_replica.cc:333] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.936414  9741 raft_consensus.cc:2243] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.937117  9741 raft_consensus.cc:2272] T 0ccace425f6c4d5ea9588504233ffee0 P 2201bad9e18849b09cf82de29dd032d3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.939993  9741 tablet_replica.cc:333] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.940724  9741 raft_consensus.cc:2243] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.941447  9741 raft_consensus.cc:2272] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.944304  9741 tablet_replica.cc:333] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3: stopping tablet replica
I20260709 12:23:56.945019  9741 raft_consensus.cc:2243] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.945657  9741 raft_consensus.cc:2272] T 74d2f9dca08d41e7a77146322049c40c P 2201bad9e18849b09cf82de29dd032d3 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:57.034451 11051 consensus_peers.cc:597] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:57.039639 11051 consensus_peers.cc:597] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:57.040055 11050 consensus_peers.cc:597] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:57.047384 11624 consensus_peers.cc:597] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:57.070354 11625 consensus_peers.cc:597] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:57.121182 11659 raft_consensus.cc:1275] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 29 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 27 index: 21. Preceding OpId from leader: term: 29 index: 22. (index mismatch)
I20260709 12:23:57.125447 19815 consensus_queue.cc:1048] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
W20260709 12:23:57.165529 11051 consensus_peers.cc:597] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:57.167982 19809 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.168567 19809 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:57.171056 19809 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:57.190194 11051 leader_election.cc:336] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:57.196355 11050 leader_election.cc:336] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:57.200073 11050 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:57.203774 19817 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:57.217159 11080 raft_consensus.cc:1275] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:23:57.218909 19758 consensus_queue.cc:1048] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:23:57.219527 11085 raft_consensus.cc:1275] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:23:57.227202 19758 consensus_queue.cc:1048] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:57.259795 19758 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.260365 19758 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:57.261816 11624 consensus_peers.cc:597] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:57.262475 19758 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:57.264175 19818 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.264722 19818 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:57.267079 19818 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:57.270433 11624 leader_election.cc:336] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
W20260709 12:23:57.277328 11624 leader_election.cc:336] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
W20260709 12:23:57.279448 11625 leader_election.cc:336] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:57.280002 11625 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:57.280936 19758 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:23:57.281962 11625 consensus_peers.cc:597] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:57.292307 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:57.293555 11080 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 20.
W20260709 12:23:57.295614 11051 consensus_peers.cc:597] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:57.300164 11622 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:57.301921 19748 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:57.302312 19748 raft_consensus.cc:493] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.302644 19748 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:57.312870 19748 raft_consensus.cc:515] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:57.335364 19817 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.351450 19817 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:57.354257 19817 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:57.357879 19818 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.358553 19818 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:57.359701 11050 leader_election.cc:336] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
W20260709 12:23:57.361613 11051 leader_election.cc:336] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:57.362057 11051 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:57.362771 19817 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:23:57.371049 11625 consensus_peers.cc:597] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:57.373133 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:57.372135 19818 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:23:57.385807 11624 leader_election.cc:336] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
W20260709 12:23:57.386379 11624 leader_election.cc:336] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:57.388334 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b75831227444d382e9c0fc5b367564" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1"
I20260709 12:23:57.388931 11080 raft_consensus.cc:3060] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:57.390183 19748 leader_election.cc:290] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:57.392256 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:57.401160 11080 raft_consensus.cc:2468] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 21.
I20260709 12:23:57.404378 11622 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:57.405591 19748 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:57.409013 11622 leader_election.cc:304] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:57.410141 19748 raft_consensus.cc:2804] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:57.410616 19748 raft_consensus.cc:697] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 LEADER]: Becoming Leader. State: Replica: 0b171b6aaedc4f809f2753dcfadb14ce, State: Running, Role: LEADER
I20260709 12:23:57.411465 19748 consensus_queue.cc:237] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:57.415938 11051 consensus_peers.cc:597] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:57.436132 10831 catalog_manager.cc:5697] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce reported cstate change: term changed from 20 to 21, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68). New cstate: current_term: 21 leader_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:57.501206 19817 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.501844 19817 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:57.504010 19817 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:57.505366 11625 consensus_peers.cc:597] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:57.537496 11051 leader_election.cc:336] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:57.521697 19817 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.538259 19817 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:57.506522 10823 maintenance_manager.cc:419] P b5a9c6dd870a436699566823a8e6e1ca: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033388
I20260709 12:23:57.563666 19748 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.564319 19748 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:57.566345 19748 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:57.515223 19815 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.569993 19815 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:57.572860 11624 leader_election.cc:336] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:57.576273 19815 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:57.582110 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:57.582828 11659 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 18.
I20260709 12:23:57.587908 19748 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.588725 19817 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:57.588490 19748 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:57.592795 11051 leader_election.cc:336] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:57.597851 11624 leader_election.cc:336] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:57.598737 19815 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.599310 19815 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:57.600245 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:57.613461 11080 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 24.
I20260709 12:23:57.600898 19748 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:57.602197 19804 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.614812 19804 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:57.612537 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:23:57.612777 11625 consensus_peers.cc:597] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:57.619813 11656 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 24.
W20260709 12:23:57.628134 11624 leader_election.cc:336] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:57.614676 19815 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:57.632784 19804 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:57.634435 19815 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.635155 19815 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:57.636068 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:57.636806 11080 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 26.
I20260709 12:23:57.637264 19815 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:57.649307 19809 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.649878 19809 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:57.652189 19809 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:57.653950 11051 leader_election.cc:336] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:57.662621 11049 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:23:57.664151 19809 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:57.664610 19809 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.665078 19809 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:57.676301 11051 leader_election.cc:336] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:57.687309 11050 leader_election.cc:336] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:57.687906 11050 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:57.692088 19817 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:23:57.691247 11051 leader_election.cc:336] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:57.692070 11625 leader_election.cc:336] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:57.693229 11625 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:57.693936 11050 leader_election.cc:336] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
W20260709 12:23:57.698244 11625 consensus_peers.cc:597] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:57.696861 19809 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:57.698004 19804 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:57.704593 19809 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:23:57.711336 11625 leader_election.cc:336] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:57.714169 11625 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:57.720176 19804 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:23:57.721521 11625 leader_election.cc:336] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:57.722036 11625 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:57.724157 11050 leader_election.cc:336] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:57.726500 19817 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.727340 10822 maintenance_manager.cc:643] P b5a9c6dd870a436699566823a8e6e1ca: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.184s	user 0.043s	sys 0.001s Metrics: {"bytes_written":9333,"delete_count":0,"lbm_write_time_us":974,"lbm_writes_lt_1ms":7,"reinsert_count":0,"update_count":374}
I20260709 12:23:57.728900 19804 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:23:57.730857 19817 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:57.732069 10823 maintenance_manager.cc:419] P b5a9c6dd870a436699566823a8e6e1ca: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.408750
I20260709 12:23:57.732968 19817 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:57.733616 11050 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:57.734448 19817 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:57.738708 11659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097e40d4693b49118b91e7a4fd8e8eb1" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:57.739248 11659 raft_consensus.cc:3060] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:57.745784 11659 raft_consensus.cc:2468] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 19.
I20260709 12:23:57.746743 11049 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:23:57.747593 19817 raft_consensus.cc:2804] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:57.748119 19817 raft_consensus.cc:697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:57.749011 19817 consensus_queue.cc:237] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 18.17, Last appended by leader: 17, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:57.755461 19809 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.756080 19809 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:57.758423 19809 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:57.760962 19748 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.761603 19748 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:57.770445 11624 leader_election.cc:336] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:57.771230 19748 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:57.780565 11051 leader_election.cc:336] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:57.790210 11051 leader_election.cc:336] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:57.790892 11051 consensus_peers.cc:597] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:57.792516 10831 catalog_manager.cc:5697] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 18 to 19, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 19 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:57.796670 19809 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.797258 19809 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:57.799468 19809 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:23:57.801954 11050 leader_election.cc:336] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:57.802412 11050 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:57.804189 10821 catalog_manager.cc:4755] TS 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9b668506e6eb4a57aa83a9e45c3eb356: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:57.809691 19809 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:57.811036 11050 leader_election.cc:336] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:57.811478 11050 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:57.812462 19817 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:23:57.804378 11625 leader_election.cc:336] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:57.813189 11625 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:57.813872 19804 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:23:57.819125 11050 leader_election.cc:336] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:57.820271 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
I20260709 12:23:57.820978 11656 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 25.
W20260709 12:23:57.821969 11625 consensus_peers.cc:597] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:57.819595 11050 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:57.824828 19817 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:23:57.825448 11050 leader_election.cc:336] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:57.827351 11049 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:23:57.828190 19817 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:23:57.828555 19817 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.828924 19817 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:57.837991 19817 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:57.844194 19817 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
I20260709 12:23:57.852871 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660a349ad34749648cae6a025708c84d" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:57.853544 11656 raft_consensus.cc:3060] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:57.856050 19817 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.856607 19817 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:57.859025 19817 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:57.860826 11656 raft_consensus.cc:2468] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 26.
I20260709 12:23:57.861931 11049 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:23:57.862722 19817 raft_consensus.cc:2804] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:23:57.863207 19817 raft_consensus.cc:697] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:57.866335 19817 consensus_queue.cc:237] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 25.20, Last appended by leader: 20, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:57.867101 11051 leader_election.cc:336] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:57.865214 11050 leader_election.cc:336] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:57.869001 11050 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:57.869738 19809 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:23:57.869916 11050 leader_election.cc:336] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:57.870350 11050 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:57.871096 19809 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:23:57.876633 11051 consensus_peers.cc:597] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:57.885699 11050 leader_election.cc:336] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
W20260709 12:23:57.886459 11050 leader_election.cc:336] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
W20260709 12:23:57.897574 11050 leader_election.cc:336] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:57.905887 11050 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:57.906618 19817 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:23:57.908923 10831 catalog_manager.cc:5697] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 25 to 26, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 26 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:57.924425 11625 consensus_peers.cc:597] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:57.934435 19817 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.935122 19817 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:57.940841 19817 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:57.943606 11051 leader_election.cc:336] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:57.944414 11050 leader_election.cc:336] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:57.944844 11050 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:57.947072 19817 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:57.963940 19817 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:57.964524 19817 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:57.966719 19817 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:57.975472 11050 leader_election.cc:336] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
W20260709 12:23:57.988076 11051 leader_election.cc:336] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:57.988981 11051 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:57.992287 19817 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:23:58.005878 19842 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:58.006438 19842 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:58.008536 19842 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:58.016463 11050 leader_election.cc:336] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
W20260709 12:23:58.036150 11624 consensus_peers.cc:597] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:58.049780 11085 raft_consensus.cc:1275] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Refusing update from remote peer 0b171b6aaedc4f809f2753dcfadb14ce: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
W20260709 12:23:58.052441 11051 leader_election.cc:336] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:58.052552 19804 consensus_queue.cc:1048] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:23:58.053045 11051 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:58.053922 19817 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:23:58.060563 11051 consensus_peers.cc:597] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:58.089980 19804 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:58.090624 19804 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:58.092880 19804 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:58.096429 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
W20260709 12:23:58.108618 11624 leader_election.cc:336] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:58.109095 11624 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:23:58.112110 19748 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:23:58.113461 11051 consensus_peers.cc:597] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:58.123317 19842 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:58.123906 19842 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:58.126241 19842 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:58.133234 19817 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:58.133780 19817 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:58.135846 19817 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:23:58.135483 11051 leader_election.cc:336] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:58.137894 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" is_pre_election: true
W20260709 12:23:58.138507 11050 leader_election.cc:336] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:58.138675 11656 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 22.
I20260709 12:23:58.140106 11049 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 
I20260709 12:23:58.140954 11050 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:58.142750 19842 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:58.143146 19842 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:58.143473 19842 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:58.148078 19809 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:23:58.156124 11050 leader_election.cc:336] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:58.179109 19842 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:58.185269 11656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f51062a99d4696bd7480d6804e7d72" candidate_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "0b171b6aaedc4f809f2753dcfadb14ce"
I20260709 12:23:58.186097 11656 raft_consensus.cc:3060] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:23:58.193229 11050 leader_election.cc:336] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:58.214958 19842 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: Requested vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 0b171b6aaedc4f809f2753dcfadb14ce (127.9.131.68:41955)
W20260709 12:23:58.221002 11625 consensus_peers.cc:597] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:58.202133 11656 raft_consensus.cc:2468] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1abf4b385a2b493ab83f593a1f8c9cd1 in term 23.
I20260709 12:23:58.229189 11049 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3
W20260709 12:23:58.229351 11051 consensus_peers.cc:597] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:58.231045 19817 raft_consensus.cc:2804] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:23:58.231577 19817 raft_consensus.cc:697] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Becoming Leader. State: Replica: 1abf4b385a2b493ab83f593a1f8c9cd1, State: Running, Role: LEADER
I20260709 12:23:58.232622 19817 consensus_queue.cc:237] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:58.236217 11050 consensus_peers.cc:597] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:58.237126 19809 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:58.237731 19809 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:58.240497 19809 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:58.248317 11050 leader_election.cc:336] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
W20260709 12:23:58.254657 11051 leader_election.cc:336] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:58.255249 11051 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:58.257663 19842 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:58.265205 11656 raft_consensus.cc:1275] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 18 index: 17. Preceding OpId from leader: term: 19 index: 18. (index mismatch)
I20260709 12:23:58.267019 19817 consensus_queue.cc:1048] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:23:58.271757 10831 catalog_manager.cc:5697] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 reported cstate change: term changed from 22 to 23, leader changed from 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66) to 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67). New cstate: current_term: 23 leader_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:58.291030 19817 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:58.291827 19817 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:58.352695 11659 raft_consensus.cc:1275] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 25 index: 20. Preceding OpId from leader: term: 26 index: 21. (index mismatch)
I20260709 12:23:58.356904 19842 consensus_queue.cc:1048] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
W20260709 12:23:58.363795 11625 consensus_peers.cc:597] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:58.352977 11051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:46109, user_credentials={real_user=slave}} blocked reactor thread for 46632.1us
I20260709 12:23:58.369004 19815 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:58.369535 19815 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:58.370014 11051 consensus_peers.cc:597] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:23:58.371589 19815 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:58.373361 19817 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:58.377218 11050 leader_election.cc:336] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
W20260709 12:23:58.377765 11050 leader_election.cc:336] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
W20260709 12:23:58.383204 11051 leader_election.cc:336] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:58.383694 11051 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:58.384447 19842 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:23:58.397722 11051 leader_election.cc:336] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:58.398274 11051 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:58.399509 19815 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:23:58.401737 11051 consensus_peers.cc:597] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:58.413201 11050 consensus_peers.cc:597] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:58.459555 10822 maintenance_manager.cc:643] P b5a9c6dd870a436699566823a8e6e1ca: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.727s	user 0.110s	sys 0.021s Metrics: {"cfile_cache_miss":8,"cfile_cache_miss_bytes":29608,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":6974,"dirs.run_cpu_time_us":306,"dirs.run_wall_time_us":307,"lbm_read_time_us":14238,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":23,"lbm_write_time_us":1831,"lbm_writes_lt_1ms":12,"peak_mem_usage":597700,"reinsert_count":0,"thread_start_us":7386,"threads_started":1,"update_count":374}
W20260709 12:23:58.490582 11050 consensus_peers.cc:597] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:58.491736 11051 consensus_peers.cc:597] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:58.516135 11050 consensus_peers.cc:597] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:58.532123 11050 consensus_peers.cc:597] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:58.542112 11050 consensus_peers.cc:597] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:58.560528 11624 consensus_peers.cc:597] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:58.589083 11050 consensus_peers.cc:597] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:58.632481 11050 consensus_peers.cc:597] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:58.773818 11050 consensus_peers.cc:597] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:58.776181 11624 consensus_peers.cc:597] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:58.784055 19853 raft_consensus.cc:493] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:23:58.785763 11050 consensus_peers.cc:597] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:58.785817 19853 raft_consensus.cc:515] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:58.794479 11050 consensus_peers.cc:597] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:58.795217 11050 consensus_peers.cc:597] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:58.796911 19853 leader_election.cc:290] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:58.803035 11050 leader_election.cc:336] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:58.806293 11658 raft_consensus.cc:1275] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Refusing update from remote peer 1abf4b385a2b493ab83f593a1f8c9cd1: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
W20260709 12:23:58.820217 11624 consensus_peers.cc:597] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:58.834710 11624 consensus_peers.cc:597] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:58.837672 19853 consensus_queue.cc:1048] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
W20260709 12:23:58.853435 11624 consensus_peers.cc:597] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:58.869665 11051 leader_election.cc:336] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:58.870394 11051 leader_election.cc:304] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:58.882900 11050 consensus_peers.cc:597] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:58.888453 19853 raft_consensus.cc:2749] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:23:58.936549 11050 consensus_peers.cc:597] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:58.947096 11624 consensus_peers.cc:597] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:58.953649 11050 consensus_peers.cc:597] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:59.017905 11051 consensus_peers.cc:597] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:59.034219 11050 consensus_peers.cc:597] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:59.044592 11050 consensus_peers.cc:597] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:59.078336 11624 consensus_peers.cc:597] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:59.092967 11624 consensus_peers.cc:597] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:59.119367 11624 consensus_peers.cc:597] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:59.166283 19859 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
W20260709 12:23:59.166744 11050 consensus_peers.cc:597] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:59.167044 19859 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:23:59.185176 11624 leader_election.cc:336] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:59.188205 19859 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:59.197104 11625 leader_election.cc:336] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:59.198434 11625 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:59.199824 19859 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:23:59.224977 11051 consensus_peers.cc:597] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:23:59.257488 19859 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:59.258246 19859 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:59.265069 19859 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:59.272818 11624 leader_election.cc:336] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
W20260709 12:23:59.275049 11625 leader_election.cc:336] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:59.278738 11625 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:59.287580 19858 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:59.296684 19858 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:59.291193 19860 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:59.304719 19866 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:59.301328 19860 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:59.310514 19860 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:59.312813 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9fc876e22f4072a34df693254c2f5e" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:59.313755 11080 raft_consensus.cc:2468] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 24.
I20260709 12:23:59.299714 19858 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:23:59.316470 11085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015a67e38c364985be24b18358579506" candidate_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" is_pre_election: true
I20260709 12:23:59.317284 11085 raft_consensus.cc:2468] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b171b6aaedc4f809f2753dcfadb14ce in term 26.
W20260709 12:23:59.323558 11051 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111) [suppressed 650 similar messages]
W20260709 12:23:59.338315 11624 leader_election.cc:336] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
W20260709 12:23:59.340293 11051 consensus_peers.cc:597] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:59.343580 11624 leader_election.cc:336] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
W20260709 12:23:59.351724 11625 leader_election.cc:336] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:59.352913 11625 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:59.354559 11625 leader_election.cc:336] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:59.354944 19858 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:59.357306 11625 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce, 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:59.370811 11624 consensus_peers.cc:597] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:59.371791 19864 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:23:59.384227 19858 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:59.384966 19858 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:23:59.387378 19858 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:59.403698 19815 raft_consensus.cc:493] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:59.404426 19815 raft_consensus.cc:515] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:59.406167 11624 leader_election.cc:336] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:59.409763 19815 leader_election.cc:290] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:59.410550 11051 leader_election.cc:336] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:59.417801 11050 leader_election.cc:336] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:59.418403 11050 leader_election.cc:304] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:59.419564 19815 raft_consensus.cc:2749] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:23:59.420711 11625 leader_election.cc:336] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:59.424158 11625 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:59.425065 19858 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:23:59.439134 11051 consensus_peers.cc:597] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:59.440448 11051 consensus_peers.cc:597] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:59.461264 11051 consensus_peers.cc:597] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:59.521330 11050 consensus_peers.cc:597] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:59.535370 19853 raft_consensus.cc:493] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:59.536082 19853 raft_consensus.cc:515] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:59.538538 19853 leader_election.cc:290] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:59.642268 11625 consensus_peers.cc:597] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:59.647712 11625 consensus_peers.cc:597] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:23:59.659051 19867 raft_consensus.cc:493] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:59.660449 19867 raft_consensus.cc:515] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:59.716992 11624 consensus_peers.cc:597] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:59.722070 19867 leader_election.cc:290] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:59.786496 19868 raft_consensus.cc:493] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:59.787217 19868 raft_consensus.cc:515] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:59.789634 19868 leader_election.cc:290] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:59.816916 19867 raft_consensus.cc:493] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:59.817653 19867 raft_consensus.cc:515] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
W20260709 12:23:59.842078 11051 leader_election.cc:336] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:59.849030 19867 leader_election.cc:290] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:23:59.852720 19867 raft_consensus.cc:493] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:59.854003 19867 raft_consensus.cc:515] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:59.857424 19867 leader_election.cc:290] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:59.882351 11050 leader_election.cc:336] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:59.882918 11050 leader_election.cc:304] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:59.885713 19869 raft_consensus.cc:2749] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:23:59.892108 11051 consensus_peers.cc:597] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:59.897269 11051 leader_election.cc:336] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:59.898051 11051 leader_election.cc:336] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:59.898581 11051 consensus_peers.cc:597] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:59.899021 11051 leader_election.cc:336] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:59.899510 11051 leader_election.cc:336] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:23:59.907007 11625 consensus_peers.cc:597] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:59.910595 11051 consensus_peers.cc:597] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:23:59.912575 19871 raft_consensus.cc:493] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:59.914453 19871 raft_consensus.cc:515] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:59.921295 19871 leader_election.cc:290] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:59.922309 11050 leader_election.cc:336] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:59.922865 11050 leader_election.cc:304] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:59.923708 19871 raft_consensus.cc:2749] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:23:59.923799 11050 leader_election.cc:336] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:59.924382 11050 leader_election.cc:304] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:59.925292 11050 leader_election.cc:336] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:59.925459 19871 raft_consensus.cc:2749] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:23:59.925743 11050 leader_election.cc:304] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
W20260709 12:23:59.926882 11050 leader_election.cc:336] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:59.927340 11050 leader_election.cc:304] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:59.928066 19869 raft_consensus.cc:2749] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:59.928687 19869 raft_consensus.cc:2749] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:59.937687 11050 leader_election.cc:336] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
W20260709 12:23:59.947085 11051 leader_election.cc:336] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:59.949613 11051 leader_election.cc:304] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:59.951489 19869 raft_consensus.cc:493] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:59.951005 19871 raft_consensus.cc:2749] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:23:59.952160 19869 raft_consensus.cc:515] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:59.955510 19869 leader_election.cc:290] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:59.960121 11050 leader_election.cc:336] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:23:59.962466 19869 raft_consensus.cc:493] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:59.963040 19869 raft_consensus.cc:515] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:59.965063 19869 leader_election.cc:290] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:59.965971 11051 consensus_peers.cc:597] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:59.975028 11051 leader_election.cc:336] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:59.976846 11051 leader_election.cc:304] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:59.979493 19869 raft_consensus.cc:2749] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:23:59.978749 11050 leader_election.cc:336] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
W20260709 12:23:59.983776 11051 leader_election.cc:336] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:23:59.984365 11051 leader_election.cc:304] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:23:59.985172 19869 raft_consensus.cc:2749] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:59.986514 19869 raft_consensus.cc:493] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:23:59.987067 19869 raft_consensus.cc:515] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:23:59.989092 19869 leader_election.cc:290] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:23:59.994925 11050 leader_election.cc:336] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
W20260709 12:23:59.995653 11625 consensus_peers.cc:597] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:00.002524 11051 leader_election.cc:336] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:24:00.003088 11051 leader_election.cc:304] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:24:00.003877 19869 raft_consensus.cc:2749] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:24:00.007054 11625 consensus_peers.cc:597] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:00.038722 11625 consensus_peers.cc:597] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:24:00.157053  9741 tablet_server.cc:196] TabletServer@127.9.131.66:0 shutdown complete.
I20260709 12:24:00.220291 19871 raft_consensus.cc:493] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:24:00.221072 19871 raft_consensus.cc:515] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:24:00.223667 19871 leader_election.cc:290] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:24:00.231158 11051 leader_election.cc:336] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:24:00.235028 11050 leader_election.cc:336] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:24:00.235644 11050 leader_election.cc:304] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:24:00.236582 19871 raft_consensus.cc:2749] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:24:00.258206 19871 raft_consensus.cc:493] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:24:00.258898 19871 raft_consensus.cc:515] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:24:00.271473 19871 leader_election.cc:290] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:24:00.272269 11051 leader_election.cc:336] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:24:00.297789 11050 leader_election.cc:336] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:24:00.302763 11050 leader_election.cc:304] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:24:00.310214 19869 raft_consensus.cc:2749] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:24:00.329195  9741 tablet_server.cc:179] TabletServer@127.9.131.67:0 shutting down...
I20260709 12:24:00.337252 19869 raft_consensus.cc:493] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:24:00.337898 19869 raft_consensus.cc:515] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:24:00.340520 19869 leader_election.cc:290] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:24:00.341239 11622 consensus_peers.cc:597] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Couldn't send request to peer 1abf4b385a2b493ab83f593a1f8c9cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:00.344471 11051 leader_election.cc:336] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:24:00.346679 19869 raft_consensus.cc:493] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:24:00.348094 19869 raft_consensus.cc:515] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } }
I20260709 12:24:00.350554 19869 leader_election.cc:290] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:24:00.353884 11050 leader_election.cc:336] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:24:00.354388 11050 leader_election.cc:304] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:24:00.356089 19871 raft_consensus.cc:2749] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:24:00.362728 11050 leader_election.cc:336] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
W20260709 12:24:00.366148 11051 leader_election.cc:336] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:24:00.368209 11051 leader_election.cc:304] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1abf4b385a2b493ab83f593a1f8c9cd1; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:24:00.369030 19871 raft_consensus.cc:2749] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:24:00.370255 11622 consensus_peers.cc:597] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Couldn't send request to peer 1abf4b385a2b493ab83f593a1f8c9cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:00.401768  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:00.403124  9741 tablet_replica.cc:333] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.404209  9741 raft_consensus.cc:2243] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.405053  9741 raft_consensus.cc:2272] T e6f7148e567a4f6da2aa56002e55b027 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.408088  9741 tablet_replica.cc:333] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.408963  9741 raft_consensus.cc:2243] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:24:00.410297  9741 raft_consensus.cc:2272] T f56f49dc9fb94be0bc1eba5a2b97049c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.415913  9741 tablet_replica.cc:333] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.416981  9741 raft_consensus.cc:2243] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Raft consensus shutting down.
W20260709 12:24:00.419744 11051 consensus_peers.cc:597] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:24:00.428184  9741 raft_consensus.cc:2272] T c4e2dd59ef5642098b4166c9da8d596d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.432466  9741 tablet_replica.cc:333] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.433378  9741 raft_consensus.cc:2243] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:24:00.434656  9741 raft_consensus.cc:2272] T c88db1b2c7304a19a16c4f9b17c02e8e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.438400  9741 tablet_replica.cc:333] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.439278  9741 raft_consensus.cc:2243] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.440321  9741 raft_consensus.cc:2272] T 8151fe64a0a84d44a837cc6abf316707 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.443336  9741 tablet_replica.cc:333] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.444201  9741 raft_consensus.cc:2243] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:24:00.445806  9741 raft_consensus.cc:2272] T 097e40d4693b49118b91e7a4fd8e8eb1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.448657  9741 tablet_replica.cc:333] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.449512  9741 raft_consensus.cc:2243] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.450186  9741 raft_consensus.cc:2272] T 9a101fb991414a5f840476aaa2d8e5b3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.453027  9741 tablet_replica.cc:333] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.453864  9741 raft_consensus.cc:2243] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.454690  9741 raft_consensus.cc:2272] T edeb14680d6b4c7b95eed2b196750242 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.457479  9741 tablet_replica.cc:333] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.458346  9741 raft_consensus.cc:2243] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:24:00.459477  9741 raft_consensus.cc:2272] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.462016  9741 tablet_replica.cc:333] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.462831  9741 raft_consensus.cc:2243] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.464483  9741 raft_consensus.cc:2272] T dc9fc876e22f4072a34df693254c2f5e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:00.465039 11625 consensus_peers.cc:597] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:24:00.468495  9741 tablet_replica.cc:333] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.469928  9741 raft_consensus.cc:2243] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:24:00.472441  9741 raft_consensus.cc:2272] T 62cfdf78af4046beba4a418e904e80b1 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.477633  9741 tablet_replica.cc:333] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.478490  9741 raft_consensus.cc:2243] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:24:00.479846  9741 raft_consensus.cc:2272] T b1c7453ea4954ac4ad9465233dd1e839 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:00.485354 11625 consensus_peers.cc:597] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:24:00.485793  9741 tablet_replica.cc:333] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.489684  9741 raft_consensus.cc:2243] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:24:00.490835  9741 raft_consensus.cc:2272] T 9b6c427f0a234dbab806dced4d3ba0fb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:00.493446 11622 consensus_peers.cc:597] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Couldn't send request to peer 1abf4b385a2b493ab83f593a1f8c9cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:00.493641  9741 tablet_replica.cc:333] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.494495  9741 raft_consensus.cc:2243] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.502049  9741 raft_consensus.cc:2272] T f0bf4b65018642ba928b62c815b01489 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.505494  9741 tablet_replica.cc:333] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.509025  9741 raft_consensus.cc:2243] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.509780  9741 raft_consensus.cc:2272] T 2ab5cd1b86b54cb89fdd3eef419ac66a P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.512727  9741 tablet_replica.cc:333] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.513633  9741 raft_consensus.cc:2243] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:24:00.514830  9741 raft_consensus.cc:2272] T 0774d95f5c1b4bdb990e50f5d858b600 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.517835  9741 tablet_replica.cc:333] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.518826  9741 raft_consensus.cc:2243] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.520128  9741 raft_consensus.cc:2272] T c9432c125c17431e881ba1329e02a201 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:00.522491 11622 consensus_peers.cc:597] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Couldn't send request to peer 1abf4b385a2b493ab83f593a1f8c9cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:00.523101  9741 tablet_replica.cc:333] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
W20260709 12:24:00.523507 11622 consensus_peers.cc:597] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Couldn't send request to peer 1abf4b385a2b493ab83f593a1f8c9cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:00.524072  9741 raft_consensus.cc:2243] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:00.524380 11622 consensus_peers.cc:597] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Couldn't send request to peer 1abf4b385a2b493ab83f593a1f8c9cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:00.525609  9741 raft_consensus.cc:2272] T c486c31e8ba74d8a9b17989a20d141bf P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.528692  9741 tablet_replica.cc:333] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.529583  9741 raft_consensus.cc:2243] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:24:00.531610  9741 raft_consensus.cc:2272] T d88dec874a3240d69746dfb302cf057e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.534572  9741 tablet_replica.cc:333] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.535454  9741 raft_consensus.cc:2243] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:24:00.536798  9741 raft_consensus.cc:2272] T 660a349ad34749648cae6a025708c84d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.539649  9741 tablet_replica.cc:333] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.540558  9741 raft_consensus.cc:2243] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:24:00.541759  9741 raft_consensus.cc:2272] T d9b41c3859494dab9f6f8bc6bccc8062 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.544751  9741 tablet_replica.cc:333] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.545610  9741 raft_consensus.cc:2243] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.546847  9741 raft_consensus.cc:2272] T e76df1b7dc3b4bada7c1112da8ce327b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.549739  9741 tablet_replica.cc:333] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.550599  9741 raft_consensus.cc:2243] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Raft consensus shutting down.
W20260709 12:24:00.551290 11625 consensus_peers.cc:597] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:24:00.553248  9741 raft_consensus.cc:2272] T f1b28a94627d4cbd8f41c75a4ef23953 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:00.562896 11625 consensus_peers.cc:597] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:24:00.565219  9741 tablet_replica.cc:333] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.566080  9741 raft_consensus.cc:2243] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:24:00.573261  9741 raft_consensus.cc:2272] T 597a004d154c4012ba8a1037b80c0109 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.576262  9741 tablet_replica.cc:333] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.577068  9741 raft_consensus.cc:2243] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.577719  9741 raft_consensus.cc:2272] T d263972b0e844fa281354fac07ccef80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:00.578472 11622 consensus_peers.cc:597] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Couldn't send request to peer 1abf4b385a2b493ab83f593a1f8c9cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:00.580570  9741 tablet_replica.cc:333] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.581466  9741 raft_consensus.cc:2243] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.590544  9741 raft_consensus.cc:2272] T 661c79d4d9c74a30911ec88c18ba8229 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.594671  9741 tablet_replica.cc:333] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.595515  9741 raft_consensus.cc:2243] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.596391  9741 raft_consensus.cc:2272] T 5b7e00767e0a443fab6f928812d5f6e2 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.599023  9741 tablet_replica.cc:333] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.599776  9741 raft_consensus.cc:2243] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:24:00.601013  9741 raft_consensus.cc:2272] T 07467552f78d410bb9e5774f3340f134 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.603734  9741 tablet_replica.cc:333] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.604529  9741 raft_consensus.cc:2243] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.605960  9741 raft_consensus.cc:2272] T 9b668506e6eb4a57aa83a9e45c3eb356 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.608789  9741 tablet_replica.cc:333] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.609552  9741 raft_consensus.cc:2243] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.610134  9741 raft_consensus.cc:2272] T 11f1b75a0edb45d493bb20e8a0f34156 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.612641  9741 tablet_replica.cc:333] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.613368  9741 raft_consensus.cc:2243] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.613929  9741 raft_consensus.cc:2272] T a8c81137a7dc49c9953309b2d9d22d7e P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.616705  9741 tablet_replica.cc:333] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.617470  9741 raft_consensus.cc:2243] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:24:00.618706  9741 raft_consensus.cc:2272] T b156bebcd53a4b6ea1f83c42906a5a03 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.621376  9741 tablet_replica.cc:333] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.622148  9741 raft_consensus.cc:2243] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.622768  9741 raft_consensus.cc:2272] T d3625831778d468cb424c06fc474c323 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.625411  9741 tablet_replica.cc:333] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.626168  9741 raft_consensus.cc:2243] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.626994  9741 raft_consensus.cc:2272] T 78fb947776bd4e70b1f04a0af3390ae3 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.629777  9741 tablet_replica.cc:333] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.630549  9741 raft_consensus.cc:2243] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:24:00.631819  9741 raft_consensus.cc:2272] T 3b768aea2bd34049a2aa54e4f4f19bf6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.636045  9741 tablet_replica.cc:333] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.636788  9741 raft_consensus.cc:2243] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:24:00.638016  9741 raft_consensus.cc:2272] T 02ce8649e6b64336a3064cc1da978105 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.640770  9741 tablet_replica.cc:333] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.641523  9741 raft_consensus.cc:2243] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.642115  9741 raft_consensus.cc:2272] T 2f281b53af584a8bab9bb1d343d005f8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.644733  9741 tablet_replica.cc:333] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.645432  9741 raft_consensus.cc:2243] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.646152  9741 raft_consensus.cc:2272] T f850953ee221438f81da7fc8c8b44f9b P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.648660  9741 tablet_replica.cc:333] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.649379  9741 raft_consensus.cc:2243] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.650343  9741 raft_consensus.cc:2272] T 84ba0a33a7f74af5b5fd862bbb01e3cb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.654049  9741 tablet_replica.cc:333] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.654757  9741 raft_consensus.cc:2243] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.655378  9741 raft_consensus.cc:2272] T 33ccd4bc26b14304b81583bf6a6d3efb P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.658529  9741 tablet_replica.cc:333] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.659253  9741 raft_consensus.cc:2243] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.659929  9741 raft_consensus.cc:2272] T c1b75831227444d382e9c0fc5b367564 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.662374  9741 tablet_replica.cc:333] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.663053  9741 raft_consensus.cc:2243] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.664188  9741 raft_consensus.cc:2272] T 015a67e38c364985be24b18358579506 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:00.665457 11622 consensus_peers.cc:597] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Couldn't send request to peer 1abf4b385a2b493ab83f593a1f8c9cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:00.667148  9741 tablet_replica.cc:333] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.667980  9741 raft_consensus.cc:2243] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:24:00.669157  9741 raft_consensus.cc:2272] T 49f51062a99d4696bd7480d6804e7d72 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.671792  9741 tablet_replica.cc:333] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.672528  9741 raft_consensus.cc:2243] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:24:00.673605  9741 raft_consensus.cc:2272] T 0ccace425f6c4d5ea9588504233ffee0 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.676079  9741 tablet_replica.cc:333] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.676733  9741 raft_consensus.cc:2243] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:00.677587 11624 consensus_peers.cc:597] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:00.677568  9741 raft_consensus.cc:2272] T 0cb303f7380c4693b70bda660f0f86a6 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.691079  9741 tablet_replica.cc:333] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.691929  9741 raft_consensus.cc:2243] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.692636  9741 raft_consensus.cc:2272] T f1f6166d836f41229df11ee42cd8e4c7 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.695497  9741 tablet_replica.cc:333] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.696237  9741 raft_consensus.cc:2243] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.697613  9741 raft_consensus.cc:2272] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.700264  9741 tablet_replica.cc:333] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.700930  9741 raft_consensus.cc:2243] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 LEADER]: Raft consensus shutting down.
W20260709 12:24:00.701325 11622 consensus_peers.cc:597] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Couldn't send request to peer 1abf4b385a2b493ab83f593a1f8c9cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:00.702126  9741 raft_consensus.cc:2272] T 74d2f9dca08d41e7a77146322049c40c P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.705122  9741 tablet_replica.cc:333] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.705842  9741 raft_consensus.cc:2243] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.706558  9741 raft_consensus.cc:2272] T 970339bba6a8454e8c722b4367924db8 P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.709378  9741 tablet_replica.cc:333] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1: stopping tablet replica
I20260709 12:24:00.710080  9741 raft_consensus.cc:2243] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:24:00.711386  9741 raft_consensus.cc:2272] T 32589fba10354b9588f7cb0a69c6e92d P 1abf4b385a2b493ab83f593a1f8c9cd1 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:00.736579 11622 consensus_peers.cc:597] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Couldn't send request to peer 1abf4b385a2b493ab83f593a1f8c9cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:00.738659 11106 debug-util.cc:398] Leaking SignalData structure 0x7b08001e0a80 after lost signal to thread 9744
W20260709 12:24:00.739880 11106 debug-util.cc:398] Leaking SignalData structure 0x7b08003254c0 after lost signal to thread 10868
W20260709 12:24:00.741287 11106 debug-util.cc:398] Leaking SignalData structure 0x7b080038a880 after lost signal to thread 11109
W20260709 12:24:00.741894 11622 consensus_peers.cc:597] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Couldn't send request to peer 1abf4b385a2b493ab83f593a1f8c9cd1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:00.742596 11106 debug-util.cc:398] Leaking SignalData structure 0x7b0800174860 after lost signal to thread 11683
W20260709 12:24:00.913005 11624 consensus_peers.cc:597] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:00.972227 19860 raft_consensus.cc:493] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:24:00.972787 19860 raft_consensus.cc:515] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:24:00.974987 19860 leader_election.cc:290] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
I20260709 12:24:00.979826 19859 raft_consensus.cc:493] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:24:00.983078 19859 raft_consensus.cc:515] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:24:00.985357 19859 leader_election.cc:290] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:24:00.980533 11625 leader_election.cc:336] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:24:00.999214 11625 leader_election.cc:336] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:24:01.000289 11624 leader_election.cc:336] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:24:01.000785 11624 leader_election.cc:304] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:24:01.003196 19860 raft_consensus.cc:2749] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:24:01.017089 11624 leader_election.cc:336] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:24:01.017630 11624 leader_election.cc:304] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:24:01.027823 19860 raft_consensus.cc:2749] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:24:01.040355 11625 consensus_peers.cc:597] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:01.169252 11624 consensus_peers.cc:597] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:01.182868 10821 catalog_manager.cc:4755] TS 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 660a349ad34749648cae6a025708c84d: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:24:01.319144 11624 consensus_peers.cc:597] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:01.340505 19873 raft_consensus.cc:493] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:24:01.341202 19873 raft_consensus.cc:515] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:24:01.347396 19873 leader_election.cc:290] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383)
W20260709 12:24:01.352464 11625 leader_election.cc:336] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:24:01.362895 11624 consensus_peers.cc:597] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:01.363471 11624 leader_election.cc:336] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:24:01.364256 11624 leader_election.cc:304] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 2201bad9e18849b09cf82de29dd032d3, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:24:01.365293 19873 raft_consensus.cc:2749] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:24:01.375705 11624 consensus_peers.cc:597] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:01.404801 11624 consensus_peers.cc:597] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:01.439262 19873 raft_consensus.cc:493] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:24:01.439905 19873 raft_consensus.cc:515] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:24:01.450557 11622 leader_election.cc:336] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Network error: Client connection negotiation failed: client connection to 127.9.131.67:40209: connect: Connection refused (error 111)
W20260709 12:24:01.453214 11625 leader_election.cc:336] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:24:01.453737 11625 leader_election.cc:304] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:24:01.455124 19860 raft_consensus.cc:2749] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:24:01.454234 19873 leader_election.cc:290] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:24:01.460865 11624 leader_election.cc:336] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:24:01.523766 19873 raft_consensus.cc:493] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:24:01.524457 19873 raft_consensus.cc:515] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:24:01.526700 19873 leader_election.cc:290] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:24:01.539376 11622 leader_election.cc:336] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Network error: Client connection negotiation failed: client connection to 127.9.131.67:40209: connect: Connection refused (error 111)
I20260709 12:24:01.541913 19860 raft_consensus.cc:493] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:24:01.542543 19860 raft_consensus.cc:515] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:24:01.545578 19860 leader_election.cc:290] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:24:01.556754 11625 leader_election.cc:336] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:24:01.559769 11624 leader_election.cc:336] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:24:01.564603 11624 leader_election.cc:304] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:24:01.567808 19873 raft_consensus.cc:2749] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:24:01.566599 11622 leader_election.cc:336] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Network error: Client connection negotiation failed: client connection to 127.9.131.67:40209: connect: Connection refused (error 111)
I20260709 12:24:01.569689 11622 leader_election.cc:304] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:24:01.573776 19873 raft_consensus.cc:2749] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:24:01.582299 11624 leader_election.cc:336] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
W20260709 12:24:01.586611 11624 consensus_peers.cc:597] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:01.652664 19873 raft_consensus.cc:493] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2201bad9e18849b09cf82de29dd032d3)
I20260709 12:24:01.653317 19873 raft_consensus.cc:515] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } attrs { replace: true } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:24:01.658087 19873 leader_election.cc:290] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:24:01.668256 11622 leader_election.cc:336] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Network error: Client connection negotiation failed: client connection to 127.9.131.67:40209: connect: Connection refused (error 111)
W20260709 12:24:01.671303 11624 leader_election.cc:336] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:24:01.671898 11624 leader_election.cc:304] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:24:01.672461 19860 raft_consensus.cc:493] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:24:01.673815 19860 raft_consensus.cc:515] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:24:01.675946 19860 leader_election.cc:290] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:24:01.672897 19873 raft_consensus.cc:493] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:24:01.676710 19873 raft_consensus.cc:515] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:24:01.679236 19873 leader_election.cc:290] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
I20260709 12:24:01.683811 19860 raft_consensus.cc:2749] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:24:01.690326 11625 leader_election.cc:336] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:24:01.698911 11622 leader_election.cc:336] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Network error: Client connection negotiation failed: client connection to 127.9.131.67:40209: connect: Connection refused (error 111)
W20260709 12:24:01.702291 11622 leader_election.cc:336] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Network error: Client connection negotiation failed: client connection to 127.9.131.67:40209: connect: Connection refused (error 111)
W20260709 12:24:01.702843 11624 leader_election.cc:336] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
W20260709 12:24:01.704035 11625 leader_election.cc:336] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:24:01.704761 11625 leader_election.cc:304] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:24:01.703728 11624 leader_election.cc:304] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:24:01.705757 19873 raft_consensus.cc:2749] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:01.707240 19873 raft_consensus.cc:2749] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:24:01.728909 11624 consensus_peers.cc:597] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:01.746835 11624 consensus_peers.cc:597] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:01.806995 19873 raft_consensus.cc:493] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:24:01.807699 19873 raft_consensus.cc:515] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } attrs { replace: true } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
W20260709 12:24:01.814549 11625 leader_election.cc:336] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:24:01.829488 11622 leader_election.cc:336] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Network error: Client connection negotiation failed: client connection to 127.9.131.67:40209: connect: Connection refused (error 111)
I20260709 12:24:01.830164 11622 leader_election.cc:304] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:24:01.832376 19860 raft_consensus.cc:2749] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:24:01.831355 19873 leader_election.cc:290] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:24:01.837522 11624 leader_election.cc:336] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
I20260709 12:24:01.855051 19873 raft_consensus.cc:493] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:24:01.856003 19873 raft_consensus.cc:515] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:24:01.859304 19873 leader_election.cc:290] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:24:01.865548 11625 leader_election.cc:336] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:24:01.869284 11622 leader_election.cc:336] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Network error: Client connection negotiation failed: client connection to 127.9.131.67:40209: connect: Connection refused (error 111)
I20260709 12:24:01.869824 11622 leader_election.cc:304] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:24:01.870851 19873 raft_consensus.cc:2749] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:24:01.893281 11624 consensus_peers.cc:597] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:01.914372 19873 raft_consensus.cc:493] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:24:01.915072 19873 raft_consensus.cc:515] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:24:01.935446 19873 leader_election.cc:290] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:24:01.942139 11624 leader_election.cc:336] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
W20260709 12:24:01.947548 11625 consensus_peers.cc:597] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:01.955997 11622 leader_election.cc:336] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Network error: Client connection negotiation failed: client connection to 127.9.131.67:40209: connect: Connection refused (error 111)
I20260709 12:24:01.956948 11622 leader_election.cc:304] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:24:01.958066 19873 raft_consensus.cc:2749] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:02.006579 19873 raft_consensus.cc:493] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:24:02.007220 19873 raft_consensus.cc:515] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e8170bbe8244e40a2b2e5011e69b697" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 46109 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:24:02.011694 19873 leader_election.cc:290] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:24:02.016659 11625 leader_election.cc:336] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:24:02.017345 11625 consensus_peers.cc:597] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:02.025624 11622 leader_election.cc:336] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Network error: Client connection negotiation failed: client connection to 127.9.131.67:40209: connect: Connection refused (error 111)
I20260709 12:24:02.026217 11622 leader_election.cc:304] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 9e8170bbe8244e40a2b2e5011e69b697
I20260709 12:24:02.026975 19873 raft_consensus.cc:2749] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:02.095274 19873 raft_consensus.cc:493] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1abf4b385a2b493ab83f593a1f8c9cd1)
I20260709 12:24:02.095877 19873 raft_consensus.cc:515] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "2201bad9e18849b09cf82de29dd032d3" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 41383 } } peers { permanent_uuid: "1abf4b385a2b493ab83f593a1f8c9cd1" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40209 } } peers { permanent_uuid: "0b171b6aaedc4f809f2753dcfadb14ce" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 41955 } attrs { promote: false } }
I20260709 12:24:02.098043 19873 leader_election.cc:290] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383), 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209)
W20260709 12:24:02.110047 11624 leader_election.cc:336] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111)
W20260709 12:24:02.111661 11622 leader_election.cc:336] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1abf4b385a2b493ab83f593a1f8c9cd1 (127.9.131.67:40209): Network error: Client connection negotiation failed: client connection to 127.9.131.67:40209: connect: Connection refused (error 111)
I20260709 12:24:02.114033 11622 leader_election.cc:304] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b171b6aaedc4f809f2753dcfadb14ce; no voters: 1abf4b385a2b493ab83f593a1f8c9cd1, 2201bad9e18849b09cf82de29dd032d3
I20260709 12:24:02.117113 19860 raft_consensus.cc:2749] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:24:02.163015 11625 consensus_peers.cc:597] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): Couldn't send request to peer 9e8170bbe8244e40a2b2e5011e69b697. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:02.217723 11624 consensus_peers.cc:597] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce -> Peer 2201bad9e18849b09cf82de29dd032d3 (127.9.131.66:41383): Couldn't send request to peer 2201bad9e18849b09cf82de29dd032d3. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:41383: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:02.278357  9741 tablet_server.cc:196] TabletServer@127.9.131.67:0 shutdown complete.
I20260709 12:24:02.411901  9741 tablet_server.cc:179] TabletServer@127.9.131.68:0 shutting down...
I20260709 12:24:02.478859  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:02.479745  9741 tablet_replica.cc:333] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.481040  9741 raft_consensus.cc:2243] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.482218  9741 raft_consensus.cc:2272] T 9b668506e6eb4a57aa83a9e45c3eb356 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.485152  9741 tablet_replica.cc:333] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.485839  9741 raft_consensus.cc:2243] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.486714  9741 raft_consensus.cc:2272] T c486c31e8ba74d8a9b17989a20d141bf P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.490114  9741 tablet_replica.cc:333] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.492015  9741 raft_consensus.cc:2243] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.492660  9741 raft_consensus.cc:2272] T 660a349ad34749648cae6a025708c84d P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.495636  9741 tablet_replica.cc:333] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.496546  9741 raft_consensus.cc:2243] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.497984  9741 raft_consensus.cc:2272] T 90e76c15ad9c49ab9b98a5d216125beb P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.500934  9741 tablet_replica.cc:333] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.501573  9741 raft_consensus.cc:2243] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.502581  9741 raft_consensus.cc:2272] T 8151fe64a0a84d44a837cc6abf316707 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.505218  9741 tablet_replica.cc:333] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.505820  9741 raft_consensus.cc:2243] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.506690  9741 raft_consensus.cc:2272] T f1f6166d836f41229df11ee42cd8e4c7 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.508760  9741 tablet_replica.cc:333] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.509424  9741 raft_consensus.cc:2243] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.510622  9741 raft_consensus.cc:2272] T 0cb303f7380c4693b70bda660f0f86a6 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.513376  9741 tablet_replica.cc:333] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.513993  9741 raft_consensus.cc:2243] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.514825  9741 raft_consensus.cc:2272] T edeb14680d6b4c7b95eed2b196750242 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.517356  9741 tablet_replica.cc:333] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.518013  9741 raft_consensus.cc:2243] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.518878  9741 raft_consensus.cc:2272] T 80db8b3fbfd046e8a5535ff4a7380107 P 0b171b6aaedc4f809f2753dcfadb14ce [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.521553  9741 tablet_replica.cc:333] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.522146  9741 raft_consensus.cc:2243] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.523149  9741 raft_consensus.cc:2272] T 6aa58b8bde194f658aced897744b4d35 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.525723  9741 tablet_replica.cc:333] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.526419  9741 raft_consensus.cc:2243] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.527344  9741 raft_consensus.cc:2272] T c1b75831227444d382e9c0fc5b367564 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.529698  9741 tablet_replica.cc:333] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.530297  9741 raft_consensus.cc:2243] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.530889  9741 raft_consensus.cc:2272] T bda5e552d0f54d1daafad75449fbb509 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.533483  9741 tablet_replica.cc:333] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.534029  9741 raft_consensus.cc:2243] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.534632  9741 raft_consensus.cc:2272] T 097e40d4693b49118b91e7a4fd8e8eb1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.536945  9741 tablet_replica.cc:333] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.537503  9741 raft_consensus.cc:2243] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.538090  9741 raft_consensus.cc:2272] T 9b6c427f0a234dbab806dced4d3ba0fb P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.540398  9741 tablet_replica.cc:333] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.540946  9741 raft_consensus.cc:2243] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.541586  9741 raft_consensus.cc:2272] T 59db2d2bb22c41aebd0d2073e2ba7d52 P 0b171b6aaedc4f809f2753dcfadb14ce [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.544046  9741 tablet_replica.cc:333] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.544621  9741 raft_consensus.cc:2243] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.545234  9741 raft_consensus.cc:2272] T 62cfdf78af4046beba4a418e904e80b1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.547793  9741 tablet_replica.cc:333] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.548473  9741 raft_consensus.cc:2243] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.549165  9741 raft_consensus.cc:2272] T dc9fc876e22f4072a34df693254c2f5e P 0b171b6aaedc4f809f2753dcfadb14ce [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.551697  9741 tablet_replica.cc:333] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.553476  9741 raft_consensus.cc:2243] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.554519  9741 raft_consensus.cc:2272] T 83b4e206b7694af695234c0e758055e2 P 0b171b6aaedc4f809f2753dcfadb14ce [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.557803  9741 tablet_replica.cc:333] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.558661  9741 raft_consensus.cc:2243] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.559652  9741 raft_consensus.cc:2272] T e4d1425ae0d743b7be813705b92d4e15 P 0b171b6aaedc4f809f2753dcfadb14ce [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.562381  9741 tablet_replica.cc:333] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.562980  9741 raft_consensus.cc:2243] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.563586  9741 raft_consensus.cc:2272] T 0774d95f5c1b4bdb990e50f5d858b600 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.566223  9741 tablet_replica.cc:333] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.566877  9741 raft_consensus.cc:2243] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.567838  9741 raft_consensus.cc:2272] T d3426d7ccdd943b882b65c3977a20040 P 0b171b6aaedc4f809f2753dcfadb14ce [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.570381  9741 tablet_replica.cc:333] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.571055  9741 raft_consensus.cc:2243] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.572032  9741 raft_consensus.cc:2272] T 11f1b75a0edb45d493bb20e8a0f34156 P 0b171b6aaedc4f809f2753dcfadb14ce [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.574546  9741 tablet_replica.cc:333] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.575156  9741 raft_consensus.cc:2243] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.576437  9741 raft_consensus.cc:2272] T ba629b94057b4c4e9085289ea50b42f1 P 0b171b6aaedc4f809f2753dcfadb14ce [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.578881  9741 tablet_replica.cc:333] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.579393  9741 raft_consensus.cc:2243] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.580050  9741 raft_consensus.cc:2272] T d88dec874a3240d69746dfb302cf057e P 0b171b6aaedc4f809f2753dcfadb14ce [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.582758  9741 tablet_replica.cc:333] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.583362  9741 raft_consensus.cc:2243] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.584321  9741 raft_consensus.cc:2272] T d263972b0e844fa281354fac07ccef80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.586865  9741 tablet_replica.cc:333] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.587371  9741 raft_consensus.cc:2243] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.588390  9741 raft_consensus.cc:2272] T 38e2bba2f11943899027eb26325e2b6a P 0b171b6aaedc4f809f2753dcfadb14ce [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.590564  9741 tablet_replica.cc:333] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.591270  9741 raft_consensus.cc:2243] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.592381  9741 raft_consensus.cc:2272] T 5e9e7be3e0bf4a1fa43f868eaf3e2c80 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.594597  9741 tablet_replica.cc:333] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.595161  9741 raft_consensus.cc:2243] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.595803  9741 raft_consensus.cc:2272] T b156bebcd53a4b6ea1f83c42906a5a03 P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.598204  9741 tablet_replica.cc:333] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.598881  9741 raft_consensus.cc:2243] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.599473  9741 raft_consensus.cc:2272] T 49f51062a99d4696bd7480d6804e7d72 P 0b171b6aaedc4f809f2753dcfadb14ce [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.601850  9741 tablet_replica.cc:333] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.602427  9741 raft_consensus.cc:2243] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.603057  9741 raft_consensus.cc:2272] T 015a67e38c364985be24b18358579506 P 0b171b6aaedc4f809f2753dcfadb14ce [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.605644  9741 tablet_replica.cc:333] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce: stopping tablet replica
I20260709 12:24:02.606199  9741 raft_consensus.cc:2243] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.607118  9741 raft_consensus.cc:2272] T 33ccd4bc26b14304b81583bf6a6d3efb P 0b171b6aaedc4f809f2753dcfadb14ce [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:03.362586  9741 tablet_server.cc:196] TabletServer@127.9.131.68:0 shutdown complete.
I20260709 12:24:03.423339  9741 master.cc:562] Master@127.9.131.126:46265 shutting down...
W20260709 12:24:03.456602 10882 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:24:03.456951 10882 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:24:03.457139 10882 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:24:06.009462 10821 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111) [suppressed 354 similar messages]
W20260709 12:24:06.012957 10821 catalog_manager.cc:4755] TS 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9b668506e6eb4a57aa83a9e45c3eb356: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:24:16.295132 10865 debug-util.cc:398] Leaking SignalData structure 0x7b0800034480 after lost signal to thread 9744
W20260709 12:24:16.295671 10865 debug-util.cc:398] Leaking SignalData structure 0x7b0800241d40 after lost signal to thread 10868
W20260709 12:24:17.575214 10821 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
W20260709 12:24:17.578730 10821 catalog_manager.cc:4755] TS 9e8170bbe8244e40a2b2e5011e69b697 (127.9.131.65:46109): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 660a349ad34749648cae6a025708c84d: Network error: Client connection negotiation failed: client connection to 127.9.131.65:46109: connect: Connection refused (error 111)
I20260709 12:24:20.477280  9741 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:20.478394  9741 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.478772  9741 tablet_replica.cc:333] T 00000000000000000000000000000000 P b5a9c6dd870a436699566823a8e6e1ca: stopping tablet replica
I20260709 12:24:20.731007  9741 master.cc:584] Master@127.9.131.126:46265 shutdown complete.
I20260709 12:24:20.779369  9741 test_util.cc:182] -----------------------------------------------
I20260709 12:24:20.779604  9741 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599527842218-9741-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (271184 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:24:20.783210  9741 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.131.126:36271
I20260709 12:24:20.784384  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:20.790143 19883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:20.790334 19884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:20.791348 19886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:20.792650  9741 server_base.cc:1061] running on GCE node
I20260709 12:24:20.796017  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:20.796231  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:20.796376  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599860796358 us; error 0 us; skew 500 ppm
I20260709 12:24:20.796892  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:20.799340  9741 webserver.cc:533] Webserver started at http://127.9.131.126:34037/ using document root <none> and password file <none>
I20260709 12:24:20.799829  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:20.800047  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:20.800379  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:20.801839  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/master-0-root/instance:
uuid: "5907f62d19ad4f6aa4da9f20e59cca3a"
format_stamp: "Formatted at 2026-07-09 12:24:20 on dist-test-slave-r7s7"
I20260709 12:24:20.806383  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:24:20.809909 19891 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:20.810738  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:24:20.811082  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/master-0-root
uuid: "5907f62d19ad4f6aa4da9f20e59cca3a"
format_stamp: "Formatted at 2026-07-09 12:24:20 on dist-test-slave-r7s7"
I20260709 12:24:20.811407  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:20.839062  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:20.840466  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:20.881114  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.126:36271
I20260709 12:24:20.881208 19943 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.126:36271 every 8 connection(s)
I20260709 12:24:20.885531 19944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:20.897040 19944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a: Bootstrap starting.
I20260709 12:24:20.901950 19944 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:20.906718 19944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a: No bootstrap required, opened a new log
I20260709 12:24:20.909157 19944 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5907f62d19ad4f6aa4da9f20e59cca3a" member_type: VOTER }
I20260709 12:24:20.909617 19944 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:20.909859 19944 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5907f62d19ad4f6aa4da9f20e59cca3a, State: Initialized, Role: FOLLOWER
I20260709 12:24:20.910511 19944 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5907f62d19ad4f6aa4da9f20e59cca3a" member_type: VOTER }
I20260709 12:24:20.910969 19944 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:24:20.911198 19944 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:24:20.911468 19944 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:20.916337 19944 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5907f62d19ad4f6aa4da9f20e59cca3a" member_type: VOTER }
I20260709 12:24:20.916884 19944 leader_election.cc:304] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5907f62d19ad4f6aa4da9f20e59cca3a; no voters: 
I20260709 12:24:20.918032 19944 leader_election.cc:290] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:24:20.918465 19947 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:20.919948 19947 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a [term 1 LEADER]: Becoming Leader. State: Replica: 5907f62d19ad4f6aa4da9f20e59cca3a, State: Running, Role: LEADER
I20260709 12:24:20.920703 19947 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5907f62d19ad4f6aa4da9f20e59cca3a" member_type: VOTER }
I20260709 12:24:20.920953 19944 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:24:20.931017 19948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5907f62d19ad4f6aa4da9f20e59cca3a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5907f62d19ad4f6aa4da9f20e59cca3a" member_type: VOTER } }
I20260709 12:24:20.931003 19949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5907f62d19ad4f6aa4da9f20e59cca3a. Latest consensus state: current_term: 1 leader_uuid: "5907f62d19ad4f6aa4da9f20e59cca3a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5907f62d19ad4f6aa4da9f20e59cca3a" member_type: VOTER } }
I20260709 12:24:20.931740 19948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:20.931916 19949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:20.933907 19958 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:24:20.939026 19958 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:24:20.940228  9741 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:24:20.948714 19958 catalog_manager.cc:1383] Generated new cluster ID: 77c3b7a7d4814f9088371ab9881ae9e7
I20260709 12:24:20.949191 19958 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:24:20.988598 19958 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:24:20.989873 19958 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:24:21.005751 19958 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a: Generated new TSK 0
I20260709 12:24:21.006464 19958 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:24:21.071810  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:21.078433 19965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:21.079074 19966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:21.081624 19968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:21.082129  9741 server_base.cc:1061] running on GCE node
I20260709 12:24:21.084798  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:21.085016  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:21.085173  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599861085155 us; error 0 us; skew 500 ppm
I20260709 12:24:21.085736  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:21.088312  9741 webserver.cc:533] Webserver started at http://127.9.131.65:41691/ using document root <none> and password file <none>
I20260709 12:24:21.088861  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:21.089043  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:21.089298  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:21.090476  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-0-root/instance:
uuid: "7204c82dd34944818a439bd468a8c410"
format_stamp: "Formatted at 2026-07-09 12:24:21 on dist-test-slave-r7s7"
I20260709 12:24:21.095322  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 12:24:21.098752 19973 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:21.099503  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:24:21.099803  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-0-root
uuid: "7204c82dd34944818a439bd468a8c410"
format_stamp: "Formatted at 2026-07-09 12:24:21 on dist-test-slave-r7s7"
I20260709 12:24:21.100147  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:21.120528  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:21.121762  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:21.123301  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:21.125705  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:21.125893  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:21.126164  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:21.126335  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:21.166925  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.65:43339
I20260709 12:24:21.167078 20035 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.65:43339 every 8 connection(s)
I20260709 12:24:21.172082  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:21.180145 20040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:21.181811 20041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:21.185758 20043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:21.186607  9741 server_base.cc:1061] running on GCE node
I20260709 12:24:21.186695 20036 heartbeater.cc:344] Connected to a master server at 127.9.131.126:36271
I20260709 12:24:21.187314 20036 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:21.188203 20036 heartbeater.cc:507] Master 127.9.131.126:36271 requested a full tablet report, sending...
I20260709 12:24:21.189457  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:21.189812  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:21.189985  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599861189966 us; error 0 us; skew 500 ppm
I20260709 12:24:21.190689 19908 ts_manager.cc:194] Registered new tserver with Master: 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:21.190864  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:21.192935 19908 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55592
I20260709 12:24:21.193972  9741 webserver.cc:533] Webserver started at http://127.9.131.66:38199/ using document root <none> and password file <none>
I20260709 12:24:21.194643  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:21.194864  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:21.195142  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:21.196527  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-1-root/instance:
uuid: "aac061e592d74289800e4c50cbb4132b"
format_stamp: "Formatted at 2026-07-09 12:24:21 on dist-test-slave-r7s7"
I20260709 12:24:21.201398  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:24:21.205137 20048 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:21.205929  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:24:21.206246  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-1-root
uuid: "aac061e592d74289800e4c50cbb4132b"
format_stamp: "Formatted at 2026-07-09 12:24:21 on dist-test-slave-r7s7"
I20260709 12:24:21.206550  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:21.221107  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:21.222435  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:21.223985  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:21.226253  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:21.226472  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:21.226701  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:21.226850  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:21.270925  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.66:38769
I20260709 12:24:21.271023 20110 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.66:38769 every 8 connection(s)
I20260709 12:24:21.275890  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:21.282732 20114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:21.284364 20115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:21.285733 20118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:21.286685  9741 server_base.cc:1061] running on GCE node
I20260709 12:24:21.287807  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:21.288076  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:21.288277  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599861288256 us; error 0 us; skew 500 ppm
I20260709 12:24:21.288496 20111 heartbeater.cc:344] Connected to a master server at 127.9.131.126:36271
I20260709 12:24:21.288964 20111 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:21.289057  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:21.289834 20111 heartbeater.cc:507] Master 127.9.131.126:36271 requested a full tablet report, sending...
I20260709 12:24:21.292091  9741 webserver.cc:533] Webserver started at http://127.9.131.67:35877/ using document root <none> and password file <none>
I20260709 12:24:21.292172 19908 ts_manager.cc:194] Registered new tserver with Master: aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:21.292708  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:21.292944  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:21.293193  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:21.293736 19908 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55604
I20260709 12:24:21.294577  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-2-root/instance:
uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
format_stamp: "Formatted at 2026-07-09 12:24:21 on dist-test-slave-r7s7"
I20260709 12:24:21.299255  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:24:21.303026 20123 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:21.303808  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:24:21.304174  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-2-root
uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
format_stamp: "Formatted at 2026-07-09 12:24:21 on dist-test-slave-r7s7"
I20260709 12:24:21.304457  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:21.332705  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:21.333966  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:21.335296  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:21.337689  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:21.337881  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:21.338116  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:21.338256  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:21.379889  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.67:40749
I20260709 12:24:21.379997 20186 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.67:40749 every 8 connection(s)
I20260709 12:24:21.384804  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:21.392346 20190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:21.393613 20191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:21.396729  9741 server_base.cc:1061] running on GCE node
W20260709 12:24:21.396687 20193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:21.398203  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:21.398501  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:21.398656 20187 heartbeater.cc:344] Connected to a master server at 127.9.131.126:36271
I20260709 12:24:21.398728  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599861398708 us; error 0 us; skew 500 ppm
I20260709 12:24:21.399225 20187 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:21.399662  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:21.400116 20187 heartbeater.cc:507] Master 127.9.131.126:36271 requested a full tablet report, sending...
I20260709 12:24:21.402633 19908 ts_manager.cc:194] Registered new tserver with Master: 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:21.402792  9741 webserver.cc:533] Webserver started at http://127.9.131.68:39471/ using document root <none> and password file <none>
I20260709 12:24:21.403455  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:21.403692  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:21.404066  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:21.404667 19908 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55618
I20260709 12:24:21.406044  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-3-root/instance:
uuid: "c470740d41ee4b9383923d08a87655d6"
format_stamp: "Formatted at 2026-07-09 12:24:21 on dist-test-slave-r7s7"
I20260709 12:24:21.411671  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:24:21.415408 20198 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:21.416299  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:24:21.416654  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-3-root
uuid: "c470740d41ee4b9383923d08a87655d6"
format_stamp: "Formatted at 2026-07-09 12:24:21 on dist-test-slave-r7s7"
I20260709 12:24:21.416942  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:21.434990  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:21.436365  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:21.437718  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:21.439801  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:21.440066  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:21.440289  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:21.440448  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:21.482141  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.68:39155
I20260709 12:24:21.482265 20261 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.68:39155 every 8 connection(s)
I20260709 12:24:21.496371 20262 heartbeater.cc:344] Connected to a master server at 127.9.131.126:36271
I20260709 12:24:21.496802 20262 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:21.497637 20262 heartbeater.cc:507] Master 127.9.131.126:36271 requested a full tablet report, sending...
I20260709 12:24:21.499640 19908 ts_manager.cc:194] Registered new tserver with Master: c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:21.500156  9741 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014925441s
I20260709 12:24:21.501451 19908 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55632
I20260709 12:24:21.527698 19908 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55634:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:24:21.780552 20152 tablet_service.cc:1511] Processing CreateTablet for tablet d5e9c01d16214bb19000600644b36d1e (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:24:21.782156 20152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5e9c01d16214bb19000600644b36d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.785005 20151 tablet_service.cc:1511] Processing CreateTablet for tablet 4a8a2aa61ada477c8750740dcc082235 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:24:21.786597 20151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a8a2aa61ada477c8750740dcc082235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.788112 20150 tablet_service.cc:1511] Processing CreateTablet for tablet 75e7b860aa254e34a20e8bdae1b626df (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:24:21.788519 20001 tablet_service.cc:1511] Processing CreateTablet for tablet d5e9c01d16214bb19000600644b36d1e (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:24:21.789604 20150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75e7b860aa254e34a20e8bdae1b626df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.789949 20001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5e9c01d16214bb19000600644b36d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.793093 20149 tablet_service.cc:1511] Processing CreateTablet for tablet ba98035197c34fce88758eedbfd23225 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:24:21.794628 20149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba98035197c34fce88758eedbfd23225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.794375 19999 tablet_service.cc:1511] Processing CreateTablet for tablet 4a8a2aa61ada477c8750740dcc082235 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:24:21.797066 19998 tablet_service.cc:1511] Processing CreateTablet for tablet ba98035197c34fce88758eedbfd23225 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:24:21.798220 20147 tablet_service.cc:1511] Processing CreateTablet for tablet e6d6ed1f33fa4b73bf5108eb0fec8f88 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:24:21.799659 20147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6d6ed1f33fa4b73bf5108eb0fec8f88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.799561 19997 tablet_service.cc:1511] Processing CreateTablet for tablet fb7527e635cb4c339c05a4b1ea702164 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:24:21.800961 19996 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff86d69d6264de598b8dd58012f7904 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:24:21.797066 20148 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff86d69d6264de598b8dd58012f7904 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:24:21.814168 20282 tablet_bootstrap.cc:492] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:21.814602 20148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff86d69d6264de598b8dd58012f7904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.793141 20000 tablet_service.cc:1511] Processing CreateTablet for tablet 073b8908cc1345f3bad72a6d8124df11 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:24:21.795802 19999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a8a2aa61ada477c8750740dcc082235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.819099 19996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff86d69d6264de598b8dd58012f7904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.804378 19995 tablet_service.cc:1511] Processing CreateTablet for tablet e740fe60a5fc470d930160cc9445bc05 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:24:21.821805 20282 tablet_bootstrap.cc:654] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:21.822170 19995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e740fe60a5fc470d930160cc9445bc05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.805256 20146 tablet_service.cc:1511] Processing CreateTablet for tablet e740fe60a5fc470d930160cc9445bc05 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:24:21.824762 20146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e740fe60a5fc470d930160cc9445bc05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.825524 20151 tablet_service.cc:1511] Processing CreateTablet for tablet 57d0409829eb45ff8e1eb6b75796eff9 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:24:21.826861 20151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57d0409829eb45ff8e1eb6b75796eff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.807017 19994 tablet_service.cc:1511] Processing CreateTablet for tablet b5b588a815a548c8a3f375012fa7e3f6 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:24:21.828812 19994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5b588a815a548c8a3f375012fa7e3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.807431 20145 tablet_service.cc:1511] Processing CreateTablet for tablet a72eb35da72b43ecb538c2a240a61646 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:24:21.826098 20143 tablet_service.cc:1511] Processing CreateTablet for tablet d5bd4e0295fa48bc8c187c7d421d8f11 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:24:21.809533 20144 tablet_service.cc:1511] Processing CreateTablet for tablet 30dc0138443e498db94e47c81d5ca81b (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:24:21.832185 20145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a72eb35da72b43ecb538c2a240a61646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.809973 19993 tablet_service.cc:1511] Processing CreateTablet for tablet a72eb35da72b43ecb538c2a240a61646 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:24:21.837010 20144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30dc0138443e498db94e47c81d5ca81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.837286 19993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a72eb35da72b43ecb538c2a240a61646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.838400 20143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5bd4e0295fa48bc8c187c7d421d8f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.844408 20000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 073b8908cc1345f3bad72a6d8124df11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.848323 19997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7527e635cb4c339c05a4b1ea702164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.849762 20282 tablet_bootstrap.cc:492] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:21.850346 20282 ts_tablet_manager.cc:1403] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.000s
I20260709 12:24:21.852385 19998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba98035197c34fce88758eedbfd23225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.853796 20282 raft_consensus.cc:359] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:21.854596 20282 raft_consensus.cc:385] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:21.854893 20282 raft_consensus.cc:740] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:21.857613 20151 tablet_service.cc:1511] Processing CreateTablet for tablet e0126559599b40c5a6447c0648a81268 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:24:21.859113 20151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0126559599b40c5a6447c0648a81268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.860525 20282 consensus_queue.cc:260] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:21.863687 19992 tablet_service.cc:1511] Processing CreateTablet for tablet 57d0409829eb45ff8e1eb6b75796eff9 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:24:21.865226 19992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57d0409829eb45ff8e1eb6b75796eff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.911808 20075 tablet_service.cc:1511] Processing CreateTablet for tablet 073b8908cc1345f3bad72a6d8124df11 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:24:21.914899 20075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 073b8908cc1345f3bad72a6d8124df11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.913188 20076 tablet_service.cc:1511] Processing CreateTablet for tablet d5e9c01d16214bb19000600644b36d1e (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:24:21.917431 20076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5e9c01d16214bb19000600644b36d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.921066 20226 tablet_service.cc:1511] Processing CreateTablet for tablet 073b8908cc1345f3bad72a6d8124df11 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:24:21.922617 20226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 073b8908cc1345f3bad72a6d8124df11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.924463 20225 tablet_service.cc:1511] Processing CreateTablet for tablet 4a8a2aa61ada477c8750740dcc082235 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:24:21.925930 20225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a8a2aa61ada477c8750740dcc082235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.929082 20072 tablet_service.cc:1511] Processing CreateTablet for tablet fb7527e635cb4c339c05a4b1ea702164 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:24:21.930622 20072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7527e635cb4c339c05a4b1ea702164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.930322 20223 tablet_service.cc:1511] Processing CreateTablet for tablet fb7527e635cb4c339c05a4b1ea702164 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:24:21.933122 20222 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff86d69d6264de598b8dd58012f7904 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:24:21.935597 20221 tablet_service.cc:1511] Processing CreateTablet for tablet e6d6ed1f33fa4b73bf5108eb0fec8f88 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:24:21.938122 20074 tablet_service.cc:1511] Processing CreateTablet for tablet 75e7b860aa254e34a20e8bdae1b626df (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:24:21.939615 20074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75e7b860aa254e34a20e8bdae1b626df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.929147 20224 tablet_service.cc:1511] Processing CreateTablet for tablet 75e7b860aa254e34a20e8bdae1b626df (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
W20260709 12:24:21.933569 19956 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:21.942577 20071 tablet_service.cc:1511] Processing CreateTablet for tablet e6d6ed1f33fa4b73bf5108eb0fec8f88 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:24:21.945070 20069 tablet_service.cc:1511] Processing CreateTablet for tablet b5b588a815a548c8a3f375012fa7e3f6 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:24:21.947501 20068 tablet_service.cc:1511] Processing CreateTablet for tablet 30dc0138443e498db94e47c81d5ca81b (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:24:21.949939 20067 tablet_service.cc:1511] Processing CreateTablet for tablet 57d0409829eb45ff8e1eb6b75796eff9 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:24:21.952878 20070 tablet_service.cc:1511] Processing CreateTablet for tablet e740fe60a5fc470d930160cc9445bc05 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:24:21.954789 20152 tablet_service.cc:1511] Processing CreateTablet for tablet e5880437f7fb435aafab505023d9f7ae (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:24:21.957464 20219 tablet_service.cc:1511] Processing CreateTablet for tablet a72eb35da72b43ecb538c2a240a61646 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:24:21.959769 20150 tablet_service.cc:1511] Processing CreateTablet for tablet f6e608aa894f4f9d96f3e1b9b16fb7cd (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:24:21.960065 20218 tablet_service.cc:1511] Processing CreateTablet for tablet 30dc0138443e498db94e47c81d5ca81b (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:24:21.960939 20220 tablet_service.cc:1511] Processing CreateTablet for tablet b5b588a815a548c8a3f375012fa7e3f6 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:24:21.961648 20152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5880437f7fb435aafab505023d9f7ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.962455 20217 tablet_service.cc:1511] Processing CreateTablet for tablet e8691968cf8f4b04b4ef459bd321e903 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:24:21.931763 20223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7527e635cb4c339c05a4b1ea702164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.964498 20219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a72eb35da72b43ecb538c2a240a61646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.965204 20217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8691968cf8f4b04b4ef459bd321e903. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.965864 20220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5b588a815a548c8a3f375012fa7e3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.966609 20218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30dc0138443e498db94e47c81d5ca81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.967275 20221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6d6ed1f33fa4b73bf5108eb0fec8f88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.972355 20150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e608aa894f4f9d96f3e1b9b16fb7cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.941201 20073 tablet_service.cc:1511] Processing CreateTablet for tablet ba98035197c34fce88758eedbfd23225 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:24:21.976217 20073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba98035197c34fce88758eedbfd23225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.976792 20222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff86d69d6264de598b8dd58012f7904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.979348 20070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e740fe60a5fc470d930160cc9445bc05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.980239 20069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5b588a815a548c8a3f375012fa7e3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.980840 20071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6d6ed1f33fa4b73bf5108eb0fec8f88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.982673 20067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57d0409829eb45ff8e1eb6b75796eff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.988286 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30dc0138443e498db94e47c81d5ca81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.998276 20150 tablet_service.cc:1511] Processing CreateTablet for tablet 988f10f24b02449cade652e210ad3b06 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:24:21.999816 20150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988f10f24b02449cade652e210ad3b06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.031517 20224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75e7b860aa254e34a20e8bdae1b626df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.005700 20143 tablet_service.cc:1511] Processing CreateTablet for tablet 24bd122132f7485fa43d171d8c857d38 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:24:22.036981 20143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24bd122132f7485fa43d171d8c857d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.055891 20152 tablet_service.cc:1511] Processing CreateTablet for tablet b0da04e85e534d9990213bfdcee4874c (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:24:22.057344 20152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0da04e85e534d9990213bfdcee4874c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.090176 20147 tablet_service.cc:1511] Processing CreateTablet for tablet bac98768a9a3430a8784fa7995363272 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:24:22.096567 20075 tablet_service.cc:1511] Processing CreateTablet for tablet e8691968cf8f4b04b4ef459bd321e903 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:24:22.098007 20075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8691968cf8f4b04b4ef459bd321e903. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.108490 20000 tablet_service.cc:1511] Processing CreateTablet for tablet e5880437f7fb435aafab505023d9f7ae (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:24:22.108857 20151 tablet_service.cc:1511] Processing CreateTablet for tablet 524118618cf740e9865e397864b56ed2 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:24:22.110037 20000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5880437f7fb435aafab505023d9f7ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.122844 20187 heartbeater.cc:499] Master 127.9.131.126:36271 was elected leader, sending a full tablet report...
I20260709 12:24:22.123983 20147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac98768a9a3430a8784fa7995363272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.125504 20001 tablet_service.cc:1511] Processing CreateTablet for tablet e05de16433174dc4b33d9fbc6afd9da1 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:24:22.133484 20067 tablet_service.cc:1511] Processing CreateTablet for tablet 988f10f24b02449cade652e210ad3b06 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:24:22.134867 20067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988f10f24b02449cade652e210ad3b06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.135728 20285 tablet_bootstrap.cc:492] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:22.137179 20282 ts_tablet_manager.cc:1434] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.287s	user 0.027s	sys 0.029s
I20260709 12:24:22.135473 20076 tablet_service.cc:1511] Processing CreateTablet for tablet e5880437f7fb435aafab505023d9f7ae (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:24:22.142056 20225 tablet_service.cc:1511] Processing CreateTablet for tablet d5bd4e0295fa48bc8c187c7d421d8f11 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:24:22.143435 20225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5bd4e0295fa48bc8c187c7d421d8f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.125413 20071 tablet_service.cc:1511] Processing CreateTablet for tablet e05de16433174dc4b33d9fbc6afd9da1 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:24:22.151724 20148 tablet_service.cc:1511] Processing CreateTablet for tablet 5038da47868e47148f6dda5d135f60fa (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:24:22.154574 20151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 524118618cf740e9865e397864b56ed2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.170576 20069 tablet_service.cc:1511] Processing CreateTablet for tablet abf0d91bbb1d4e40b769bc07ef380517 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:24:22.161654 19994 tablet_service.cc:1511] Processing CreateTablet for tablet d5bd4e0295fa48bc8c187c7d421d8f11 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:24:22.154248 20282 tablet_bootstrap.cc:492] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:22.156673 20150 tablet_service.cc:1511] Processing CreateTablet for tablet 3651ee11a6184a34bed06bc86be62c29 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:24:22.175463 20150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3651ee11a6184a34bed06bc86be62c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.090713 19993 tablet_service.cc:1511] Processing CreateTablet for tablet e8691968cf8f4b04b4ef459bd321e903 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:24:22.182309 19998 tablet_service.cc:1511] Processing CreateTablet for tablet 24bd122132f7485fa43d171d8c857d38 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:24:22.183236 20001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e05de16433174dc4b33d9fbc6afd9da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.182940 20146 tablet_service.cc:1511] Processing CreateTablet for tablet af265a90671a46cbafb3fced0f952aef (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:24:22.184278 20146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af265a90671a46cbafb3fced0f952aef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.153739 20149 tablet_service.cc:1511] Processing CreateTablet for tablet d2a53dd7c6fa4a338973463bf3cf0f9c (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:24:22.189265 20149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2a53dd7c6fa4a338973463bf3cf0f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.189841 20144 tablet_service.cc:1511] Processing CreateTablet for tablet 528817cd200941fb84e40c79dbd16261 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:24:22.191260 20144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 528817cd200941fb84e40c79dbd16261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.194094 19996 tablet_service.cc:1511] Processing CreateTablet for tablet abf0d91bbb1d4e40b769bc07ef380517 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:24:22.195477 19996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf0d91bbb1d4e40b769bc07ef380517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.160764 20073 tablet_service.cc:1511] Processing CreateTablet for tablet e0126559599b40c5a6447c0648a81268 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:24:22.195993 20036 heartbeater.cc:499] Master 127.9.131.126:36271 was elected leader, sending a full tablet report...
I20260709 12:24:22.156456 20218 tablet_service.cc:1511] Processing CreateTablet for tablet e0126559599b40c5a6447c0648a81268 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:24:22.197005 20222 tablet_service.cc:1511] Processing CreateTablet for tablet f6e608aa894f4f9d96f3e1b9b16fb7cd (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:24:22.197722 20218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0126559599b40c5a6447c0648a81268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.198349 20222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e608aa894f4f9d96f3e1b9b16fb7cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.203007 20075 tablet_service.cc:1511] Processing CreateTablet for tablet bac98768a9a3430a8784fa7995363272 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:24:22.173979 20217 tablet_service.cc:1511] Processing CreateTablet for tablet e05de16433174dc4b33d9fbc6afd9da1 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:24:22.234421 20217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e05de16433174dc4b33d9fbc6afd9da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.154960 19995 tablet_service.cc:1511] Processing CreateTablet for tablet f6e608aa894f4f9d96f3e1b9b16fb7cd (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:24:22.211700 20076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5880437f7fb435aafab505023d9f7ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.236487 20287 tablet_bootstrap.cc:492] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:22.213160 19993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8691968cf8f4b04b4ef459bd321e903. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.213907 20286 tablet_bootstrap.cc:492] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:22.222280 20226 tablet_service.cc:1511] Processing CreateTablet for tablet abf0d91bbb1d4e40b769bc07ef380517 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:24:22.226652 20285 tablet_bootstrap.cc:654] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:22.226207 19992 tablet_service.cc:1511] Processing CreateTablet for tablet b0da04e85e534d9990213bfdcee4874c (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:24:22.237963 20071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e05de16433174dc4b33d9fbc6afd9da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.232482 20145 tablet_service.cc:1511] Processing CreateTablet for tablet 995e00d57e1040b7b6d193c60fd84405 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:24:22.238881 20284 raft_consensus.cc:493] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.260066 20073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0126559599b40c5a6447c0648a81268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.260232 20284 raft_consensus.cc:515] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:22.261430 19997 tablet_service.cc:1511] Processing CreateTablet for tablet 144ce9a2901342abbabee63851505b75 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:24:22.262845 20152 tablet_service.cc:1511] Processing CreateTablet for tablet 0988a236f3934f8692fd434098766112 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:24:22.156280 20072 tablet_service.cc:1511] Processing CreateTablet for tablet 24bd122132f7485fa43d171d8c857d38 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:24:22.265666 20284 leader_election.cc:290] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:22.244165 19994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5bd4e0295fa48bc8c187c7d421d8f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.229465 20223 tablet_service.cc:1511] Processing CreateTablet for tablet bac98768a9a3430a8784fa7995363272 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:24:22.242492 20148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5038da47868e47148f6dda5d135f60fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.250881 19999 tablet_service.cc:1511] Processing CreateTablet for tablet d2a53dd7c6fa4a338973463bf3cf0f9c (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:24:22.270653 20069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf0d91bbb1d4e40b769bc07ef380517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.252532 20226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf0d91bbb1d4e40b769bc07ef380517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.272574 20223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac98768a9a3430a8784fa7995363272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.258988 20074 tablet_service.cc:1511] Processing CreateTablet for tablet 144ce9a2901342abbabee63851505b75 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:24:22.270116 19995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e608aa894f4f9d96f3e1b9b16fb7cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.203007 20220 tablet_service.cc:1511] Processing CreateTablet for tablet 988f10f24b02449cade652e210ad3b06 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:24:22.294508 20282 tablet_bootstrap.cc:654] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:22.295934 20075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac98768a9a3430a8784fa7995363272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.296764 20111 heartbeater.cc:499] Master 127.9.131.126:36271 was elected leader, sending a full tablet report...
I20260709 12:24:22.243574 20068 tablet_service.cc:1511] Processing CreateTablet for tablet d2a53dd7c6fa4a338973463bf3cf0f9c (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:24:22.304900 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2a53dd7c6fa4a338973463bf3cf0f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.305223 20070 tablet_service.cc:1511] Processing CreateTablet for tablet 5038da47868e47148f6dda5d135f60fa (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:24:22.306718 20070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5038da47868e47148f6dda5d135f60fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.313047 20219 tablet_service.cc:1511] Processing CreateTablet for tablet 144ce9a2901342abbabee63851505b75 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:24:22.321096 20286 tablet_bootstrap.cc:654] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:22.324349 19999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2a53dd7c6fa4a338973463bf3cf0f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.337026 20072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24bd122132f7485fa43d171d8c857d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.339330 20219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 144ce9a2901342abbabee63851505b75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.342837 20220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988f10f24b02449cade652e210ad3b06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.346383 20143 tablet_service.cc:1511] Processing CreateTablet for tablet 1127f55bd43a4c988dfd61547a03b3fa (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:24:22.351052 20221 tablet_service.cc:1511] Processing CreateTablet for tablet 524118618cf740e9865e397864b56ed2 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:24:22.352617 20221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 524118618cf740e9865e397864b56ed2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.356555 20222 tablet_service.cc:1511] Processing CreateTablet for tablet 5038da47868e47148f6dda5d135f60fa (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:24:22.358057 20222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5038da47868e47148f6dda5d135f60fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.399067 20146 tablet_service.cc:1511] Processing CreateTablet for tablet 36c5a6e3d37c46f585ebd85003fbe15a (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:24:22.226228 20224 tablet_service.cc:1511] Processing CreateTablet for tablet b0da04e85e534d9990213bfdcee4874c (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:24:22.406945 20224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0da04e85e534d9990213bfdcee4874c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.374495 20076 tablet_service.cc:1511] Processing CreateTablet for tablet 3651ee11a6184a34bed06bc86be62c29 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:24:22.376324 20147 tablet_service.cc:1511] Processing CreateTablet for tablet 141c2e84c15e4ad38afc0a52b330f9b9 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:24:22.377035 20151 tablet_service.cc:1511] Processing CreateTablet for tablet b0ac5e9dcbf74c29aa24300975246ad3 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:24:22.378741 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8a2aa61ada477c8750740dcc082235" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
W20260709 12:24:22.384869 20188 tablet.cc:2406] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260709 12:24:22.414942 20124 leader_election.cc:343] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:22.388578 20074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 144ce9a2901342abbabee63851505b75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.420014 20076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3651ee11a6184a34bed06bc86be62c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.423703 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8a2aa61ada477c8750740dcc082235" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:22.390180 20287 tablet_bootstrap.cc:654] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:22.376216 19992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0da04e85e534d9990213bfdcee4874c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:22.426075 20125 leader_election.cc:343] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:22.431022 20125 leader_election.cc:304] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:22.402209 20217 tablet_service.cc:1511] Processing CreateTablet for tablet dd398fffdf6d468f88108a6a7bec0681 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:24:22.432399 20284 raft_consensus.cc:2749] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:22.432825 20217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd398fffdf6d468f88108a6a7bec0681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.433171 19997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 144ce9a2901342abbabee63851505b75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.403499 20286 tablet_bootstrap.cc:492] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:22.436002 20286 ts_tablet_manager.cc:1403] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.223s	user 0.009s	sys 0.012s
I20260709 12:24:22.436746 19998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24bd122132f7485fa43d171d8c857d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.404103 20071 tablet_service.cc:1511] Processing CreateTablet for tablet dd398fffdf6d468f88108a6a7bec0681 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:24:22.440783 20071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd398fffdf6d468f88108a6a7bec0681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.444458 20075 tablet_service.cc:1511] Processing CreateTablet for tablet 528817cd200941fb84e40c79dbd16261 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:24:22.446004 20075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 528817cd200941fb84e40c79dbd16261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.411053 20285 tablet_bootstrap.cc:492] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:22.358415 20152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0988a236f3934f8692fd434098766112. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.439303 20286 raft_consensus.cc:359] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:22.460419 20286 raft_consensus.cc:385] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:22.460753 20286 raft_consensus.cc:740] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:22.461542 20286 consensus_queue.cc:260] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:22.462603 20069 tablet_service.cc:1511] Processing CreateTablet for tablet 0252a8e0d9ac4440b3affdcbf4cf2246 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:24:22.455742 20147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 141c2e84c15e4ad38afc0a52b330f9b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.454438 20285 ts_tablet_manager.cc:1403] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.319s	user 0.041s	sys 0.057s
I20260709 12:24:22.443243 20150 tablet_service.cc:1511] Processing CreateTablet for tablet e71a18e780d74303884e208106817dec (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:24:22.480290 20145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 995e00d57e1040b7b6d193c60fd84405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.455590 20225 tablet_service.cc:1511] Processing CreateTablet for tablet af265a90671a46cbafb3fced0f952aef (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:24:22.504839 20150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e71a18e780d74303884e208106817dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.505091 20225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af265a90671a46cbafb3fced0f952aef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.505635 20262 heartbeater.cc:499] Master 127.9.131.126:36271 was elected leader, sending a full tablet report...
I20260709 12:24:22.477753 20069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0252a8e0d9ac4440b3affdcbf4cf2246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.506484 20149 tablet_service.cc:1511] Processing CreateTablet for tablet 94b96b6be45d43b6aceaf2afe76d79e4 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:24:22.473835 20067 tablet_service.cc:1511] Processing CreateTablet for tablet 995e00d57e1040b7b6d193c60fd84405 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:24:22.508626 20067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 995e00d57e1040b7b6d193c60fd84405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.481578 20287 tablet_bootstrap.cc:492] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:22.512267 20287 ts_tablet_manager.cc:1403] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.276s	user 0.009s	sys 0.010s
I20260709 12:24:22.515539 20287 raft_consensus.cc:359] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:22.515899 20001 tablet_service.cc:1511] Processing CreateTablet for tablet dd398fffdf6d468f88108a6a7bec0681 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:24:22.516443 20287 raft_consensus.cc:385] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:22.516808 20287 raft_consensus.cc:740] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:22.517287 20001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd398fffdf6d468f88108a6a7bec0681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.517644 20287 consensus_queue.cc:260] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:22.518784 20285 raft_consensus.cc:359] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:22.519519 20285 raft_consensus.cc:385] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:22.522115 20149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b96b6be45d43b6aceaf2afe76d79e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.483178 19993 tablet_service.cc:1511] Processing CreateTablet for tablet 524118618cf740e9865e397864b56ed2 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:24:22.486707 20000 tablet_service.cc:1511] Processing CreateTablet for tablet 3651ee11a6184a34bed06bc86be62c29 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:24:22.497617 20073 tablet_service.cc:1511] Processing CreateTablet for tablet cb8871be082b42e1b4cb33626f240b8d (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:24:22.457058 20068 tablet_service.cc:1511] Processing CreateTablet for tablet 1127f55bd43a4c988dfd61547a03b3fa (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:24:22.501093 20223 tablet_service.cc:1511] Processing CreateTablet for tablet cb8871be082b42e1b4cb33626f240b8d (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:24:22.530247 20282 tablet_bootstrap.cc:492] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:22.534938 20282 ts_tablet_manager.cc:1403] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.381s	user 0.014s	sys 0.008s
I20260709 12:24:22.538223 20282 raft_consensus.cc:359] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:22.538966 20282 raft_consensus.cc:385] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:22.539258 20282 raft_consensus.cc:740] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:22.519799 20285 raft_consensus.cc:740] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:22.540552 20285 consensus_queue.cc:260] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:22.540946 19999 tablet_service.cc:1511] Processing CreateTablet for tablet af265a90671a46cbafb3fced0f952aef (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:24:22.541769 20146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c5a6e3d37c46f585ebd85003fbe15a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.544559 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1127f55bd43a4c988dfd61547a03b3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.467687 20070 tablet_service.cc:1511] Processing CreateTablet for tablet b0ac5e9dcbf74c29aa24300975246ad3 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:24:22.548209 20282 consensus_queue.cc:260] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:22.513029 20218 tablet_service.cc:1511] Processing CreateTablet for tablet 0988a236f3934f8692fd434098766112 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:24:22.553013 20286 ts_tablet_manager.cc:1434] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.117s	user 0.016s	sys 0.010s
I20260709 12:24:22.548152 20070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ac5e9dcbf74c29aa24300975246ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.553567 19993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 524118618cf740e9865e397864b56ed2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.565439 20000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3651ee11a6184a34bed06bc86be62c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.568801 20282 ts_tablet_manager.cc:1434] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:24:22.569710 19999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af265a90671a46cbafb3fced0f952aef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.570910 20226 tablet_service.cc:1511] Processing CreateTablet for tablet 1127f55bd43a4c988dfd61547a03b3fa (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:24:22.572973 20223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8871be082b42e1b4cb33626f240b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.575537 20073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8871be082b42e1b4cb33626f240b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.599097 20218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0988a236f3934f8692fd434098766112. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.600225 20220 tablet_service.cc:1511] Processing CreateTablet for tablet 0252a8e0d9ac4440b3affdcbf4cf2246 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:24:22.601678 20226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1127f55bd43a4c988dfd61547a03b3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.602677 20220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0252a8e0d9ac4440b3affdcbf4cf2246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.604457 20151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ac5e9dcbf74c29aa24300975246ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.604126 20221 tablet_service.cc:1511] Processing CreateTablet for tablet 141c2e84c15e4ad38afc0a52b330f9b9 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:24:22.605460 20221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 141c2e84c15e4ad38afc0a52b330f9b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.609102 20222 tablet_service.cc:1511] Processing CreateTablet for tablet 36c5a6e3d37c46f585ebd85003fbe15a (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:24:22.609629 20074 tablet_service.cc:1511] Processing CreateTablet for tablet 36c5a6e3d37c46f585ebd85003fbe15a (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:24:22.610386 20222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c5a6e3d37c46f585ebd85003fbe15a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.611065 20074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c5a6e3d37c46f585ebd85003fbe15a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.617462 19992 tablet_service.cc:1511] Processing CreateTablet for tablet 995e00d57e1040b7b6d193c60fd84405 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:24:22.639816 19992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 995e00d57e1040b7b6d193c60fd84405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.620147 20286 tablet_bootstrap.cc:492] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:22.619837 19995 tablet_service.cc:1511] Processing CreateTablet for tablet cb8871be082b42e1b4cb33626f240b8d (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:24:22.626524 20075 tablet_service.cc:1511] Processing CreateTablet for tablet 8635d89e903c48a786062efb05feaa75 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:24:22.642449 19995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8871be082b42e1b4cb33626f240b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.629112 20287 ts_tablet_manager.cc:1434] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.116s	user 0.013s	sys 0.000s
I20260709 12:24:22.644873 20075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8635d89e903c48a786062efb05feaa75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.647629 20287 tablet_bootstrap.cc:492] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:22.652994 20143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1127f55bd43a4c988dfd61547a03b3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.654927 19996 tablet_service.cc:1511] Processing CreateTablet for tablet 0988a236f3934f8692fd434098766112 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:24:22.658082 20286 tablet_bootstrap.cc:654] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:22.634601 20224 tablet_service.cc:1511] Processing CreateTablet for tablet 8635d89e903c48a786062efb05feaa75 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:24:22.638474 20144 tablet_service.cc:1511] Processing CreateTablet for tablet fb2234eae9544c8898b57db26f4533d3 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:24:22.665344 20144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb2234eae9544c8898b57db26f4533d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.669585 20296 raft_consensus.cc:493] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.670158 20296 raft_consensus.cc:515] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:22.672559 20072 tablet_service.cc:1511] Processing CreateTablet for tablet fb2234eae9544c8898b57db26f4533d3 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:24:22.673920 20072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb2234eae9544c8898b57db26f4533d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.678789 20282 tablet_bootstrap.cc:492] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:22.680657 20217 tablet_service.cc:1511] Processing CreateTablet for tablet 94b96b6be45d43b6aceaf2afe76d79e4 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:24:22.682272 20217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b96b6be45d43b6aceaf2afe76d79e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.501616 20219 tablet_service.cc:1511] Processing CreateTablet for tablet 528817cd200941fb84e40c79dbd16261 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:24:22.693158 20295 raft_consensus.cc:493] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.694810 20295 raft_consensus.cc:515] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:22.705480 20219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 528817cd200941fb84e40c79dbd16261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.700052 20295 leader_election.cc:290] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:22.711442 19996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0988a236f3934f8692fd434098766112. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.727277 20294 raft_consensus.cc:493] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.728032 20294 raft_consensus.cc:515] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:22.731174 20294 leader_election.cc:290] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:22.740921 20151 tablet_service.cc:1511] Processing CreateTablet for tablet c084bfebf47c4ede978b6da72f620608 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:24:22.741325 19998 tablet_service.cc:1511] Processing CreateTablet for tablet b0ac5e9dcbf74c29aa24300975246ad3 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:24:22.742516 20151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c084bfebf47c4ede978b6da72f620608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.742815 19998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ac5e9dcbf74c29aa24300975246ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.718163 20285 ts_tablet_manager.cc:1434] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.203s	user 0.008s	sys 0.016s
I20260709 12:24:22.770413 20001 tablet_service.cc:1511] Processing CreateTablet for tablet 0252a8e0d9ac4440b3affdcbf4cf2246 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:24:22.774974 20001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0252a8e0d9ac4440b3affdcbf4cf2246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.765683 20224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8635d89e903c48a786062efb05feaa75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.780857 20150 tablet_service.cc:1511] Processing CreateTablet for tablet 1257e7996388445eaa292ac68c3ad0ef (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:24:22.807228 19994 tablet_service.cc:1511] Processing CreateTablet for tablet 141c2e84c15e4ad38afc0a52b330f9b9 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:24:22.814188 20296 leader_election.cc:290] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:22.823629 20070 tablet_service.cc:1511] Processing CreateTablet for tablet c084bfebf47c4ede978b6da72f620608 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:24:22.825161 20070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c084bfebf47c4ede978b6da72f620608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.827236 19994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 141c2e84c15e4ad38afc0a52b330f9b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.766010 20076 tablet_service.cc:1511] Processing CreateTablet for tablet e71a18e780d74303884e208106817dec (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:24:22.830027 20076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e71a18e780d74303884e208106817dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.834721 20067 tablet_service.cc:1511] Processing CreateTablet for tablet d45bea543fc142ee90510d18e0d7c029 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:24:22.837229 20282 tablet_bootstrap.cc:654] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:22.858292 20286 tablet_bootstrap.cc:492] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:22.858860 20286 ts_tablet_manager.cc:1403] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.239s	user 0.014s	sys 0.013s
I20260709 12:24:22.861891 20225 tablet_service.cc:1511] Processing CreateTablet for tablet fb2234eae9544c8898b57db26f4533d3 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:24:22.862154 20286 raft_consensus.cc:359] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:22.863090 20286 raft_consensus.cc:385] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:22.863371 20225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb2234eae9544c8898b57db26f4533d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.770402 20145 tablet_service.cc:1511] Processing CreateTablet for tablet 20a52c50180741b9a6165c183733f3fa (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:24:22.864260 20150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1257e7996388445eaa292ac68c3ad0ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.864962 20145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a52c50180741b9a6165c183733f3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.877969 20220 tablet_service.cc:1511] Processing CreateTablet for tablet d45bea543fc142ee90510d18e0d7c029 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:24:22.879364 20285 tablet_bootstrap.cc:492] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:22.753845 20152 tablet_service.cc:1511] Processing CreateTablet for tablet c9370ed3b42941c683b03215e8ae3344 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:24:22.884712 20152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9370ed3b42941c683b03215e8ae3344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.871636 20287 tablet_bootstrap.cc:654] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:22.903363 20069 tablet_service.cc:1511] Processing CreateTablet for tablet 20a52c50180741b9a6165c183733f3fa (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:24:22.863466 20286 raft_consensus.cc:740] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:22.907011 20220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45bea543fc142ee90510d18e0d7c029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.915000 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7527e635cb4c339c05a4b1ea702164" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
W20260709 12:24:22.922043 20049 leader_election.cc:343] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:22.934018 20284 raft_consensus.cc:493] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.934599 20284 raft_consensus.cc:515] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:22.937422 20218 tablet_service.cc:1511] Processing CreateTablet for tablet c9370ed3b42941c683b03215e8ae3344 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:24:22.940848 20284 leader_election.cc:290] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:22.941392 19995 tablet_service.cc:1511] Processing CreateTablet for tablet 8635d89e903c48a786062efb05feaa75 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:24:22.944409 20072 tablet_service.cc:1511] Processing CreateTablet for tablet 1257e7996388445eaa292ac68c3ad0ef (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 12:24:22.943655 19956 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:22.908970 20067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45bea543fc142ee90510d18e0d7c029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.950423 20226 tablet_service.cc:1511] Processing CreateTablet for tablet 20a52c50180741b9a6165c183733f3fa (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:24:22.957320 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d0409829eb45ff8e1eb6b75796eff9" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:22.965497 20072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1257e7996388445eaa292ac68c3ad0ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:22.976635 19993 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48226 (request call id 20) took 1104 ms. Trace:
I20260709 12:24:22.961453 19997 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48226 (request call id 19) took 1089 ms. Trace:
I20260709 12:24:22.978053 20075 tablet_service.cc:1511] Processing CreateTablet for tablet dd4d18eda43b4a17bd5b552c4e04225c (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:24:22.990113 19997 rpcz_store.cc:276] 0709 12:24:21.871373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.241664 (+370291us) service_pool.cc:224] Handling call
0709 12:24:22.262372 (+ 20708us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:24:22.262470 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:24:22.676665 (+414195us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:22.913346 (+236681us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:22.960226 (+ 46880us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":500}
W20260709 12:24:22.991454 20125 leader_election.cc:343] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:22.992388 19997 tablet_service.cc:1511] Processing CreateTablet for tablet 94b96b6be45d43b6aceaf2afe76d79e4 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:24:22.994117 20285 tablet_bootstrap.cc:654] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:22.995460 20071 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49114 (request call id 22) took 1009 ms. Trace:
I20260709 12:24:22.981073 20068 tablet_service.cc:1511] Processing CreateTablet for tablet 515975cb81844e8787a53147bb766080 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:24:22.999056 20071 rpcz_store.cc:276] 0709 12:24:21.985878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.400626 (+414748us) service_pool.cc:224] Handling call
0709 12:24:22.440255 (+ 39629us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:24:22.440378 (+   123us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:24:22.623305 (+182927us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:22.876971 (+253666us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:22.995004 (+118033us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b5800116a98. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3c1a2 00007f9bb6d7d889 00007f9bb5eaed88 00007f9bb5f75973 00007f9bb5f7170f 00007f9bb5f71ecd 00007f9bb5f20400 00007f9baf3a5af4 00007f9baf3a5a82
0709 12:24:22.995389 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46989696}
I20260709 12:24:22.996366 19993 rpcz_store.cc:276] 0709 12:24:21.871718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.482157 (+610439us) service_pool.cc:224] Handling call
0709 12:24:22.553075 (+ 70918us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:24:22.553190 (+   115us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:24:22.808446 (+255256us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:22.899625 (+ 91179us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:22.976551 (+ 76926us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:23.013453 19993 tablet_service.cc:1511] Processing CreateTablet for tablet c084bfebf47c4ede978b6da72f620608 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:24:22.970314 20149 tablet_service.cc:1511] Processing CreateTablet for tablet 04cd0aa441274cf38da93eec0bfadeff (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:24:23.015209 20149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04cd0aa441274cf38da93eec0bfadeff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.016304 20219 tablet_service.cc:1511] Processing CreateTablet for tablet b091f47eb9da43e6a24dd1b2bd9e9ce8 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:24:23.010257 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57040 (request call id 20) took 1107 ms. Trace:
I20260709 12:24:23.017555 20148 rpcz_store.cc:276] 0709 12:24:21.902961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.150617 (+247656us) service_pool.cc:224] Handling call
0709 12:24:22.169719 (+ 19102us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:24:22.169816 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:24:22.881465 (+711649us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:22.976295 (+ 94830us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:23.010196 (+ 33901us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12970}
I20260709 12:24:23.020535 20148 tablet_service.cc:1511] Processing CreateTablet for tablet 515975cb81844e8787a53147bb766080 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:24:23.010068 20146 tablet_service.cc:1511] Processing CreateTablet for tablet dd4d18eda43b4a17bd5b552c4e04225c (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:24:23.010792 19999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48226 (request call id 23) took 1068 ms. Trace:
I20260709 12:24:23.022131 20146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd4d18eda43b4a17bd5b552c4e04225c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.021939 20074 tablet_service.cc:1511] Processing CreateTablet for tablet b091f47eb9da43e6a24dd1b2bd9e9ce8 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:24:23.021023 20071 tablet_service.cc:1511] Processing CreateTablet for tablet d063c9d79f904091aade12ce2aba8bd1 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:24:22.944322 20286 consensus_queue.cc:260] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:22.972620 20226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a52c50180741b9a6165c183733f3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.027949 19999 rpcz_store.cc:276] 0709 12:24:21.942247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.496247 (+554000us) service_pool.cc:224] Handling call
0709 12:24:22.555402 (+ 59155us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b5800000998. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f94831 00007f9bb5f71ac3 00007f9bb5f20400 00007f9baf3a5af4 00007f9baf3a5a82 00007f9baf3a59b1
0709 12:24:22.555564 (+   162us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:24:22.555713 (+   149us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:24:22.675178 (+119465us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:22.940297 (+265119us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:23.010722 (+ 70425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12897536}
I20260709 12:24:23.037995 19999 tablet_service.cc:1511] Processing CreateTablet for tablet d45bea543fc142ee90510d18e0d7c029 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:24:23.047761 20282 tablet_bootstrap.cc:492] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:23.048396 20282 ts_tablet_manager.cc:1403] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.370s	user 0.025s	sys 0.000s
I20260709 12:24:23.048169 19996 tablet_service.cc:1511] Processing CreateTablet for tablet e71a18e780d74303884e208106817dec (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:24:23.050719 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073b8908cc1345f3bad72a6d8124df11" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
W20260709 12:24:23.052721 20201 leader_election.cc:343] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.054396 20286 ts_tablet_manager.cc:1434] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.195s	user 0.002s	sys 0.006s
I20260709 12:24:23.061429 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98035197c34fce88758eedbfd23225" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:23.066579 20286 tablet_bootstrap.cc:492] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:23.071220 20222 tablet_service.cc:1511] Processing CreateTablet for tablet d063c9d79f904091aade12ce2aba8bd1 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:24:23.072394 20143 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57040 (request call id 26) took 1024 ms. Trace:
I20260709 12:24:23.056232 20075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd4d18eda43b4a17bd5b552c4e04225c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.084661 20074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b091f47eb9da43e6a24dd1b2bd9e9ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.086344 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 515975cb81844e8787a53147bb766080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.086603 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7527e635cb4c339c05a4b1ea702164" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:23.087983 20069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a52c50180741b9a6165c183733f3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.086355 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073b8908cc1345f3bad72a6d8124df11" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:23.089231 19992 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48226 (request call id 24) took 1146 ms. Trace:
I20260709 12:24:23.068928 20147 tablet_service.cc:1511] Processing CreateTablet for tablet bf44484d11914a83a44c9a333eed7777 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:24:23.092694 19994 tablet_service.cc:1511] Processing CreateTablet for tablet c9370ed3b42941c683b03215e8ae3344 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:24:23.078487 20287 tablet_bootstrap.cc:492] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:23.056336 20148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 515975cb81844e8787a53147bb766080. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:23.079556 19976 leader_election.cc:343] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.080224 20282 raft_consensus.cc:359] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.047245 20223 tablet_service.cc:1511] Processing CreateTablet for tablet 04cd0aa441274cf38da93eec0bfadeff (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 12:24:23.089512 20200 leader_election.cc:343] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.099407 20282 raft_consensus.cc:385] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.100682 20282 raft_consensus.cc:740] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.100699 20200 leader_election.cc:304] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:23.102008 20295 raft_consensus.cc:2749] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:23.101987 20282 consensus_queue.cc:260] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.106050 20147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf44484d11914a83a44c9a333eed7777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.066493 20219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b091f47eb9da43e6a24dd1b2bd9e9ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.095674 20001 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48226 (request call id 28) took 1086 ms. Trace:
I20260709 12:24:23.108711 20001 rpcz_store.cc:276] 0709 12:24:22.008893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.769560 (+760667us) service_pool.cc:224] Handling call
0709 12:24:22.774464 (+  4904us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:24:22.774570 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:24:23.035963 (+261393us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:23.075437 (+ 39474us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:23.095596 (+ 20159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3248}
I20260709 12:24:23.109615 20282 ts_tablet_manager.cc:1434] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 12:24:23.110788 20282 tablet_bootstrap.cc:492] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:23.110925 20001 tablet_service.cc:1511] Processing CreateTablet for tablet 1257e7996388445eaa292ac68c3ad0ef (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:24:23.063530 20221 tablet_service.cc:1511] Processing CreateTablet for tablet dd4d18eda43b4a17bd5b552c4e04225c (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:24:23.073292 19995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8635d89e903c48a786062efb05feaa75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.107482 20224 tablet_service.cc:1511] Processing CreateTablet for tablet bf44484d11914a83a44c9a333eed7777 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 12:24:23.088572 20050 leader_election.cc:343] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.112139 20073 tablet_service.cc:1511] Processing CreateTablet for tablet ffa0a444b80347b0b9adc37ad505b0c5 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:24:23.094574 19992 rpcz_store.cc:276] 0709 12:24:21.942613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.616565 (+673952us) service_pool.cc:224] Handling call
0709 12:24:22.639345 (+ 22780us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:24:22.639443 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:24:22.800090 (+160647us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:22.966001 (+165911us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:23.086079 (+120078us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b5800000998. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3c2b8 00007f9bade3c1db 00007f9bb6d7d889 00007f9bb5eaed88 00007f9bb5f75973 00007f9bb5f7170f 00007f9bb5f71ecd 00007f9bb5f20400 00007f9baf3a5af4 00007f9baf3a5a82
0709 12:24:23.089162 (+  3083us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5449984}
I20260709 12:24:23.112455 20287 ts_tablet_manager.cc:1403] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.465s	user 0.017s	sys 0.007s
I20260709 12:24:23.124934 20071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d063c9d79f904091aade12ce2aba8bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.130023 19992 tablet_service.cc:1511] Processing CreateTablet for tablet b091f47eb9da43e6a24dd1b2bd9e9ce8 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:24:23.131582 20073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa0a444b80347b0b9adc37ad505b0c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.132117 20287 raft_consensus.cc:359] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.132885 20287 raft_consensus.cc:385] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.133183 20287 raft_consensus.cc:740] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.090695 20143 rpcz_store.cc:276] 0709 12:24:22.048395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.345369 (+296974us) service_pool.cc:224] Handling call
0709 12:24:22.347414 (+  2045us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:24:22.347520 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:24:22.977476 (+629956us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:23.071732 (+ 94256us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:23.072328 (+   596us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:23.127372 20218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9370ed3b42941c683b03215e8ae3344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.134554 20224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf44484d11914a83a44c9a333eed7777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.134922 20286 tablet_bootstrap.cc:654] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.127949 19997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b96b6be45d43b6aceaf2afe76d79e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.137549 19994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9370ed3b42941c683b03215e8ae3344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.133863 20050 leader_election.cc:304] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:23.138377 20294 raft_consensus.cc:2749] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:23.137694 20221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd4d18eda43b4a17bd5b552c4e04225c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.141803 19996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e71a18e780d74303884e208106817dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.142729 20001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1257e7996388445eaa292ac68c3ad0ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.144718 19993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c084bfebf47c4ede978b6da72f620608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.149075 20222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d063c9d79f904091aade12ce2aba8bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.147167 19999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45bea543fc142ee90510d18e0d7c029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.150281 20223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04cd0aa441274cf38da93eec0bfadeff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.150920 19992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b091f47eb9da43e6a24dd1b2bd9e9ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.169309 20000 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48226 (request call id 21) took 1268 ms. Trace:
I20260709 12:24:23.169796 20000 rpcz_store.cc:276] 0709 12:24:21.900810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.485755 (+584945us) service_pool.cc:224] Handling call
0709 12:24:22.554341 (+ 68586us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b5800000998. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f94831 00007f9bb5f71ac3 00007f9bb5f20400 00007f9baf3a5af4 00007f9baf3a5a82 00007f9baf3a59b1
0709 12:24:22.554501 (+   160us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:24:22.554585 (+    84us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:24:22.850929 (+296344us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:23.168715 (+317786us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:23.169241 (+   526us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50055040}
W20260709 12:24:23.175992 20050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 87599.6us
I20260709 12:24:23.186707 19998 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48226 (request call id 27) took 1187 ms. Trace:
I20260709 12:24:23.187191 19998 rpcz_store.cc:276] 0709 12:24:21.999401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.731746 (+732345us) service_pool.cc:224] Handling call
0709 12:24:22.742289 (+ 10543us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:24:22.742396 (+   107us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:24:23.050778 (+308382us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:23.186189 (+135411us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:23.186641 (+   452us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:23.189124 19998 tablet_service.cc:1511] Processing CreateTablet for tablet d063c9d79f904091aade12ce2aba8bd1 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:24:23.190465 19998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d063c9d79f904091aade12ce2aba8bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.197261 20285 tablet_bootstrap.cc:492] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:23.197867 20285 ts_tablet_manager.cc:1403] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.381s	user 0.016s	sys 0.005s
I20260709 12:24:23.200917 20150 tablet_service.cc:1511] Processing CreateTablet for tablet ffa0a444b80347b0b9adc37ad505b0c5 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:24:23.202323 20150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa0a444b80347b0b9adc37ad505b0c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.182348 20287 consensus_queue.cc:260] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.206575 20287 ts_tablet_manager.cc:1434] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.000s
I20260709 12:24:23.207708 20287 tablet_bootstrap.cc:492] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:23.211297 20217 tablet_service.cc:1511] Processing CreateTablet for tablet ffa0a444b80347b0b9adc37ad505b0c5 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:24:23.212853 20217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa0a444b80347b0b9adc37ad505b0c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.217240 20285 raft_consensus.cc:359] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:23.218096 20285 raft_consensus.cc:385] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.218408 20285 raft_consensus.cc:740] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.219424 20285 consensus_queue.cc:260] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:23.220145 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d0409829eb45ff8e1eb6b75796eff9" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:23.221673 20285 ts_tablet_manager.cc:1434] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:24:23.183241 20000 tablet_service.cc:1511] Processing CreateTablet for tablet 04cd0aa441274cf38da93eec0bfadeff (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 12:24:23.230225 20126 leader_election.cc:343] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.231307 20126 leader_election.cc:304] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:23.232774 20284 raft_consensus.cc:2749] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:23.232993 20282 tablet_bootstrap.cc:654] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.227357 20067 tablet_service.cc:1511] Processing CreateTablet for tablet 976741a38d1c42329394a00cbe085319 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:24:23.253216 20000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04cd0aa441274cf38da93eec0bfadeff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.258876 20285 tablet_bootstrap.cc:492] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:23.268950 20286 tablet_bootstrap.cc:492] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:23.283219 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98035197c34fce88758eedbfd23225" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:23.284204 20001 tablet_service.cc:1511] Processing CreateTablet for tablet 515975cb81844e8787a53147bb766080 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:24:23.285677 20001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 515975cb81844e8787a53147bb766080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.295594 20152 tablet_service.cc:1511] Processing CreateTablet for tablet 976741a38d1c42329394a00cbe085319 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:24:23.297086 20152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 976741a38d1c42329394a00cbe085319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.300588 20225 tablet_service.cc:1511] Processing CreateTablet for tablet 8ed53455b57840a780d37b1db5103826 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:24:23.302153 20225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ed53455b57840a780d37b1db5103826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.322027 20286 ts_tablet_manager.cc:1403] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.257s	user 0.025s	sys 0.032s
I20260709 12:24:23.307809 19995 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48226 (request call id 31) took 1098 ms. Trace:
W20260709 12:24:23.327840 19976 leader_election.cc:343] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.328369 19976 leader_election.cc:304] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:23.329155 20296 raft_consensus.cc:2749] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:23.310415 20294 raft_consensus.cc:493] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.330525 20294 raft_consensus.cc:515] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.331511 20067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 976741a38d1c42329394a00cbe085319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.335898 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c01d16214bb19000600644b36d1e" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:23.336891 20286 raft_consensus.cc:359] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:23.337671 20286 raft_consensus.cc:385] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.337973 20286 raft_consensus.cc:740] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
W20260709 12:24:23.339493 20050 leader_election.cc:343] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.340934 19994 tablet_service.cc:1511] Processing CreateTablet for tablet bf44484d11914a83a44c9a333eed7777 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:24:23.342384 19994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf44484d11914a83a44c9a333eed7777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.346642 20285 tablet_bootstrap.cc:654] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.326951 19995 rpcz_store.cc:276] 0709 12:24:22.209081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.940312 (+731231us) service_pool.cc:224] Handling call
0709 12:24:22.986981 (+ 46669us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:24:22.999417 (+ 12436us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:24:23.187716 (+188299us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:23.254258 (+ 66542us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:23.307737 (+ 53479us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7508}
I20260709 12:24:23.332967 20294 leader_election.cc:290] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:23.351713 19997 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48226 (request call id 32) took 1055 ms. Trace:
I20260709 12:24:23.354826 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c01d16214bb19000600644b36d1e" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:23.356645 20295 raft_consensus.cc:493] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.357092 20282 tablet_bootstrap.cc:492] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:23.357283 19992 tablet_service.cc:1511] Processing CreateTablet for tablet 976741a38d1c42329394a00cbe085319 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:24:23.362905 20073 tablet_service.cc:1511] Processing CreateTablet for tablet 8ed53455b57840a780d37b1db5103826 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:24:23.331504 20287 tablet_bootstrap.cc:654] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.369077 20295 raft_consensus.cc:515] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.365605 20162 raft_consensus.cc:2468] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:23.370173 20282 ts_tablet_manager.cc:1403] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.260s	user 0.016s	sys 0.000s
I20260709 12:24:23.388300 20051 leader_election.cc:304] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:23.389817 20294 raft_consensus.cc:2804] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:23.390249 20294 raft_consensus.cc:493] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.390623 20294 raft_consensus.cc:3060] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:23.391573 20295 leader_election.cc:290] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:23.384912 20224 tablet_service.cc:1511] Processing CreateTablet for tablet f834f9ccdefc4baebc23e9477701af69 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:24:23.397048 20224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f834f9ccdefc4baebc23e9477701af69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.398816 20282 raft_consensus.cc:359] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:23.399672 20282 raft_consensus.cc:385] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.400023 20282 raft_consensus.cc:740] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.402487 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8a2aa61ada477c8750740dcc082235" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:23.404515 19996 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48226 (request call id 30) took 1209 ms. Trace:
W20260709 12:24:23.404538 20200 leader_election.cc:343] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.405004 19996 rpcz_store.cc:276] 0709 12:24:22.194864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.879795 (+684931us) service_pool.cc:224] Handling call
0709 12:24:23.092558 (+212763us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:24:23.092785 (+   227us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:24:23.366699 (+273914us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:23.403980 (+ 37281us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:23.404457 (+   477us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:23.365792 19997 rpcz_store.cc:276] 0709 12:24:22.296419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.991381 (+694962us) service_pool.cc:224] Handling call
0709 12:24:23.034518 (+ 43137us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b5800000998. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3c1a2 00007f9bb6d7d889 00007f9bb5eaed88 00007f9bb5f71b80 00007f9bb5f20400 00007f9baf3a5af4 00007f9baf3a5a82 00007f9baf3a59b1 00007f9baf3a592c
0709 12:24:23.091096 (+ 56578us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:24:23.091229 (+   133us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:24:23.265847 (+174618us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:23.351194 (+ 85347us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:23.351644 (+   450us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8225,"spinlock_wait_cycles":3328896}
I20260709 12:24:23.407435 19996 tablet_service.cc:1511] Processing CreateTablet for tablet f834f9ccdefc4baebc23e9477701af69 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:24:23.376082 20286 consensus_queue.cc:260] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:23.383422 20148 tablet_service.cc:1511] Processing CreateTablet for tablet f834f9ccdefc4baebc23e9477701af69 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:24:23.410917 19992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 976741a38d1c42329394a00cbe085319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.405117 19993 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48226 (request call id 33) took 1090 ms. Trace:
I20260709 12:24:23.412725 20073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ed53455b57840a780d37b1db5103826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.413316 19996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f834f9ccdefc4baebc23e9477701af69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.414368 20148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f834f9ccdefc4baebc23e9477701af69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.400911 20282 consensus_queue.cc:260] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:23.413254 19993 rpcz_store.cc:276] 0709 12:24:22.314974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.012536 (+697562us) service_pool.cc:224] Handling call
0709 12:24:23.050293 (+ 37757us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b5800000998. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9badcfbdb1 00007f9bade3bb71 00007f9bade3ba22 00007f9bb6d548d9 00007f9bb5eaeee0 00007f9bb5f94831 00007f9bb5f71ac3 00007f9bb5f20400 00007f9baf3a5af4 00007f9baf3a5a82 00007f9baf3a59b1
0709 12:24:23.093149 (+ 42856us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:24:23.093372 (+   223us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:24:23.195536 (+102164us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:23.401748 (+206212us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:23.405054 (+  3306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34566912}
I20260709 12:24:23.417057 20282 ts_tablet_manager.cc:1434] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.002s
I20260709 12:24:23.418273 20282 tablet_bootstrap.cc:492] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:23.413722 19995 tablet_service.cc:1511] Processing CreateTablet for tablet 8ed53455b57840a780d37b1db5103826 (DEFAULT_TABLE table=test-workload [id=9157ea1ecce94a71af82fc0c13d14a13]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:24:23.412390 19999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48226 (request call id 34) took 1043 ms. Trace:
I20260709 12:24:23.423439 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8a2aa61ada477c8750740dcc082235" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:23.432027 20162 raft_consensus.cc:2468] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
I20260709 12:24:23.433337 20201 leader_election.cc:304] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:23.434267 20295 raft_consensus.cc:2804] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:23.434676 20295 raft_consensus.cc:493] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.435032 20295 raft_consensus.cc:3060] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:23.435433 20285 tablet_bootstrap.cc:492] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:23.436009 20285 ts_tablet_manager.cc:1403] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.177s	user 0.012s	sys 0.002s
I20260709 12:24:23.431639 19999 rpcz_store.cc:276] 0709 12:24:22.368629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.037035 (+668406us) service_pool.cc:224] Handling call
0709 12:24:23.089844 (+ 52809us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:24:23.094452 (+  4608us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:24:23.245377 (+150925us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:23.378691 (+133314us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:23.411947 (+ 33256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:23.442976 20295 raft_consensus.cc:515] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.448340 19995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ed53455b57840a780d37b1db5103826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:23.433175 20294 raft_consensus.cc:515] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.454211 20282 tablet_bootstrap.cc:654] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.455132 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c01d16214bb19000600644b36d1e" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:23.455816 20162 raft_consensus.cc:3060] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:23.439389 20285 raft_consensus.cc:359] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.465894 20285 raft_consensus.cc:385] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.466264 20285 raft_consensus.cc:740] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.467156 20162 raft_consensus.cc:2468] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:23.467072 20285 consensus_queue.cc:260] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.469087 20051 leader_election.cc:304] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:23.470942 20285 ts_tablet_manager.cc:1434] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:24:23.472116 20285 tablet_bootstrap.cc:492] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:23.470767 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c01d16214bb19000600644b36d1e" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
W20260709 12:24:23.477478 20050 leader_election.cc:343] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.478817 20285 tablet_bootstrap.cc:654] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.478981 20286 ts_tablet_manager.cc:1434] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.153s	user 0.009s	sys 0.001s
I20260709 12:24:23.479781 20315 raft_consensus.cc:2804] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:23.469131 20294 leader_election.cc:290] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:23.485868 20286 tablet_bootstrap.cc:492] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:23.492812 20295 leader_election.cc:290] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:23.497922 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8a2aa61ada477c8750740dcc082235" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:23.495402 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8a2aa61ada477c8750740dcc082235" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:23.499490 20162 raft_consensus.cc:3060] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:23.503980 20286 tablet_bootstrap.cc:654] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.496277 20296 raft_consensus.cc:493] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.507997 20296 raft_consensus.cc:515] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
W20260709 12:24:23.507406 20200 leader_election.cc:343] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.514652 20294 raft_consensus.cc:493] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.515584 20294 raft_consensus.cc:515] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:23.517692 20294 leader_election.cc:290] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:23.513015 20296 leader_election.cc:290] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:23.518543 20282 tablet_bootstrap.cc:492] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:23.518533 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b588a815a548c8a3f375012fa7e3f6" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:23.528793 20315 raft_consensus.cc:697] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:23.530428 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073b8908cc1345f3bad72a6d8124df11" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:23.528260 20282 ts_tablet_manager.cc:1403] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.110s	user 0.013s	sys 0.000s
I20260709 12:24:23.530428 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073b8908cc1345f3bad72a6d8124df11" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
W20260709 12:24:23.533351 20050 leader_election.cc:343] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.531232 20237 raft_consensus.cc:2468] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:23.534682 20282 raft_consensus.cc:359] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.535693 20282 raft_consensus.cc:385] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.535265 20315 consensus_queue.cc:237] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.536041 20282 raft_consensus.cc:740] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
W20260709 12:24:23.538254 19976 leader_election.cc:343] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.537598 20049 leader_election.cc:304] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:23.540145 20318 raft_consensus.cc:2804] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:23.540777 20318 raft_consensus.cc:493] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.541162 20318 raft_consensus.cc:3060] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:23.543222 20162 raft_consensus.cc:2468] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:23.544771 20201 leader_election.cc:304] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:23.546711 20295 raft_consensus.cc:2804] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:23.551947 20282 consensus_queue.cc:260] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.554107 20287 tablet_bootstrap.cc:492] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:23.554704 20287 ts_tablet_manager.cc:1403] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.347s	user 0.018s	sys 0.023s
I20260709 12:24:23.558269 20287 raft_consensus.cc:359] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:23.559020 20287 raft_consensus.cc:385] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.559312 20287 raft_consensus.cc:740] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.562184 20286 tablet_bootstrap.cc:492] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:23.562783 20286 ts_tablet_manager.cc:1403] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.015s
I20260709 12:24:23.563095 20282 ts_tablet_manager.cc:1434] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.001s
I20260709 12:24:23.564318 20282 tablet_bootstrap.cc:492] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:23.565608 20286 raft_consensus.cc:359] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:23.566371 20286 raft_consensus.cc:385] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.566696 20286 raft_consensus.cc:740] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.567143 20318 raft_consensus.cc:515] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:23.567510 20286 consensus_queue.cc:260] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:23.569836 20318 leader_election.cc:290] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:23.570278 20295 raft_consensus.cc:697] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:23.570057 20287 consensus_queue.cc:260] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:23.569854 20286 ts_tablet_manager.cc:1434] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:24:23.570998 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073b8908cc1345f3bad72a6d8124df11" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:23.573583 20286 tablet_bootstrap.cc:492] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:23.573966 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073b8908cc1345f3bad72a6d8124df11" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
W20260709 12:24:23.574237 20050 leader_election.cc:343] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.574663 20237 raft_consensus.cc:3060] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:23.572393 20287 ts_tablet_manager.cc:1434] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.006s
I20260709 12:24:23.576160 20287 tablet_bootstrap.cc:492] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:23.571380 20295 consensus_queue.cc:237] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.579084 20282 tablet_bootstrap.cc:654] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.579931 19905 catalog_manager.cc:5697] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 0 to 1, leader changed from <none> to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 1 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:23.575071 20285 tablet_bootstrap.cc:492] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:23.587194 20285 ts_tablet_manager.cc:1403] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.115s	user 0.036s	sys 0.036s
I20260709 12:24:23.590937 20287 tablet_bootstrap.cc:654] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.592123 20286 tablet_bootstrap.cc:654] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.594238 20285 raft_consensus.cc:359] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:23.597198 20237 raft_consensus.cc:2468] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:23.599386 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b588a815a548c8a3f375012fa7e3f6" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:23.599536 20285 raft_consensus.cc:385] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.600428 20285 raft_consensus.cc:740] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.600693 20049 leader_election.cc:304] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:23.602644 20315 raft_consensus.cc:2804] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:23.603193 20315 raft_consensus.cc:697] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
W20260709 12:24:23.603384 19974 leader_election.cc:343] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.603910 19974 leader_election.cc:304] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:23.604177 20315 consensus_queue.cc:237] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:23.602804 20285 consensus_queue.cc:260] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:23.605314 20296 raft_consensus.cc:2749] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:23.604902 19906 catalog_manager.cc:5697] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 1 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:23.616307 20282 tablet_bootstrap.cc:492] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:23.617084 20282 ts_tablet_manager.cc:1403] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.005s
I20260709 12:24:23.620734 20282 raft_consensus.cc:359] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.621562 20282 raft_consensus.cc:385] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.621893 20282 raft_consensus.cc:740] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.624008 20282 consensus_queue.cc:260] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.625828 20285 ts_tablet_manager.cc:1434] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.009s
I20260709 12:24:23.627018 20285 tablet_bootstrap.cc:492] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:23.627341 20282 ts_tablet_manager.cc:1434] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.006s
I20260709 12:24:23.627930 20287 tablet_bootstrap.cc:492] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:23.628484 20282 tablet_bootstrap.cc:492] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:23.629331 20287 ts_tablet_manager.cc:1403] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.001s
I20260709 12:24:23.632688 20287 raft_consensus.cc:359] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:23.633494 20287 raft_consensus.cc:385] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.633796 20287 raft_consensus.cc:740] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.634646 20287 consensus_queue.cc:260] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:23.628708 20286 tablet_bootstrap.cc:492] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:23.636511 20286 ts_tablet_manager.cc:1403] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.063s	user 0.005s	sys 0.014s
I20260709 12:24:23.636792 20287 ts_tablet_manager.cc:1434] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:23.637526 20285 tablet_bootstrap.cc:654] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.637944 20287 tablet_bootstrap.cc:492] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:23.636750 20284 raft_consensus.cc:493] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.638811 20284 raft_consensus.cc:515] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.641129 20284 leader_election.cc:290] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:23.642529 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd4e0295fa48bc8c187c7d421d8f11" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
W20260709 12:24:23.644533 20125 leader_election.cc:343] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.645459 20282 tablet_bootstrap.cc:654] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.642726 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd4e0295fa48bc8c187c7d421d8f11" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
W20260709 12:24:23.648075 20124 leader_election.cc:343] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.648586 20124 leader_election.cc:304] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:23.642486 20286 raft_consensus.cc:359] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:23.649341 20286 raft_consensus.cc:385] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.649673 20286 raft_consensus.cc:740] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.649597 20287 tablet_bootstrap.cc:654] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.650508 20286 consensus_queue.cc:260] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:23.653092 20285 tablet_bootstrap.cc:492] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:23.653642 20285 ts_tablet_manager.cc:1403] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.004s
I20260709 12:24:23.654066 20284 raft_consensus.cc:2749] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:23.654650 20286 ts_tablet_manager.cc:1434] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 12:24:23.655669 20286 tablet_bootstrap.cc:492] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:23.661734 20287 tablet_bootstrap.cc:492] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:23.662334 20287 ts_tablet_manager.cc:1403] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.008s
I20260709 12:24:23.662935 20286 tablet_bootstrap.cc:654] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.666272 20315 raft_consensus.cc:493] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.666733 20329 raft_consensus.cc:493] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.666806 20315 raft_consensus.cc:515] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:23.667429 20329 raft_consensus.cc:515] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:23.667609 20285 raft_consensus.cc:359] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.668385 20285 raft_consensus.cc:385] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.668707 20285 raft_consensus.cc:740] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.669582 20285 consensus_queue.cc:260] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.670114 20315 leader_election.cc:290] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:23.670928 20329 leader_election.cc:290] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:23.671130 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98035197c34fce88758eedbfd23225" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:23.671510 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98035197c34fce88758eedbfd23225" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:23.671916 20011 raft_consensus.cc:2468] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
W20260709 12:24:23.672853 20051 leader_election.cc:343] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.673333 20282 tablet_bootstrap.cc:492] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:23.673677 20050 leader_election.cc:304] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f
I20260709 12:24:23.674083 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073b8908cc1345f3bad72a6d8124df11" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:23.674247 20296 raft_consensus.cc:493] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.675005 20237 raft_consensus.cc:2393] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7204c82dd34944818a439bd468a8c410 in current term 1: Already voted for candidate aac061e592d74289800e4c50cbb4132b in this term.
I20260709 12:24:23.674847 20296 raft_consensus.cc:515] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.676741 20315 raft_consensus.cc:2804] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:23.677142 20315 raft_consensus.cc:493] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.677472 20315 raft_consensus.cc:3060] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:23.673478 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073b8908cc1345f3bad72a6d8124df11" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:23.679493 20285 ts_tablet_manager.cc:1434] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.003s
I20260709 12:24:23.680666 20285 tablet_bootstrap.cc:492] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:23.680430 19976 leader_election.cc:304] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:23.681952 20329 raft_consensus.cc:3060] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:23.683460 20282 ts_tablet_manager.cc:1403] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.004s
I20260709 12:24:23.686347 20315 raft_consensus.cc:515] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:23.686981 20282 raft_consensus.cc:359] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:23.687726 20282 raft_consensus.cc:385] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.688056 20282 raft_consensus.cc:740] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.688900 20282 consensus_queue.cc:260] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:23.690150 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98035197c34fce88758eedbfd23225" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:23.690778 20011 raft_consensus.cc:3060] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:23.691287 20282 ts_tablet_manager.cc:1434] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:24:23.692621 20282 tablet_bootstrap.cc:492] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:23.698037 20285 tablet_bootstrap.cc:654] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.701567 20296 leader_election.cc:290] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:23.705889 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c01d16214bb19000600644b36d1e" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:23.706815 20162 raft_consensus.cc:2393] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7204c82dd34944818a439bd468a8c410 in current term 1: Already voted for candidate aac061e592d74289800e4c50cbb4132b in this term.
I20260709 12:24:23.707643 20284 raft_consensus.cc:493] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.708194 20284 raft_consensus.cc:515] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.710501 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c01d16214bb19000600644b36d1e" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:23.665521 20287 raft_consensus.cc:359] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.712100 20287 raft_consensus.cc:385] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.712451 20287 raft_consensus.cc:740] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.712546 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e608aa894f4f9d96f3e1b9b16fb7cd" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:23.712713 19976 leader_election.cc:304] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:23.713527 20287 consensus_queue.cc:260] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
W20260709 12:24:23.714079 20125 leader_election.cc:343] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.714336 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e608aa894f4f9d96f3e1b9b16fb7cd" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:23.714685 20284 leader_election.cc:290] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
W20260709 12:24:23.716156 20124 leader_election.cc:343] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.716657 20124 leader_election.cc:304] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:23.717345 20011 raft_consensus.cc:2468] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:23.717900 20284 raft_consensus.cc:2749] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:23.718600 20050 leader_election.cc:304] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:23.719607 20318 raft_consensus.cc:2804] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:23.720189 20318 raft_consensus.cc:697] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:23.719800 20282 tablet_bootstrap.cc:654] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.721132 20318 consensus_queue.cc:237] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:23.697197 19906 catalog_manager.cc:5697] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 0 to 1, leader changed from <none> to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 1 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:23.724289 20296 raft_consensus.cc:3060] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:23.727347 20285 tablet_bootstrap.cc:492] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:23.728037 20285 ts_tablet_manager.cc:1403] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.009s
I20260709 12:24:23.730749 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98035197c34fce88758eedbfd23225" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:23.731197 20285 raft_consensus.cc:359] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.732164 20285 raft_consensus.cc:385] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.732468 20285 raft_consensus.cc:740] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
W20260709 12:24:23.732645 20051 leader_election.cc:343] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.733392 20285 consensus_queue.cc:260] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.739990 20315 leader_election.cc:290] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:23.716269 20287 ts_tablet_manager.cc:1434] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 12:24:23.742198 20285 ts_tablet_manager.cc:1434] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:24:23.743469 20285 tablet_bootstrap.cc:492] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:23.742400 20287 tablet_bootstrap.cc:492] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:23.751785 20329 raft_consensus.cc:2749] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:23.755231 20296 raft_consensus.cc:2749] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:23.758314 20286 tablet_bootstrap.cc:492] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:23.759011 20286 ts_tablet_manager.cc:1403] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.104s	user 0.031s	sys 0.057s
I20260709 12:24:23.758587 20285 tablet_bootstrap.cc:654] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.758904 20287 tablet_bootstrap.cc:654] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.761720 20282 tablet_bootstrap.cc:492] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:23.762287 20282 ts_tablet_manager.cc:1403] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.070s	user 0.011s	sys 0.007s
I20260709 12:24:23.762782 20286 raft_consensus.cc:359] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:23.763602 20286 raft_consensus.cc:385] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.763989 20286 raft_consensus.cc:740] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.764906 20286 consensus_queue.cc:260] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:23.765391 20282 raft_consensus.cc:359] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:23.766222 20282 raft_consensus.cc:385] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.767041 20282 raft_consensus.cc:740] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.767767 20286 ts_tablet_manager.cc:1434] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:24:23.769346 20286 tablet_bootstrap.cc:492] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:23.767829 20282 consensus_queue.cc:260] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:23.772061 20287 tablet_bootstrap.cc:492] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:23.772608 20287 ts_tablet_manager.cc:1403] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.002s
I20260709 12:24:23.772785 20282 ts_tablet_manager.cc:1434] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:24:23.774040 20282 tablet_bootstrap.cc:492] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:23.773690 19908 catalog_manager.cc:5697] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 0 to 1, leader changed from <none> to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 1 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:23.774645 20296 raft_consensus.cc:493] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.775705 20296 raft_consensus.cc:515] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.779124 20286 tablet_bootstrap.cc:654] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.780656 20282 tablet_bootstrap.cc:654] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.780471 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72eb35da72b43ecb538c2a240a61646" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:23.781250 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72eb35da72b43ecb538c2a240a61646" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
W20260709 12:24:23.782496 19976 leader_election.cc:343] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:23.783787 19974 leader_election.cc:343] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.784268 19974 leader_election.cc:304] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:23.778012 20296 leader_election.cc:290] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:23.785009 20285 tablet_bootstrap.cc:492] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:23.785712 20329 raft_consensus.cc:2749] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:23.785657 20285 ts_tablet_manager.cc:1403] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.004s
I20260709 12:24:23.787796 20287 raft_consensus.cc:359] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:23.789556 20287 raft_consensus.cc:385] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.790274 20287 raft_consensus.cc:740] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.790812 20285 raft_consensus.cc:359] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:23.791550 20285 raft_consensus.cc:385] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.791831 20285 raft_consensus.cc:740] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.792768 20285 consensus_queue.cc:260] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:23.794763 20286 tablet_bootstrap.cc:492] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:23.795377 20285 ts_tablet_manager.cc:1434] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:24:23.795377 20286 ts_tablet_manager.cc:1403] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.026s	user 0.005s	sys 0.011s
I20260709 12:24:23.796386 20287 consensus_queue.cc:260] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:23.799135 20287 ts_tablet_manager.cc:1434] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.005s
I20260709 12:24:23.799798 20285 tablet_bootstrap.cc:492] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:23.800343 20287 tablet_bootstrap.cc:492] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:23.806561 20286 raft_consensus.cc:359] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:23.807412 20286 raft_consensus.cc:385] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.808254 20287 tablet_bootstrap.cc:654] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.807718 20286 raft_consensus.cc:740] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.810038 20318 raft_consensus.cc:493] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.810621 20318 raft_consensus.cc:515] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:23.811196 20285 tablet_bootstrap.cc:654] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.813866 20318 leader_election.cc:290] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:23.815631 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b588a815a548c8a3f375012fa7e3f6" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:23.816426 20282 tablet_bootstrap.cc:492] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:23.816412 20011 raft_consensus.cc:2468] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:23.817121 20282 ts_tablet_manager.cc:1403] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.043s	user 0.019s	sys 0.002s
I20260709 12:24:23.818167 20050 leader_election.cc:304] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:23.810038 20286 consensus_queue.cc:260] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:23.820183 20315 raft_consensus.cc:2804] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:23.820672 20315 raft_consensus.cc:493] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.821017 20315 raft_consensus.cc:3060] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:23.821349 20286 ts_tablet_manager.cc:1434] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:24:23.822547 20286 tablet_bootstrap.cc:492] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:23.824323 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b588a815a548c8a3f375012fa7e3f6" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:23.825110 20237 raft_consensus.cc:2468] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:23.827666 20282 raft_consensus.cc:359] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:23.828457 20282 raft_consensus.cc:385] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.828730 20282 raft_consensus.cc:740] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.829461 20282 consensus_queue.cc:260] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:23.837642 20282 ts_tablet_manager.cc:1434] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:24:23.838671 20282 tablet_bootstrap.cc:492] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:23.841943 20284 raft_consensus.cc:493] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.842533 20284 raft_consensus.cc:515] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:23.845100 20284 leader_election.cc:290] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:23.846019 20285 tablet_bootstrap.cc:492] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:23.846053 20286 tablet_bootstrap.cc:654] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.845100 20282 tablet_bootstrap.cc:654] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.846947 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d6ed1f33fa4b73bf5108eb0fec8f88" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:23.850839 20086 raft_consensus.cc:2468] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 0.
I20260709 12:24:23.849327 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d6ed1f33fa4b73bf5108eb0fec8f88" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:23.846804 20285 ts_tablet_manager.cc:1403] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.047s	user 0.025s	sys 0.017s
I20260709 12:24:23.853823 20126 leader_election.cc:304] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:23.855743 20284 raft_consensus.cc:2804] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:23.856278 20284 raft_consensus.cc:493] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.855588 20285 raft_consensus.cc:359] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:23.856781 20285 raft_consensus.cc:385] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.857265 20285 raft_consensus.cc:740] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.856679 20284 raft_consensus.cc:3060] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:23.858266 20285 consensus_queue.cc:260] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
W20260709 12:24:23.857401 20124 leader_election.cc:343] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.857517 20350 raft_consensus.cc:493] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.860991 20285 ts_tablet_manager.cc:1434] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:24:23.842550 20315 raft_consensus.cc:515] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:23.869441 20286 tablet_bootstrap.cc:492] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:23.870146 20286 ts_tablet_manager.cc:1403] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.005s
I20260709 12:24:23.872975 20285 tablet_bootstrap.cc:492] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:23.873131 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b588a815a548c8a3f375012fa7e3f6" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:23.867385 20350 raft_consensus.cc:515] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:23.873899 20237 raft_consensus.cc:3060] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:23.876416 20282 tablet_bootstrap.cc:492] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:23.876303 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b588a815a548c8a3f375012fa7e3f6" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:23.877069 20282 ts_tablet_manager.cc:1403] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.002s
I20260709 12:24:23.879213 20286 raft_consensus.cc:359] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:23.880014 20286 raft_consensus.cc:385] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.880340 20286 raft_consensus.cc:740] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.877120 20011 raft_consensus.cc:3060] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:23.883388 20350 leader_election.cc:290] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:23.884019 20350 raft_consensus.cc:493] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.884250 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5880437f7fb435aafab505023d9f7ae" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:23.884542 20350 raft_consensus.cc:515] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
W20260709 12:24:23.886003 20125 leader_election.cc:343] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.876322 20284 raft_consensus.cc:515] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:23.887573 20351 raft_consensus.cc:493] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.888322 20351 raft_consensus.cc:515] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:23.889660 20284 leader_election.cc:290] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:23.890161 20285 tablet_bootstrap.cc:654] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.890864 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d6ed1f33fa4b73bf5108eb0fec8f88" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:23.891921 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98035197c34fce88758eedbfd23225" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
W20260709 12:24:23.892196 20124 leader_election.cc:343] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.892742 20010 raft_consensus.cc:2393] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ea8ca532304a8f9ffda636d59f6f0f in current term 1: Already voted for candidate aac061e592d74289800e4c50cbb4132b in this term.
I20260709 12:24:23.892532 20286 consensus_queue.cc:260] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:23.894749 20286 ts_tablet_manager.cc:1434] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:24:23.895179 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b860aa254e34a20e8bdae1b626df" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:23.895656 20350 leader_election.cc:290] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
W20260709 12:24:23.896885 20124 leader_election.cc:343] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.897009 20286 tablet_bootstrap.cc:492] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:23.898293 20351 leader_election.cc:290] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:23.903895 20286 tablet_bootstrap.cc:654] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.892239 20282 raft_consensus.cc:359] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:23.905884 20282 raft_consensus.cc:385] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.906176 20282 raft_consensus.cc:740] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.907145 20285 tablet_bootstrap.cc:492] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:23.907721 20285 ts_tablet_manager.cc:1403] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.008s
I20260709 12:24:23.908138 20282 consensus_queue.cc:260] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:23.910403 20282 ts_tablet_manager.cc:1434] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:24:23.913211 20282 tablet_bootstrap.cc:492] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:23.915082 20237 raft_consensus.cc:2468] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:23.917228 20049 leader_election.cc:304] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:23.918035 20011 raft_consensus.cc:2468] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:23.918123 20318 raft_consensus.cc:2804] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:23.921855 20318 raft_consensus.cc:697] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:23.922753 20282 tablet_bootstrap.cc:654] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:23.922802 20318 consensus_queue.cc:237] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:23.925225 20294 consensus_queue.cc:1048] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:23.925794 20287 tablet_bootstrap.cc:492] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:23.926460 20287 ts_tablet_manager.cc:1403] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.126s	user 0.030s	sys 0.030s
I20260709 12:24:23.929894 20287 raft_consensus.cc:359] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:23.930632 20287 raft_consensus.cc:385] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.930931 20287 raft_consensus.cc:740] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.931915 20287 consensus_queue.cc:260] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:23.942067 20287 ts_tablet_manager.cc:1434] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:24:23.943590 20287 tablet_bootstrap.cc:492] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:23.945850 20295 raft_consensus.cc:493] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.946506 20295 raft_consensus.cc:515] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:23.954789 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc0138443e498db94e47c81d5ca81b" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
W20260709 12:24:23.956660 20201 leader_election.cc:343] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.959231 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc0138443e498db94e47c81d5ca81b" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
W20260709 12:24:23.961601 20201 leader_election.cc:343] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.962136 20201 leader_election.cc:304] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:23.963344 20322 raft_consensus.cc:493] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.964043 20322 raft_consensus.cc:515] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
W20260709 12:24:23.966111 19956 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:23.918715 20315 leader_election.cc:290] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:23.919057 20329 raft_consensus.cc:493] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.921061 20285 raft_consensus.cc:359] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:23.970108 20329 raft_consensus.cc:515] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:23.972610 20296 raft_consensus.cc:493] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.972797 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8691968cf8f4b04b4ef459bd321e903" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:23.973268 20296 raft_consensus.cc:515] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.970073 20285 raft_consensus.cc:385] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:23.974309 20285 raft_consensus.cc:740] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:23.975172 20285 consensus_queue.cc:260] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:23.976620 20296 leader_election.cc:290] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:23.977826 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff86d69d6264de598b8dd58012f7904" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:23.972687 20329 leader_election.cc:290] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:23.966379 20322 leader_election.cc:290] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:23.948974 20295 leader_election.cc:290] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:23.977002 20285 ts_tablet_manager.cc:1434] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.000s
I20260709 12:24:23.978654 20237 raft_consensus.cc:2468] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 0.
I20260709 12:24:23.978976 20295 raft_consensus.cc:2749] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:23.979738 20285 tablet_bootstrap.cc:492] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:23.977828 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e740fe60a5fc470d930160cc9445bc05" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
W20260709 12:24:23.981761 19976 leader_election.cc:343] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:23.982069 20322 raft_consensus.cc:493] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.982589 20322 raft_consensus.cc:515] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:23.985268 20322 leader_election.cc:290] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:23.981911 19974 leader_election.cc:304] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:23.986716 20329 raft_consensus.cc:2804] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:23.987108 20329 raft_consensus.cc:493] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.987466 20329 raft_consensus.cc:3060] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:23.993000 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e740fe60a5fc470d930160cc9445bc05" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:23.995266 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff86d69d6264de598b8dd58012f7904" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
W20260709 12:24:24.000398 19976 leader_election.cc:343] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:24.000993 19976 leader_election.cc:304] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:24.001996 20341 raft_consensus.cc:2749] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:24:24.004220 19976 leader_election.cc:343] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:24.006137 20315 raft_consensus.cc:493] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.006812 20315 raft_consensus.cc:515] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:24.007138 20329 raft_consensus.cc:515] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.010563 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff86d69d6264de598b8dd58012f7904" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:24.018342 20011 raft_consensus.cc:2393] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c470740d41ee4b9383923d08a87655d6 in current term 1: Already voted for candidate 7204c82dd34944818a439bd468a8c410 in this term.
W20260709 12:24:24.008970 20200 leader_election.cc:343] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:24.019564 20329 leader_election.cc:290] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:24.021163 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff86d69d6264de598b8dd58012f7904" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:24.021931 20237 raft_consensus.cc:3060] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.021235 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff86d69d6264de598b8dd58012f7904" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
W20260709 12:24:24.011583 20201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:38769, user_credentials={real_user=slave}} blocked reactor thread for 50031.4us
I20260709 12:24:24.025930 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8691968cf8f4b04b4ef459bd321e903" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:24.026546 20355 raft_consensus.cc:493] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.027112 20355 raft_consensus.cc:515] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:24.027664 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b860aa254e34a20e8bdae1b626df" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:24.028439 20236 raft_consensus.cc:2468] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:24.029471 20355 leader_election.cc:290] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:24.031716 20049 leader_election.cc:304] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:24.033211 20318 raft_consensus.cc:2804] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:24.033675 20318 raft_consensus.cc:493] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.034054 20318 raft_consensus.cc:3060] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.034672 20315 leader_election.cc:290] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
W20260709 12:24:24.035322 20051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40749, user_credentials={real_user=slave}} blocked reactor thread for 111079us
I20260709 12:24:24.036409 20237 raft_consensus.cc:2468] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 1.
I20260709 12:24:24.037446 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b860aa254e34a20e8bdae1b626df" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:24.037765 19974 leader_election.cc:304] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:24.038203 20161 raft_consensus.cc:2468] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:24.032961 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff86d69d6264de598b8dd58012f7904" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:24.033056 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d0409829eb45ff8e1eb6b75796eff9" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
W20260709 12:24:24.040205 19976 leader_election.cc:343] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:24.024343 20200 consensus_peers.cc:597] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.040496 20011 raft_consensus.cc:2468] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:24.042742 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d0409829eb45ff8e1eb6b75796eff9" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:24.043673 20162 raft_consensus.cc:2468] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:24.044164 20050 leader_election.cc:304] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:24.045272 20294 raft_consensus.cc:2804] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:24.045722 20294 raft_consensus.cc:493] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.046064 20294 raft_consensus.cc:3060] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.046128 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5880437f7fb435aafab505023d9f7ae" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:24.039793 20329 raft_consensus.cc:2804] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:24.048446 20329 raft_consensus.cc:697] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [term 1 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:24.012395 20287 tablet_bootstrap.cc:654] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.050912 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d6ed1f33fa4b73bf5108eb0fec8f88" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:24.051690 20086 raft_consensus.cc:3060] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:24.049657 20201 leader_election.cc:343] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:24.053793 20201 leader_election.cc:304] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:24.054898 20361 raft_consensus.cc:2749] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:24:24.055357 20201 leader_election.cc:343] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:24.055950 20201 leader_election.cc:304] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:24.056885 20361 raft_consensus.cc:2749] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:24.012627 20285 tablet_bootstrap.cc:654] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.062417 20287 tablet_bootstrap.cc:492] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:24.063004 20287 ts_tablet_manager.cc:1403] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.120s	user 0.011s	sys 0.000s
I20260709 12:24:24.064116 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b860aa254e34a20e8bdae1b626df" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:24.065584 20294 raft_consensus.cc:515] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:24.066025 20287 raft_consensus.cc:359] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:24.066291 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98035197c34fce88758eedbfd23225" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:24.069077 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d0409829eb45ff8e1eb6b75796eff9" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:24.069860 20011 raft_consensus.cc:3060] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:24.072227 20126 leader_election.cc:343] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:24.072647 20362 consensus_queue.cc:1048] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:24.073377 20086 raft_consensus.cc:2468] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:24:24.049556 20329 consensus_queue.cc:237] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.072784 20126 leader_election.cc:304] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:24.080225 20352 raft_consensus.cc:2749] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:24.082686 20286 tablet_bootstrap.cc:492] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:24.083310 20286 ts_tablet_manager.cc:1403] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.187s	user 0.039s	sys 0.064s
I20260709 12:24:24.084584 20126 leader_election.cc:304] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:24.085886 20352 raft_consensus.cc:3060] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.086450 20286 raft_consensus.cc:359] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:24.087194 20286 raft_consensus.cc:385] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.087517 20286 raft_consensus.cc:740] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.088394 20286 consensus_queue.cc:260] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:24.089344 20362 consensus_queue.cc:1048] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:24.092110 20126 leader_election.cc:304] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: c470740d41ee4b9383923d08a87655d6
I20260709 12:24:24.094134 20351 raft_consensus.cc:2804] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:24.094754 20351 raft_consensus.cc:697] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:24.095639 20351 consensus_queue.cc:237] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:24.100104 20318 raft_consensus.cc:515] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:24.101485 20085 raft_consensus.cc:2393] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ea8ca532304a8f9ffda636d59f6f0f in current term 1: Already voted for candidate aac061e592d74289800e4c50cbb4132b in this term.
I20260709 12:24:24.101493 20286 ts_tablet_manager.cc:1434] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 12:24:24.103771 20286 tablet_bootstrap.cc:492] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:24.105154 20011 raft_consensus.cc:2468] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:24.066701 20287 raft_consensus.cc:385] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.121145 20287 raft_consensus.cc:740] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.121584 20285 tablet_bootstrap.cc:492] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:24.122155 20287 consensus_queue.cc:260] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:24.112473 20318 leader_election.cc:290] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:24.113276 19906 catalog_manager.cc:5697] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:24.118050 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b860aa254e34a20e8bdae1b626df" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:24.122210 20285 ts_tablet_manager.cc:1403] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.143s	user 0.013s	sys 0.002s
I20260709 12:24:24.132193 20161 raft_consensus.cc:3060] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.120453 20126 leader_election.cc:304] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:24.132056 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b860aa254e34a20e8bdae1b626df" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:24.138638 20236 raft_consensus.cc:3060] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.148779 20050 leader_election.cc:304] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:24.152772 20315 raft_consensus.cc:2804] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:24.151971 19906 catalog_manager.cc:5697] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 1 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:24.153726 20315 raft_consensus.cc:697] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:24.154784 20315 consensus_queue.cc:237] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:24.156597 20287 ts_tablet_manager.cc:1434] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.093s	user 0.009s	sys 0.000s
I20260709 12:24:24.157698 20287 tablet_bootstrap.cc:492] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:24.124300 20352 raft_consensus.cc:2749] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:24.159514 20361 consensus_queue.cc:1048] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:24.162714 20318 consensus_queue.cc:1048] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:24.163985 20282 tablet_bootstrap.cc:492] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:24.164537 20282 ts_tablet_manager.cc:1403] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.252s	user 0.085s	sys 0.076s
I20260709 12:24:24.166486 20286 tablet_bootstrap.cc:654] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.167518 20282 raft_consensus.cc:359] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.168329 20282 raft_consensus.cc:385] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.162649 19907 catalog_manager.cc:5697] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 0 to 1, leader changed from <none> to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 1 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:24.168644 20282 raft_consensus.cc:740] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.171769 20287 tablet_bootstrap.cc:654] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.172379 20282 consensus_queue.cc:260] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.174993 20282 ts_tablet_manager.cc:1434] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:24:24.181066 20282 tablet_bootstrap.cc:492] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:24.155721 20161 raft_consensus.cc:2468] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:24.186084 20285 raft_consensus.cc:359] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.187144 20285 raft_consensus.cc:385] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.187556 20285 raft_consensus.cc:740] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.189859 20285 consensus_queue.cc:260] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.197969 20352 raft_consensus.cc:493] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.198604 20352 raft_consensus.cc:515] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:24.199913 20282 tablet_bootstrap.cc:654] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.185055 20236 raft_consensus.cc:2468] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:24.188395 20351 raft_consensus.cc:2749] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:24.206343 20352 leader_election.cc:290] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:24.207966 20051 leader_election.cc:304] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:24.209414 20362 raft_consensus.cc:2804] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:24.209977 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0126559599b40c5a6447c0648a81268" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
W20260709 12:24:24.212235 20126 leader_election.cc:343] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:24.210150 20362 raft_consensus.cc:697] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:24.213415 20285 ts_tablet_manager.cc:1434] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.084s	user 0.005s	sys 0.003s
I20260709 12:24:24.213632 20362 consensus_queue.cc:237] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:24.221292 20285 tablet_bootstrap.cc:492] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:24.215397 20235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0126559599b40c5a6447c0648a81268" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:24.215459 20160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d0409829eb45ff8e1eb6b75796eff9" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:24.223016 20160 raft_consensus.cc:3060] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:24.223280 20124 leader_election.cc:343] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:24.223845 20124 leader_election.cc:304] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:24.224687 20351 raft_consensus.cc:2749] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:24.200549 20294 leader_election.cc:290] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:24.237789 20287 tablet_bootstrap.cc:492] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:24.238531 20287 ts_tablet_manager.cc:1403] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.081s	user 0.015s	sys 0.020s
I20260709 12:24:24.250988 20282 tablet_bootstrap.cc:492] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:24.251631 20282 ts_tablet_manager.cc:1403] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.001s
I20260709 12:24:24.251561 20287 raft_consensus.cc:359] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.252925 20287 raft_consensus.cc:385] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.253371 20287 raft_consensus.cc:740] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.258639 20287 consensus_queue.cc:260] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.262452 20287 ts_tablet_manager.cc:1434] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 12:24:24.263283 20287 tablet_bootstrap.cc:492] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:24.247639 20355 consensus_queue.cc:1048] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:24:24.274829 20282 raft_consensus.cc:359] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:24.275642 20282 raft_consensus.cc:385] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.277527 20282 raft_consensus.cc:740] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.277704 20285 tablet_bootstrap.cc:654] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.287225 20282 consensus_queue.cc:260] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:24.293116 20282 ts_tablet_manager.cc:1434] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 12:24:24.294765 20282 tablet_bootstrap.cc:492] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:24.297041 20374 consensus_queue.cc:1048] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:24.306751 20286 tablet_bootstrap.cc:492] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:24.307397 20286 ts_tablet_manager.cc:1403] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.204s	user 0.017s	sys 0.013s
I20260709 12:24:24.299315 20287 tablet_bootstrap.cc:654] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.317385 20286 raft_consensus.cc:359] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:24.319494 20286 raft_consensus.cc:385] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.319974 20286 raft_consensus.cc:740] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.320006 20361 raft_consensus.cc:493] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.320977 20286 consensus_queue.cc:260] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:24.321346 20361 raft_consensus.cc:515] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:24.323434 20286 ts_tablet_manager.cc:1434] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.005s
I20260709 12:24:24.324851 20361 leader_election.cc:290] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:24.325277 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7527e635cb4c339c05a4b1ea702164" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:24.326084 20010 raft_consensus.cc:2468] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
I20260709 12:24:24.326829 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7527e635cb4c339c05a4b1ea702164" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:24.327396 20200 leader_election.cc:304] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:24.327618 20085 raft_consensus.cc:2468] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
I20260709 12:24:24.328456 20322 raft_consensus.cc:2804] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:24.328855 20322 raft_consensus.cc:493] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.329178 20322 raft_consensus.cc:3060] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.333271 20374 raft_consensus.cc:493] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.333842 20374 raft_consensus.cc:515] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:24.336169 20374 leader_election.cc:290] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:24.337960 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8691968cf8f4b04b4ef459bd321e903" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:24.338683 20236 raft_consensus.cc:2468] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:24.317073 20160 raft_consensus.cc:2468] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:24.340229 20049 leader_election.cc:304] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:24.341279 20374 raft_consensus.cc:2804] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:24.341727 20374 raft_consensus.cc:493] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.338430 20322 raft_consensus.cc:515] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:24.342129 20374 raft_consensus.cc:3060] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.351506 20286 tablet_bootstrap.cc:492] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:24.358281 20287 tablet_bootstrap.cc:492] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:24.358863 20287 ts_tablet_manager.cc:1403] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.096s	user 0.011s	sys 0.005s
I20260709 12:24:24.346817 20322 leader_election.cc:290] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:24.347916 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7527e635cb4c339c05a4b1ea702164" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:24.362362 20085 raft_consensus.cc:3060] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.364621 20287 raft_consensus.cc:359] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:24.365348 20287 raft_consensus.cc:385] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.365614 20287 raft_consensus.cc:740] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.360996 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8691968cf8f4b04b4ef459bd321e903" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:24.366282 20287 consensus_queue.cc:260] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
W20260709 12:24:24.368898 20050 leader_election.cc:343] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:24.369616 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7527e635cb4c339c05a4b1ea702164" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:24.370223 20010 raft_consensus.cc:3060] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.370548 20287 ts_tablet_manager.cc:1434] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:24:24.375379 20282 tablet_bootstrap.cc:654] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.382763 20085 raft_consensus.cc:2468] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:24.384586 20374 raft_consensus.cc:515] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:24.393607 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8691968cf8f4b04b4ef459bd321e903" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:24.394261 20237 raft_consensus.cc:3060] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.396458 20201 leader_election.cc:304] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:24.386094 20287 tablet_bootstrap.cc:492] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:24.397516 20322 raft_consensus.cc:2804] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:24.388768 20285 tablet_bootstrap.cc:492] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:24.398006 20322 raft_consensus.cc:697] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:24.398532 20285 ts_tablet_manager.cc:1403] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.177s	user 0.014s	sys 0.019s
I20260709 12:24:24.398850 20322 consensus_queue.cc:237] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:24.403723 20010 raft_consensus.cc:2468] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:24.410909 20285 raft_consensus.cc:359] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:24.411731 20285 raft_consensus.cc:385] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.412066 20285 raft_consensus.cc:740] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.412757 20285 consensus_queue.cc:260] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:24.389840 20286 tablet_bootstrap.cc:654] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.417496 20374 leader_election.cc:290] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:24.418918 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8691968cf8f4b04b4ef459bd321e903" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:24.422569 20285 ts_tablet_manager.cc:1434] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:24:24.420686 20287 tablet_bootstrap.cc:654] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.422971 20010 raft_consensus.cc:3060] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.419391 20237 raft_consensus.cc:2468] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:24.426297 20285 tablet_bootstrap.cc:492] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:24.426635 20049 leader_election.cc:304] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:24.419680 19908 catalog_manager.cc:5697] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 0 to 1, leader changed from <none> to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 1 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:24.433672 19906 catalog_manager.cc:5697] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 1 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:24.435169 20374 raft_consensus.cc:2804] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:24.441215 20374 raft_consensus.cc:697] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:24.442391 20374 consensus_queue.cc:237] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:24.438915 20010 raft_consensus.cc:2468] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:24.455155 20322 raft_consensus.cc:493] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.455827 20322 raft_consensus.cc:515] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:24.439422 20285 tablet_bootstrap.cc:654] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.458118 20322 leader_election.cc:290] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:24.459745 20318 raft_consensus.cc:493] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.460253 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d6ed1f33fa4b73bf5108eb0fec8f88" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:24.460290 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d6ed1f33fa4b73bf5108eb0fec8f88" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:24.460296 20318 raft_consensus.cc:515] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:24.461480 20085 raft_consensus.cc:2393] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c470740d41ee4b9383923d08a87655d6 in current term 1: Already voted for candidate 45ea8ca532304a8f9ffda636d59f6f0f in this term.
I20260709 12:24:24.462806 20318 leader_election.cc:290] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:24.463287 20201 leader_election.cc:304] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:24.464545 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc0138443e498db94e47c81d5ca81b" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:24.464959 20322 raft_consensus.cc:3060] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.465080 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc0138443e498db94e47c81d5ca81b" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:24.465840 20237 raft_consensus.cc:2468] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:24.467227 20049 leader_election.cc:304] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:24.468247 20318 raft_consensus.cc:2804] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:24:24.468645 20051 leader_election.cc:343] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:24.468698 20318 raft_consensus.cc:493] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.469543 20318 raft_consensus.cc:3060] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.473356 20315 consensus_queue.cc:1048] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:24.473282 20322 raft_consensus.cc:2749] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:24.500344 20286 tablet_bootstrap.cc:492] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:24.501032 20286 ts_tablet_manager.cc:1403] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.177s	user 0.014s	sys 0.015s
I20260709 12:24:24.502588 20318 raft_consensus.cc:515] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:24.510154 20282 tablet_bootstrap.cc:492] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:24.510535 20285 tablet_bootstrap.cc:492] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:24.512840 20282 ts_tablet_manager.cc:1403] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.218s	user 0.062s	sys 0.053s
I20260709 12:24:24.513628 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc0138443e498db94e47c81d5ca81b" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:24.514793 20351 raft_consensus.cc:493] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.515370 20351 raft_consensus.cc:515] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.515998 20282 raft_consensus.cc:359] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:24.516683 20282 raft_consensus.cc:385] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.516958 20282 raft_consensus.cc:740] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.517637 20282 consensus_queue.cc:260] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:24.519677 20282 ts_tablet_manager.cc:1434] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:24:24.519644 20350 consensus_queue.cc:1048] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:24:24.520533 20051 leader_election.cc:343] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:24.520905 20282 tablet_bootstrap.cc:492] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:24.517655 20351 leader_election.cc:290] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:24.522253 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff86d69d6264de598b8dd58012f7904" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:24.513160 20285 ts_tablet_manager.cc:1403] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.087s	user 0.018s	sys 0.003s
I20260709 12:24:24.524850 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff86d69d6264de598b8dd58012f7904" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:24.525677 20237 raft_consensus.cc:2393] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ea8ca532304a8f9ffda636d59f6f0f in current term 1: Already voted for candidate 7204c82dd34944818a439bd468a8c410 in this term.
I20260709 12:24:24.527772 20315 consensus_queue.cc:1048] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:24.528687 20282 tablet_bootstrap.cc:654] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.527509 20285 raft_consensus.cc:359] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:24.529214 20285 raft_consensus.cc:385] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.530319 20350 consensus_queue.cc:1048] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:24.530494 20124 leader_election.cc:304] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:24.531699 20350 raft_consensus.cc:3060] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.529578 20285 raft_consensus.cc:740] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.538548 20285 consensus_queue.cc:260] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:24.528465 20286 raft_consensus.cc:359] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:24.540254 20286 raft_consensus.cc:385] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.540633 20286 raft_consensus.cc:740] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.541457 20286 consensus_queue.cc:260] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:24.543057 20287 tablet_bootstrap.cc:492] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:24.547851 20287 ts_tablet_manager.cc:1403] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.162s	user 0.012s	sys 0.018s
I20260709 12:24:24.543663 20286 ts_tablet_manager.cc:1434] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.000s
I20260709 12:24:24.546325 20395 raft_consensus.cc:493] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.550027 20395 raft_consensus.cc:515] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:24.551396 20235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc0138443e498db94e47c81d5ca81b" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:24.545797 20010 raft_consensus.cc:3060] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.550522 20286 tablet_bootstrap.cc:492] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:24.552228 20235 raft_consensus.cc:3060] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.546607 20285 ts_tablet_manager.cc:1434] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 12:24:24.556831 20285 tablet_bootstrap.cc:492] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:24.558550 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988f10f24b02449cade652e210ad3b06" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:24.559373 20395 leader_election.cc:290] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:24.560106 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988f10f24b02449cade652e210ad3b06" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
W20260709 12:24:24.560312 20126 leader_election.cc:343] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:24.562103 20124 leader_election.cc:343] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:24.562572 20124 leader_election.cc:304] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:24.563704 20395 raft_consensus.cc:2749] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:24.567513 20285 tablet_bootstrap.cc:654] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.576376 20318 leader_election.cc:290] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:24.577538 20235 raft_consensus.cc:2468] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:24.579032 20049 leader_election.cc:304] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f
I20260709 12:24:24.580672 20374 raft_consensus.cc:2804] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:24.586891 20350 raft_consensus.cc:2749] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:24.586031 20374 raft_consensus.cc:697] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:24.595974 20287 raft_consensus.cc:359] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.596982 20287 raft_consensus.cc:385] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.597206 20287 raft_consensus.cc:740] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.597872 20287 consensus_queue.cc:260] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.600063 20329 raft_consensus.cc:493] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.600584 20329 raft_consensus.cc:515] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:24.602494 20329 leader_election.cc:290] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:24.603408 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05de16433174dc4b33d9fbc6afd9da1" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:24.604660 20322 raft_consensus.cc:493] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.604859 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05de16433174dc4b33d9fbc6afd9da1" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
W20260709 12:24:24.604889 19974 leader_election.cc:343] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:24.606575 19976 leader_election.cc:343] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:24.607048 19976 leader_election.cc:304] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:24.607928 20329 raft_consensus.cc:2749] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:24.608685 20322 raft_consensus.cc:515] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.609885 20329 consensus_queue.cc:1048] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:24.610707 20322 leader_election.cc:290] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:24.612397 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72eb35da72b43ecb538c2a240a61646" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:24.613022 20009 raft_consensus.cc:2468] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
I20260709 12:24:24.614100 20200 leader_election.cc:304] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:24.615164 20322 raft_consensus.cc:2804] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:24.615326 20160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72eb35da72b43ecb538c2a240a61646" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:24.615630 20287 ts_tablet_manager.cc:1434] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
W20260709 12:24:24.616887 20201 leader_election.cc:343] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:24.617774 20287 tablet_bootstrap.cc:492] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:24.620035 20322 raft_consensus.cc:493] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.620580 20322 raft_consensus.cc:3060] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.620155 20374 consensus_queue.cc:237] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:24.625411 20287 tablet_bootstrap.cc:654] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.631610 20282 tablet_bootstrap.cc:492] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:24.632196 20282 ts_tablet_manager.cc:1403] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.112s	user 0.040s	sys 0.028s
I20260709 12:24:24.631119 19905 catalog_manager.cc:5697] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 0 to 1, leader changed from <none> to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 1 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:24.635126 20282 raft_consensus.cc:359] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:24.635839 20282 raft_consensus.cc:385] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.638996 20282 raft_consensus.cc:740] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.642283 20286 tablet_bootstrap.cc:654] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.658174 20374 consensus_queue.cc:1048] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:24.661712 19905 catalog_manager.cc:5697] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 0 to 1, leader changed from <none> to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 1 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:24.668152 20285 tablet_bootstrap.cc:492] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:24.668715 20285 ts_tablet_manager.cc:1403] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.112s	user 0.008s	sys 0.027s
I20260709 12:24:24.671617 20285 raft_consensus.cc:359] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:24.672372 20285 raft_consensus.cc:385] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.672642 20285 raft_consensus.cc:740] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.672597 20282 consensus_queue.cc:260] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:24.673103 20374 raft_consensus.cc:493] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.673846 20374 raft_consensus.cc:515] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:24.674527 20329 consensus_queue.cc:1048] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:24.675172 20282 ts_tablet_manager.cc:1434] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 12:24:24.676002 20374 leader_election.cc:290] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:24.676199 20282 tablet_bootstrap.cc:492] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:24.677313 20285 consensus_queue.cc:260] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:24.677591 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e740fe60a5fc470d930160cc9445bc05" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:24.678609 20009 raft_consensus.cc:2468] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:24.677598 20160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e740fe60a5fc470d930160cc9445bc05" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:24.679664 20160 raft_consensus.cc:2468] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:24.679955 20285 ts_tablet_manager.cc:1434] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:24:24.680962 20285 tablet_bootstrap.cc:492] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:24.681087 20051 leader_election.cc:304] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:24.681957 20374 raft_consensus.cc:2804] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:24.682305 20374 raft_consensus.cc:493] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.682618 20374 raft_consensus.cc:3060] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.687381 20285 tablet_bootstrap.cc:654] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.691301 20374 raft_consensus.cc:515] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:24.695446 20160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e740fe60a5fc470d930160cc9445bc05" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:24.696307 20160 raft_consensus.cc:3060] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.697657 20282 tablet_bootstrap.cc:654] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.703434 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e740fe60a5fc470d930160cc9445bc05" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:24.704183 20009 raft_consensus.cc:3060] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.707195 19908 catalog_manager.cc:5697] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 0 to 1, leader changed from <none> to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 1 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:24.724128 20286 tablet_bootstrap.cc:492] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:24.727785 20009 raft_consensus.cc:2468] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:24.736485 20322 raft_consensus.cc:515] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.728171 20286 ts_tablet_manager.cc:1403] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.178s	user 0.013s	sys 0.000s
I20260709 12:24:24.739221 20322 leader_election.cc:290] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:24.739449 20050 leader_election.cc:304] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:24.742081 20286 raft_consensus.cc:359] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:24.744535 20362 raft_consensus.cc:2804] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:24.757124 20362 raft_consensus.cc:697] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:24.757886 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72eb35da72b43ecb538c2a240a61646" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:24.758008 20362 consensus_queue.cc:237] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:24.758651 20009 raft_consensus.cc:3060] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.744779 20355 consensus_queue.cc:1048] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:24.746382 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72eb35da72b43ecb538c2a240a61646" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:24.747251 20285 tablet_bootstrap.cc:492] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:24.761371 20285 ts_tablet_manager.cc:1403] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.081s	user 0.027s	sys 0.029s
I20260709 12:24:24.762838 20287 tablet_bootstrap.cc:492] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:24.763370 20287 ts_tablet_manager.cc:1403] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.146s	user 0.008s	sys 0.010s
I20260709 12:24:24.748502 20374 leader_election.cc:290] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:24.750905 20160 raft_consensus.cc:2468] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:24.752905 20358 raft_consensus.cc:493] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.765055 20358 raft_consensus.cc:515] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.766153 20287 raft_consensus.cc:359] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:24.766914 20287 raft_consensus.cc:385] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.767186 20287 raft_consensus.cc:740] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.767372 20358 leader_election.cc:290] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:24.767899 20287 consensus_queue.cc:260] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:24.768627 20285 raft_consensus.cc:359] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:24.769315 20285 raft_consensus.cc:385] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.769587 20285 raft_consensus.cc:740] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.770241 20287 ts_tablet_manager.cc:1434] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:24:24.770418 20285 consensus_queue.cc:260] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:24.771267 20287 tablet_bootstrap.cc:492] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:24.772646 20285 ts_tablet_manager.cc:1434] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:24:24.773648 20285 tablet_bootstrap.cc:492] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:24.773913 20160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e608aa894f4f9d96f3e1b9b16fb7cd" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:24.774682 20160 raft_consensus.cc:2468] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
I20260709 12:24:24.776648 20201 leader_election.cc:304] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:24.778663 20358 raft_consensus.cc:2804] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:24.779083 20358 raft_consensus.cc:493] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.779422 20358 raft_consensus.cc:3060] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.779963 20286 raft_consensus.cc:385] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.780364 20286 raft_consensus.cc:740] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
W20260709 12:24:24.781826 20201 leader_election.cc:343] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:24.781935 20285 tablet_bootstrap.cc:654] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.782538 20286 consensus_queue.cc:260] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:24.785228 20009 raft_consensus.cc:2468] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:24.787887 20358 raft_consensus.cc:515] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.795802 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e608aa894f4f9d96f3e1b9b16fb7cd" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:24.799530 20329 raft_consensus.cc:493] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.799651 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e608aa894f4f9d96f3e1b9b16fb7cd" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:24.800338 20161 raft_consensus.cc:3060] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.800170 20329 raft_consensus.cc:515] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:24.800648 20287 tablet_bootstrap.cc:654] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.802338 20329 leader_election.cc:290] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:24.805183 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a53dd7c6fa4a338973463bf3cf0f9c" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:24.806583 20160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a53dd7c6fa4a338973463bf3cf0f9c" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
W20260709 12:24:24.808736 19976 leader_election.cc:343] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:24.809480 19976 leader_election.cc:343] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:24.809911 19976 leader_election.cc:304] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:24.810845 20161 raft_consensus.cc:2468] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:24.811551 20329 raft_consensus.cc:2749] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:24.799072 20285 tablet_bootstrap.cc:492] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:24.812202 20201 leader_election.cc:304] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:24.812912 20285 ts_tablet_manager.cc:1403] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.004s
I20260709 12:24:24.814994 20358 leader_election.cc:290] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:24.815747 20358 raft_consensus.cc:2804] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:24.816982 20200 leader_election.cc:304] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f
W20260709 12:24:24.823822 20200 leader_election.cc:343] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:24.818231 20315 consensus_queue.cc:1048] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:24.826464 20359 raft_consensus.cc:2804] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:24.827059 20359 raft_consensus.cc:697] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:24.827239 20285 raft_consensus.cc:359] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.827788 20285 raft_consensus.cc:385] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.827543 20374 consensus_queue.cc:1048] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:24.828061 20285 raft_consensus.cc:740] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.828689 20285 consensus_queue.cc:260] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.830381 20285 ts_tablet_manager.cc:1434] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.000s
I20260709 12:24:24.831367 20285 tablet_bootstrap.cc:492] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:24.833771 20359 consensus_queue.cc:237] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.837524 20285 tablet_bootstrap.cc:654] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.837961 20287 tablet_bootstrap.cc:492] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:24.838537 20287 ts_tablet_manager.cc:1403] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.010s
I20260709 12:24:24.839543 19907 catalog_manager.cc:5697] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 0 to 1, leader changed from <none> to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 1 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:24.820565 20322 consensus_queue.cc:1048] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:24.821489 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e608aa894f4f9d96f3e1b9b16fb7cd" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:24.849608 20010 raft_consensus.cc:3060] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.857010 20358 raft_consensus.cc:697] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:24.841715 20287 raft_consensus.cc:359] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.858531 20287 raft_consensus.cc:385] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.858862 20287 raft_consensus.cc:740] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.819380 20286 ts_tablet_manager.cc:1434] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.000s
I20260709 12:24:24.859818 19906 catalog_manager.cc:5697] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 1 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:24.861563 20010 raft_consensus.cc:2468] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:24.861248 20358 consensus_queue.cc:237] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.859584 20287 consensus_queue.cc:260] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.860879 20286 tablet_bootstrap.cc:492] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:24.864370 20287 ts_tablet_manager.cc:1434] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 12:24:24.865386 20287 tablet_bootstrap.cc:492] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:24.870976 20282 tablet_bootstrap.cc:492] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:24.871361 20287 tablet_bootstrap.cc:654] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.876588 20322 consensus_queue.cc:1048] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:24.871542 20282 ts_tablet_manager.cc:1403] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.196s	user 0.010s	sys 0.002s
I20260709 12:24:24.880163 20282 raft_consensus.cc:359] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.880889 20282 raft_consensus.cc:385] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.881166 20282 raft_consensus.cc:740] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.882009 20282 consensus_queue.cc:260] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.884964 20287 tablet_bootstrap.cc:492] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:24.885526 20287 ts_tablet_manager.cc:1403] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.001s
I20260709 12:24:24.888458 20287 raft_consensus.cc:359] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:24.889158 20287 raft_consensus.cc:385] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.889446 20287 raft_consensus.cc:740] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.889729 20282 ts_tablet_manager.cc:1434] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:24:24.890336 20287 consensus_queue.cc:260] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:24.892525 20286 tablet_bootstrap.cc:654] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.893247 20285 tablet_bootstrap.cc:492] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:24.893771 20285 ts_tablet_manager.cc:1403] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.012s
I20260709 12:24:24.896847 20282 tablet_bootstrap.cc:492] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:24.896660 20285 raft_consensus.cc:359] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.897388 20285 raft_consensus.cc:385] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.897663 20285 raft_consensus.cc:740] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.897753 20287 ts_tablet_manager.cc:1434] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 12:24:24.898742 20287 tablet_bootstrap.cc:492] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:24.898393 20285 consensus_queue.cc:260] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.900774 20285 ts_tablet_manager.cc:1434] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:24:24.902240 20285 tablet_bootstrap.cc:492] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:24.905421 20287 tablet_bootstrap.cc:654] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.914387 20285 tablet_bootstrap.cc:654] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.916194 20282 tablet_bootstrap.cc:654] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.917394 20400 raft_consensus.cc:493] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.917949 20400 raft_consensus.cc:515] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:24.921167 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc0138443e498db94e47c81d5ca81b" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:24.922719 20287 tablet_bootstrap.cc:492] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:24.923251 20287 ts_tablet_manager.cc:1403] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.005s
I20260709 12:24:24.924978 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc0138443e498db94e47c81d5ca81b" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:24.925829 20237 raft_consensus.cc:2393] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ea8ca532304a8f9ffda636d59f6f0f in current term 1: Already voted for candidate aac061e592d74289800e4c50cbb4132b in this term.
I20260709 12:24:24.926496 20287 raft_consensus.cc:359] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:24.927203 20287 raft_consensus.cc:385] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.927470 20287 raft_consensus.cc:740] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.928267 20287 consensus_queue.cc:260] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:24.930908 20287 ts_tablet_manager.cc:1434] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:24:24.923391 20400 leader_election.cc:290] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:24.933493 20359 raft_consensus.cc:493] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.928682 20124 leader_election.cc:304] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:24.934089 20359 raft_consensus.cc:515] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:24.935057 20400 raft_consensus.cc:3060] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.932119 20287 tablet_bootstrap.cc:492] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:24.936326 20359 leader_election.cc:290] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:24.938159 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac98768a9a3430a8784fa7995363272" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:24.938476 20285 tablet_bootstrap.cc:492] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:24.939020 20285 ts_tablet_manager.cc:1403] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.002s
I20260709 12:24:24.939162 20329 raft_consensus.cc:493] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.939674 20329 raft_consensus.cc:515] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
W20260709 12:24:24.940665 20201 leader_election.cc:343] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:24.940141 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac98768a9a3430a8784fa7995363272" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:24.941795 20329 leader_election.cc:290] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:24.941818 20285 raft_consensus.cc:359] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:24.943001 20285 raft_consensus.cc:385] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.943264 20285 raft_consensus.cc:740] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
W20260709 12:24:24.943150 20201 leader_election.cc:343] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:24.944080 20201 leader_election.cc:304] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:24.944229 20285 consensus_queue.cc:260] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:24.945065 20359 raft_consensus.cc:2749] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:24.945598 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0da04e85e534d9990213bfdcee4874c" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:24.946573 20287 tablet_bootstrap.cc:654] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.946660 20285 ts_tablet_manager.cc:1434] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:24:24.947147 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0da04e85e534d9990213bfdcee4874c" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:24.947714 20285 tablet_bootstrap.cc:492] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
W20260709 12:24:24.948426 19974 leader_election.cc:343] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:24.951336 20400 raft_consensus.cc:2749] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:24.954202 20285 tablet_bootstrap.cc:654] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:24.956326 20286 tablet_bootstrap.cc:492] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:24.955971 19908 catalog_manager.cc:5697] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 1 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:24.957080 20286 ts_tablet_manager.cc:1403] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.096s	user 0.015s	sys 0.003s
I20260709 12:24:24.959764 20374 consensus_queue.cc:1048] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:24.961709 20286 raft_consensus.cc:359] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:24.962589 20286 raft_consensus.cc:385] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.962901 20286 raft_consensus.cc:740] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.963666 20286 consensus_queue.cc:260] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:24.947831 20162 raft_consensus.cc:2468] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 0.
I20260709 12:24:24.967058 19976 leader_election.cc:304] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: c470740d41ee4b9383923d08a87655d6
I20260709 12:24:24.968374 20329 raft_consensus.cc:2804] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:24.968765 20329 raft_consensus.cc:493] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.969090 20329 raft_consensus.cc:3060] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:24.975479 20285 tablet_bootstrap.cc:492] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:24.976070 20285 ts_tablet_manager.cc:1403] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.010s
I20260709 12:24:24.979213 20285 raft_consensus.cc:359] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:24.981961 20282 tablet_bootstrap.cc:492] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:24.982546 20282 ts_tablet_manager.cc:1403] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.092s	user 0.010s	sys 0.003s
I20260709 12:24:24.984210 20286 ts_tablet_manager.cc:1434] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:24:24.985548 20286 tablet_bootstrap.cc:492] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:24.985622 20282 raft_consensus.cc:359] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.986507 20282 raft_consensus.cc:385] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.986775 20282 raft_consensus.cc:740] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.987555 20282 consensus_queue.cc:260] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:24.989787 20282 ts_tablet_manager.cc:1434] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:24:24.985755 20285 raft_consensus.cc:385] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:24.990348 20285 raft_consensus.cc:740] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:24.991761 20285 consensus_queue.cc:260] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:24.994807 20285 ts_tablet_manager.cc:1434] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:24:24.995308 20362 consensus_queue.cc:1048] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:24.995836 20285 tablet_bootstrap.cc:492] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:25.001768 20282 tablet_bootstrap.cc:492] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:25.009627 20362 raft_consensus.cc:493] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.010601 20282 tablet_bootstrap.cc:654] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.010357 20362 raft_consensus.cc:515] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:25.012707 20286 tablet_bootstrap.cc:654] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.015786 20361 raft_consensus.cc:493] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.016436 20361 raft_consensus.cc:515] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:25.013355 20285 tablet_bootstrap.cc:654] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.018541 20361 leader_election.cc:290] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:25.021126 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05de16433174dc4b33d9fbc6afd9da1" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:25.022048 20085 raft_consensus.cc:2468] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
I20260709 12:24:25.023877 20201 leader_election.cc:304] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:25.026062 20362 leader_election.cc:290] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:25.058012 20329 raft_consensus.cc:515] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:25.026978 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5880437f7fb435aafab505023d9f7ae" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:25.034673 20361 raft_consensus.cc:2804] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:25.037628 20412 raft_consensus.cc:493] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.069075 20162 raft_consensus.cc:2468] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:25.069222 20412 raft_consensus.cc:515] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:25.038763 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5880437f7fb435aafab505023d9f7ae" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
W20260709 12:24:25.041280 19956 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:25.048811 20374 consensus_queue.cc:1048] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:25.072268 20010 raft_consensus.cc:2468] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:25.034264 20286 tablet_bootstrap.cc:492] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:25.073931 20286 ts_tablet_manager.cc:1403] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.089s	user 0.012s	sys 0.006s
I20260709 12:24:25.074120 20051 leader_election.cc:304] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:25.075316 20361 raft_consensus.cc:493] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.076445 20361 raft_consensus.cc:3060] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.075939 20374 raft_consensus.cc:2804] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:25.076982 20374 raft_consensus.cc:493] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.077335 20374 raft_consensus.cc:3060] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.078625 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5880437f7fb435aafab505023d9f7ae" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:25.084087 20412 leader_election.cc:290] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:25.084524 20286 raft_consensus.cc:359] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.085412 20286 raft_consensus.cc:385] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.085717 20286 raft_consensus.cc:740] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.086556 20286 consensus_queue.cc:260] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.038736 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05de16433174dc4b33d9fbc6afd9da1" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:25.088336 20009 raft_consensus.cc:2468] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
I20260709 12:24:25.089582 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5880437f7fb435aafab505023d9f7ae" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:25.090446 20162 raft_consensus.cc:2468] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 0.
I20260709 12:24:25.091946 19976 leader_election.cc:304] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: 
I20260709 12:24:25.093123 20412 raft_consensus.cc:2804] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:25.093864 20412 raft_consensus.cc:493] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.094420 20412 raft_consensus.cc:3060] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.093722 20286 ts_tablet_manager.cc:1434] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:24:25.097142 20286 tablet_bootstrap.cc:492] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:25.109856 20374 raft_consensus.cc:515] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:25.118304 20329 leader_election.cc:290] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:25.119086 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0da04e85e534d9990213bfdcee4874c" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:25.120846 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0da04e85e534d9990213bfdcee4874c" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:25.103163 20412 raft_consensus.cc:515] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:25.124415 20085 raft_consensus.cc:2393] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7204c82dd34944818a439bd468a8c410 in current term 1: Already voted for candidate aac061e592d74289800e4c50cbb4132b in this term.
I20260709 12:24:25.123577 20361 raft_consensus.cc:515] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:25.140770 20160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5880437f7fb435aafab505023d9f7ae" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:25.141239 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5880437f7fb435aafab505023d9f7ae" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:25.141412 20160 raft_consensus.cc:3060] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.142007 20361 leader_election.cc:290] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:25.127205 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5880437f7fb435aafab505023d9f7ae" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:25.131973 20282 tablet_bootstrap.cc:492] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:25.143610 20282 ts_tablet_manager.cc:1403] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.142s	user 0.015s	sys 0.051s
I20260709 12:24:25.126969 20374 leader_election.cc:290] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:25.144433 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05de16433174dc4b33d9fbc6afd9da1" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:25.144958 20085 raft_consensus.cc:3060] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.146534 20282 raft_consensus.cc:359] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.147246 20282 raft_consensus.cc:385] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.147514 20282 raft_consensus.cc:740] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.142130 20086 raft_consensus.cc:2393] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7204c82dd34944818a439bd468a8c410 in current term 1: Already voted for candidate aac061e592d74289800e4c50cbb4132b in this term.
I20260709 12:24:25.129055 20162 raft_consensus.cc:3060] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.152681 20400 raft_consensus.cc:493] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.153472 20400 raft_consensus.cc:515] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:25.138938 20285 tablet_bootstrap.cc:492] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:25.139433 20287 tablet_bootstrap.cc:492] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:25.183696 20285 ts_tablet_manager.cc:1403] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.188s	user 0.038s	sys 0.038s
I20260709 12:24:25.186816 20285 raft_consensus.cc:359] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:25.187430 20085 raft_consensus.cc:2468] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:25.187918 20287 ts_tablet_manager.cc:1403] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.256s	user 0.092s	sys 0.088s
I20260709 12:24:25.189736 20201 leader_election.cc:304] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:25.189710 20160 raft_consensus.cc:2468] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 1.
I20260709 12:24:25.191102 20361 raft_consensus.cc:2804] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:25.192548 19976 leader_election.cc:304] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:24:25.193653 20315 consensus_queue.cc:1048] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:25.193873 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05de16433174dc4b33d9fbc6afd9da1" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:25.194543 20287 raft_consensus.cc:359] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.183879 20282 consensus_queue.cc:260] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.198688 20287 raft_consensus.cc:385] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.199131 20287 raft_consensus.cc:740] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.197997 20286 tablet_bootstrap.cc:654] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.197072 20400 leader_election.cc:290] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:25.187537 20285 raft_consensus.cc:385] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.195159 20361 raft_consensus.cc:697] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:25.199772 20009 raft_consensus.cc:3060] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.139504 20412 leader_election.cc:290] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:25.219712 20285 raft_consensus.cc:740] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.221509 20411 raft_consensus.cc:493] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.217383 20329 raft_consensus.cc:2804] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:25.224885 20329 raft_consensus.cc:697] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [term 1 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:25.225627 20162 raft_consensus.cc:2468] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 1.
I20260709 12:24:25.224398 20285 consensus_queue.cc:260] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:25.203711 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72eb35da72b43ecb538c2a240a61646" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:25.224347 20411 raft_consensus.cc:515] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:25.229243 20285 ts_tablet_manager.cc:1434] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.001s
I20260709 12:24:25.229696 20411 leader_election.cc:290] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:25.199966 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72eb35da72b43ecb538c2a240a61646" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:25.230247 20285 tablet_bootstrap.cc:492] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
W20260709 12:24:25.199442 19974 leader_election.cc:343] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.222539 20287 consensus_queue.cc:260] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.225754 20329 consensus_queue.cc:237] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:25.234524 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf0d91bbb1d4e40b769bc07ef380517" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:25.235248 20010 raft_consensus.cc:2393] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ea8ca532304a8f9ffda636d59f6f0f in current term 1: Already voted for candidate c470740d41ee4b9383923d08a87655d6 in this term.
I20260709 12:24:25.235987 20287 ts_tablet_manager.cc:1434] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 12:24:25.237432 20287 tablet_bootstrap.cc:492] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:25.239802 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5880437f7fb435aafab505023d9f7ae" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:25.243789 19976 leader_election.cc:304] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: c470740d41ee4b9383923d08a87655d6
I20260709 12:24:25.246999 20125 leader_election.cc:304] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:25.234550 20361 consensus_queue.cc:237] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:25.248482 20400 raft_consensus.cc:3060] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:25.248785 19976 leader_election.cc:343] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.250669 20287 tablet_bootstrap.cc:654] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.251200 20411 raft_consensus.cc:2804] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:25.251770 20411 raft_consensus.cc:697] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [term 1 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:25.252686 20411 consensus_queue.cc:237] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:25.256014 20410 raft_consensus.cc:493] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.256603 20410 raft_consensus.cc:515] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:25.257382 20362 consensus_queue.cc:1048] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:25.258813 20410 leader_election.cc:290] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:25.260855 20282 ts_tablet_manager.cc:1434] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.117s	user 0.013s	sys 0.003s
I20260709 12:24:25.262362 20282 tablet_bootstrap.cc:492] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:25.265443 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd398fffdf6d468f88108a6a7bec0681" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:25.265295 20050 leader_election.cc:304] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:25.274324 20376 raft_consensus.cc:2749] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:25.279874 20359 raft_consensus.cc:493] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.280530 20359 raft_consensus.cc:515] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:25.283638 20359 leader_election.cc:290] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:25.284258 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144ce9a2901342abbabee63851505b75" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
W20260709 12:24:25.286152 20201 leader_election.cc:343] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.289446 20400 raft_consensus.cc:2749] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:25.290843 20358 raft_consensus.cc:493] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.291440 20358 raft_consensus.cc:515] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:25.293879 20358 leader_election.cc:290] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:25.295912 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd4e0295fa48bc8c187c7d421d8f11" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:25.296669 20162 raft_consensus.cc:2468] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
W20260709 12:24:25.271989 19976 leader_election.cc:343] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.298926 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd398fffdf6d468f88108a6a7bec0681" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:25.301525 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd4e0295fa48bc8c187c7d421d8f11" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:25.302487 20201 leader_election.cc:304] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:25.302897 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144ce9a2901342abbabee63851505b75" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:25.303625 20359 raft_consensus.cc:2804] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:25.304152 20359 raft_consensus.cc:493] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.304570 20359 raft_consensus.cc:3060] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.256582 20009 raft_consensus.cc:2468] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:25.312640 20285 tablet_bootstrap.cc:654] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.314074 20400 raft_consensus.cc:493] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:25.318549 20200 leader_election.cc:343] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:25.325150 20200 leader_election.cc:343] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.325680 20200 leader_election.cc:304] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:25.320088 20322 consensus_queue.cc:1048] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:25.327790 20322 raft_consensus.cc:2749] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:25.328961 20400 raft_consensus.cc:515] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.317480 20358 consensus_queue.cc:1048] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:24:25.330152 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf0d91bbb1d4e40b769bc07ef380517" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
W20260709 12:24:25.320382 19974 leader_election.cc:343] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.330991 19974 leader_election.cc:304] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:25.334312 20412 raft_consensus.cc:2749] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:25.334336 20286 tablet_bootstrap.cc:492] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:25.336431 20286 ts_tablet_manager.cc:1403] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.240s	user 0.017s	sys 0.014s
I20260709 12:24:25.341593 20286 raft_consensus.cc:359] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:25.344017 20286 raft_consensus.cc:385] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.342941 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac98768a9a3430a8784fa7995363272" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:25.345631 19906 catalog_manager.cc:5697] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 1 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.346369 20085 raft_consensus.cc:2468] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 0.
I20260709 12:24:25.346028 20286 raft_consensus.cc:740] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.348620 20286 consensus_queue.cc:260] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:25.326668 20282 tablet_bootstrap.cc:654] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:25.335110 19974 leader_election.cc:343] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.350970 20126 leader_election.cc:304] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:25.352562 20286 ts_tablet_manager.cc:1434] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:24:25.352270 19974 leader_election.cc:304] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:25.353513 20439 raft_consensus.cc:2804] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:25.353982 20439 raft_consensus.cc:493] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.354338 20439 raft_consensus.cc:3060] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.354817 20400 leader_election.cc:290] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:25.355054 20329 raft_consensus.cc:2749] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:25.349342 20359 raft_consensus.cc:515] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:25.362864 20359 leader_election.cc:290] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:25.364035 20286 tablet_bootstrap.cc:492] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:25.364221 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd4e0295fa48bc8c187c7d421d8f11" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
W20260709 12:24:25.366663 20200 leader_election.cc:343] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.368340 20287 tablet_bootstrap.cc:492] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:25.369055 20287 ts_tablet_manager.cc:1403] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.132s	user 0.008s	sys 0.004s
I20260709 12:24:25.374846 20315 consensus_queue.cc:1048] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:25.377367 20285 tablet_bootstrap.cc:492] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:25.378033 20285 ts_tablet_manager.cc:1403] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.148s	user 0.012s	sys 0.001s
I20260709 12:24:25.385929 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac98768a9a3430a8784fa7995363272" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:25.387096 20236 raft_consensus.cc:2468] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 0.
I20260709 12:24:25.391500 19905 catalog_manager.cc:5697] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.397222 19905 catalog_manager.cc:5697] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:25.402082 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd4e0295fa48bc8c187c7d421d8f11" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:25.404544 20359 consensus_queue.cc:1048] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:25.406093 20161 raft_consensus.cc:3060] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.409898 20286 tablet_bootstrap.cc:654] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.413352 20359 consensus_queue.cc:1048] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:25.417688 20287 raft_consensus.cc:359] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:25.415647 20285 raft_consensus.cc:359] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:25.404983 20439 raft_consensus.cc:515] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.418455 20287 raft_consensus.cc:385] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.425014 20287 raft_consensus.cc:740] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.425949 20285 raft_consensus.cc:385] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.426345 20285 raft_consensus.cc:740] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.427495 20287 consensus_queue.cc:260] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:25.437489 20285 consensus_queue.cc:260] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:25.440824 20285 ts_tablet_manager.cc:1434] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.001s
I20260709 12:24:25.441123 20286 tablet_bootstrap.cc:492] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:25.441615 20286 ts_tablet_manager.cc:1403] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.000s
I20260709 12:24:25.441843 20285 tablet_bootstrap.cc:492] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:25.444417 20286 raft_consensus.cc:359] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.445117 20286 raft_consensus.cc:385] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.445389 20286 raft_consensus.cc:740] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.446918 20329 raft_consensus.cc:493] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.447475 20329 raft_consensus.cc:515] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:25.446183 20286 consensus_queue.cc:260] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.449958 20287 ts_tablet_manager.cc:1434] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.000s
I20260709 12:24:25.450815 20287 tablet_bootstrap.cc:492] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:25.452149 20439 leader_election.cc:290] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:25.454138 20285 tablet_bootstrap.cc:654] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.466284 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac98768a9a3430a8784fa7995363272" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:25.466970 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac98768a9a3430a8784fa7995363272" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:25.467608 20236 raft_consensus.cc:3060] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.467043 20085 raft_consensus.cc:3060] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.478281 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd122132f7485fa43d171d8c857d38" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
W20260709 12:24:25.480072 19976 leader_election.cc:343] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.473026 20329 leader_election.cc:290] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:25.483420 20286 ts_tablet_manager.cc:1434] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.002s
I20260709 12:24:25.489732 20286 tablet_bootstrap.cc:492] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:25.492964 20161 raft_consensus.cc:2468] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:25.483361 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd122132f7485fa43d171d8c857d38" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:25.495000 20201 leader_election.cc:304] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
W20260709 12:24:25.495666 19976 leader_election.cc:343] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.496168 19976 leader_election.cc:304] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:25.497350 20329 raft_consensus.cc:2749] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:25.498842 20287 tablet_bootstrap.cc:654] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.496155 20359 raft_consensus.cc:2804] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:25.499629 20359 raft_consensus.cc:697] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:25.500510 20359 consensus_queue.cc:237] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:25.482378 20236 raft_consensus.cc:2468] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:24:25.507329 20085 raft_consensus.cc:2468] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:24:25.513743 20286 tablet_bootstrap.cc:654] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.527307 20282 tablet_bootstrap.cc:492] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:25.527832 20282 ts_tablet_manager.cc:1403] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.266s	user 0.034s	sys 0.025s
I20260709 12:24:25.528663 20358 raft_consensus.cc:493] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.529328 20362 raft_consensus.cc:493] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.529678 20358 raft_consensus.cc:515] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:25.530035 20362 raft_consensus.cc:515] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.528249 20126 leader_election.cc:304] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:25.532707 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf0d91bbb1d4e40b769bc07ef380517" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:25.532948 20439 raft_consensus.cc:2804] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:25.533412 20010 raft_consensus.cc:2468] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
I20260709 12:24:25.533516 20439 raft_consensus.cc:697] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:25.534852 20200 leader_election.cc:304] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:25.534478 20439 consensus_queue.cc:237] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.540062 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf0d91bbb1d4e40b769bc07ef380517" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:25.541512 20362 leader_election.cc:290] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:25.531809 20358 leader_election.cc:290] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:25.540277 20322 raft_consensus.cc:2804] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:25.549582 20322 raft_consensus.cc:493] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.550014 20322 raft_consensus.cc:3060] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:25.542776 20201 leader_election.cc:343] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.555943 19904 catalog_manager.cc:5697] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 1 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.561962 20322 raft_consensus.cc:515] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:25.564299 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988f10f24b02449cade652e210ad3b06" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:25.545233 20160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988f10f24b02449cade652e210ad3b06" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:25.545959 20287 tablet_bootstrap.cc:492] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
W20260709 12:24:25.566068 20049 leader_election.cc:343] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.566249 20160 raft_consensus.cc:2468] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:25.566468 20287 ts_tablet_manager.cc:1403] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.116s	user 0.023s	sys 0.007s
I20260709 12:24:25.568598 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf0d91bbb1d4e40b769bc07ef380517" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:25.568795 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf0d91bbb1d4e40b769bc07ef380517" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:25.569281 20008 raft_consensus.cc:3060] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.569412 20287 raft_consensus.cc:359] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.548090 20282 raft_consensus.cc:359] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:25.570307 20282 raft_consensus.cc:385] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.570161 20287 raft_consensus.cc:385] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.570731 20282 raft_consensus.cc:740] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.570951 20287 raft_consensus.cc:740] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.571543 20282 consensus_queue.cc:260] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:25.571877 20287 consensus_queue.cc:260] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.573982 20282 ts_tablet_manager.cc:1434] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.001s
I20260709 12:24:25.574559 20287 ts_tablet_manager.cc:1434] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:24:25.574971 20282 tablet_bootstrap.cc:492] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:25.575529 20287 tablet_bootstrap.cc:492] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:25.577296 20008 raft_consensus.cc:2468] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:25.580215 20286 tablet_bootstrap.cc:492] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:25.581032 20286 ts_tablet_manager.cc:1403] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.091s	user 0.007s	sys 0.005s
I20260709 12:24:25.582062 20051 leader_election.cc:304] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: c470740d41ee4b9383923d08a87655d6
I20260709 12:24:25.583261 20362 raft_consensus.cc:2804] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:25.583632 20362 raft_consensus.cc:493] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.583979 20362 raft_consensus.cc:3060] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:25.570144 20201 leader_election.cc:343] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.584851 20322 leader_election.cc:290] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:25.588792 20282 tablet_bootstrap.cc:654] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.583973 20286 raft_consensus.cc:359] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.596885 20286 raft_consensus.cc:385] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.598178 20286 raft_consensus.cc:740] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.601732 20200 leader_election.cc:304] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:24:25.602674 20322 raft_consensus.cc:2804] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:25.603150 20322 raft_consensus.cc:697] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:25.603969 20322 consensus_queue.cc:237] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:25.604578 20287 tablet_bootstrap.cc:654] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.606532 20362 raft_consensus.cc:515] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.608773 20362 leader_election.cc:290] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:25.613500 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988f10f24b02449cade652e210ad3b06" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:25.614367 20236 raft_consensus.cc:3060] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.617089 20160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988f10f24b02449cade652e210ad3b06" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:25.599630 20286 consensus_queue.cc:260] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.623193 20286 ts_tablet_manager.cc:1434] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 12:24:25.622625 19907 catalog_manager.cc:5697] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 1 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.624822 20286 tablet_bootstrap.cc:492] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:25.634162 20282 tablet_bootstrap.cc:492] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:25.634714 20282 ts_tablet_manager.cc:1403] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.000s
I20260709 12:24:25.635808 20286 tablet_bootstrap.cc:654] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.637609 20282 raft_consensus.cc:359] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:25.638393 20282 raft_consensus.cc:385] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.638645 20282 raft_consensus.cc:740] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.639360 20282 consensus_queue.cc:260] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:25.641750 20282 ts_tablet_manager.cc:1434] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:24:25.642689 20282 tablet_bootstrap.cc:492] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:25.650523 20285 tablet_bootstrap.cc:492] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:25.651101 20285 ts_tablet_manager.cc:1403] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.209s	user 0.014s	sys 0.005s
I20260709 12:24:25.652549 20160 raft_consensus.cc:3060] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.656852 20322 raft_consensus.cc:493] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.657285 20236 raft_consensus.cc:2468] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:25.657384 20285 raft_consensus.cc:359] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:25.658463 20285 raft_consensus.cc:385] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.657500 20322 raft_consensus.cc:515] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.658681 20285 raft_consensus.cc:740] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.660897 20322 leader_election.cc:290] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:25.660928 20285 consensus_queue.cc:260] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:25.662974 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0126559599b40c5a6447c0648a81268" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:25.665088 20287 tablet_bootstrap.cc:492] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:25.666424 20287 ts_tablet_manager.cc:1403] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.091s	user 0.017s	sys 0.011s
I20260709 12:24:25.667800 20282 tablet_bootstrap.cc:654] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.669344 20287 raft_consensus.cc:359] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:25.670059 20287 raft_consensus.cc:385] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.670334 20287 raft_consensus.cc:740] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.671051 20287 consensus_queue.cc:260] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:25.663790 20085 raft_consensus.cc:2468] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
I20260709 12:24:25.672327 20285 ts_tablet_manager.cc:1434] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.002s
I20260709 12:24:25.673530 20285 tablet_bootstrap.cc:492] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:25.681660 20287 ts_tablet_manager.cc:1434] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:24:25.683465 20049 leader_election.cc:304] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:25.664615 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0126559599b40c5a6447c0648a81268" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:25.684764 20287 tablet_bootstrap.cc:492] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:25.681633 20201 leader_election.cc:304] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:25.685947 20285 tablet_bootstrap.cc:654] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.684890 20162 raft_consensus.cc:2468] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
I20260709 12:24:25.685196 20294 raft_consensus.cc:2804] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:25.689445 20286 tablet_bootstrap.cc:492] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:25.690140 20286 ts_tablet_manager.cc:1403] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.027s
I20260709 12:24:25.692096 20322 raft_consensus.cc:2804] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:25.692127 20329 consensus_queue.cc:1048] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:25.693344 20286 raft_consensus.cc:359] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:25.692359 20294 raft_consensus.cc:697] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:25.694123 20286 raft_consensus.cc:385] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.693996 20322 raft_consensus.cc:493] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.694602 20286 raft_consensus.cc:740] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.694661 20322 raft_consensus.cc:3060] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.695554 20286 consensus_queue.cc:260] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:25.701592 20286 ts_tablet_manager.cc:1434] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
W20260709 12:24:25.703130 19974 consensus_peers.cc:597] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 -> Peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Couldn't send request to peer c470740d41ee4b9383923d08a87655d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:25.703986 20286 tablet_bootstrap.cc:492] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:25.708787 20362 raft_consensus.cc:493] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.709398 20362 raft_consensus.cc:515] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:25.711185 20294 consensus_queue.cc:237] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.713146 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a53dd7c6fa4a338973463bf3cf0f9c" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:25.713919 20008 raft_consensus.cc:2468] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:25.711071 20287 tablet_bootstrap.cc:654] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.717087 19907 catalog_manager.cc:5697] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 1 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.714426 20362 leader_election.cc:290] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:25.722309 20160 raft_consensus.cc:2468] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:25.725981 20286 tablet_bootstrap.cc:654] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.718647 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a53dd7c6fa4a338973463bf3cf0f9c" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:25.727988 20050 leader_election.cc:304] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
W20260709 12:24:25.730871 20051 leader_election.cc:343] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.734928 20322 raft_consensus.cc:515] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.735733 20329 consensus_queue.cc:1048] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:24:25.739005 20282 tablet_bootstrap.cc:492] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:25.739540 20282 ts_tablet_manager.cc:1403] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.097s	user 0.033s	sys 0.026s
I20260709 12:24:25.742489 20282 raft_consensus.cc:359] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:25.743229 20282 raft_consensus.cc:385] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.743502 20282 raft_consensus.cc:740] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.744238 20282 consensus_queue.cc:260] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:25.732883 20362 raft_consensus.cc:2804] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:25.750923 20282 ts_tablet_manager.cc:1434] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:24:25.751427 20285 tablet_bootstrap.cc:492] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:25.752048 20285 ts_tablet_manager.cc:1403] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.079s	user 0.013s	sys 0.003s
I20260709 12:24:25.752099 20282 tablet_bootstrap.cc:492] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:25.750546 20362 raft_consensus.cc:493] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.759085 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0126559599b40c5a6447c0648a81268" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:25.759480 20285 raft_consensus.cc:359] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:25.762444 20285 raft_consensus.cc:385] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.755527 20362 raft_consensus.cc:3060] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.762764 20285 raft_consensus.cc:740] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.771117 20285 consensus_queue.cc:260] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:25.763312 20086 raft_consensus.cc:3060] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.770836 20411 raft_consensus.cc:493] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.776394 20411 raft_consensus.cc:515] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:25.778254 20359 consensus_queue.cc:1048] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:25.777376 20439 raft_consensus.cc:493] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.780174 20439 raft_consensus.cc:515] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:25.781490 20086 raft_consensus.cc:2468] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:25.782369 20439 leader_election.cc:290] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:25.783427 20322 leader_election.cc:290] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:25.783634 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524118618cf740e9865e397864b56ed2" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:25.784212 20201 leader_election.cc:304] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:25.786870 20411 leader_election.cc:290] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:25.787448 20322 raft_consensus.cc:2804] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:25.788892 20286 tablet_bootstrap.cc:492] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:25.789441 20286 ts_tablet_manager.cc:1403] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.087s	user 0.011s	sys 0.007s
I20260709 12:24:25.789263 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524118618cf740e9865e397864b56ed2" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:25.798687 20236 raft_consensus.cc:2468] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 0.
I20260709 12:24:25.800071 20124 leader_election.cc:304] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:25.801170 20439 raft_consensus.cc:2804] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:25.801383 20156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0988a236f3934f8692fd434098766112" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:25.801761 20439 raft_consensus.cc:493] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.802175 20439 raft_consensus.cc:3060] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:25.803509 19976 leader_election.cc:343] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.803719 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0126559599b40c5a6447c0648a81268" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:25.804369 20158 raft_consensus.cc:3060] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.809996 20286 raft_consensus.cc:359] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.810786 20286 raft_consensus.cc:385] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.811076 20286 raft_consensus.cc:740] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.811494 20400 raft_consensus.cc:493] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.811122 20439 raft_consensus.cc:515] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:25.811832 20286 consensus_queue.cc:260] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.812170 20400 raft_consensus.cc:515] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:25.788920 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0988a236f3934f8692fd434098766112" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:25.814606 20286 ts_tablet_manager.cc:1434] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
W20260709 12:24:25.815204 19974 leader_election.cc:343] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.815723 19974 leader_election.cc:304] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:25.796906 19907 catalog_manager.cc:5697] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 0 to 1, leader changed from <none> to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 1 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.816591 20329 raft_consensus.cc:2749] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:24:25.817014 20125 leader_election.cc:343] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.815649 20286 tablet_bootstrap.cc:492] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:25.796880 20322 raft_consensus.cc:697] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:25.821029 20322 consensus_queue.cc:237] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.827474 20286 tablet_bootstrap.cc:654] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.835709 20285 ts_tablet_manager.cc:1434] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.083s	user 0.009s	sys 0.000s
I20260709 12:24:25.840375 20285 tablet_bootstrap.cc:492] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:25.835089 20362 raft_consensus.cc:515] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:25.861276 20287 tablet_bootstrap.cc:492] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:25.862694 20287 ts_tablet_manager.cc:1403] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.180s	user 0.011s	sys 0.009s
I20260709 12:24:25.859807 20282 tablet_bootstrap.cc:654] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.869910 20400 leader_election.cc:290] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:25.870536 20472 consensus_queue.cc:1048] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:25.860095 20158 raft_consensus.cc:2468] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:25.876195 20439 leader_election.cc:290] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:25.874049 20359 consensus_queue.cc:1048] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:24:25.878350 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af265a90671a46cbafb3fced0f952aef" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:25.883452 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524118618cf740e9865e397864b56ed2" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:25.880466 20315 raft_consensus.cc:493] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.884315 20315 raft_consensus.cc:515] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
W20260709 12:24:25.884995 20125 leader_election.cc:343] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.889150 20315 leader_election.cc:290] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:25.890230 20472 raft_consensus.cc:493] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.890767 20472 raft_consensus.cc:515] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:25.880203 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524118618cf740e9865e397864b56ed2" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:25.895326 20287 raft_consensus.cc:359] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.896196 20287 raft_consensus.cc:385] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.896415 20287 raft_consensus.cc:740] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.896947 20287 consensus_queue.cc:260] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.899246 20286 tablet_bootstrap.cc:492] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:25.895421 20237 raft_consensus.cc:3060] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.893354 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af265a90671a46cbafb3fced0f952aef" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:25.900163 20472 leader_election.cc:290] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:25.900426 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:25.903597 20235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5038da47868e47148f6dda5d135f60fa" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
W20260709 12:24:25.905727 20124 leader_election.cc:343] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.907931 20286 ts_tablet_manager.cc:1403] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.092s	user 0.020s	sys 0.004s
I20260709 12:24:25.914961 20287 ts_tablet_manager.cc:1434] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
W20260709 12:24:25.918181 19976 leader_election.cc:343] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.916940 20235 raft_consensus.cc:2468] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:25.915439 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5038da47868e47148f6dda5d135f60fa" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:25.920528 20472 raft_consensus.cc:493] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.921042 20472 raft_consensus.cc:515] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:25.921249 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a53dd7c6fa4a338973463bf3cf0f9c" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:25.921880 20009 raft_consensus.cc:3060] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.922875 20049 leader_election.cc:304] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:25.923949 20294 raft_consensus.cc:2804] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:25.924319 20294 raft_consensus.cc:493] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.924639 20294 raft_consensus.cc:3060] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.928778 20472 leader_election.cc:290] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
W20260709 12:24:25.921557 20125 leader_election.cc:343] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.934147 20125 leader_election.cc:304] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:25.934866 20439 raft_consensus.cc:2749] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:25.935707 20287 tablet_bootstrap.cc:492] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
W20260709 12:24:25.935941 20051 leader_election.cc:343] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.936440 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a53dd7c6fa4a338973463bf3cf0f9c" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:25.936884 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd4e0295fa48bc8c187c7d421d8f11" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:25.937690 20162 raft_consensus.cc:2393] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7204c82dd34944818a439bd468a8c410 in current term 1: Already voted for candidate c470740d41ee4b9383923d08a87655d6 in this term.
I20260709 12:24:25.937525 20235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd4e0295fa48bc8c187c7d421d8f11" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:25.932366 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:25.942066 19974 leader_election.cc:304] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:25.942466 19908 catalog_manager.cc:5697] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 1 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:25.944103 20010 raft_consensus.cc:3060] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.942468 20439 consensus_queue.cc:1048] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 12:24:25.947237 19974 leader_election.cc:343] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:25.948477 20051 leader_election.cc:343] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.947762 19974 leader_election.cc:304] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:25.931000 20362 leader_election.cc:290] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:25.956784 20285 tablet_bootstrap.cc:654] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.961107 20472 raft_consensus.cc:2749] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:25.961361 20439 consensus_queue.cc:1048] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:25.964215 20472 raft_consensus.cc:2749] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:25.972393 20009 raft_consensus.cc:2468] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:25.958033 20286 raft_consensus.cc:359] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:25.974771 20358 consensus_queue.cc:1048] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:25.975128 20286 raft_consensus.cc:385] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.966442 20294 raft_consensus.cc:515] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:25.975965 20286 raft_consensus.cc:740] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.976261 20358 consensus_queue.cc:1048] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:25.973803 20050 leader_election.cc:304] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f
W20260709 12:24:25.981909 20476 log.cc:927] Time spent T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:24:25.982164 20362 raft_consensus.cc:2804] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:25.983135 20362 raft_consensus.cc:697] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:25.978335 20286 consensus_queue.cc:260] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:25.996142 20287 tablet_bootstrap.cc:654] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.998698 20286 ts_tablet_manager.cc:1434] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.083s	user 0.008s	sys 0.000s
I20260709 12:24:26.000003 20286 tablet_bootstrap.cc:492] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:25.984465 20362 consensus_queue.cc:237] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:25.997395 20237 raft_consensus.cc:2468] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:24:26.011509 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5038da47868e47148f6dda5d135f60fa" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
W20260709 12:24:26.012511 20475 log.cc:927] Time spent T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:24:26.014307 20282 tablet_bootstrap.cc:492] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:26.024078 20282 ts_tablet_manager.cc:1403] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.272s	user 0.014s	sys 0.003s
W20260709 12:24:26.024290 20051 leader_election.cc:343] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:26.025589 20287 tablet_bootstrap.cc:492] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:26.026022 20287 ts_tablet_manager.cc:1403] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.091s	user 0.015s	sys 0.004s
I20260709 12:24:26.027359 20282 raft_consensus.cc:359] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.028318 20282 raft_consensus.cc:385] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:26.028635 20282 raft_consensus.cc:740] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:26.028750 20287 raft_consensus.cc:359] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:26.029479 20287 raft_consensus.cc:385] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:26.029834 20287 raft_consensus.cc:740] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:26.029613 20282 consensus_queue.cc:260] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.030589 20287 consensus_queue.cc:260] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:26.031508 20439 raft_consensus.cc:493] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.045079 20282 ts_tablet_manager.cc:1434] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 12:24:26.046809 20282 tablet_bootstrap.cc:492] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:26.048782 20287 ts_tablet_manager.cc:1434] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.008s
I20260709 12:24:26.057670 20287 tablet_bootstrap.cc:492] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:26.059810 20294 leader_election.cc:290] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:26.074821 20286 tablet_bootstrap.cc:654] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:26.047032 20439 raft_consensus.cc:515] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
W20260709 12:24:26.070447 20477 log.cc:927] Time spent T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:24:26.070876 20294 raft_consensus.cc:493] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.066047 20124 leader_election.cc:304] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:26.088186 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5038da47868e47148f6dda5d135f60fa" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:26.088848 20237 raft_consensus.cc:3060] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.090057 20439 leader_election.cc:290] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:26.091779 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd122132f7485fa43d171d8c857d38" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:26.092686 20285 tablet_bootstrap.cc:492] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:26.093214 20285 ts_tablet_manager.cc:1403] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.253s	user 0.021s	sys 0.006s
I20260709 12:24:26.092603 20009 raft_consensus.cc:2468] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 0.
I20260709 12:24:26.098636 20486 raft_consensus.cc:2804] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:26.099262 20486 raft_consensus.cc:697] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:26.100093 20486 consensus_queue.cc:237] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:26.106025 20359 consensus_queue.cc:1048] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:26.109267 20359 raft_consensus.cc:493] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.109817 20359 raft_consensus.cc:515] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:26.110939 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd122132f7485fa43d171d8c857d38" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:26.113226 20359 leader_election.cc:290] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
W20260709 12:24:26.115720 20126 leader_election.cc:343] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:26.109292 20400 raft_consensus.cc:493] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.087327 20294 raft_consensus.cc:515] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:26.149369 20285 raft_consensus.cc:359] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:26.150236 20285 raft_consensus.cc:385] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:26.150538 20285 raft_consensus.cc:740] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:26.151360 20285 consensus_queue.cc:260] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:26.156580 20285 ts_tablet_manager.cc:1434] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 12:24:26.157871 20285 tablet_bootstrap.cc:492] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:26.146620 20400 raft_consensus.cc:515] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.165657 20400 leader_election.cc:290] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:26.167085 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0da04e85e534d9990213bfdcee4874c" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
W20260709 12:24:26.165673 20124 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:39155, user_credentials={real_user=slave}} blocked reactor thread for 105508us
I20260709 12:24:26.148773 20125 leader_election.cc:304] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:24:26.187220 20294 leader_election.cc:290] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
W20260709 12:24:26.191577 20125 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 49731.1us
I20260709 12:24:26.196892 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3651ee11a6184a34bed06bc86be62c29" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
W20260709 12:24:26.198483 20125 leader_election.cc:343] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:26.200603 20282 tablet_bootstrap.cc:654] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:26.204843 20126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:38769, user_credentials={real_user=slave}} blocked reactor thread for 88212.6us
I20260709 12:24:26.205662 20287 tablet_bootstrap.cc:654] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:26.207417 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3651ee11a6184a34bed06bc86be62c29" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:26.211786 20234 raft_consensus.cc:3060] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.215704 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf0d91bbb1d4e40b769bc07ef380517" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
W20260709 12:24:26.216905 20126 leader_election.cc:343] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:26.217473 20126 leader_election.cc:304] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:26.220126 20400 raft_consensus.cc:2749] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:26.195581 20237 raft_consensus.cc:2468] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:26.236886 19908 catalog_manager.cc:5697] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 0 to 1, leader changed from <none> to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 1 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:26.208369 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0da04e85e534d9990213bfdcee4874c" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:26.242794 20286 tablet_bootstrap.cc:492] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:26.245932 20286 ts_tablet_manager.cc:1403] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.246s	user 0.010s	sys 0.011s
W20260709 12:24:26.271596 19956 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:26.277735 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf0d91bbb1d4e40b769bc07ef380517" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:26.278599 20049 leader_election.cc:304] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f
I20260709 12:24:26.280164 20362 raft_consensus.cc:2804] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:26.280679 20362 raft_consensus.cc:697] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:26.281529 20362 consensus_queue.cc:237] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:26.283967 20315 consensus_queue.cc:1048] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.291129 19908 catalog_manager.cc:5697] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 1 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:26.299350 20489 raft_consensus.cc:2804] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:26.300107 20489 raft_consensus.cc:493] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.300535 20489 raft_consensus.cc:3060] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.308579 20049 leader_election.cc:304] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:26.309717 20201 leader_election.cc:304] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:26.310092 20294 raft_consensus.cc:2749] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:26.335135 20285 tablet_bootstrap.cc:654] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:26.337672 20086 raft_consensus.cc:3060] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.347962 20282 tablet_bootstrap.cc:492] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:26.348588 20282 ts_tablet_manager.cc:1403] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.302s	user 0.044s	sys 0.051s
W20260709 12:24:26.344229 20200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 55006us
I20260709 12:24:26.365809 20286 raft_consensus.cc:359] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.366624 20286 raft_consensus.cc:385] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:26.366922 20286 raft_consensus.cc:740] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:26.367339 20491 consensus_queue.cc:1048] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:26.367736 20286 consensus_queue.cc:260] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.369940 20286 ts_tablet_manager.cc:1434] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.123s	user 0.005s	sys 0.001s
I20260709 12:24:26.370975 20286 tablet_bootstrap.cc:492] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:26.373060 20282 raft_consensus.cc:359] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.374589 20282 raft_consensus.cc:385] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:26.374877 20282 raft_consensus.cc:740] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:26.375890 20282 consensus_queue.cc:260] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.383215 20282 ts_tablet_manager.cc:1434] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:24:26.385059 20287 tablet_bootstrap.cc:492] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:26.385699 20287 ts_tablet_manager.cc:1403] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.336s	user 0.012s	sys 0.010s
I20260709 12:24:26.358425 20362 consensus_queue.cc:1048] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:24:26.388866 20282 tablet_bootstrap.cc:492] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:26.374334 20489 raft_consensus.cc:515] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.400005 20491 consensus_queue.cc:1048] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:26.403218 20489 leader_election.cc:290] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:26.403952 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd122132f7485fa43d171d8c857d38" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:26.403331 20287 raft_consensus.cc:359] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:26.405581 20287 raft_consensus.cc:385] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:26.405901 20287 raft_consensus.cc:740] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:26.404630 20006 raft_consensus.cc:3060] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.406505 20492 raft_consensus.cc:2749] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:26.418424 20359 consensus_queue.cc:1048] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.422736 20286 tablet_bootstrap.cc:654] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:26.424139 20287 consensus_queue.cc:260] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:26.427892 20282 tablet_bootstrap.cc:654] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:26.431107 20006 raft_consensus.cc:2468] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:24:26.432734 20125 leader_election.cc:304] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: 
I20260709 12:24:26.433863 20494 raft_consensus.cc:2804] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:26.434401 20494 raft_consensus.cc:697] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:26.435256 20494 consensus_queue.cc:237] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.443073 20374 raft_consensus.cc:493] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.443815 20374 raft_consensus.cc:515] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:26.445202 20285 tablet_bootstrap.cc:492] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:26.445731 20285 ts_tablet_manager.cc:1403] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.288s	user 0.022s	sys 0.006s
I20260709 12:24:26.448227 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144ce9a2901342abbabee63851505b75" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:26.448750 20285 raft_consensus.cc:359] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:26.449110 20006 raft_consensus.cc:2468] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:26.449994 20285 raft_consensus.cc:385] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:26.450518 20050 leader_election.cc:304] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:26.449574 20374 leader_election.cc:290] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:26.453611 20374 raft_consensus.cc:2804] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:26.453981 20374 raft_consensus.cc:493] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.454315 20374 raft_consensus.cc:3060] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.454967 20287 ts_tablet_manager.cc:1434] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.001s
I20260709 12:24:26.456048 20287 tablet_bootstrap.cc:492] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:26.450309 20285 raft_consensus.cc:740] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:26.460575 20285 consensus_queue.cc:260] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:26.463064 20285 ts_tablet_manager.cc:1434] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:24:26.464259 20285 tablet_bootstrap.cc:492] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:26.469861 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd122132f7485fa43d171d8c857d38" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:26.470778 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144ce9a2901342abbabee63851505b75" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:26.471486 20237 raft_consensus.cc:2468] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
W20260709 12:24:26.475312 20126 leader_election.cc:343] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:26.477392 20287 tablet_bootstrap.cc:654] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:26.483074 20374 raft_consensus.cc:515] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:26.499334 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144ce9a2901342abbabee63851505b75" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:26.500051 20237 raft_consensus.cc:3060] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.500418 20374 leader_election.cc:290] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:26.495371 20285 tablet_bootstrap.cc:654] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:26.507716 20237 raft_consensus.cc:2468] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:26.511173 20049 leader_election.cc:304] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:26.512914 20362 raft_consensus.cc:2804] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:26.513545 20362 raft_consensus.cc:697] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:26.514392 20362 consensus_queue.cc:237] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:26.518149 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144ce9a2901342abbabee63851505b75" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:26.519274 20009 raft_consensus.cc:3060] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.529373 20287 tablet_bootstrap.cc:492] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:26.529942 20287 ts_tablet_manager.cc:1403] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.074s	user 0.018s	sys 0.012s
I20260709 12:24:26.532859 20287 raft_consensus.cc:359] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:26.533556 20287 raft_consensus.cc:385] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:26.533828 20287 raft_consensus.cc:740] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:26.534940 20285 tablet_bootstrap.cc:492] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:26.535503 20285 ts_tablet_manager.cc:1403] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.071s	user 0.009s	sys 0.002s
I20260709 12:24:26.538581 20285 raft_consensus.cc:359] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:26.539305 20285 raft_consensus.cc:385] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:26.539773 20285 raft_consensus.cc:740] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:26.534564 20287 consensus_queue.cc:260] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:26.540512 20285 consensus_queue.cc:260] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:26.542559 20286 tablet_bootstrap.cc:492] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:26.543124 20286 ts_tablet_manager.cc:1403] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.172s	user 0.023s	sys 0.019s
I20260709 12:24:26.545084 20285 ts_tablet_manager.cc:1434] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:24:26.546164 20285 tablet_bootstrap.cc:492] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:26.547551 20287 ts_tablet_manager.cc:1434] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:24:26.548739 20287 tablet_bootstrap.cc:492] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:26.546075 20286 raft_consensus.cc:359] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:26.552594 20286 raft_consensus.cc:385] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:26.552911 20286 raft_consensus.cc:740] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:26.553606 20286 consensus_queue.cc:260] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:26.556106 20286 ts_tablet_manager.cc:1434] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 12:24:26.557314 20286 tablet_bootstrap.cc:492] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:26.558686 20507 raft_consensus.cc:493] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.559237 20507 raft_consensus.cc:515] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.561543 20507 leader_election.cc:290] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:26.562836 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3651ee11a6184a34bed06bc86be62c29" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:26.563303 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3651ee11a6184a34bed06bc86be62c29" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:26.563696 20158 raft_consensus.cc:2468] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:26.564183 20285 tablet_bootstrap.cc:654] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:26.565122 20051 leader_election.cc:304] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:26.566485 20286 tablet_bootstrap.cc:654] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:26.562924 20287 tablet_bootstrap.cc:654] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:26.567039 20472 raft_consensus.cc:493] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.572772 20472 raft_consensus.cc:515] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:26.574920 20472 leader_election.cc:290] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:26.567595 20362 raft_consensus.cc:2804] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:26.575836 20362 raft_consensus.cc:493] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.576203 20362 raft_consensus.cc:3060] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.580655 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af265a90671a46cbafb3fced0f952aef" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:26.581365 20161 raft_consensus.cc:2468] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 0.
I20260709 12:24:26.581776 20286 tablet_bootstrap.cc:492] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:26.582285 20286 ts_tablet_manager.cc:1403] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.025s	user 0.003s	sys 0.010s
I20260709 12:24:26.582856 19976 leader_election.cc:304] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: 
I20260709 12:24:26.585121 20286 raft_consensus.cc:359] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.585870 20286 raft_consensus.cc:385] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:26.586146 20286 raft_consensus.cc:740] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:26.569710 19908 catalog_manager.cc:5697] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 0 to 1, leader changed from <none> to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 1 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:26.589308 20287 tablet_bootstrap.cc:492] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:26.589802 20287 ts_tablet_manager.cc:1403] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.005s
I20260709 12:24:26.591512 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af265a90671a46cbafb3fced0f952aef" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:26.592257 20236 raft_consensus.cc:2468] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 0.
I20260709 12:24:26.592818 20287 raft_consensus.cc:359] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:26.593521 20287 raft_consensus.cc:385] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:26.593784 20287 raft_consensus.cc:740] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:26.594359 20472 raft_consensus.cc:2804] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:26.594491 20287 consensus_queue.cc:260] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:26.594907 20472 raft_consensus.cc:493] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.595361 20472 raft_consensus.cc:3060] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.597045 20287 ts_tablet_manager.cc:1434] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
W20260709 12:24:26.571784 20050 leader_election.cc:343] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:26.598104 20287 tablet_bootstrap.cc:492] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:26.600157 20286 consensus_queue.cc:260] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.605073 20006 raft_consensus.cc:3060] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.606542 20286 ts_tablet_manager.cc:1434] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.006s
I20260709 12:24:26.607573 20286 tablet_bootstrap.cc:492] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:26.614291 20294 raft_consensus.cc:493] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.614796 20294 raft_consensus.cc:515] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.617067 20294 leader_election.cc:290] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:26.613372 19906 catalog_manager.cc:5697] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 1 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:26.619009 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd122132f7485fa43d171d8c857d38" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:26.620116 20287 tablet_bootstrap.cc:654] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:26.621521 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd122132f7485fa43d171d8c857d38" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:26.622350 20010 raft_consensus.cc:2393] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aac061e592d74289800e4c50cbb4132b in current term 1: Already voted for candidate 45ea8ca532304a8f9ffda636d59f6f0f in this term.
I20260709 12:24:26.623495 20494 raft_consensus.cc:493] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.624310 20286 tablet_bootstrap.cc:654] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:26.624008 20494 raft_consensus.cc:515] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.618659 20009 raft_consensus.cc:2468] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:26.627574 20282 tablet_bootstrap.cc:492] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:26.628118 20282 ts_tablet_manager.cc:1403] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.244s	user 0.038s	sys 0.050s
I20260709 12:24:26.628147 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a53dd7c6fa4a338973463bf3cf0f9c" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:26.629154 20010 raft_consensus.cc:2393] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ea8ca532304a8f9ffda636d59f6f0f in current term 1: Already voted for candidate aac061e592d74289800e4c50cbb4132b in this term.
I20260709 12:24:26.630523 20494 leader_election.cc:290] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:26.631976 20050 leader_election.cc:304] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:26.632983 20294 raft_consensus.cc:3060] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.634572 20286 tablet_bootstrap.cc:492] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:26.635105 20286 ts_tablet_manager.cc:1403] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.002s
I20260709 12:24:26.637984 20286 raft_consensus.cc:359] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.638675 20286 raft_consensus.cc:385] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:26.638952 20286 raft_consensus.cc:740] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:26.639580 20286 consensus_queue.cc:260] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.641379 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a53dd7c6fa4a338973463bf3cf0f9c" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:26.643396 20126 leader_election.cc:304] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:26.644840 20494 raft_consensus.cc:3060] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.647145 20507 consensus_queue.cc:1048] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.653143 20294 raft_consensus.cc:2749] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:26.651530 20282 raft_consensus.cc:359] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:26.659770 20282 raft_consensus.cc:385] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:26.660147 20282 raft_consensus.cc:740] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:26.660873 20282 consensus_queue.cc:260] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:26.664559 20362 raft_consensus.cc:515] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.668059 20362 leader_election.cc:290] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:26.669166 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3651ee11a6184a34bed06bc86be62c29" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:26.672539 20158 raft_consensus.cc:3060] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.672780 20286 ts_tablet_manager.cc:1434] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:24:26.673331 20494 raft_consensus.cc:2749] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:26.675396 20286 tablet_bootstrap.cc:492] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:26.680308 20158 raft_consensus.cc:2468] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:26.681689 20051 leader_election.cc:304] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:26.669076 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3651ee11a6184a34bed06bc86be62c29" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:26.682523 20286 tablet_bootstrap.cc:654] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:26.673743 20282 ts_tablet_manager.cc:1434] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 12:24:26.686486 20507 raft_consensus.cc:2804] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:26.687086 20507 raft_consensus.cc:697] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:26.688294 20315 consensus_queue.cc:1048] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.688838 20282 tablet_bootstrap.cc:492] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
W20260709 12:24:26.683696 20050 leader_election.cc:343] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:26.692739 20494 consensus_queue.cc:1048] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.695850 20486 consensus_queue.cc:1048] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.688071 20507 consensus_queue.cc:237] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.671726 20472 raft_consensus.cc:515] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:26.697407 20282 tablet_bootstrap.cc:654] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:26.700326 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af265a90671a46cbafb3fced0f952aef" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:26.700680 20472 leader_election.cc:290] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:26.701072 20162 raft_consensus.cc:3060] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.700326 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af265a90671a46cbafb3fced0f952aef" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:26.704744 20236 raft_consensus.cc:3060] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.707582 19907 catalog_manager.cc:5697] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 0 to 1, leader changed from <none> to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 1 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:26.712302 20285 tablet_bootstrap.cc:492] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:26.718958 20285 ts_tablet_manager.cc:1403] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.173s	user 0.020s	sys 0.015s
I20260709 12:24:26.715072 20282 tablet_bootstrap.cc:492] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:26.719656 20282 ts_tablet_manager.cc:1403] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.000s
I20260709 12:24:26.722750 20282 raft_consensus.cc:359] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.723533 20282 raft_consensus.cc:385] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:26.723800 20282 raft_consensus.cc:740] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:26.724670 20287 tablet_bootstrap.cc:492] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:26.725201 20287 ts_tablet_manager.cc:1403] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.127s	user 0.014s	sys 0.004s
W20260709 12:24:26.725571 20051 consensus_peers.cc:597] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b -> Peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Couldn't send request to peer 45ea8ca532304a8f9ffda636d59f6f0f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:26.726527 20282 consensus_queue.cc:260] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.728042 20287 raft_consensus.cc:359] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:26.728775 20287 raft_consensus.cc:385] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:26.729060 20282 ts_tablet_manager.cc:1434] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:24:26.730222 20282 tablet_bootstrap.cc:492] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:26.729050 20287 raft_consensus.cc:740] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:26.731189 20287 consensus_queue.cc:260] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:26.734005 20162 raft_consensus.cc:2468] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 1.
I20260709 12:24:26.741174 19976 leader_election.cc:304] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: 
I20260709 12:24:26.734180 20287 ts_tablet_manager.cc:1434] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:24:26.736831 20236 raft_consensus.cc:2468] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 1.
I20260709 12:24:26.742889 20287 tablet_bootstrap.cc:492] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:26.739356 20286 tablet_bootstrap.cc:492] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:26.744462 20472 raft_consensus.cc:2804] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:26.745308 20472 raft_consensus.cc:697] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [term 1 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:26.744699 20286 ts_tablet_manager.cc:1403] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.070s	user 0.011s	sys 0.004s
I20260709 12:24:26.747304 20282 tablet_bootstrap.cc:654] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:26.756625 20287 tablet_bootstrap.cc:654] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:26.749552 19906 catalog_manager.cc:5697] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 0 to 1, leader changed from <none> to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 1 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:26.754622 20282 tablet_bootstrap.cc:492] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:26.760782 20282 ts_tablet_manager.cc:1403] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.000s
I20260709 12:24:26.761624 20315 raft_consensus.cc:493] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.762154 20315 raft_consensus.cc:515] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:26.722333 20285 raft_consensus.cc:359] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.764078 20285 raft_consensus.cc:385] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:26.766213 20285 raft_consensus.cc:740] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:26.767138 20285 consensus_queue.cc:260] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.754212 20286 raft_consensus.cc:359] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.768317 20286 raft_consensus.cc:385] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:26.768626 20286 raft_consensus.cc:740] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:26.775101 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528817cd200941fb84e40c79dbd16261" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:26.776703 20162 raft_consensus.cc:2468] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:26.778959 20051 leader_election.cc:304] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:26.779776 20282 raft_consensus.cc:359] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:26.780408 20294 raft_consensus.cc:2804] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:26.780643 20282 raft_consensus.cc:385] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:26.781123 20294 raft_consensus.cc:493] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.781188 20282 raft_consensus.cc:740] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:26.781685 20294 raft_consensus.cc:3060] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.781725 20315 leader_election.cc:290] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:26.782290 20282 consensus_queue.cc:260] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:26.783638 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528817cd200941fb84e40c79dbd16261" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
W20260709 12:24:26.785207 20049 leader_election.cc:343] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:26.786303 20286 consensus_queue.cc:260] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.788450 20282 ts_tablet_manager.cc:1434] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.004s
I20260709 12:24:26.790287 20282 tablet_bootstrap.cc:492] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:26.790442 20286 ts_tablet_manager.cc:1434] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.001s
I20260709 12:24:26.791460 20286 tablet_bootstrap.cc:492] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:26.760281 20472 consensus_queue.cc:237] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:26.796182 20282 tablet_bootstrap.cc:654] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:26.799382 20294 raft_consensus.cc:515] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:26.808789 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528817cd200941fb84e40c79dbd16261" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:26.809516 20162 raft_consensus.cc:3060] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.818372 20282 tablet_bootstrap.cc:492] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:26.819103 20507 consensus_queue.cc:1048] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:26.818584 19906 catalog_manager.cc:5697] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:26.819089 20282 ts_tablet_manager.cc:1403] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.004s
I20260709 12:24:26.824805 20282 raft_consensus.cc:359] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.825606 20282 raft_consensus.cc:385] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:26.825929 20282 raft_consensus.cc:740] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:26.826664 20282 consensus_queue.cc:260] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.828863 20282 ts_tablet_manager.cc:1434] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:26.829873 20282 tablet_bootstrap.cc:492] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:26.835943 20282 tablet_bootstrap.cc:654] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:26.843158 20162 raft_consensus.cc:2468] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:26.853787 20051 leader_election.cc:304] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:26.854652 20507 raft_consensus.cc:2804] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:26.855136 20507 raft_consensus.cc:697] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:26.857128 20507 consensus_queue.cc:237] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:26.859164 20282 tablet_bootstrap.cc:492] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:26.859498 20492 raft_consensus.cc:493] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.859721 20282 ts_tablet_manager.cc:1403] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.002s
I20260709 12:24:26.843503 20286 tablet_bootstrap.cc:654] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:26.848675 20287 tablet_bootstrap.cc:492] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:26.849846 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528817cd200941fb84e40c79dbd16261" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:26.860677 20287 ts_tablet_manager.cc:1403] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.118s	user 0.014s	sys 0.021s
I20260709 12:24:26.862640 20282 raft_consensus.cc:359] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.863466 20282 raft_consensus.cc:385] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:26.863791 20282 raft_consensus.cc:740] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:26.864174 20492 raft_consensus.cc:515] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
W20260709 12:24:26.862522 20049 leader_election.cc:343] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:26.864590 20282 consensus_queue.cc:260] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.866434 20492 leader_election.cc:290] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:26.867040 20282 ts_tablet_manager.cc:1434] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:26.863524 20287 raft_consensus.cc:359] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:26.868462 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd398fffdf6d468f88108a6a7bec0681" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:26.869246 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd398fffdf6d468f88108a6a7bec0681" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:26.850353 20294 leader_election.cc:290] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:26.870597 20287 raft_consensus.cc:385] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:26.871691 20287 raft_consensus.cc:740] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:26.872581 20282 tablet_bootstrap.cc:492] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:26.873569 20287 consensus_queue.cc:260] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:26.876641 20287 ts_tablet_manager.cc:1434] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:24:26.877625 20287 tablet_bootstrap.cc:492] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
W20260709 12:24:26.877966 20201 leader_election.cc:343] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:26.873453 20008 raft_consensus.cc:2468] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
I20260709 12:24:26.885908 20287 tablet_bootstrap.cc:654] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:26.887053 20200 leader_election.cc:304] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:24:26.888283 20492 raft_consensus.cc:2804] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:26.895444 20494 raft_consensus.cc:493] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.892697 20492 raft_consensus.cc:493] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.896041 20494 raft_consensus.cc:515] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.896636 20492 raft_consensus.cc:3060] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.898181 20494 leader_election.cc:290] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:26.899962 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac5e9dcbf74c29aa24300975246ad3" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:26.900686 20086 raft_consensus.cc:2468] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 0.
I20260709 12:24:26.901129 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac5e9dcbf74c29aa24300975246ad3" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
W20260709 12:24:26.904397 20125 leader_election.cc:343] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:26.906621 20126 leader_election.cc:304] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:26.908385 20494 raft_consensus.cc:2804] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:26.908877 20494 raft_consensus.cc:493] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.909191 20494 raft_consensus.cc:3060] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.913347 20492 raft_consensus.cc:515] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:26.920468 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd398fffdf6d468f88108a6a7bec0681" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:26.921721 20008 raft_consensus.cc:3060] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.923414 20374 consensus_queue.cc:1048] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:26.921542 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd398fffdf6d468f88108a6a7bec0681" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
W20260709 12:24:26.926087 20201 leader_election.cc:343] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:26.929282 20008 raft_consensus.cc:2468] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:26.930596 20200 leader_election.cc:304] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:24:26.931872 20491 raft_consensus.cc:2804] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:26.932492 20491 raft_consensus.cc:697] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:26.933473 20492 leader_election.cc:290] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:26.933334 20491 consensus_queue.cc:237] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:26.934731 20494 raft_consensus.cc:515] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.937119 20282 tablet_bootstrap.cc:654] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:26.949656 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac5e9dcbf74c29aa24300975246ad3" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:26.951450 20285 ts_tablet_manager.cc:1434] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.232s	user 0.009s	sys 0.038s
W20260709 12:24:26.951336 20125 leader_election.cc:343] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:26.951259 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac5e9dcbf74c29aa24300975246ad3" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:26.953256 20085 raft_consensus.cc:3060] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.956403 20286 tablet_bootstrap.cc:492] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:26.960050 19907 catalog_manager.cc:5697] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 0 to 1, leader changed from <none> to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 1 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:26.962165 20085 raft_consensus.cc:2468] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:24:26.963817 20126 leader_election.cc:304] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:26.964751 20486 raft_consensus.cc:2804] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:26.964763 20494 leader_election.cc:290] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:26.965317 20486 raft_consensus.cc:697] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:26.967238 20486 consensus_queue.cc:237] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:26.983587 20494 consensus_queue.cc:1048] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.984390 20294 consensus_queue.cc:1048] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.986187 20287 tablet_bootstrap.cc:492] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:26.986809 20287 ts_tablet_manager.cc:1403] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.109s	user 0.020s	sys 0.000s
I20260709 12:24:26.989593 20285 tablet_bootstrap.cc:492] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:26.997891 20286 ts_tablet_manager.cc:1403] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.207s	user 0.013s	sys 0.018s
I20260709 12:24:27.001365 20286 raft_consensus.cc:359] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:27.007220 20286 raft_consensus.cc:385] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:27.007848 20286 raft_consensus.cc:740] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:27.008555 20282 tablet_bootstrap.cc:492] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:27.009940 20285 tablet_bootstrap.cc:654] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:27.008749 20286 consensus_queue.cc:260] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:27.013280 19908 catalog_manager.cc:5697] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 1 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:27.014293 20286 ts_tablet_manager.cc:1434] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 12:24:27.015292 20286 tablet_bootstrap.cc:492] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:27.016042 20489 consensus_queue.cc:1048] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:27.019457 20282 ts_tablet_manager.cc:1403] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.148s	user 0.011s	sys 0.018s
I20260709 12:24:27.019613 20287 raft_consensus.cc:359] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.021778 20287 raft_consensus.cc:385] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:27.022184 20287 raft_consensus.cc:740] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:27.022533 20282 raft_consensus.cc:359] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:27.023260 20282 raft_consensus.cc:385] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:27.022943 20287 consensus_queue.cc:260] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.025801 20287 ts_tablet_manager.cc:1434] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:24:27.026751 20287 tablet_bootstrap.cc:492] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:27.023563 20282 raft_consensus.cc:740] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:27.030509 20282 consensus_queue.cc:260] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:27.033463 20282 ts_tablet_manager.cc:1434] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 12:24:27.034467 20282 tablet_bootstrap.cc:492] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:27.037151 20322 raft_consensus.cc:493] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.037866 20286 tablet_bootstrap.cc:654] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:27.037712 20322 raft_consensus.cc:515] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:27.040702 20322 leader_election.cc:290] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:27.041249 20322 raft_consensus.cc:493] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.041725 20322 raft_consensus.cc:515] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:27.045883 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0988a236f3934f8692fd434098766112" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:27.046599 20162 raft_consensus.cc:2468] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
I20260709 12:24:27.045922 20322 leader_election.cc:290] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:27.048377 19906 catalog_manager.cc:5697] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 1 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:27.053547 20287 tablet_bootstrap.cc:654] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:27.054817 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0252a8e0d9ac4440b3affdcbf4cf2246" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:27.058718 20282 tablet_bootstrap.cc:654] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:27.062495 20201 leader_election.cc:304] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:27.067565 20286 tablet_bootstrap.cc:492] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:27.068126 20286 ts_tablet_manager.cc:1403] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.008s
I20260709 12:24:27.070802 20286 raft_consensus.cc:359] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.071480 20286 raft_consensus.cc:385] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:27.074093 20287 tablet_bootstrap.cc:492] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:27.074657 20287 ts_tablet_manager.cc:1403] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 12:24:27.078790 20282 tablet_bootstrap.cc:492] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:27.078518 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0252a8e0d9ac4440b3affdcbf4cf2246" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:27.079299 20282 ts_tablet_manager.cc:1403] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 12:24:27.079334 20085 raft_consensus.cc:2468] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
I20260709 12:24:27.080761 20533 raft_consensus.cc:493] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.081322 20533 raft_consensus.cc:515] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:27.081517 20287 raft_consensus.cc:359] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.082249 20287 raft_consensus.cc:385] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:27.082540 20287 raft_consensus.cc:740] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:27.083499 20201 leader_election.cc:304] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:27.085071 20359 raft_consensus.cc:2804] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:27.085294 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0988a236f3934f8692fd434098766112" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:27.071740 20286 raft_consensus.cc:740] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:27.086169 20011 raft_consensus.cc:2468] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
I20260709 12:24:27.083171 20492 raft_consensus.cc:2804] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:27.086517 20286 consensus_queue.cc:260] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.083168 20287 consensus_queue.cc:260] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.087098 20492 raft_consensus.cc:493] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.089991 20287 ts_tablet_manager.cc:1434] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:24:27.090178 20359 raft_consensus.cc:493] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.090677 20359 raft_consensus.cc:3060] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:27.091101 20287 tablet_bootstrap.cc:492] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:27.085716 20282 raft_consensus.cc:359] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:27.092486 20282 raft_consensus.cc:385] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:27.092787 20282 raft_consensus.cc:740] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:27.090085 20492 raft_consensus.cc:3060] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:27.089799 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995e00d57e1040b7b6d193c60fd84405" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:27.097051 20085 raft_consensus.cc:2468] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 0.
I20260709 12:24:27.098582 19976 leader_election.cc:304] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:27.099545 20411 raft_consensus.cc:2804] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:27.099958 20411 raft_consensus.cc:493] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.100286 20411 raft_consensus.cc:3060] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:27.101079 20322 raft_consensus.cc:493] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.101613 20322 raft_consensus.cc:515] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.103637 20287 tablet_bootstrap.cc:654] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:27.104012 20200 leader_election.cc:343] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:27.104833 20533 leader_election.cc:290] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:27.103679 20322 leader_election.cc:290] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:27.107923 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995e00d57e1040b7b6d193c60fd84405" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:27.108656 20162 raft_consensus.cc:2468] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 0.
I20260709 12:24:27.110357 20286 ts_tablet_manager.cc:1434] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 12:24:27.110594 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c5a6e3d37c46f585ebd85003fbe15a" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:27.111337 20286 tablet_bootstrap.cc:492] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:27.106050 20359 raft_consensus.cc:515] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:27.119968 20282 consensus_queue.cc:260] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:27.123056 20359 leader_election.cc:290] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:27.125422 20374 raft_consensus.cc:493] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.125936 20374 raft_consensus.cc:515] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.125083 20282 ts_tablet_manager.cc:1434] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.002s
I20260709 12:24:27.127563 20282 tablet_bootstrap.cc:492] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:27.128798 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2234eae9544c8898b57db26f4533d3" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:27.118568 20411 raft_consensus.cc:515] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:27.125082 20507 consensus_queue.cc:1048] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:24:27.133188 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995e00d57e1040b7b6d193c60fd84405" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:27.133903 20085 raft_consensus.cc:3060] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:27.130295 20051 leader_election.cc:343] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:27.133507 20286 tablet_bootstrap.cc:654] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:27.139783 20282 tablet_bootstrap.cc:654] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:27.138610 20374 leader_election.cc:290] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:27.142905 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995e00d57e1040b7b6d193c60fd84405" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:27.143677 20162 raft_consensus.cc:3060] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:27.145231 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c5a6e3d37c46f585ebd85003fbe15a" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:27.151454 20286 tablet_bootstrap.cc:492] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:27.152009 20286 ts_tablet_manager.cc:1403] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.003s
I20260709 12:24:27.157810 20282 tablet_bootstrap.cc:492] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:27.157934 20085 raft_consensus.cc:2468] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 1.
I20260709 12:24:27.159418 19976 leader_election.cc:304] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:27.160578 20533 raft_consensus.cc:2804] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:27.161084 20533 raft_consensus.cc:697] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [term 1 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:27.162019 20533 consensus_queue.cc:237] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:27.163817 20282 ts_tablet_manager.cc:1403] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.000s
I20260709 12:24:27.167802 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0252a8e0d9ac4440b3affdcbf4cf2246" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:27.168545 20086 raft_consensus.cc:3060] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:27.171326 20282 raft_consensus.cc:359] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.172104 20282 raft_consensus.cc:385] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:27.172405 20282 raft_consensus.cc:740] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:27.173231 20282 consensus_queue.cc:260] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.178603 20282 ts_tablet_manager.cc:1434] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:24:27.179744 20282 tablet_bootstrap.cc:492] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:27.179991 20411 leader_election.cc:290] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:27.185451 20086 raft_consensus.cc:2468] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:27.185786 20282 tablet_bootstrap.cc:654] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:27.159745 20201 leader_election.cc:343] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:27.187536 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0252a8e0d9ac4440b3affdcbf4cf2246" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
W20260709 12:24:27.198771 20201 leader_election.cc:343] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:27.199397 20201 leader_election.cc:304] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:27.200331 20491 raft_consensus.cc:2749] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:27.183897 20162 raft_consensus.cc:2468] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 1.
W20260709 12:24:27.193120 20050 consensus_peers.cc:597] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:27.203893 20200 leader_election.cc:343] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:27.208037 20282 tablet_bootstrap.cc:492] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:27.208653 20282 ts_tablet_manager.cc:1403] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.000s
I20260709 12:24:27.193041 20411 consensus_queue.cc:1048] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:27.211365 20489 raft_consensus.cc:493] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.211907 20489 raft_consensus.cc:515] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:27.214041 20489 leader_election.cc:290] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:27.151245 20492 raft_consensus.cc:515] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:27.219129 20533 consensus_queue.cc:1048] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:27.220887 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0988a236f3934f8692fd434098766112" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:27.221925 20010 raft_consensus.cc:3060] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:27.222993 20282 raft_consensus.cc:359] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.223591 20282 raft_consensus.cc:385] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:27.223835 20282 raft_consensus.cc:740] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:27.224717 20282 consensus_queue.cc:260] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.225875 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141c2e84c15e4ad38afc0a52b330f9b9" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:27.226747 20486 raft_consensus.cc:493] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.227674 20486 raft_consensus.cc:515] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:27.191617 20286 raft_consensus.cc:359] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.229063 20286 raft_consensus.cc:385] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:27.229434 20286 raft_consensus.cc:740] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:27.231442 20282 ts_tablet_manager.cc:1434] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.005s
I20260709 12:24:27.232688 20282 tablet_bootstrap.cc:492] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:27.238379 20286 consensus_queue.cc:260] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.233189 20492 leader_election.cc:290] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:27.246094 20286 ts_tablet_manager.cc:1434] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.001s
W20260709 12:24:27.242666 20125 leader_election.cc:343] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:27.255774 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71a18e780d74303884e208106817dec" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:27.256942 20285 tablet_bootstrap.cc:492] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:27.257532 20285 ts_tablet_manager.cc:1403] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.268s	user 0.054s	sys 0.055s
I20260709 12:24:27.257664 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141c2e84c15e4ad38afc0a52b330f9b9" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:27.262533 20286 tablet_bootstrap.cc:492] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:27.265391 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2234eae9544c8898b57db26f4533d3" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:27.265599 20285 raft_consensus.cc:359] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:27.266525 20285 raft_consensus.cc:385] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:27.266884 20285 raft_consensus.cc:740] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
W20260709 12:24:27.263759 20125 leader_election.cc:343] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:27.268338 20285 consensus_queue.cc:260] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:27.269224 20374 raft_consensus.cc:493] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.269626 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0988a236f3934f8692fd434098766112" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:27.269766 20374 raft_consensus.cc:515] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.270299 20158 raft_consensus.cc:3060] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:27.270682 20285 ts_tablet_manager.cc:1434] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 12:24:27.271549 20282 tablet_bootstrap.cc:654] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:27.272410 20285 tablet_bootstrap.cc:492] T 0252a8e0d9ac4440b3affdcbf4cf2246 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
W20260709 12:24:27.275149 20124 leader_election.cc:343] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:27.281432 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71a18e780d74303884e208106817dec" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:27.281495 20124 leader_election.cc:304] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:27.283223 20010 raft_consensus.cc:2468] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:27.277500 20201 leader_election.cc:304] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:27.284045 20489 raft_consensus.cc:2749] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:27.284346 20492 raft_consensus.cc:2804] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:27.285063 20492 raft_consensus.cc:697] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:27.280510 20486 leader_election.cc:290] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:27.285943 20492 consensus_queue.cc:237] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
W20260709 12:24:27.285247 20126 leader_election.cc:343] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:27.287603 20126 leader_election.cc:304] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:27.289373 20157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c5a6e3d37c46f585ebd85003fbe15a" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:27.290134 20157 raft_consensus.cc:2468] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:27.293424 20287 tablet_bootstrap.cc:492] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:27.294087 20287 ts_tablet_manager.cc:1403] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.203s	user 0.023s	sys 0.041s
I20260709 12:24:27.288379 20158 raft_consensus.cc:2468] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:27.287683 20374 leader_election.cc:290] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:27.293462 20486 raft_consensus.cc:2749] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:27.301957 20051 leader_election.cc:304] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:27.308581 20287 raft_consensus.cc:359] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:27.309365 20287 raft_consensus.cc:385] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:27.309636 20287 raft_consensus.cc:740] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:27.310508 20287 consensus_queue.cc:260] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:27.317242 20286 tablet_bootstrap.cc:654] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:27.315358 20049 leader_election.cc:343] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:27.324146 20200 leader_election.cc:304] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:27.331002 20322 raft_consensus.cc:2804] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:27.330202 20491 raft_consensus.cc:493] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.332216 20491 raft_consensus.cc:515] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.334337 20491 leader_election.cc:290] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:27.320545 20374 raft_consensus.cc:2804] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:27.336020 20374 raft_consensus.cc:493] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.336434 20374 raft_consensus.cc:3060] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:27.341812 20287 ts_tablet_manager.cc:1434] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.003s
I20260709 12:24:27.345094 20158 raft_consensus.cc:3060] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:27.350368 20287 tablet_bootstrap.cc:492] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:27.349431 20359 raft_consensus.cc:493] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.351488 20359 raft_consensus.cc:515] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.354516 20359 leader_election.cc:290] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:27.357221 19907 catalog_manager.cc:5697] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:27.349850 20049 leader_election.cc:304] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:27.369184 20315 raft_consensus.cc:2749] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:27.358860 20322 raft_consensus.cc:697] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:27.369211 20285 tablet_bootstrap.cc:654] T 0252a8e0d9ac4440b3affdcbf4cf2246 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:27.374243 20049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:39155, user_credentials={real_user=slave}} blocked reactor thread for 58954.2us
I20260709 12:24:27.375694 20287 tablet_bootstrap.cc:654] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:27.398526 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c5a6e3d37c46f585ebd85003fbe15a" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:27.398967 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528817cd200941fb84e40c79dbd16261" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:27.400063 20161 raft_consensus.cc:2393] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c470740d41ee4b9383923d08a87655d6 in current term 1: Already voted for candidate aac061e592d74289800e4c50cbb4132b in this term.
I20260709 12:24:27.401559 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528817cd200941fb84e40c79dbd16261" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:27.402971 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1127f55bd43a4c988dfd61547a03b3fa" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:27.405755 20374 raft_consensus.cc:515] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.410465 20322 consensus_queue.cc:237] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:27.410820 20564 consensus_queue.cc:1048] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:27.402889 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1127f55bd43a4c988dfd61547a03b3fa" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:27.413705 20236 raft_consensus.cc:2468] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:27.416347 20374 leader_election.cc:290] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:27.417048 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c5a6e3d37c46f585ebd85003fbe15a" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:27.417706 20162 raft_consensus.cc:3060] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:27.420637 20286 tablet_bootstrap.cc:492] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:27.421172 20286 ts_tablet_manager.cc:1403] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.159s	user 0.019s	sys 0.006s
I20260709 12:24:27.423534 20486 raft_consensus.cc:493] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:27.424134 20486 raft_consensus.cc:515] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.424307 20286 raft_consensus.cc:359] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:27.425051 20236 raft_consensus.cc:3060] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:27.425410 20286 raft_consensus.cc:385] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:27.425957 20286 raft_consensus.cc:740] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:27.427026 20286 consensus_queue.cc:260] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:27.430145 20162 raft_consensus.cc:2468] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:27.438370 20286 ts_tablet_manager.cc:1434] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:24:27.440079 20286 tablet_bootstrap.cc:492] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:27.441861 20051 leader_election.cc:304] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:27.443230 20374 raft_consensus.cc:2804] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:27.443737 20374 raft_consensus.cc:697] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
W20260709 12:24:27.444096 20125 consensus_peers.cc:597] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:27.444564 20374 consensus_queue.cc:237] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
W20260709 12:24:27.445659 20201 consensus_peers.cc:597] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:27.446580 20201 leader_election.cc:343] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:27.447239 20201 leader_election.cc:304] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:27.444926 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c5a6e3d37c46f585ebd85003fbe15a" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:27.450837 20234 raft_consensus.cc:3060] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:27.450363 20285 tablet_bootstrap.cc:492] T 0252a8e0d9ac4440b3affdcbf4cf2246 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:27.452615 20285 ts_tablet_manager.cc:1403] T 0252a8e0d9ac4440b3affdcbf4cf2246 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.181s	user 0.008s	sys 0.012s
I20260709 12:24:27.454514 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5038da47868e47148f6dda5d135f60fa" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:27.461316 20282 tablet_bootstrap.cc:492] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:27.461892 20282 ts_tablet_manager.cc:1403] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.229s	user 0.029s	sys 0.015s
I20260709 12:24:27.462945 20362 consensus_queue.cc:1048] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:27.464744 20282 raft_consensus.cc:359] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.465448 20282 raft_consensus.cc:385] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:27.465708 20282 raft_consensus.cc:740] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:27.466428 20282 consensus_queue.cc:260] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.467993 20486 leader_election.cc:290] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:27.468608 20234 raft_consensus.cc:2468] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:27.470677 20287 tablet_bootstrap.cc:492] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:27.471304 20287 ts_tablet_manager.cc:1403] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.129s	user 0.012s	sys 0.006s
I20260709 12:24:27.455717 20285 raft_consensus.cc:359] T 0252a8e0d9ac4440b3affdcbf4cf2246 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:27.474504 20285 raft_consensus.cc:385] T 0252a8e0d9ac4440b3affdcbf4cf2246 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:27.474813 20285 raft_consensus.cc:740] T 0252a8e0d9ac4440b3affdcbf4cf2246 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:27.475592 20285 consensus_queue.cc:260] T 0252a8e0d9ac4440b3affdcbf4cf2246 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:27.477957 20285 ts_tablet_manager.cc:1434] T 0252a8e0d9ac4440b3affdcbf4cf2246 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:24:27.479137 20285 tablet_bootstrap.cc:492] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:27.480443 20282 ts_tablet_manager.cc:1434] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:24:27.481690 20282 tablet_bootstrap.cc:492] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:27.482424 20564 raft_consensus.cc:2749] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:27.484202 20287 raft_consensus.cc:359] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:27.486434 20494 consensus_queue.cc:1048] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:24:27.492257 20201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40749, user_credentials={real_user=slave}} blocked reactor thread for 45090.9us
I20260709 12:24:27.494051 20287 raft_consensus.cc:385] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:27.495438 20287 raft_consensus.cc:740] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:27.499351 20287 consensus_queue.cc:260] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:27.494457 20486 raft_consensus.cc:493] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.508108 20359 raft_consensus.cc:493] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.508684 20359 raft_consensus.cc:515] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:27.510429 20486 raft_consensus.cc:515] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
W20260709 12:24:27.504904 20201 leader_election.cc:343] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:27.513695 20201 leader_election.cc:304] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:27.514725 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:27.516084 20287 ts_tablet_manager.cc:1434] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:24:27.516252 20006 raft_consensus.cc:2468] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
I20260709 12:24:27.517614 20564 raft_consensus.cc:2749] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:27.520153 20287 tablet_bootstrap.cc:492] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:27.522006 20200 leader_election.cc:304] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:27.523007 20492 raft_consensus.cc:2804] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:27.520756 20494 raft_consensus.cc:493] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.525128 20492 raft_consensus.cc:493] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.535724 20492 raft_consensus.cc:3060] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:27.533957 20494 raft_consensus.cc:515] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.542991 20359 leader_election.cc:290] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:27.544135 20374 consensus_queue.cc:1048] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:27.548961 20486 leader_election.cc:290] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:27.550129 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b96b6be45d43b6aceaf2afe76d79e4" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
W20260709 12:24:27.551905 20125 leader_election.cc:343] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:27.562924 20285 tablet_bootstrap.cc:654] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:27.564121 19956 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:27.567373 20287 tablet_bootstrap.cc:654] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:27.570334 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5038da47868e47148f6dda5d135f60fa" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:27.568897 19908 catalog_manager.cc:5697] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 1 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:27.571467 20286 tablet_bootstrap.cc:654] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:27.572372 19908 catalog_manager.cc:5697] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 1 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:27.582427 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b96b6be45d43b6aceaf2afe76d79e4" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:27.596675 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2234eae9544c8898b57db26f4533d3" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:27.597510 20086 raft_consensus.cc:2468] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 0.
I20260709 12:24:27.598637 20126 leader_election.cc:304] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:27.599618 20489 raft_consensus.cc:2804] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:27.600039 20489 raft_consensus.cc:493] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.600358 20489 raft_consensus.cc:3060] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:27.606282 20534 consensus_queue.cc:1048] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:27.611442 20494 leader_election.cc:290] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:27.613524 20534 raft_consensus.cc:493] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.618002 19908 catalog_manager.cc:5697] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 0 to 1, leader changed from <none> to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 1 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:27.616170 20534 raft_consensus.cc:515] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:27.630172 20534 leader_election.cc:290] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:27.632306 20282 tablet_bootstrap.cc:654] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:27.631625 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141c2e84c15e4ad38afc0a52b330f9b9" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:27.634101 20162 raft_consensus.cc:2468] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 0.
I20260709 12:24:27.635424 19976 leader_election.cc:304] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: 
I20260709 12:24:27.638985 20534 raft_consensus.cc:2804] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:27.639930 20534 raft_consensus.cc:493] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.640368 20534 raft_consensus.cc:3060] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:27.644347 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141c2e84c15e4ad38afc0a52b330f9b9" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:27.645136 20236 raft_consensus.cc:2468] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 0.
I20260709 12:24:27.654703 20287 tablet_bootstrap.cc:492] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:27.655207 20287 ts_tablet_manager.cc:1403] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.135s	user 0.016s	sys 0.020s
I20260709 12:24:27.611807 20489 raft_consensus.cc:515] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.661471 20287 raft_consensus.cc:359] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:27.662264 20287 raft_consensus.cc:385] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:27.662571 20287 raft_consensus.cc:740] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:27.661918 20124 leader_election.cc:304] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:27.664752 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:27.665454 20084 raft_consensus.cc:2468] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
I20260709 12:24:27.665320 20494 raft_consensus.cc:2749] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:27.667333 20232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2234eae9544c8898b57db26f4533d3" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:27.659106 20492 raft_consensus.cc:515] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:27.672222 20492 leader_election.cc:290] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:27.663239 20287 consensus_queue.cc:260] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:27.679212 20489 leader_election.cc:290] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:27.675486 20534 raft_consensus.cc:515] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:27.681767 20534 leader_election.cc:290] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:27.682751 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141c2e84c15e4ad38afc0a52b330f9b9" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
W20260709 12:24:27.691708 20124 leader_election.cc:343] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:27.686120 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:27.700975 20158 raft_consensus.cc:3060] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:27.683748 20287 ts_tablet_manager.cc:1434] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 12:24:27.701177 20124 leader_election.cc:304] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:27.688230 20286 tablet_bootstrap.cc:492] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
W20260709 12:24:27.702962 20124 leader_election.cc:343] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:27.703213 20286 ts_tablet_manager.cc:1403] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.263s	user 0.018s	sys 0.013s
I20260709 12:24:27.684307 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2234eae9544c8898b57db26f4533d3" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:27.706069 20084 raft_consensus.cc:3060] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:27.706682 20286 raft_consensus.cc:359] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:27.707479 20286 raft_consensus.cc:385] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:27.707768 20286 raft_consensus.cc:740] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:27.708180 20008 raft_consensus.cc:3060] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:27.708560 20286 consensus_queue.cc:260] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:27.710721 20286 ts_tablet_manager.cc:1434] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:24:27.711804 20286 tablet_bootstrap.cc:492] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:27.712311 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141c2e84c15e4ad38afc0a52b330f9b9" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:27.713056 20236 raft_consensus.cc:3060] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:27.718318 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:27.702497 20287 tablet_bootstrap.cc:492] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:27.705627 20578 raft_consensus.cc:2749] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:27.735060 20287 tablet_bootstrap.cc:654] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:27.723425 20158 raft_consensus.cc:2468] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 1.
I20260709 12:24:27.723893 20232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2234eae9544c8898b57db26f4533d3" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:27.727380 20286 tablet_bootstrap.cc:654] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:27.738937 20008 raft_consensus.cc:2468] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:27.739147 19976 leader_election.cc:304] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: 
I20260709 12:24:27.743191 20534 raft_consensus.cc:2804] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:27.743801 20534 raft_consensus.cc:697] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [term 1 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:27.744666 20534 consensus_queue.cc:237] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:27.748752 20086 raft_consensus.cc:3060] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:27.745241 20200 leader_election.cc:304] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:27.769301 20282 tablet_bootstrap.cc:492] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:27.768289 20359 raft_consensus.cc:2804] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:27.772266 20006 raft_consensus.cc:3060] T 0252a8e0d9ac4440b3affdcbf4cf2246 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:27.773422 20282 ts_tablet_manager.cc:1403] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.292s	user 0.017s	sys 0.000s
I20260709 12:24:27.772944 20359 raft_consensus.cc:697] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
W20260709 12:24:27.778177 20124 leader_election.cc:343] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:27.793510 20359 consensus_queue.cc:237] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:27.802595 20285 tablet_bootstrap.cc:492] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:27.803157 20285 ts_tablet_manager.cc:1403] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.324s	user 0.029s	sys 0.026s
I20260709 12:24:27.807483 20285 raft_consensus.cc:359] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:27.808226 20285 raft_consensus.cc:385] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:27.808648 20285 raft_consensus.cc:740] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:27.809289 20285 consensus_queue.cc:260] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:27.811514 20285 ts_tablet_manager.cc:1434] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.000s
I20260709 12:24:27.812592 20285 tablet_bootstrap.cc:492] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:27.814894 20411 consensus_queue.cc:1048] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:27.819607 20287 tablet_bootstrap.cc:492] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:27.820266 20287 ts_tablet_manager.cc:1403] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.118s	user 0.007s	sys 0.015s
I20260709 12:24:27.822157 20286 tablet_bootstrap.cc:492] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:27.822827 20286 ts_tablet_manager.cc:1403] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.111s	user 0.014s	sys 0.012s
I20260709 12:24:27.826797 20286 raft_consensus.cc:359] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.827622 20286 raft_consensus.cc:385] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:27.823619 20287 raft_consensus.cc:359] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.828636 19908 catalog_manager.cc:5697] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:27.831341 20286 raft_consensus.cc:740] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:27.835651 20286 consensus_queue.cc:260] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.836246 20322 consensus_queue.cc:1048] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:27.838356 20286 ts_tablet_manager.cc:1434] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:24:27.839926 20286 tablet_bootstrap.cc:492] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:27.844659 20282 raft_consensus.cc:359] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.838806 20285 tablet_bootstrap.cc:654] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:27.845583 20282 raft_consensus.cc:385] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:27.831389 20287 raft_consensus.cc:385] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:27.845952 20282 raft_consensus.cc:740] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:27.847118 20287 raft_consensus.cc:740] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:27.848093 20286 tablet_bootstrap.cc:654] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:27.848641 20282 consensus_queue.cc:260] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.832659 20554 consensus_queue.cc:1048] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:24:27.850961 20282 ts_tablet_manager.cc:1434] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.077s	user 0.001s	sys 0.004s
I20260709 12:24:27.852161 20282 tablet_bootstrap.cc:492] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:27.849995 20287 consensus_queue.cc:260] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.857481 20554 consensus_queue.cc:1048] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:27.858683 20282 tablet_bootstrap.cc:654] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:27.864586 20287 ts_tablet_manager.cc:1434] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.000s
I20260709 12:24:27.870891 20287 tablet_bootstrap.cc:492] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:27.872599 20084 raft_consensus.cc:2468] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:24:27.888484 19908 catalog_manager.cc:5697] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 1 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:27.874320 20236 raft_consensus.cc:2468] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 1.
I20260709 12:24:27.914084 20126 leader_election.cc:304] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: c470740d41ee4b9383923d08a87655d6
I20260709 12:24:27.915340 20578 raft_consensus.cc:2804] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:27.917451 20578 raft_consensus.cc:697] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:27.918322 20578 consensus_queue.cc:237] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.921319 20362 raft_consensus.cc:493] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.922075 20362 raft_consensus.cc:515] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:27.924719 20362 leader_election.cc:290] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:27.926433 20232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8635d89e903c48a786062efb05feaa75" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:27.927435 20285 tablet_bootstrap.cc:492] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:27.933123 20285 ts_tablet_manager.cc:1403] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.121s	user 0.017s	sys 0.000s
I20260709 12:24:27.935029 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8635d89e903c48a786062efb05feaa75" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:27.936436 20232 raft_consensus.cc:2468] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:27.939044 20492 consensus_queue.cc:1048] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:24:27.940840 20050 leader_election.cc:343] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:27.915637 20086 raft_consensus.cc:2468] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:27.946523 20286 tablet_bootstrap.cc:492] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:27.947002 20286 ts_tablet_manager.cc:1403] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.107s	user 0.013s	sys 0.006s
I20260709 12:24:27.951905 20049 leader_election.cc:304] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:27.950016 20362 consensus_queue.cc:1048] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:24:27.955650 20362 raft_consensus.cc:2804] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:27.956102 20362 raft_consensus.cc:493] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.956446 20362 raft_consensus.cc:3060] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:27.962110 20287 tablet_bootstrap.cc:654] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:27.962630 20533 raft_consensus.cc:493] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.965405 20489 raft_consensus.cc:493] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.969318 20533 raft_consensus.cc:515] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:27.969898 20489 raft_consensus.cc:515] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.971807 20533 leader_election.cc:290] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:27.971935 20489 leader_election.cc:290] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:27.972749 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a52c50180741b9a6165c183733f3fa" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:27.973426 20232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a52c50180741b9a6165c183733f3fa" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:27.973999 20232 raft_consensus.cc:2468] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 0.
W20260709 12:24:27.974555 20126 leader_election.cc:343] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:27.975198 20124 leader_election.cc:304] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:24:27.966311 20285 raft_consensus.cc:359] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:27.975840 20285 raft_consensus.cc:385] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:27.976265 20489 raft_consensus.cc:2804] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:27.974568 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3651ee11a6184a34bed06bc86be62c29" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:27.976788 20489 raft_consensus.cc:493] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.976724 20285 raft_consensus.cc:740] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:27.977317 20489 raft_consensus.cc:3060] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:27.978011 20285 consensus_queue.cc:260] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:27.976480 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3651ee11a6184a34bed06bc86be62c29" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:27.980615 20285 ts_tablet_manager.cc:1434] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.001s
I20260709 12:24:27.981631 20285 tablet_bootstrap.cc:492] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:27.985210 20489 raft_consensus.cc:515] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:27.986591 19976 leader_election.cc:304] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:27.987850 20586 raft_consensus.cc:2749] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:27.988523 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a52c50180741b9a6165c183733f3fa" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:27.989640 20489 leader_election.cc:290] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:27.990192 20232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a52c50180741b9a6165c183733f3fa" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:27.990661 20232 raft_consensus.cc:3060] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:27.993472 20126 leader_election.cc:343] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:28.005788 20232 raft_consensus.cc:2468] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:24:28.007248 20124 leader_election.cc:304] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:24:28.008710 20489 raft_consensus.cc:2804] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:28.009456 20489 raft_consensus.cc:697] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:28.011314 20489 consensus_queue.cc:237] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:28.014492 20285 tablet_bootstrap.cc:654] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:28.088624 20286 raft_consensus.cc:359] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:28.090889 20286 raft_consensus.cc:385] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:28.091122 20286 raft_consensus.cc:740] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:28.093837 20315 raft_consensus.cc:493] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.094398 20315 raft_consensus.cc:515] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:28.096488 20315 leader_election.cc:290] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:28.100726 20286 consensus_queue.cc:260] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:28.102113 20282 tablet_bootstrap.cc:492] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:28.102749 20282 ts_tablet_manager.cc:1403] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.251s	user 0.014s	sys 0.007s
W20260709 12:24:28.093703 20590 log.cc:927] Time spent T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:24:28.116115 20287 tablet_bootstrap.cc:492] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:28.116757 20287 ts_tablet_manager.cc:1403] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.251s	user 0.011s	sys 0.014s
I20260709 12:24:28.122455 20157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1127f55bd43a4c988dfd61547a03b3fa" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:28.121325 20287 raft_consensus.cc:359] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:28.124197 20287 raft_consensus.cc:385] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:28.124516 20287 raft_consensus.cc:740] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:28.159888 20286 ts_tablet_manager.cc:1434] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.213s	user 0.010s	sys 0.000s
I20260709 12:24:28.161106 20286 tablet_bootstrap.cc:492] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:28.165628 20287 consensus_queue.cc:260] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:28.173549 20287 ts_tablet_manager.cc:1434] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.056s	user 0.004s	sys 0.003s
I20260709 12:24:28.174357 20287 tablet_bootstrap.cc:492] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:28.175248 20282 raft_consensus.cc:359] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:28.175838 20282 raft_consensus.cc:385] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:28.176119 20282 raft_consensus.cc:740] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
W20260709 12:24:28.166953 20051 leader_election.cc:343] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:28.178536 20282 consensus_queue.cc:260] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:28.189939 20282 ts_tablet_manager.cc:1434] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.087s	user 0.003s	sys 0.005s
I20260709 12:24:28.193773 20586 raft_consensus.cc:493] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.194963 20586 raft_consensus.cc:515] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:28.196646 20586 leader_election.cc:290] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:28.200659 20362 raft_consensus.cc:515] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:28.202957 20285 tablet_bootstrap.cc:492] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:28.203510 20285 ts_tablet_manager.cc:1403] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.222s	user 0.015s	sys 0.004s
I20260709 12:24:28.204632 20362 leader_election.cc:290] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:28.207828 20285 raft_consensus.cc:359] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:28.209311 20285 raft_consensus.cc:385] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:28.214461 20157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac5e9dcbf74c29aa24300975246ad3" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:28.208367 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8635d89e903c48a786062efb05feaa75" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:28.215296 20282 tablet_bootstrap.cc:492] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:28.209599 20285 raft_consensus.cc:740] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:28.222983 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1127f55bd43a4c988dfd61547a03b3fa" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:28.224049 20285 consensus_queue.cc:260] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
W20260709 12:24:28.231163 20050 leader_election.cc:343] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:28.232398 20285 ts_tablet_manager.cc:1434] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:24:28.233064 20282 tablet_bootstrap.cc:654] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:28.227355 20236 raft_consensus.cc:2468] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:28.236932 20286 tablet_bootstrap.cc:654] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:28.236173 19908 catalog_manager.cc:5697] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 1 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:28.241070 19908 catalog_manager.cc:5697] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 1 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:28.239097 20285 tablet_bootstrap.cc:492] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:28.246198 20533 consensus_queue.cc:1048] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:28.256161 20533 consensus_queue.cc:1048] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:28.277294 20287 tablet_bootstrap.cc:654] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:28.285574 20287 tablet_bootstrap.cc:492] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:28.291021 20287 ts_tablet_manager.cc:1403] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.117s	user 0.012s	sys 0.000s
I20260709 12:24:28.291414 20232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8635d89e903c48a786062efb05feaa75" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:28.292215 20232 raft_consensus.cc:3060] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:28.289187 20282 tablet_bootstrap.cc:492] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:28.293473 20282 ts_tablet_manager.cc:1403] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.078s	user 0.006s	sys 0.006s
I20260709 12:24:28.294154 20287 raft_consensus.cc:359] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:28.294914 20287 raft_consensus.cc:385] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:28.295182 20287 raft_consensus.cc:740] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:28.295925 20287 consensus_queue.cc:260] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:28.296460 20282 raft_consensus.cc:359] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:28.297250 20282 raft_consensus.cc:385] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:28.297533 20282 raft_consensus.cc:740] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:28.298008 20287 ts_tablet_manager.cc:1434] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:24:28.298221 20282 consensus_queue.cc:260] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:28.299084 20287 tablet_bootstrap.cc:492] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:28.300830 20282 ts_tablet_manager.cc:1434] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:28.301853 20282 tablet_bootstrap.cc:492] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:28.305867 20287 tablet_bootstrap.cc:654] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:28.307492 20282 tablet_bootstrap.cc:654] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:28.315737 20282 tablet_bootstrap.cc:492] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:28.316267 20282 ts_tablet_manager.cc:1403] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 12:24:28.318898 20282 raft_consensus.cc:359] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:28.319561 20282 raft_consensus.cc:385] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:28.319836 20282 raft_consensus.cc:740] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:28.321360 20282 consensus_queue.cc:260] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:28.324265 20287 tablet_bootstrap.cc:492] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:28.324855 20287 ts_tablet_manager.cc:1403] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.008s
I20260709 12:24:28.327607 20287 raft_consensus.cc:359] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:28.328333 20287 raft_consensus.cc:385] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:28.328612 20287 raft_consensus.cc:740] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:28.329326 20287 consensus_queue.cc:260] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:28.331928 20282 ts_tablet_manager.cc:1434] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 12:24:28.333021 20282 tablet_bootstrap.cc:492] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:28.333595 20287 ts_tablet_manager.cc:1434] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:24:28.334631 20287 tablet_bootstrap.cc:492] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:28.333389 20008 raft_consensus.cc:3060] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:28.339052 20282 tablet_bootstrap.cc:654] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:28.340340 20287 tablet_bootstrap.cc:654] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:28.343194 20006 raft_consensus.cc:3060] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:28.354703 20287 tablet_bootstrap.cc:492] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:28.355288 20287 ts_tablet_manager.cc:1403] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.004s
I20260709 12:24:28.358309 20287 raft_consensus.cc:359] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:28.359019 20287 raft_consensus.cc:385] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:28.359298 20287 raft_consensus.cc:740] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:28.361171 20287 consensus_queue.cc:260] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:28.364555 20287 ts_tablet_manager.cc:1434] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:24:28.366402 20287 tablet_bootstrap.cc:492] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:28.366041 20604 consensus_queue.cc:1048] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:28.376253 20580 raft_consensus.cc:493] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.376843 20580 raft_consensus.cc:515] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:28.378969 20580 leader_election.cc:290] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:28.381263 20287 tablet_bootstrap.cc:654] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:28.381804 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1127f55bd43a4c988dfd61547a03b3fa" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:28.382522 20083 raft_consensus.cc:2468] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 0.
I20260709 12:24:28.384337 20126 leader_election.cc:304] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:28.386271 20580 raft_consensus.cc:2804] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:28.386391 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1127f55bd43a4c988dfd61547a03b3fa" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:28.386785 20580 raft_consensus.cc:493] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:28.387223 20236 raft_consensus.cc:2468] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 0.
I20260709 12:24:28.387205 20580 raft_consensus.cc:3060] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:28.394029 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac5e9dcbf74c29aa24300975246ad3" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:28.398236 20580 raft_consensus.cc:515] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:28.398408 20287 tablet_bootstrap.cc:492] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:28.401361 20287 ts_tablet_manager.cc:1403] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.004s
I20260709 12:24:28.407719 20580 leader_election.cc:290] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:28.404404 20287 raft_consensus.cc:359] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:28.410506 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1127f55bd43a4c988dfd61547a03b3fa" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:28.415279 20236 raft_consensus.cc:3060] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:28.409145 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1127f55bd43a4c988dfd61547a03b3fa" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:28.420657 20083 raft_consensus.cc:3060] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:28.421204 20604 consensus_queue.cc:1048] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:28.430488 20236 raft_consensus.cc:2468] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:24:28.410745 20287 raft_consensus.cc:385] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:28.433187 20287 raft_consensus.cc:740] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:28.433398 20124 leader_election.cc:304] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:28.433979 20287 consensus_queue.cc:260] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:28.434409 20580 raft_consensus.cc:2804] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:28.435014 20580 raft_consensus.cc:697] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:28.435837 20580 consensus_queue.cc:237] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:28.436538 20287 ts_tablet_manager.cc:1434] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 12:24:28.437572 20287 tablet_bootstrap.cc:492] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:28.439836 20492 raft_consensus.cc:493] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.440532 20492 raft_consensus.cc:515] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:28.443737 20157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b96b6be45d43b6aceaf2afe76d79e4" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:28.444492 20157 raft_consensus.cc:2468] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
I20260709 12:24:28.445946 20201 leader_election.cc:304] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:28.446792 20604 raft_consensus.cc:2804] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:28.447146 20604 raft_consensus.cc:493] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:28.447477 20604 raft_consensus.cc:3060] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:28.449625 20232 raft_consensus.cc:2468] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:28.451009 20601 consensus_queue.cc:1048] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:24:28.457378 20049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:39155, user_credentials={real_user=slave}} blocked reactor thread for 57676us
I20260709 12:24:28.460489 20049 leader_election.cc:304] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f
I20260709 12:24:28.461210 20586 raft_consensus.cc:493] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.461779 20586 raft_consensus.cc:515] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:28.463301 20083 raft_consensus.cc:2468] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:24:28.464540 20586 leader_election.cc:290] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:28.466086 20157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1257e7996388445eaa292ac68c3ad0ef" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:28.486159 20603 raft_consensus.cc:2764] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:24:28.487416 20157 raft_consensus.cc:2468] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 0.
I20260709 12:24:28.489166 19976 leader_election.cc:304] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: 
I20260709 12:24:28.259681 20285 tablet_bootstrap.cc:654] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:28.475178 20492 leader_election.cc:290] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:28.477492 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b96b6be45d43b6aceaf2afe76d79e4" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:28.493862 20049 leader_election.cc:304] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:28.495019 20602 raft_consensus.cc:2804] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:28.495544 20602 raft_consensus.cc:697] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:28.496763 20322 raft_consensus.cc:493] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.497366 20322 raft_consensus.cc:515] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:28.467700 20604 raft_consensus.cc:515] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:28.501926 20604 leader_election.cc:290] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:28.502472 20282 tablet_bootstrap.cc:492] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:28.503005 20282 ts_tablet_manager.cc:1403] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.170s	user 0.046s	sys 0.044s
W20260709 12:24:28.503238 20200 leader_election.cc:343] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:28.503556 20157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:28.504263 20287 tablet_bootstrap.cc:654] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:28.505229 20201 leader_election.cc:343] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:28.505810 20282 raft_consensus.cc:359] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:28.506247 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b96b6be45d43b6aceaf2afe76d79e4" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:28.506609 20282 raft_consensus.cc:385] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:28.506959 20282 raft_consensus.cc:740] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:28.507066 20158 raft_consensus.cc:3060] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:28.507833 20282 consensus_queue.cc:260] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:28.508610 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b96b6be45d43b6aceaf2afe76d79e4" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:28.509634 20282 ts_tablet_manager.cc:1434] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
W20260709 12:24:28.509945 20200 leader_election.cc:343] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:28.510699 20282 tablet_bootstrap.cc:492] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:28.512423 20602 consensus_queue.cc:237] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:28.517001 20287 tablet_bootstrap.cc:492] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:28.517527 20287 ts_tablet_manager.cc:1403] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.080s	user 0.006s	sys 0.005s
I20260709 12:24:28.519582 20282 tablet_bootstrap.cc:654] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:28.520216 20287 raft_consensus.cc:359] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:28.520936 20158 raft_consensus.cc:2468] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:28.522265 20201 leader_election.cc:304] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:28.523469 20604 raft_consensus.cc:2804] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:28.523983 20604 raft_consensus.cc:697] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:28.524796 20604 consensus_queue.cc:237] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:28.528591 20083 raft_consensus.cc:3060] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:28.490303 20489 consensus_queue.cc:1048] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:28.490125 20586 raft_consensus.cc:2804] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:28.535575 20586 raft_consensus.cc:493] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:28.536074 20586 raft_consensus.cc:3060] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:28.540305 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:28.499577 20322 leader_election.cc:290] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:28.520948 20287 raft_consensus.cc:385] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:28.544958 20287 raft_consensus.cc:740] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:28.484692 20286 tablet_bootstrap.cc:492] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:28.545735 20287 consensus_queue.cc:260] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:28.546262 20286 ts_tablet_manager.cc:1403] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.385s	user 0.011s	sys 0.004s
I20260709 12:24:28.548676 20580 raft_consensus.cc:493] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.563318 20580 raft_consensus.cc:515] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:28.568668 20287 ts_tablet_manager.cc:1434] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 12:24:28.569334 20282 tablet_bootstrap.cc:492] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:28.569972 20282 ts_tablet_manager.cc:1403] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.059s	user 0.008s	sys 0.008s
I20260709 12:24:28.528929 20232 raft_consensus.cc:3060] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:28.572099 20287 tablet_bootstrap.cc:492] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
W20260709 12:24:28.573194 20201 leader_election.cc:343] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:28.573822 20201 leader_election.cc:304] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
W20260709 12:24:28.544428 20049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:39155, user_credentials={real_user=slave}} blocked reactor thread for 50653us
I20260709 12:24:28.587141 20282 raft_consensus.cc:359] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:28.588414 19976 leader_election.cc:304] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:28.578310 20554 raft_consensus.cc:2749] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:28.596009 20285 tablet_bootstrap.cc:492] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:28.596704 20285 ts_tablet_manager.cc:1403] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.361s	user 0.030s	sys 0.026s
I20260709 12:24:28.598778 20586 raft_consensus.cc:515] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:28.604651 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9370ed3b42941c683b03215e8ae3344" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:28.591356 20282 raft_consensus.cc:385] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:28.605924 20282 raft_consensus.cc:740] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
W20260709 12:24:28.607044 20125 leader_election.cc:343] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:28.608560 20126 consensus_peers.cc:597] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:28.590294 20580 leader_election.cc:290] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:28.613447 20286 raft_consensus.cc:359] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:28.606787 20282 consensus_queue.cc:260] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:28.614244 20286 raft_consensus.cc:385] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:28.616425 20286 raft_consensus.cc:740] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:28.614248 20411 raft_consensus.cc:2749] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:28.618098 20286 consensus_queue.cc:260] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:28.620297 19907 catalog_manager.cc:5697] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 1 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:28.623196 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1257e7996388445eaa292ac68c3ad0ef" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:28.624085 20359 raft_consensus.cc:493] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.624607 20359 raft_consensus.cc:515] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:28.626780 20359 leader_election.cc:290] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:28.632910 20286 ts_tablet_manager.cc:1434] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.000s
I20260709 12:24:28.633067 20282 ts_tablet_manager.cc:1434] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.063s	user 0.003s	sys 0.006s
I20260709 12:24:28.634140 20286 tablet_bootstrap.cc:492] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:28.636132 20282 tablet_bootstrap.cc:492] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:28.640198 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:28.666728 20586 leader_election.cc:290] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:28.674926 20285 raft_consensus.cc:359] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:28.675839 20285 raft_consensus.cc:385] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:28.676225 20285 raft_consensus.cc:740] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:28.677083 20285 consensus_queue.cc:260] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:28.679419 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1257e7996388445eaa292ac68c3ad0ef" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:28.680088 20162 raft_consensus.cc:3060] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:28.660594 20578 raft_consensus.cc:493] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.680716 20578 raft_consensus.cc:515] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:28.667500 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9370ed3b42941c683b03215e8ae3344" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:28.693107 20285 ts_tablet_manager.cc:1434] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.001s
I20260709 12:24:28.694454 20162 raft_consensus.cc:2468] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 1.
W20260709 12:24:28.695268 20124 leader_election.cc:343] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:28.695742 20124 leader_election.cc:304] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:28.703363 19976 leader_election.cc:304] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: 
I20260709 12:24:28.704335 20586 raft_consensus.cc:2804] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:28.705114 20586 raft_consensus.cc:697] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [term 1 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:28.705989 20586 consensus_queue.cc:237] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:28.710572 20578 leader_election.cc:290] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:28.714417 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:28.714723 20578 consensus_queue.cc:1048] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:24:28.716437 20125 leader_election.cc:343] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:28.717962 20486 raft_consensus.cc:2749] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:28.723874 20322 raft_consensus.cc:493] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.724602 20322 raft_consensus.cc:515] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:28.730655 20286 tablet_bootstrap.cc:654] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:28.723973 20200 leader_election.cc:343] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:28.735348 20359 raft_consensus.cc:493] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.735973 20359 raft_consensus.cc:515] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
W20260709 12:24:28.731437 20049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:39155, user_credentials={real_user=slave}} blocked reactor thread for 70519.9us
W20260709 12:24:28.737608 19976 leader_election.cc:343] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:28.740198 20322 leader_election.cc:290] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:28.741830 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4d18eda43b4a17bd5b552c4e04225c" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
W20260709 12:24:28.745503 20201 leader_election.cc:343] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:28.747826 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:28.750137 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4d18eda43b4a17bd5b552c4e04225c" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:28.754384 20285 tablet_bootstrap.cc:492] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:28.755824 19906 catalog_manager.cc:5697] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 1 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:28.758020 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1257e7996388445eaa292ac68c3ad0ef" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:28.764297 20282 tablet_bootstrap.cc:654] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:28.765487 20287 tablet_bootstrap.cc:654] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:28.768685 20124 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:39155, user_credentials={real_user=slave}} blocked reactor thread for 65717.2us
I20260709 12:24:28.775470 19905 catalog_manager.cc:5697] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 0 to 1, leader changed from <none> to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 1 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:28.791494 20359 leader_election.cc:290] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:28.791769 20322 raft_consensus.cc:493] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.795440 20285 tablet_bootstrap.cc:654] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:28.796298 20201 leader_election.cc:343] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:28.796877 20201 leader_election.cc:304] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:28.794060 20631 consensus_queue.cc:1048] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:24:28.796227 20322 raft_consensus.cc:515] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:28.803440 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2234eae9544c8898b57db26f4533d3" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:28.808722 20322 leader_election.cc:290] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:28.809353 20322 raft_consensus.cc:2749] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:24:28.814107 19976 leader_election.cc:343] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:28.814702 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:28.815443 20084 raft_consensus.cc:2468] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 0.
W20260709 12:24:28.816181 20201 leader_election.cc:343] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:28.816731 20201 leader_election.cc:304] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:28.813453 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf44484d11914a83a44c9a333eed7777" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:28.827986 20554 raft_consensus.cc:2749] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:28.828034 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2234eae9544c8898b57db26f4533d3" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:28.833195 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf44484d11914a83a44c9a333eed7777" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:28.834158 20126 leader_election.cc:304] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:28.835372 20632 raft_consensus.cc:2804] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:28.835804 20632 raft_consensus.cc:493] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:28.837162 20201 leader_election.cc:304] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
W20260709 12:24:28.848098 20201 leader_election.cc:343] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:28.836194 20632 raft_consensus.cc:3060] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:28.851341 20554 raft_consensus.cc:2749] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:28.876137 20631 raft_consensus.cc:493] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.880542 20507 raft_consensus.cc:493] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:28.889003 20507 raft_consensus.cc:515] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:28.891274 20287 tablet_bootstrap.cc:492] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
W20260709 12:24:28.879169 20200 leader_election.cc:343] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:28.889027 20282 tablet_bootstrap.cc:492] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:28.897738 20282 ts_tablet_manager.cc:1403] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.262s	user 0.018s	sys 0.004s
I20260709 12:24:28.891892 20287 ts_tablet_manager.cc:1403] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.322s	user 0.039s	sys 0.032s
I20260709 12:24:28.908058 20286 tablet_bootstrap.cc:492] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:28.908866 20286 ts_tablet_manager.cc:1403] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.275s	user 0.022s	sys 0.014s
I20260709 12:24:28.908883 20285 tablet_bootstrap.cc:492] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:28.910828 20285 ts_tablet_manager.cc:1403] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.157s	user 0.023s	sys 0.018s
I20260709 12:24:28.906328 20578 raft_consensus.cc:493] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.915555 20287 raft_consensus.cc:359] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:28.916323 20287 raft_consensus.cc:385] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:28.916587 20287 raft_consensus.cc:740] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:28.917241 20287 consensus_queue.cc:260] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:28.919266 20287 ts_tablet_manager.cc:1434] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.000s
I20260709 12:24:28.920305 20287 tablet_bootstrap.cc:492] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:28.919526 20632 raft_consensus.cc:515] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:28.899346 20631 raft_consensus.cc:515] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:28.922489 20507 leader_election.cc:290] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:28.922493 20632 leader_election.cc:290] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
W20260709 12:24:28.924080 20630 log.cc:927] Time spent T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:24:28.924203 20631 leader_election.cc:290] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:28.914083 20578 raft_consensus.cc:515] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:28.926996 20287 tablet_bootstrap.cc:654] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:28.928383 20578 leader_election.cc:290] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
W20260709 12:24:28.971697 19956 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:28.986631 19905 catalog_manager.cc:5697] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:28.996683 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd398fffdf6d468f88108a6a7bec0681" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:29.029412 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd398fffdf6d468f88108a6a7bec0681" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:29.031064 20532 raft_consensus.cc:493] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.032497 20532 raft_consensus.cc:515] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:29.034765 20282 raft_consensus.cc:359] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:29.035941 20282 raft_consensus.cc:385] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:29.036346 20282 raft_consensus.cc:740] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:29.037303 20282 consensus_queue.cc:260] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
W20260709 12:24:29.022105 20126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:38769, user_credentials={real_user=slave}} blocked reactor thread for 115023us
I20260709 12:24:28.905503 20200 leader_election.cc:304] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:29.057499 20285 raft_consensus.cc:359] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:29.058138 20322 raft_consensus.cc:2749] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:29.062460 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8635d89e903c48a786062efb05feaa75" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:29.070215 20285 raft_consensus.cc:385] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:29.070412 20237 raft_consensus.cc:2393] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7204c82dd34944818a439bd468a8c410 in current term 1: Already voted for candidate aac061e592d74289800e4c50cbb4132b in this term.
I20260709 12:24:29.071149 20285 raft_consensus.cc:740] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:29.072135 20282 ts_tablet_manager.cc:1434] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.174s	user 0.010s	sys 0.002s
I20260709 12:24:29.055066 20532 leader_election.cc:290] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:29.072170 20285 consensus_queue.cc:260] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
W20260709 12:24:29.057610 20200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 181084us
I20260709 12:24:29.090240 20285 ts_tablet_manager.cc:1434] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.179s	user 0.013s	sys 0.000s
I20260709 12:24:29.092520 20285 tablet_bootstrap.cc:492] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:29.098778 20282 tablet_bootstrap.cc:492] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:29.106082 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04cd0aa441274cf38da93eec0bfadeff" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:29.107061 20236 raft_consensus.cc:2468] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 0.
I20260709 12:24:29.109589 20282 tablet_bootstrap.cc:654] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:29.131181 20124 leader_election.cc:304] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:29.133111 20489 raft_consensus.cc:2804] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:29.133615 20489 raft_consensus.cc:493] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.133988 20489 raft_consensus.cc:3060] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:29.139321 20631 consensus_queue.cc:1048] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:24:29.159687 20050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 160244us
W20260709 12:24:29.165747 20200 consensus_peers.cc:597] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:29.173053 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04cd0aa441274cf38da93eec0bfadeff" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:29.173846 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71a18e780d74303884e208106817dec" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
W20260709 12:24:29.177435 20125 leader_election.cc:343] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:29.178996 20125 leader_election.cc:343] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:29.183352 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:29.199800 20286 raft_consensus.cc:359] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:29.200956 20286 raft_consensus.cc:385] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:29.201308 20286 raft_consensus.cc:740] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:29.202412 20286 consensus_queue.cc:260] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:29.222648 20286 ts_tablet_manager.cc:1434] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.313s	user 0.002s	sys 0.006s
I20260709 12:24:29.224099 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71a18e780d74303884e208106817dec" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:29.224575 20286 tablet_bootstrap.cc:492] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:29.224900 20083 raft_consensus.cc:2468] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 0.
I20260709 12:24:29.225481 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:29.226392 20086 raft_consensus.cc:3060] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:29.254043 20647 consensus_queue.cc:1048] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:29.263736 20287 tablet_bootstrap.cc:492] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:29.264772 20287 ts_tablet_manager.cc:1403] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.345s	user 0.015s	sys 0.010s
I20260709 12:24:29.277760 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8635d89e903c48a786062efb05feaa75" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:29.299382 20580 raft_consensus.cc:493] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.300735 20580 raft_consensus.cc:515] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:29.305053 20126 leader_election.cc:304] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410
W20260709 12:24:29.299432 20125 leader_election.cc:343] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:29.307078 20631 raft_consensus.cc:2804] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:29.307548 20631 raft_consensus.cc:493] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.308022 20631 raft_consensus.cc:3060] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:29.309725 20287 raft_consensus.cc:359] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:29.310580 20287 raft_consensus.cc:385] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:29.310849 20287 raft_consensus.cc:740] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:29.312064 20580 leader_election.cc:290] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:29.314790 20232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4d18eda43b4a17bd5b552c4e04225c" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:29.315802 20232 raft_consensus.cc:2468] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 0.
I20260709 12:24:29.316075 20492 consensus_queue.cc:1048] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:29.331243 20124 leader_election.cc:304] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:29.332333 20580 raft_consensus.cc:2804] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:29.332741 20580 raft_consensus.cc:493] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.333102 20580 raft_consensus.cc:3060] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:29.311582 20287 consensus_queue.cc:260] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:29.344066 20489 raft_consensus.cc:515] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:29.344517 20086 raft_consensus.cc:2468] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:24:29.348016 20644 consensus_queue.cc:1048] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:24:29.349032 20287 ts_tablet_manager.cc:1434] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.000s
I20260709 12:24:29.376489 20578 consensus_queue.cc:1048] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:24:29.387606 20282 tablet_bootstrap.cc:492] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:29.357362 20050 leader_election.cc:304] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:29.388319 20282 ts_tablet_manager.cc:1403] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.290s	user 0.025s	sys 0.014s
I20260709 12:24:29.380383 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4d18eda43b4a17bd5b552c4e04225c" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
W20260709 12:24:29.397219 20050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 55115.1us
I20260709 12:24:29.404531 20603 raft_consensus.cc:2749] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:29.404999 20580 raft_consensus.cc:515] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:29.395604 20282 raft_consensus.cc:359] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:29.425083 20282 raft_consensus.cc:385] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:29.425509 20282 raft_consensus.cc:740] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:29.432461 20282 consensus_queue.cc:260] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
W20260709 12:24:29.531769 20649 log.cc:927] Time spent T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:24:29.566991 20631 raft_consensus.cc:515] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:29.569712 20631 leader_election.cc:290] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
W20260709 12:24:29.610949 20050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 202051us
I20260709 12:24:29.710979 20285 tablet_bootstrap.cc:654] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:29.721665 20285 tablet_bootstrap.cc:492] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:29.722281 20285 ts_tablet_manager.cc:1403] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.630s	user 0.015s	sys 0.003s
I20260709 12:24:29.725317 20285 raft_consensus.cc:359] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:29.726022 20285 raft_consensus.cc:385] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:29.726279 20285 raft_consensus.cc:740] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:29.726979 20285 consensus_queue.cc:260] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:29.730527 20285 ts_tablet_manager.cc:1434] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.004s
I20260709 12:24:29.731787 20285 tablet_bootstrap.cc:492] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:29.738154 20285 tablet_bootstrap.cc:654] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:29.739871 20647 raft_consensus.cc:493] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.740572 20647 raft_consensus.cc:515] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:29.743068 20647 leader_election.cc:290] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:29.764925 20011 raft_consensus.cc:3060] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:29.775225 20285 tablet_bootstrap.cc:492] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:29.775944 20285 ts_tablet_manager.cc:1403] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.003s
I20260709 12:24:29.778906 20602 consensus_queue.cc:1048] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:29.781790 20285 raft_consensus.cc:359] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:29.782655 20285 raft_consensus.cc:385] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:29.782927 20285 raft_consensus.cc:740] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:29.783644 20285 consensus_queue.cc:260] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:29.789170 20658 raft_consensus.cc:493] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.789790 20658 raft_consensus.cc:515] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:29.789259 20285 ts_tablet_manager.cc:1434] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:24:29.793332 20285 tablet_bootstrap.cc:492] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:29.798491 20489 leader_election.cc:290] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:29.801506 20658 leader_election.cc:290] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:29.804843 20285 tablet_bootstrap.cc:654] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:29.809012 20532 raft_consensus.cc:493] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.809615 20532 raft_consensus.cc:515] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:29.812026 20532 leader_election.cc:290] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:29.814525 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9370ed3b42941c683b03215e8ae3344" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:29.815258 20006 raft_consensus.cc:2468] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
I20260709 12:24:29.816906 20008 raft_consensus.cc:3060] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:29.833310 20282 ts_tablet_manager.cc:1434] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.445s	user 0.009s	sys 0.000s
I20260709 12:24:29.834746 20282 tablet_bootstrap.cc:492] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
W20260709 12:24:29.840627 20051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40749, user_credentials={real_user=slave}} blocked reactor thread for 469970us
I20260709 12:24:29.871254 20126 leader_election.cc:304] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:29.876801 20627 raft_consensus.cc:2804] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:29.877382 20627 raft_consensus.cc:697] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:29.878428 20627 consensus_queue.cc:237] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:29.895836 20009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71a18e780d74303884e208106817dec" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:29.898681 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091f47eb9da43e6a24dd1b2bd9e9ce8" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:29.901643 20232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9370ed3b42941c683b03215e8ae3344" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:29.902400 20232 raft_consensus.cc:2468] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 0.
I20260709 12:24:29.906111 20200 leader_election.cc:304] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:29.908643 20604 raft_consensus.cc:2804] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:29.909086 20604 raft_consensus.cc:493] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.909406 20604 raft_consensus.cc:3060] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:29.912382 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091f47eb9da43e6a24dd1b2bd9e9ce8" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:29.945401 20007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04cd0aa441274cf38da93eec0bfadeff" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:29.887539 19976 leader_election.cc:304] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
W20260709 12:24:29.947224 19976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:38769, user_credentials={real_user=slave}} blocked reactor thread for 59905.8us
W20260709 12:24:29.948092 19976 consensus_peers.cc:597] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:29.950835 20287 tablet_bootstrap.cc:492] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
W20260709 12:24:29.951254 20126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:38769, user_credentials={real_user=slave}} blocked reactor thread for 80116.4us
W20260709 12:24:29.952075 20126 leader_election.cc:343] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:29.960376 20125 leader_election.cc:343] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:29.966427 20287 tablet_bootstrap.cc:654] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:29.972424 20658 raft_consensus.cc:493] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.973140 20658 raft_consensus.cc:515] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:29.975461 20658 leader_election.cc:290] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
W20260709 12:24:29.949415 19976 leader_election.cc:343] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:29.988250 20580 leader_election.cc:290] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:29.995916 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9370ed3b42941c683b03215e8ae3344" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:29.996872 20158 raft_consensus.cc:2468] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 0.
I20260709 12:24:30.000072 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71a18e780d74303884e208106817dec" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:30.001101 20086 raft_consensus.cc:3060] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:30.002816 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4d18eda43b4a17bd5b552c4e04225c" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:30.005798 20286 tablet_bootstrap.cc:654] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:30.012020 19974 leader_election.cc:304] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:30.013841 20586 raft_consensus.cc:2804] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:30.014330 20586 raft_consensus.cc:493] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:30.014691 20586 raft_consensus.cc:3060] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:30.022502 19974 leader_election.cc:343] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:30.023204 19974 leader_election.cc:304] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:30.084226 20532 raft_consensus.cc:2749] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:24:30.041333 20200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 49553.5us
I20260709 12:24:30.046485 20235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04cd0aa441274cf38da93eec0bfadeff" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:30.085803 20235 raft_consensus.cc:3060] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:30.050295 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8635d89e903c48a786062efb05feaa75" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:30.051402 20086 raft_consensus.cc:2468] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:24:30.056226 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4d18eda43b4a17bd5b552c4e04225c" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:30.096403 20236 raft_consensus.cc:3060] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:30.096438 20580 raft_consensus.cc:493] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.097213 20580 raft_consensus.cc:515] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:30.099606 20580 leader_election.cc:290] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:30.109931 20235 raft_consensus.cc:2468] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
W20260709 12:24:30.063657 20125 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 102441us
I20260709 12:24:30.151260 20007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976741a38d1c42329394a00cbe085319" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:30.152058 20157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9370ed3b42941c683b03215e8ae3344" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:30.152901 20157 raft_consensus.cc:2468] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
W20260709 12:24:30.154978 20125 leader_election.cc:343] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:30.157055 20125 leader_election.cc:343] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:30.123416 20282 tablet_bootstrap.cc:654] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:30.128166 20285 tablet_bootstrap.cc:492] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:30.158950 20285 ts_tablet_manager.cc:1403] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.366s	user 0.047s	sys 0.073s
I20260709 12:24:30.165369 20411 raft_consensus.cc:2749] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:30.166968 20236 raft_consensus.cc:2468] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
W20260709 12:24:30.124117 19974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:39155, user_credentials={real_user=slave}} blocked reactor thread for 101658us
W20260709 12:24:30.143993 20051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40749, user_credentials={real_user=slave}} blocked reactor thread for 63738.1us
I20260709 12:24:30.142985 20586 raft_consensus.cc:515] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:30.164898 20124 leader_election.cc:304] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:30.173892 20124 leader_election.cc:304] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:30.174698 20580 raft_consensus.cc:2804] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:30.175305 20580 raft_consensus.cc:697] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:30.174676 20627 raft_consensus.cc:2804] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:30.177076 20627 raft_consensus.cc:697] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:30.176160 20580 consensus_queue.cc:237] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:30.181615 20586 leader_election.cc:290] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:30.148517 20604 raft_consensus.cc:515] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:30.184583 20604 leader_election.cc:290] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:30.189145 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9370ed3b42941c683b03215e8ae3344" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:30.189877 20159 raft_consensus.cc:3060] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:30.190014 20126 leader_election.cc:343] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:30.193542 20285 raft_consensus.cc:359] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:30.194404 20285 raft_consensus.cc:385] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:30.194669 20285 raft_consensus.cc:740] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:30.195744 20285 consensus_queue.cc:260] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:30.197950 20285 ts_tablet_manager.cc:1434] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:24:30.199700 20285 tablet_bootstrap.cc:492] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:30.199251 19907 catalog_manager.cc:5697] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 1 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:30.178143 20627 consensus_queue.cc:237] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:30.197748 20126 leader_election.cc:304] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:30.208762 20578 raft_consensus.cc:2804] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:30.209329 20578 raft_consensus.cc:697] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:30.210335 20578 consensus_queue.cc:237] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
W20260709 12:24:30.213536 19976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40749, user_credentials={real_user=slave}} blocked reactor thread for 164001us
I20260709 12:24:30.217697 20287 tablet_bootstrap.cc:492] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:30.218345 20287 ts_tablet_manager.cc:1403] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.699s	user 0.018s	sys 0.007s
I20260709 12:24:30.220357 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8635d89e903c48a786062efb05feaa75" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:30.223114 20003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9370ed3b42941c683b03215e8ae3344" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:30.224002 20003 raft_consensus.cc:2393] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c470740d41ee4b9383923d08a87655d6 in current term 1: Already voted for candidate 7204c82dd34944818a439bd468a8c410 in this term.
I20260709 12:24:30.228485 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976741a38d1c42329394a00cbe085319" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
W20260709 12:24:30.236302 20126 leader_election.cc:343] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:30.236828 20126 leader_election.cc:304] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:30.240060 20631 raft_consensus.cc:2749] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:30.199641 20159 raft_consensus.cc:2468] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:30.248196 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9370ed3b42941c683b03215e8ae3344" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:30.249071 20236 raft_consensus.cc:2393] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7204c82dd34944818a439bd468a8c410 in current term 1: Already voted for candidate c470740d41ee4b9383923d08a87655d6 in this term.
I20260709 12:24:30.251060 20201 leader_election.cc:304] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:30.251829 20322 raft_consensus.cc:2804] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:30.252698 20322 raft_consensus.cc:697] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:30.253947 20322 consensus_queue.cc:237] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:30.255463 20285 tablet_bootstrap.cc:654] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:30.251722 20200 leader_election.cc:304] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:30.258018 20492 raft_consensus.cc:2749] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:30.269907 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9370ed3b42941c683b03215e8ae3344" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:30.271104 20159 raft_consensus.cc:2393] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7204c82dd34944818a439bd468a8c410 in current term 1: Already voted for candidate c470740d41ee4b9383923d08a87655d6 in this term.
W20260709 12:24:30.287751 19956 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:30.300617 20645 raft_consensus.cc:493] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:30.314350 20669 raft_consensus.cc:493] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.315022 20669 raft_consensus.cc:515] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:30.309751 20645 raft_consensus.cc:515] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:30.312296 20287 raft_consensus.cc:359] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:30.319918 20287 raft_consensus.cc:385] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:30.320250 20287 raft_consensus.cc:740] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:30.329342 20669 leader_election.cc:290] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:30.332882 20282 tablet_bootstrap.cc:492] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:30.333484 20282 ts_tablet_manager.cc:1403] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.499s	user 0.019s	sys 0.000s
I20260709 12:24:30.333871 20287 consensus_queue.cc:260] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:30.337965 20233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d063c9d79f904091aade12ce2aba8bd1" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
W20260709 12:24:30.339708 19974 leader_election.cc:343] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:30.343402 20645 leader_election.cc:290] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:30.343693 20286 tablet_bootstrap.cc:492] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:30.344281 20286 ts_tablet_manager.cc:1403] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 1.120s	user 0.039s	sys 0.051s
I20260709 12:24:30.347193 20286 raft_consensus.cc:359] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:30.347939 20286 raft_consensus.cc:385] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:30.348222 20286 raft_consensus.cc:740] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:30.348948 20286 consensus_queue.cc:260] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:30.349165 20233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b96b6be45d43b6aceaf2afe76d79e4" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:30.351162 20286 ts_tablet_manager.cc:1434] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:24:30.353103 20285 tablet_bootstrap.cc:492] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:30.353814 20285 ts_tablet_manager.cc:1403] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.154s	user 0.024s	sys 0.000s
I20260709 12:24:30.355093 20286 tablet_bootstrap.cc:492] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:30.358103 20285 raft_consensus.cc:359] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:30.359028 20285 raft_consensus.cc:385] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:30.359359 20285 raft_consensus.cc:740] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:30.360064 20285 consensus_queue.cc:260] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:30.361981 20286 tablet_bootstrap.cc:654] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:30.363379 20285 ts_tablet_manager.cc:1434] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:24:30.364688 20287 ts_tablet_manager.cc:1434] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.146s	user 0.003s	sys 0.005s
I20260709 12:24:30.368443 20287 tablet_bootstrap.cc:492] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:30.371568 20285 tablet_bootstrap.cc:492] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:30.351442 20282 raft_consensus.cc:359] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:30.375571 20282 raft_consensus.cc:385] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:30.376088 20282 raft_consensus.cc:740] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:30.376931 20282 consensus_queue.cc:260] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:30.379675 20282 ts_tablet_manager.cc:1434] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 12:24:30.382941 20287 tablet_bootstrap.cc:654] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:30.385324 20285 tablet_bootstrap.cc:654] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:30.420316 20282 tablet_bootstrap.cc:492] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:30.402777 20492 raft_consensus.cc:493] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.420867 20492 raft_consensus.cc:515] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:30.422994 20492 leader_election.cc:290] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:30.418056 19905 catalog_manager.cc:5697] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 1 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:30.390697 19976 leader_election.cc:304] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:30.425208 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091f47eb9da43e6a24dd1b2bd9e9ce8" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:30.425773 20533 raft_consensus.cc:2749] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:30.426056 20008 raft_consensus.cc:2468] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
I20260709 12:24:30.430521 20200 leader_election.cc:304] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:30.427932 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091f47eb9da43e6a24dd1b2bd9e9ce8" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:30.432116 20492 raft_consensus.cc:2804] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:30.433322 20492 raft_consensus.cc:493] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:30.433815 20492 raft_consensus.cc:3060] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:30.436086 20201 leader_election.cc:343] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:30.445340 20285 tablet_bootstrap.cc:492] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:30.446004 20285 ts_tablet_manager.cc:1403] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.000s
I20260709 12:24:30.448304 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b96b6be45d43b6aceaf2afe76d79e4" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:30.449327 20285 raft_consensus.cc:359] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:30.450256 20285 raft_consensus.cc:385] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:30.450080 20645 raft_consensus.cc:493] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.451116 20645 raft_consensus.cc:515] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:30.453872 20645 leader_election.cc:290] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:30.454340 20285 raft_consensus.cc:740] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:30.455255 20285 consensus_queue.cc:260] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:30.457818 20285 ts_tablet_manager.cc:1434] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:24:30.458989 20285 tablet_bootstrap.cc:492] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:30.459367 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d063c9d79f904091aade12ce2aba8bd1" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
W20260709 12:24:30.466768 20125 consensus_peers.cc:597] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:30.469548 20285 tablet_bootstrap.cc:654] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:30.466825 20282 tablet_bootstrap.cc:654] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:30.476083 20286 tablet_bootstrap.cc:492] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:30.476661 20286 ts_tablet_manager.cc:1403] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.122s	user 0.043s	sys 0.060s
I20260709 12:24:30.477442 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515975cb81844e8787a53147bb766080" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:30.478358 20082 raft_consensus.cc:2468] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 0.
I20260709 12:24:30.479893 20286 raft_consensus.cc:359] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:30.480916 20286 raft_consensus.cc:385] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:30.481282 20286 raft_consensus.cc:740] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:30.482122 20286 consensus_queue.cc:260] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:30.482745 20285 tablet_bootstrap.cc:492] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:30.483651 20285 ts_tablet_manager.cc:1403] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.001s
I20260709 12:24:30.486397 20285 raft_consensus.cc:359] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:30.487270 20285 raft_consensus.cc:385] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:30.487567 20285 raft_consensus.cc:740] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:30.488225 20285 consensus_queue.cc:260] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:30.489948 20285 ts_tablet_manager.cc:1434] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:30.491214 20285 tablet_bootstrap.cc:492] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:30.501267 20286 ts_tablet_manager.cc:1434] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:24:30.503535 20285 tablet_bootstrap.cc:654] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:30.504642 20282 tablet_bootstrap.cc:492] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:30.505993 20282 ts_tablet_manager.cc:1403] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.000s
I20260709 12:24:30.509140 20282 raft_consensus.cc:359] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:30.512997 20282 raft_consensus.cc:385] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:30.513518 20282 raft_consensus.cc:740] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:30.514456 20282 consensus_queue.cc:260] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:30.510746 20286 tablet_bootstrap.cc:492] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:30.518167 20282 ts_tablet_manager.cc:1434] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:24:30.519608 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515975cb81844e8787a53147bb766080" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:30.521978 20159 raft_consensus.cc:2468] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 0.
I20260709 12:24:30.525925 20282 tablet_bootstrap.cc:492] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
W20260709 12:24:30.532058 19976 leader_election.cc:343] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:30.540705 20032 debug-util.cc:398] Leaking SignalData structure 0x7b08003d36e0 after lost signal to thread 9744
W20260709 12:24:30.609854 20032 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc7a0 after lost signal to thread 19943
I20260709 12:24:30.547442 20604 raft_consensus.cc:493] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.611395 20604 raft_consensus.cc:515] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:30.666188 20656 consensus_queue.cc:1048] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:30.609076 19976 leader_election.cc:304] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:30.711831 20645 raft_consensus.cc:2749] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:30.715831 20492 raft_consensus.cc:515] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
W20260709 12:24:30.708047 20032 debug-util.cc:398] Leaking SignalData structure 0x7b080022ae00 after lost signal to thread 20035
I20260709 12:24:30.726845 20628 raft_consensus.cc:493] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.727445 20628 raft_consensus.cc:515] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:30.729097 20285 tablet_bootstrap.cc:492] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:30.729676 20285 ts_tablet_manager.cc:1403] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.239s	user 0.041s	sys 0.067s
W20260709 12:24:30.724782 19976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:38769, user_credentials={real_user=slave}} blocked reactor thread for 192784us
W20260709 12:24:30.732959 20032 debug-util.cc:398] Leaking SignalData structure 0x7b0800256140 after lost signal to thread 20110
I20260709 12:24:30.733436 19976 leader_election.cc:304] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:30.734613 20533 raft_consensus.cc:2804] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:30.735066 20533 raft_consensus.cc:493] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:30.735392 20533 raft_consensus.cc:3060] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:30.749028 20286 tablet_bootstrap.cc:654] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:30.734315 20032 debug-util.cc:398] Leaking SignalData structure 0x7b0800140480 after lost signal to thread 20186
I20260709 12:24:30.769006 20287 tablet_bootstrap.cc:492] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:30.769699 20287 ts_tablet_manager.cc:1403] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.401s	user 0.074s	sys 0.067s
I20260709 12:24:30.758625 19976 leader_election.cc:304] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:30.778393 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:30.780843 20656 raft_consensus.cc:493] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.781467 20656 raft_consensus.cc:515] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:30.782925 20627 consensus_queue.cc:1048] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:30.777447 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091f47eb9da43e6a24dd1b2bd9e9ce8" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:30.785146 20008 raft_consensus.cc:3060] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:30.795136 20032 debug-util.cc:398] Leaking SignalData structure 0x7b08000f8d20 after lost signal to thread 20261
W20260709 12:24:30.801882 20032 debug-util.cc:398] Leaking SignalData structure 0x7b08000cfb40 after lost signal to thread 20614
I20260709 12:24:30.804060 20629 raft_consensus.cc:493] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.806883 20285 raft_consensus.cc:359] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:30.807654 20285 raft_consensus.cc:385] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:30.807986 20285 raft_consensus.cc:740] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:30.808835 20285 consensus_queue.cc:260] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:30.811615 20282 tablet_bootstrap.cc:654] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:30.780057 20628 leader_election.cc:290] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:30.792994 20669 raft_consensus.cc:2749] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:30.779781 19906 catalog_manager.cc:5697] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 1 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:30.807037 20629 raft_consensus.cc:515] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:30.819905 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091f47eb9da43e6a24dd1b2bd9e9ce8" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:30.821610 19906 catalog_manager.cc:5697] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 1 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:30.824055 20629 leader_election.cc:290] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:30.823902 20580 consensus_queue.cc:1048] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:30.827112 20007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:30.828029 20235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:30.828730 20235 raft_consensus.cc:2468] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
W20260709 12:24:30.830665 20050 leader_election.cc:343] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:30.833055 20201 leader_election.cc:343] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:30.834124 20604 leader_election.cc:290] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:30.835330 20008 raft_consensus.cc:2468] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
W20260709 12:24:30.836015 20201 leader_election.cc:343] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:30.836282 20492 leader_election.cc:290] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:30.837487 20533 raft_consensus.cc:515] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:30.841328 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
W20260709 12:24:30.806252 19976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40749, user_credentials={real_user=slave}} blocked reactor thread for 58699.1us
I20260709 12:24:30.845971 19906 catalog_manager.cc:5697] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 1 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:30.844413 20126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:38769, user_credentials={real_user=slave}} blocked reactor thread for 44944.2us
I20260709 12:24:30.860692 20656 leader_election.cc:290] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:30.857967 20647 raft_consensus.cc:493] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.862715 20285 ts_tablet_manager.cc:1434] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.133s	user 0.010s	sys 0.000s
I20260709 12:24:30.864562 20656 raft_consensus.cc:493] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.866154 20656 raft_consensus.cc:515] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:30.862118 20647 raft_consensus.cc:515] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:30.868443 20006 raft_consensus.cc:3060] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:30.869762 20647 leader_election.cc:290] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:30.870124 20656 leader_election.cc:290] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:30.875842 20647 raft_consensus.cc:493] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.876504 20647 raft_consensus.cc:515] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:30.880328 20049 leader_election.cc:304] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:30.882130 20642 raft_consensus.cc:2804] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:30.882535 20642 raft_consensus.cc:493] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:30.882861 20642 raft_consensus.cc:3060] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:30.884572 20287 raft_consensus.cc:359] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:30.885344 20287 raft_consensus.cc:385] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:30.885608 20287 raft_consensus.cc:740] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:30.888932 20285 tablet_bootstrap.cc:492] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
W20260709 12:24:30.889626 20125 consensus_peers.cc:597] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:30.893368 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71a18e780d74303884e208106817dec" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:30.894440 20086 raft_consensus.cc:2393] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7204c82dd34944818a439bd468a8c410 in current term 1: Already voted for candidate 45ea8ca532304a8f9ffda636d59f6f0f in this term.
I20260709 12:24:30.895255 20647 leader_election.cc:290] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:30.896732 20287 consensus_queue.cc:260] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
W20260709 12:24:30.900327 20200 leader_election.cc:343] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:30.901675 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf44484d11914a83a44c9a333eed7777" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:30.905351 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04cd0aa441274cf38da93eec0bfadeff" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:30.906148 20236 raft_consensus.cc:2393] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7204c82dd34944818a439bd468a8c410 in current term 1: Already voted for candidate 45ea8ca532304a8f9ffda636d59f6f0f in this term.
I20260709 12:24:30.909569 20200 leader_election.cc:304] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:24:30.912436 20696 raft_consensus.cc:2804] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:30.916234 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:30.916725 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:30.917368 20159 raft_consensus.cc:2468] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
I20260709 12:24:30.918457 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf44484d11914a83a44c9a333eed7777" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:30.913187 20696 raft_consensus.cc:697] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:30.920317 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:30.920969 20236 raft_consensus.cc:2468] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 0.
I20260709 12:24:30.921785 20697 consensus_queue.cc:1048] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:30.919806 20629 raft_consensus.cc:493] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.920553 20696 consensus_queue.cc:237] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:30.923096 20629 raft_consensus.cc:515] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:30.919658 20642 raft_consensus.cc:515] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:30.928820 20083 raft_consensus.cc:2393] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c470740d41ee4b9383923d08a87655d6 in current term 1: Already voted for candidate aac061e592d74289800e4c50cbb4132b in this term.
I20260709 12:24:30.931422 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:30.932271 20006 raft_consensus.cc:2468] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 0.
I20260709 12:24:30.931452 20629 leader_election.cc:290] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:30.936442 20287 ts_tablet_manager.cc:1434] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.166s	user 0.006s	sys 0.001s
W20260709 12:24:30.932103 20200 leader_election.cc:343] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:30.942672 20050 leader_election.cc:304] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:30.953598 20124 leader_election.cc:304] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:30.941337 20642 leader_election.cc:290] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:30.977165 20201 leader_election.cc:304] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:30.979179 20201 leader_election.cc:304] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:24:30.985158 20287 tablet_bootstrap.cc:492] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:30.967960 20628 raft_consensus.cc:2804] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:24:30.988091 20201 leader_election.cc:343] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:30.988663 20201 leader_election.cc:304] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:30.976490 20157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:30.978859 20233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:30.999961 20286 tablet_bootstrap.cc:492] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:31.000671 20286 ts_tablet_manager.cc:1403] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.490s	user 0.024s	sys 0.040s
I20260709 12:24:30.985756 20604 raft_consensus.cc:2804] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:30.987066 20628 raft_consensus.cc:493] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:30.996500 20492 raft_consensus.cc:2749] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:31.012373 20486 consensus_queue.cc:1048] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 12:24:31.016642 20359 raft_consensus.cc:3060] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:31.016651 20285 tablet_bootstrap.cc:654] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:31.017112 20507 raft_consensus.cc:2804] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:31.016892 20698 consensus_queue.cc:1048] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.176s
I20260709 12:24:31.030710 20533 leader_election.cc:290] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:31.030061 20507 raft_consensus.cc:493] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.034912 20507 raft_consensus.cc:3060] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:31.046247 20359 raft_consensus.cc:2749] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:31.009197 20628 raft_consensus.cc:3060] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:31.007261 20604 raft_consensus.cc:493] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.034646 20286 raft_consensus.cc:359] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:31.054307 20286 raft_consensus.cc:385] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:31.054703 20286 raft_consensus.cc:740] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
W20260709 12:24:31.055456 20049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:39155, user_credentials={real_user=slave}} blocked reactor thread for 101221us
I20260709 12:24:31.056830 20604 raft_consensus.cc:3060] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:31.058596 20322 raft_consensus.cc:493] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.059183 20322 raft_consensus.cc:515] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:31.065745 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515975cb81844e8787a53147bb766080" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:31.066505 20083 raft_consensus.cc:3060] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:31.068137 20282 tablet_bootstrap.cc:492] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
W20260709 12:24:31.068370 20126 consensus_peers.cc:597] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:31.068698 20282 ts_tablet_manager.cc:1403] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.543s	user 0.059s	sys 0.076s
I20260709 12:24:31.069727 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:31.072233 20322 leader_election.cc:290] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:31.050590 20287 tablet_bootstrap.cc:654] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:31.071614 20282 raft_consensus.cc:359] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:31.080652 20282 raft_consensus.cc:385] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:24:31.068851 20126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:38769, user_credentials={real_user=slave}} blocked reactor thread for 208831us
I20260709 12:24:31.096594 20003 raft_consensus.cc:3060] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:31.105638 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71a18e780d74303884e208106817dec" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:31.106819 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d063c9d79f904091aade12ce2aba8bd1" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:31.107508 20008 raft_consensus.cc:2468] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
W20260709 12:24:31.108955 20050 leader_election.cc:343] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:31.110694 20200 leader_election.cc:304] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:31.112397 20006 raft_consensus.cc:3060] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:31.112037 20286 consensus_queue.cc:260] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:31.113207 20322 raft_consensus.cc:2804] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:31.113653 20322 raft_consensus.cc:493] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.113996 20322 raft_consensus.cc:3060] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:31.081018 20282 raft_consensus.cc:740] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:31.120086 20282 consensus_queue.cc:260] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:31.121953 20604 raft_consensus.cc:515] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:31.122630 20282 ts_tablet_manager.cc:1434] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 12:24:31.122885 20628 raft_consensus.cc:515] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:31.140043 20233 raft_consensus.cc:2468] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:31.140672 20604 leader_election.cc:290] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:31.143005 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04cd0aa441274cf38da93eec0bfadeff" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:31.153008 20049 leader_election.cc:304] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:31.155609 20286 ts_tablet_manager.cc:1434] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.155s	user 0.007s	sys 0.001s
I20260709 12:24:31.129868 20507 raft_consensus.cc:515] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:31.161713 20282 tablet_bootstrap.cc:492] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f: Bootstrap starting.
I20260709 12:24:31.161921 20601 raft_consensus.cc:2804] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:31.163682 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:31.163897 20083 raft_consensus.cc:2468] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 1.
I20260709 12:24:31.165575 20157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:31.177505 19906 catalog_manager.cc:5697] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 1 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:31.181529 20287 tablet_bootstrap.cc:492] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:31.182168 20287 ts_tablet_manager.cc:1403] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.201s	user 0.020s	sys 0.002s
I20260709 12:24:31.188228 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515975cb81844e8787a53147bb766080" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:31.188973 20162 raft_consensus.cc:3060] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:31.205298 20286 tablet_bootstrap.cc:492] T 20a52c50180741b9a6165c183733f3fa P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:31.202780 20086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:31.243299 20285 tablet_bootstrap.cc:492] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:31.244047 20285 ts_tablet_manager.cc:1403] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.355s	user 0.021s	sys 0.000s
I20260709 12:24:31.255484 20322 raft_consensus.cc:515] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:31.241245 20157 raft_consensus.cc:2393] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c470740d41ee4b9383923d08a87655d6 in current term 1: Already voted for candidate 45ea8ca532304a8f9ffda636d59f6f0f in this term.
W20260709 12:24:31.263432 20126 leader_election.cc:343] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:31.252247 20082 raft_consensus.cc:1240] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Rejecting Update request from peer 45ea8ca532304a8f9ffda636d59f6f0f for earlier term 1. Current term is 2. Ops: [1.1-1.1]
W20260709 12:24:31.317118 19976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40749, user_credentials={real_user=slave}} blocked reactor thread for 119476us
I20260709 12:24:31.258359 20601 raft_consensus.cc:697] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:31.317937 19976 leader_election.cc:304] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:31.329948 19976 leader_election.cc:304] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:31.343413 19976 leader_election.cc:304] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:31.273146 20604 consensus_queue.cc:1048] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.067s
I20260709 12:24:31.349423 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:31.326642 20645 raft_consensus.cc:2749] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:24:31.409358 20201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40749, user_credentials={real_user=slave}} blocked reactor thread for 91406.6us
W20260709 12:24:31.449787 19976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:38769, user_credentials={real_user=slave}} blocked reactor thread for 108129us
W20260709 12:24:31.452723 20201 leader_election.cc:343] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:31.421255 20669 raft_consensus.cc:2804] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:31.421912 20507 leader_election.cc:290] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:31.475348 20282 tablet_bootstrap.cc:654] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:31.415715 20601 consensus_queue.cc:237] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:31.479104 20286 tablet_bootstrap.cc:654] T 20a52c50180741b9a6165c183733f3fa P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:31.488729 20322 leader_election.cc:290] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:31.492586 20162 raft_consensus.cc:2468] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 1.
I20260709 12:24:31.509773 20586 raft_consensus.cc:2749] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:31.524349 20698 raft_consensus.cc:493] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.525020 20698 raft_consensus.cc:515] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:31.528965 20698 leader_election.cc:290] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:31.534154 20201 leader_election.cc:304] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:31.535522 20709 raft_consensus.cc:2749] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:24:31.537147 20126 leader_election.cc:343] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:31.538937 20716 log.cc:927] Time spent T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6: Append to log took a long time: real 0.059s	user 0.003s	sys 0.000s
I20260709 12:24:31.539498 20080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d063c9d79f904091aade12ce2aba8bd1" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:31.540321 20080 raft_consensus.cc:2468] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
I20260709 12:24:31.545374 20698 consensus_queue.cc:1059] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:31.548949 20698 raft_consensus.cc:3055] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:31.549403 20698 raft_consensus.cc:740] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:31.550360 20698 consensus_queue.cc:260] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:31.553609 20287 raft_consensus.cc:359] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:31.554404 20287 raft_consensus.cc:385] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:31.554677 20287 raft_consensus.cc:740] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
W20260709 12:24:31.557291 20126 consensus_peers.cc:597] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:31.555346 20287 consensus_queue.cc:260] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:31.551689 20698 raft_consensus.cc:3060] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:31.506978 20285 raft_consensus.cc:359] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:31.566685 20285 raft_consensus.cc:385] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:31.567059 20285 raft_consensus.cc:740] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:31.570045 20285 consensus_queue.cc:260] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
W20260709 12:24:31.572666 20049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:39155, user_credentials={real_user=slave}} blocked reactor thread for 102188us
I20260709 12:24:31.580551 20287 ts_tablet_manager.cc:1434] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.398s	user 0.009s	sys 0.000s
I20260709 12:24:31.594872 20285 ts_tablet_manager.cc:1434] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.350s	user 0.018s	sys 0.000s
W20260709 12:24:31.622825 20126 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.583420 20669 raft_consensus.cc:697] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [term 1 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
W20260709 12:24:31.638492 20050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 275053us
I20260709 12:24:31.638088 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf44484d11914a83a44c9a333eed7777" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
W20260709 12:24:31.665182 20724 log.cc:927] Time spent T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:24:31.666447 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:31.668604 20232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:31.669222 20235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf44484d11914a83a44c9a333eed7777" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:31.669975 20235 raft_consensus.cc:2468] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 0.
I20260709 12:24:31.675540 20008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d063c9d79f904091aade12ce2aba8bd1" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:31.676266 20008 raft_consensus.cc:3060] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:31.659317 20733 raft_consensus.cc:493] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.676955 20733 raft_consensus.cc:515] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:31.679512 20733 leader_election.cc:290] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:31.669492 20232 raft_consensus.cc:2393] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ea8ca532304a8f9ffda636d59f6f0f in current term 1: Already voted for candidate c470740d41ee4b9383923d08a87655d6 in this term.
I20260709 12:24:31.663194 20669 consensus_queue.cc:237] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:31.682883 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:31.655932 20282 tablet_bootstrap.cc:492] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f: No bootstrap required, opened a new log
I20260709 12:24:31.705549 20282 ts_tablet_manager.cc:1403] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent bootstrapping tablet: real 0.567s	user 0.012s	sys 0.006s
I20260709 12:24:31.689178 20628 leader_election.cc:290] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:31.692585 20709 raft_consensus.cc:493] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.692618 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:31.716004 20162 raft_consensus.cc:2410] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate aac061e592d74289800e4c50cbb4132b for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:24:31.695757 20285 tablet_bootstrap.cc:492] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:31.698704 20287 tablet_bootstrap.cc:492] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6: Bootstrap starting.
I20260709 12:24:31.709399 20322 consensus_queue.cc:1048] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:31.721161 20124 leader_election.cc:304] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:31.744119 20282 raft_consensus.cc:359] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:31.744935 20282 raft_consensus.cc:385] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:31.745210 20282 raft_consensus.cc:740] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Initialized, Role: FOLLOWER
I20260709 12:24:31.745266 20627 raft_consensus.cc:2804] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:31.745680 20627 raft_consensus.cc:493] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.746017 20627 raft_consensus.cc:3060] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:31.734166 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d063c9d79f904091aade12ce2aba8bd1" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:31.749172 20081 raft_consensus.cc:3060] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:31.753048 20232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:31.754170 20232 raft_consensus.cc:2393] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7204c82dd34944818a439bd468a8c410 in current term 1: Already voted for candidate aac061e592d74289800e4c50cbb4132b in this term.
I20260709 12:24:31.745926 20282 consensus_queue.cc:260] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
W20260709 12:24:31.764180 20201 consensus_peers.cc:597] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:31.767228 20282 ts_tablet_manager.cc:1434] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.001s
I20260709 12:24:31.719628 20709 raft_consensus.cc:515] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:31.774107 20285 tablet_bootstrap.cc:654] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:31.774541 20709 leader_election.cc:290] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
W20260709 12:24:31.775203 20727 log.cc:927] Time spent T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410: Append to log took a long time: real 0.126s	user 0.002s	sys 0.000s
W20260709 12:24:31.726089 20125 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 136526us
I20260709 12:24:31.780550 19974 leader_election.cc:304] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:31.786911 20586 raft_consensus.cc:3060] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:31.794828 20586 raft_consensus.cc:2749] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:31.786043 20287 tablet_bootstrap.cc:654] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:31.762563 20008 raft_consensus.cc:2468] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
W20260709 12:24:31.868026 20200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 153120us
W20260709 12:24:31.876946 20125 leader_election.cc:343] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:31.878516 20285 tablet_bootstrap.cc:492] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:31.879081 20285 ts_tablet_manager.cc:1403] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.184s	user 0.016s	sys 0.008s
I20260709 12:24:31.883157 20287 tablet_bootstrap.cc:492] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6: No bootstrap required, opened a new log
I20260709 12:24:31.883818 20287 ts_tablet_manager.cc:1403] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6: Time spent bootstrapping tablet: real 0.185s	user 0.016s	sys 0.006s
I20260709 12:24:31.886874 20287 raft_consensus.cc:359] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:31.887634 20287 raft_consensus.cc:385] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:31.888880 20287 raft_consensus.cc:740] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Initialized, Role: FOLLOWER
I20260709 12:24:31.873605 20200 leader_election.cc:304] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:31.894610 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f834f9ccdefc4baebc23e9477701af69" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:31.895444 20158 raft_consensus.cc:2468] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 0.
I20260709 12:24:31.896574 20201 leader_election.cc:304] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:31.895483 20604 raft_consensus.cc:2804] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:31.897320 20604 raft_consensus.cc:697] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:31.898262 20604 consensus_queue.cc:237] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:31.898919 20007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f834f9ccdefc4baebc23e9477701af69" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:31.899410 20722 raft_consensus.cc:2804] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:31.899837 20722 raft_consensus.cc:493] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.900211 20722 raft_consensus.cc:3060] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:31.908133 20287 consensus_queue.cc:260] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:31.912774 20286 tablet_bootstrap.cc:492] T 20a52c50180741b9a6165c183733f3fa P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:31.913477 20286 ts_tablet_manager.cc:1403] T 20a52c50180741b9a6165c183733f3fa P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.730s	user 0.024s	sys 0.043s
I20260709 12:24:31.914526 20285 raft_consensus.cc:359] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:31.915372 20285 raft_consensus.cc:385] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:31.915647 20285 raft_consensus.cc:740] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:31.916436 20285 consensus_queue.cc:260] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:31.920086 20285 ts_tablet_manager.cc:1434] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 12:24:31.924420 20286 raft_consensus.cc:359] T 20a52c50180741b9a6165c183733f3fa P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:31.925879 20286 raft_consensus.cc:385] T 20a52c50180741b9a6165c183733f3fa P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:31.926156 20286 raft_consensus.cc:740] T 20a52c50180741b9a6165c183733f3fa P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:31.932565 20287 ts_tablet_manager.cc:1434] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
W20260709 12:24:31.937534 20124 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:39155, user_credentials={real_user=slave}} blocked reactor thread for 216464us
W20260709 12:24:31.938607 20200 leader_election.cc:343] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:31.933208 20627 raft_consensus.cc:515] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:31.937098 20286 consensus_queue.cc:260] T 20a52c50180741b9a6165c183733f3fa P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:31.942195 20124 leader_election.cc:304] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:31.946378 20486 raft_consensus.cc:2749] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:31.946225 20081 raft_consensus.cc:2468] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:31.953860 20722 raft_consensus.cc:515] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:31.955103 20627 leader_election.cc:290] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:31.964185 20285 tablet_bootstrap.cc:492] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:31.954080 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf44484d11914a83a44c9a333eed7777" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
W20260709 12:24:31.965783 20125 leader_election.cc:343] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:31.966753 20722 leader_election.cc:290] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
W20260709 12:24:31.957855 19956 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:31.988794 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf44484d11914a83a44c9a333eed7777" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:31.989446 20236 raft_consensus.cc:3060] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:31.994205 20011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f834f9ccdefc4baebc23e9477701af69" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:31.996335 20051 leader_election.cc:304] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:32.001021 20286 ts_tablet_manager.cc:1434] T 20a52c50180741b9a6165c183733f3fa P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
I20260709 12:24:32.002113 20286 tablet_bootstrap.cc:492] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
W20260709 12:24:32.005476 20200 leader_election.cc:343] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.004393 20730 raft_consensus.cc:2749] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:32.011615 19906 catalog_manager.cc:5697] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 0 to 1, leader changed from <none> to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 1 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:32.012079 20709 raft_consensus.cc:493] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.034286 20236 raft_consensus.cc:2468] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:24:32.040112 20286 tablet_bootstrap.cc:654] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.055307 20124 leader_election.cc:304] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:32.038729 20709 raft_consensus.cc:515] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:32.042990 20507 consensus_queue.cc:1048] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:24:32.063162 20709 leader_election.cc:290] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:32.064429 20285 tablet_bootstrap.cc:654] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.066617 20007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed53455b57840a780d37b1db5103826" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
W20260709 12:24:32.068315 20200 leader_election.cc:343] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.072155 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed53455b57840a780d37b1db5103826" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:32.072762 20698 raft_consensus.cc:2804] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:32.073361 20698 raft_consensus.cc:697] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:32.074261 20698 consensus_queue.cc:237] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:32.079929 20156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f834f9ccdefc4baebc23e9477701af69" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:32.080688 20156 raft_consensus.cc:3060] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:32.084175 20201 leader_election.cc:343] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.087510 20201 leader_election.cc:304] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:32.094285 20722 raft_consensus.cc:2749] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:32.108565 20082 raft_consensus.cc:3060] T 20a52c50180741b9a6165c183733f3fa P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.134424 20507 consensus_queue.cc:1048] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:32.167743 20285 tablet_bootstrap.cc:492] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:32.168473 20285 ts_tablet_manager.cc:1403] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.205s	user 0.013s	sys 0.004s
I20260709 12:24:32.177485 20285 raft_consensus.cc:359] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:32.178202 20285 raft_consensus.cc:385] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.178469 20285 raft_consensus.cc:740] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.186398 20647 raft_consensus.cc:493] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.187966 19908 catalog_manager.cc:5697] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 1 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:32.193430 19906 catalog_manager.cc:5697] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:32.194693 20156 raft_consensus.cc:2468] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:32.194907 20647 raft_consensus.cc:515] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:32.197960 20201 leader_election.cc:304] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:32.199091 20604 raft_consensus.cc:2804] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:32.199677 20604 raft_consensus.cc:697] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:32.199839 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976741a38d1c42329394a00cbe085319" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:32.200656 20604 consensus_queue.cc:237] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
W20260709 12:24:32.201416 19976 leader_election.cc:343] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.202039 20156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976741a38d1c42329394a00cbe085319" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:32.202785 20156 raft_consensus.cc:2468] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 0.
I20260709 12:24:32.204147 19976 leader_election.cc:304] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:24:32.205108 20286 tablet_bootstrap.cc:492] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:32.205618 20286 ts_tablet_manager.cc:1403] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.204s	user 0.016s	sys 0.004s
I20260709 12:24:32.206103 20669 raft_consensus.cc:2804] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:32.199029 20647 leader_election.cc:290] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:32.208580 20286 raft_consensus.cc:359] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:32.209308 20286 raft_consensus.cc:385] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.209582 20286 raft_consensus.cc:740] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.210290 20286 consensus_queue.cc:260] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:32.196307 20285 consensus_queue.cc:260] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:32.212805 20647 raft_consensus.cc:493] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.213313 20647 raft_consensus.cc:515] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:32.206564 20669 raft_consensus.cc:493] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.217182 20669 raft_consensus.cc:3060] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.217908 20286 ts_tablet_manager.cc:1434] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:24:32.232829 19908 catalog_manager.cc:5697] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 1 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:32.235189 20285 ts_tablet_manager.cc:1434] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 12:24:32.238392 20285 tablet_bootstrap.cc:492] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:32.241472 20647 leader_election.cc:290] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:32.241649 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f834f9ccdefc4baebc23e9477701af69" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:32.242844 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f834f9ccdefc4baebc23e9477701af69" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:32.242846 20158 raft_consensus.cc:2393] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7204c82dd34944818a439bd468a8c410 in current term 1: Already voted for candidate c470740d41ee4b9383923d08a87655d6 in this term.
I20260709 12:24:32.245903 19976 leader_election.cc:304] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:32.247656 20647 raft_consensus.cc:3060] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.248772 20286 tablet_bootstrap.cc:492] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:32.250643 20669 raft_consensus.cc:515] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:32.276388 20733 consensus_queue.cc:1048] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:32.294654 19905 catalog_manager.cc:5697] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 1 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:32.308506 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976741a38d1c42329394a00cbe085319" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:32.308760 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976741a38d1c42329394a00cbe085319" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:32.309409 20158 raft_consensus.cc:3060] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:32.314735 19976 leader_election.cc:343] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.317637 20158 raft_consensus.cc:2468] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 1.
I20260709 12:24:32.322206 19976 leader_election.cc:304] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:24:32.329136 20726 raft_consensus.cc:2804] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:32.307684 20669 leader_election.cc:290] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:32.339250 20726 raft_consensus.cc:697] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [term 1 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:32.343377 20726 consensus_queue.cc:237] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:32.347513 20647 raft_consensus.cc:2749] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:32.332348 20285 tablet_bootstrap.cc:654] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.356271 20084 raft_consensus.cc:3060] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.394882 20726 consensus_queue.cc:1048] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:32.397859 20286 tablet_bootstrap.cc:654] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.403303 19907 catalog_manager.cc:5697] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:32.437520 20285 tablet_bootstrap.cc:492] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:32.438089 20285 ts_tablet_manager.cc:1403] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.202s	user 0.014s	sys 0.013s
I20260709 12:24:32.441219 20285 raft_consensus.cc:359] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:32.442168 20285 raft_consensus.cc:385] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.442441 20285 raft_consensus.cc:740] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.443257 20285 consensus_queue.cc:260] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:32.445709 20722 consensus_queue.cc:1048] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:32.446666 20285 ts_tablet_manager.cc:1434] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:24:32.447765 20285 tablet_bootstrap.cc:492] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:32.454492 20285 tablet_bootstrap.cc:654] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.467247 20709 consensus_queue.cc:1048] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:24:32.468786 20125 consensus_peers.cc:597] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:32.481693 20285 tablet_bootstrap.cc:492] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410: No bootstrap required, opened a new log
I20260709 12:24:32.482257 20285 ts_tablet_manager.cc:1403] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.000s
I20260709 12:24:32.493824 20285 raft_consensus.cc:359] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:32.494612 20285 raft_consensus.cc:385] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.496078 20285 raft_consensus.cc:740] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.496835 20285 consensus_queue.cc:260] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:32.499243 20285 ts_tablet_manager.cc:1434] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:24:32.503327 20286 tablet_bootstrap.cc:492] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:32.503902 20286 ts_tablet_manager.cc:1403] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.261s	user 0.018s	sys 0.011s
I20260709 12:24:32.511987 20726 raft_consensus.cc:493] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.512589 20726 raft_consensus.cc:515] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:32.513129 20286 raft_consensus.cc:359] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:32.514668 20726 leader_election.cc:290] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:32.515486 20286 raft_consensus.cc:385] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.515791 20286 raft_consensus.cc:740] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.517076 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed53455b57840a780d37b1db5103826" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:32.518070 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed53455b57840a780d37b1db5103826" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
W20260709 12:24:32.518499 19976 leader_election.cc:343] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.518669 20236 raft_consensus.cc:2468] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 0.
I20260709 12:24:32.516615 20286 consensus_queue.cc:260] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:32.519874 19974 leader_election.cc:304] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:24:32.520721 20726 raft_consensus.cc:2804] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:32.521085 20726 raft_consensus.cc:493] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.521389 20726 raft_consensus.cc:3060] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.521947 20286 ts_tablet_manager.cc:1434] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.002s
I20260709 12:24:32.522801 20286 tablet_bootstrap.cc:492] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:32.529938 20286 tablet_bootstrap.cc:654] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.546450 20726 raft_consensus.cc:515] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:32.549494 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed53455b57840a780d37b1db5103826" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:32.550094 20236 raft_consensus.cc:3060] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.566218 20236 raft_consensus.cc:2468] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 1.
I20260709 12:24:32.567586 19974 leader_election.cc:304] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:32.568498 20647 raft_consensus.cc:2804] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:32.569002 20726 leader_election.cc:290] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:32.569037 20647 raft_consensus.cc:697] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 1 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:32.570261 20647 consensus_queue.cc:237] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:32.570566 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed53455b57840a780d37b1db5103826" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:32.573338 20286 tablet_bootstrap.cc:492] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:32.573864 20286 ts_tablet_manager.cc:1403] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.018s
I20260709 12:24:32.576610 20286 raft_consensus.cc:359] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
W20260709 12:24:32.579499 19976 leader_election.cc:343] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:32.582597 20286 raft_consensus.cc:385] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.582950 20286 raft_consensus.cc:740] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.583738 20286 consensus_queue.cc:260] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:32.586776 20286 ts_tablet_manager.cc:1434] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 12:24:32.587813 20286 tablet_bootstrap.cc:492] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:32.597784 20286 tablet_bootstrap.cc:654] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.603246 19906 catalog_manager.cc:5697] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:32.650883 19976 consensus_peers.cc:597] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:32.656867 20743 consensus_queue.cc:1048] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:32.664124 20286 tablet_bootstrap.cc:492] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:32.664712 20286 ts_tablet_manager.cc:1403] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.077s	user 0.008s	sys 0.023s
I20260709 12:24:32.673470 20286 raft_consensus.cc:359] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:32.674213 20286 raft_consensus.cc:385] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.674480 20286 raft_consensus.cc:740] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.675112 20286 consensus_queue.cc:260] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:32.684309 20286 ts_tablet_manager.cc:1434] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:24:32.685395 20286 tablet_bootstrap.cc:492] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:32.716589 20286 tablet_bootstrap.cc:654] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.725154 20722 consensus_queue.cc:1048] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:32.772507 20658 consensus_queue.cc:1048] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:32.807698 20286 tablet_bootstrap.cc:492] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:32.808211 20286 ts_tablet_manager.cc:1403] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.123s	user 0.043s	sys 0.034s
I20260709 12:24:32.810760 20286 raft_consensus.cc:359] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:32.811437 20286 raft_consensus.cc:385] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.811707 20286 raft_consensus.cc:740] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.812373 20286 consensus_queue.cc:260] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:32.814599 20286 ts_tablet_manager.cc:1434] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:24:32.816128 20286 tablet_bootstrap.cc:492] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b: Bootstrap starting.
I20260709 12:24:32.821827 20286 tablet_bootstrap.cc:654] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:32.837455 20286 tablet_bootstrap.cc:492] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b: No bootstrap required, opened a new log
I20260709 12:24:32.837970 20286 ts_tablet_manager.cc:1403] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.004s
I20260709 12:24:32.842341 20286 raft_consensus.cc:359] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:32.843209 20286 raft_consensus.cc:385] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:32.843514 20286 raft_consensus.cc:740] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Initialized, Role: FOLLOWER
I20260709 12:24:32.845245 20286 consensus_queue.cc:260] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:32.855266 20726 consensus_queue.cc:1048] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:32.856709 20286 ts_tablet_manager.cc:1434] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:24:32.858317 20706 raft_consensus.cc:493] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.858850 20706 raft_consensus.cc:515] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:32.861600 20010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976741a38d1c42329394a00cbe085319" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:32.861900 20647 raft_consensus.cc:493] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.862506 20647 raft_consensus.cc:515] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:32.863917 20706 leader_election.cc:290] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:32.864779 20082 raft_consensus.cc:3060] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.865612 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976741a38d1c42329394a00cbe085319" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:32.867089 20051 leader_election.cc:304] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:32.869626 20647 leader_election.cc:290] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:32.870659 20232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf44484d11914a83a44c9a333eed7777" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:32.873759 20156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf44484d11914a83a44c9a333eed7777" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:32.875237 19976 leader_election.cc:304] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:32.878496 20726 raft_consensus.cc:2749] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:32.899034 20706 raft_consensus.cc:2749] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:32.905092 20733 consensus_queue.cc:1048] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:32.934052 20706 raft_consensus.cc:493] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.934597 20706 raft_consensus.cc:515] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:32.936789 20706 leader_election.cc:290] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:32.937458 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1257e7996388445eaa292ac68c3ad0ef" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:32.937752 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1257e7996388445eaa292ac68c3ad0ef" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:32.939273 20051 leader_election.cc:304] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:32.940373 20720 raft_consensus.cc:2749] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:32.979671 20706 raft_consensus.cc:493] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.980229 20706 raft_consensus.cc:515] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:32.983098 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:32.983440 20232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:32.983747 20158 raft_consensus.cc:2393] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aac061e592d74289800e4c50cbb4132b in current term 1: Already voted for candidate 45ea8ca532304a8f9ffda636d59f6f0f in this term.
I20260709 12:24:32.984323 20232 raft_consensus.cc:2393] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aac061e592d74289800e4c50cbb4132b in current term 1: Already voted for candidate c470740d41ee4b9383923d08a87655d6 in this term.
I20260709 12:24:32.985530 20051 leader_election.cc:304] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:32.986279 20708 raft_consensus.cc:3060] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:32.982998 20706 leader_election.cc:290] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:32.994635 20708 raft_consensus.cc:2749] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:24:33.019791 19956 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:33.024233 20733 raft_consensus.cc:493] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:33.024879 20733 raft_consensus.cc:515] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:33.027112 20733 leader_election.cc:290] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:33.028084 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:33.028569 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:33.029199 20158 raft_consensus.cc:2468] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:33.028903 20084 raft_consensus.cc:2393] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7204c82dd34944818a439bd468a8c410 in current term 2: Already voted for candidate aac061e592d74289800e4c50cbb4132b in this term.
I20260709 12:24:33.031147 19976 leader_election.cc:304] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: 
I20260709 12:24:33.031754 20733 raft_consensus.cc:2804] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:33.032218 20733 raft_consensus.cc:493] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:33.032577 20733 raft_consensus.cc:3060] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:33.039762 20733 raft_consensus.cc:515] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:33.044090 20733 leader_election.cc:290] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:33.052966 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:33.053072 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:33.053939 20084 raft_consensus.cc:2393] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7204c82dd34944818a439bd468a8c410 in current term 2: Already voted for candidate aac061e592d74289800e4c50cbb4132b in this term.
I20260709 12:24:33.061432 20158 raft_consensus.cc:2468] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:33.062538 19976 leader_election.cc:304] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:24:33.064028 20733 raft_consensus.cc:2804] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:33.065056 20733 raft_consensus.cc:697] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:33.065943 20733 consensus_queue.cc:237] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:33.074508 20010 raft_consensus.cc:3060] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:33.075562 20708 raft_consensus.cc:493] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.076217 20708 raft_consensus.cc:515] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:33.079027 20232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed53455b57840a780d37b1db5103826" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:33.079912 20232 raft_consensus.cc:2393] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aac061e592d74289800e4c50cbb4132b in current term 1: Already voted for candidate 7204c82dd34944818a439bd468a8c410 in this term.
I20260709 12:24:33.080863 20708 leader_election.cc:290] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:33.082185 20006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed53455b57840a780d37b1db5103826" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:33.085215 19908 catalog_manager.cc:5697] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 1 to 2, leader changed from 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67) to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:33.087649 20084 raft_consensus.cc:3060] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:33.091096 20049 leader_election.cc:304] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:33.109800 20733 consensus_queue.cc:1048] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:33.113268 20706 raft_consensus.cc:2749] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:33.120031 20733 consensus_queue.cc:1048] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:33.195053 20084 raft_consensus.cc:3060] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:33.210676 20082 raft_consensus.cc:3060] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:33.459311 20159 raft_consensus.cc:1275] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:33.460738 20647 consensus_queue.cc:1048] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:33.477190 20082 raft_consensus.cc:1275] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:33.480311 20733 consensus_queue.cc:1048] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:33.636435 20658 raft_consensus.cc:493] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.637001 20658 raft_consensus.cc:515] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:33.642814 20658 leader_election.cc:290] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:33.643925 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:33.644806 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:33.650471 20084 raft_consensus.cc:2468] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:33.650573 20158 raft_consensus.cc:2468] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:33.652133 20201 leader_election.cc:304] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:33.653389 20658 raft_consensus.cc:2804] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:33.653790 20658 raft_consensus.cc:493] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:33.654134 20658 raft_consensus.cc:3060] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:33.661765 20658 raft_consensus.cc:515] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:33.663959 20658 leader_election.cc:290] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:33.664422 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:33.665069 20084 raft_consensus.cc:3060] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:33.665416 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:33.665964 20158 raft_consensus.cc:3060] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:33.672428 20084 raft_consensus.cc:2468] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 2.
I20260709 12:24:33.672797 20158 raft_consensus.cc:2468] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 2.
I20260709 12:24:33.674018 20201 leader_election.cc:304] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:33.674779 20658 raft_consensus.cc:2804] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:33.675272 20658 raft_consensus.cc:697] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 2 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:33.676123 20658 consensus_queue.cc:237] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:33.698169 19905 catalog_manager.cc:5697] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 0 to 2, leader changed from <none> to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 2 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:34.231159 20084 raft_consensus.cc:1275] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Refusing update from remote peer c470740d41ee4b9383923d08a87655d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:24:34.232750 20658 consensus_queue.cc:1048] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:34.279884 20159 raft_consensus.cc:1275] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Refusing update from remote peer c470740d41ee4b9383923d08a87655d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:24:34.285518 20709 consensus_queue.cc:1048] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:34.339511  9741 tablet_server.cc:179] TabletServer@127.9.131.65:0 shutting down...
W20260709 12:24:34.347038 20125 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 12:24:34.391004 20200 consensus_peers.cc:597] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:34.413622 20125 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 66622.4us
W20260709 12:24:34.415154 20050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 55732.3us
W20260709 12:24:34.419545 20125 consensus_peers.cc:597] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:34.433768 20200 consensus_peers.cc:597] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:34.435513 20050 consensus_peers.cc:597] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:34.450959 20125 consensus_peers.cc:597] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:34.457707  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:34.459548  9741 tablet_replica.cc:333] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.460292  9741 raft_consensus.cc:2243] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.460819  9741 raft_consensus.cc:2272] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:34.462486 20200 consensus_peers.cc:597] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:34.463699  9741 tablet_replica.cc:333] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.464921  9741 raft_consensus.cc:2243] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.465698  9741 raft_consensus.cc:2272] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.468266  9741 tablet_replica.cc:333] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.469087  9741 raft_consensus.cc:2243] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.469631  9741 raft_consensus.cc:2272] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.472204  9741 tablet_replica.cc:333] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.473066  9741 raft_consensus.cc:2243] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.473606  9741 raft_consensus.cc:2272] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.476061  9741 tablet_replica.cc:333] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.476850  9741 raft_consensus.cc:2243] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:34.477813  9741 raft_consensus.cc:2272] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.480525  9741 tablet_replica.cc:333] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.481360  9741 raft_consensus.cc:2243] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:24:34.481882 20200 consensus_peers.cc:597] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:34.482288  9741 raft_consensus.cc:2272] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.484834  9741 tablet_replica.cc:333] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.485711  9741 raft_consensus.cc:2243] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.486290  9741 raft_consensus.cc:2272] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.490736  9741 tablet_replica.cc:333] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.491628  9741 raft_consensus.cc:2243] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.492193  9741 raft_consensus.cc:2272] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:34.493489 20200 consensus_peers.cc:597] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:34.494966  9741 tablet_replica.cc:333] T 0252a8e0d9ac4440b3affdcbf4cf2246 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.495837  9741 raft_consensus.cc:2243] T 0252a8e0d9ac4440b3affdcbf4cf2246 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.496430  9741 raft_consensus.cc:2272] T 0252a8e0d9ac4440b3affdcbf4cf2246 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:34.497714 20050 consensus_peers.cc:597] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:34.499087  9741 tablet_replica.cc:333] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.500041  9741 raft_consensus.cc:2243] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:34.501102  9741 raft_consensus.cc:2272] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.503626  9741 tablet_replica.cc:333] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.504464  9741 raft_consensus.cc:2243] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:34.505486  9741 raft_consensus.cc:2272] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.508054  9741 tablet_replica.cc:333] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.508862  9741 raft_consensus.cc:2243] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.509383  9741 raft_consensus.cc:2272] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:34.510226 20050 consensus_peers.cc:597] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:34.511780  9741 tablet_replica.cc:333] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.512704  9741 raft_consensus.cc:2243] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:34.513669  9741 raft_consensus.cc:2272] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:34.515584 20125 consensus_peers.cc:597] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:34.516191  9741 tablet_replica.cc:333] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.517118  9741 raft_consensus.cc:2243] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:34.518167  9741 raft_consensus.cc:2272] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.520911  9741 tablet_replica.cc:333] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.521713  9741 raft_consensus.cc:2243] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.522225  9741 raft_consensus.cc:2272] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.524701  9741 tablet_replica.cc:333] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.525432  9741 raft_consensus.cc:2243] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.525938  9741 raft_consensus.cc:2272] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.528695  9741 tablet_replica.cc:333] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.529464  9741 raft_consensus.cc:2243] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.529978  9741 raft_consensus.cc:2272] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.532742  9741 tablet_replica.cc:333] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.533531  9741 raft_consensus.cc:2243] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.534106  9741 raft_consensus.cc:2272] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.537067  9741 tablet_replica.cc:333] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.537858  9741 raft_consensus.cc:2243] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:34.538971  9741 raft_consensus.cc:2272] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.541749  9741 tablet_replica.cc:333] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
W20260709 12:24:34.542200 20050 consensus_peers.cc:597] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:34.542520  9741 raft_consensus.cc:2243] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.543164  9741 raft_consensus.cc:2272] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.545914  9741 tablet_replica.cc:333] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.546737  9741 raft_consensus.cc:2243] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.547261  9741 raft_consensus.cc:2272] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.550225  9741 tablet_replica.cc:333] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.551112  9741 raft_consensus.cc:2243] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.551692  9741 raft_consensus.cc:2272] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.554683  9741 tablet_replica.cc:333] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.555478  9741 raft_consensus.cc:2243] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.556104  9741 raft_consensus.cc:2272] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:34.556133 20200 consensus_peers.cc:597] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:34.557380 20200 consensus_peers.cc:597] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:34.559088  9741 tablet_replica.cc:333] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.560035  9741 raft_consensus.cc:2243] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:34.560204 20200 consensus_peers.cc:597] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:34.560592  9741 raft_consensus.cc:2272] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.563180  9741 tablet_replica.cc:333] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.563989  9741 raft_consensus.cc:2243] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.564549  9741 raft_consensus.cc:2272] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.567252  9741 tablet_replica.cc:333] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.568090  9741 raft_consensus.cc:2243] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:34.568995  9741 raft_consensus.cc:2272] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.571502  9741 tablet_replica.cc:333] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.572206  9741 raft_consensus.cc:2243] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.572676  9741 raft_consensus.cc:2272] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.574905  9741 tablet_replica.cc:333] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.575655  9741 raft_consensus.cc:2243] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:34.576619  9741 raft_consensus.cc:2272] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.579643  9741 tablet_replica.cc:333] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.580410  9741 raft_consensus.cc:2243] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.581619  9741 raft_consensus.cc:2272] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.584669  9741 tablet_replica.cc:333] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.585844  9741 raft_consensus.cc:2243] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.586315  9741 raft_consensus.cc:2272] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:34.586498 20050 consensus_peers.cc:597] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:34.588884  9741 tablet_replica.cc:333] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.589808  9741 raft_consensus.cc:2243] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.590374  9741 raft_consensus.cc:2272] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.593117  9741 tablet_replica.cc:333] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
W20260709 12:24:34.593360 20050 consensus_peers.cc:597] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:34.593776  9741 raft_consensus.cc:2243] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.594472  9741 raft_consensus.cc:2272] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.597362  9741 tablet_replica.cc:333] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.598199  9741 raft_consensus.cc:2243] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:34.599272  9741 raft_consensus.cc:2272] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.601943  9741 tablet_replica.cc:333] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.602674  9741 raft_consensus.cc:2243] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.603231  9741 raft_consensus.cc:2272] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.606001  9741 tablet_replica.cc:333] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.606648  9741 raft_consensus.cc:2243] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.607179  9741 raft_consensus.cc:2272] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.609602  9741 tablet_replica.cc:333] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.610170  9741 raft_consensus.cc:2243] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:34.610944  9741 raft_consensus.cc:2272] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.612902  9741 tablet_replica.cc:333] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.613479  9741 raft_consensus.cc:2243] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.614027  9741 raft_consensus.cc:2272] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.616591  9741 tablet_replica.cc:333] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.617357  9741 raft_consensus.cc:2243] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.617872  9741 raft_consensus.cc:2272] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.620805  9741 tablet_replica.cc:333] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.621510  9741 raft_consensus.cc:2243] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:34.621655 20125 consensus_peers.cc:597] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:34.622172  9741 raft_consensus.cc:2272] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:34.624750 20200 consensus_peers.cc:597] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:34.625162  9741 tablet_replica.cc:333] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.625972  9741 raft_consensus.cc:2243] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.626511  9741 raft_consensus.cc:2272] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:34.628422 20050 consensus_peers.cc:597] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:34.629372  9741 tablet_replica.cc:333] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.630151  9741 raft_consensus.cc:2243] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.630693  9741 raft_consensus.cc:2272] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.633841  9741 tablet_replica.cc:333] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.634580  9741 raft_consensus.cc:2243] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.635087  9741 raft_consensus.cc:2272] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.637693  9741 tablet_replica.cc:333] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.638377  9741 raft_consensus.cc:2243] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.638938  9741 raft_consensus.cc:2272] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.641528  9741 tablet_replica.cc:333] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.642186  9741 raft_consensus.cc:2243] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.642668  9741 raft_consensus.cc:2272] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:34.645000  9741 tablet_replica.cc:333] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410: stopping tablet replica
I20260709 12:24:34.645617  9741 raft_consensus.cc:2243] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:34.646157  9741 raft_consensus.cc:2272] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:34.669601 20200 consensus_peers.cc:597] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:34.670387 20200 consensus_peers.cc:597] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:34.672571 20200 consensus_peers.cc:597] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:34.673261 20200 consensus_peers.cc:597] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:34.676682 20050 consensus_peers.cc:597] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:34.713459 20125 consensus_peers.cc:597] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:34.717913 19974 connection.cc:466] server connection from 127.0.0.1:48248 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48248 (request call id 253) could send its response
W20260709 12:24:34.725449 20050 consensus_peers.cc:597] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:34.775204 20200 consensus_peers.cc:597] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:34.802193 20050 consensus_peers.cc:597] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:34.812978 20050 consensus_peers.cc:597] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:34.817560 20200 consensus_peers.cc:597] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:34.831619 20050 consensus_peers.cc:597] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:34.894943 20200 consensus_peers.cc:597] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:34.895123 20125 consensus_peers.cc:597] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:35.549903 20709 raft_consensus.cc:493] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.550451 20709 raft_consensus.cc:515] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:35.552312 20709 leader_election.cc:290] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:35.553699 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff86d69d6264de598b8dd58012f7904" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
W20260709 12:24:35.557238 20200 leader_election.cc:336] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:35.557698 20200 leader_election.cc:304] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:35.558424 20709 raft_consensus.cc:2749] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.582975 20816 raft_consensus.cc:493] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.583511 20816 raft_consensus.cc:515] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:35.585588 20816 leader_election.cc:290] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:35.587338 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:35.587844 20698 raft_consensus.cc:493] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.588466 20698 raft_consensus.cc:515] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:35.589538 20159 raft_consensus.cc:2468] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 2.
I20260709 12:24:35.590672 20698 leader_election.cc:290] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:35.591796 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:35.592546 20082 raft_consensus.cc:2468] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 2.
I20260709 12:24:35.593901 20126 leader_election.cc:304] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:35.594755 20698 raft_consensus.cc:2804] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:35.594805 20050 leader_election.cc:336] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
W20260709 12:24:35.596215 20125 leader_election.cc:336] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:35.595240 20698 raft_consensus.cc:493] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.597137 20051 leader_election.cc:304] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:35.597568 20698 raft_consensus.cc:3060] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:35.600013 20816 raft_consensus.cc:2804] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:35.601140 20816 raft_consensus.cc:493] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.601681 20816 raft_consensus.cc:3060] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:35.607208 20698 raft_consensus.cc:515] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:35.608525 20797 raft_consensus.cc:493] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.609377 20816 raft_consensus.cc:515] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:35.609306 20797 raft_consensus.cc:515] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:35.612483 20232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed53455b57840a780d37b1db5103826" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:35.612864 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:35.613942 20159 raft_consensus.cc:2393] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aac061e592d74289800e4c50cbb4132b in current term 3: Already voted for candidate 45ea8ca532304a8f9ffda636d59f6f0f in this term.
I20260709 12:24:35.617980 20816 leader_election.cc:290] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:35.618161 20709 raft_consensus.cc:493] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.618700 20709 raft_consensus.cc:515] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:35.620060 20797 leader_election.cc:290] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:35.620630 20709 leader_election.cc:290] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:35.623093 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141c2e84c15e4ad38afc0a52b330f9b9" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:35.624166 20698 leader_election.cc:290] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:35.625185 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
W20260709 12:24:35.625931 20050 leader_election.cc:336] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:35.626024 20082 raft_consensus.cc:2393] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ea8ca532304a8f9ffda636d59f6f0f in current term 3: Already voted for candidate aac061e592d74289800e4c50cbb4132b in this term.
I20260709 12:24:35.626471 20050 leader_election.cc:304] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:35.628391 20797 raft_consensus.cc:2749] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:24:35.630041 20050 leader_election.cc:336] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
W20260709 12:24:35.630211 20125 leader_election.cc:336] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:35.630867 20050 leader_election.cc:304] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:35.630995 20125 leader_election.cc:304] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:35.632037 20816 raft_consensus.cc:2749] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.632421 20698 raft_consensus.cc:2749] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:24:35.630740 20200 leader_election.cc:336] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:35.633183 20200 leader_election.cc:304] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:35.633831 20709 raft_consensus.cc:2749] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.686874 20816 raft_consensus.cc:493] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.687376 20816 raft_consensus.cc:515] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:35.689479 20816 leader_election.cc:290] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:35.690498 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1257e7996388445eaa292ac68c3ad0ef" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
W20260709 12:24:35.696116 20050 leader_election.cc:336] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:35.696580 20050 leader_election.cc:304] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:35.697280 20816 raft_consensus.cc:2749] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.712199 20813 raft_consensus.cc:493] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.712730 20813 raft_consensus.cc:515] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:35.714675 20813 leader_election.cc:290] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:35.715426 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af265a90671a46cbafb3fced0f952aef" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
W20260709 12:24:35.720008 20200 leader_election.cc:336] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:35.720554 20200 leader_election.cc:304] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:35.721127 20813 raft_consensus.cc:2749] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.731351 20698 raft_consensus.cc:493] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.731900 20698 raft_consensus.cc:515] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:35.735075 20698 leader_election.cc:290] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:35.735030 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141c2e84c15e4ad38afc0a52b330f9b9" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:35.736065 20236 raft_consensus.cc:2468] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
W20260709 12:24:35.736835  9741 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 20032)
I20260709 12:24:35.737768 20124 leader_election.cc:304] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
W20260709 12:24:35.738495 20125 leader_election.cc:336] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:35.739313 20698 raft_consensus.cc:2804] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:35.739722 20698 raft_consensus.cc:493] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.740258 20698 raft_consensus.cc:3060] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.743000 20818 raft_consensus.cc:493] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.743643 20818 raft_consensus.cc:515] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:35.749187 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af265a90671a46cbafb3fced0f952aef" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:35.749769 20236 raft_consensus.cc:2468] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:24:35.746061 20818 leader_election.cc:290] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
W20260709 12:24:35.750869 20125 leader_election.cc:336] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:35.748481 20698 raft_consensus.cc:515] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:35.751399 20124 leader_election.cc:304] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:35.752157 20818 raft_consensus.cc:2804] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:35.752501 20818 raft_consensus.cc:493] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.752837 20698 leader_election.cc:290] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:35.753516 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141c2e84c15e4ad38afc0a52b330f9b9" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:35.754175 20236 raft_consensus.cc:3060] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.752864 20818 raft_consensus.cc:3060] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:35.760221 20125 leader_election.cc:336] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:35.761482 20236 raft_consensus.cc:2468] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 2.
I20260709 12:24:35.762436 20124 leader_election.cc:304] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:35.762778 20818 raft_consensus.cc:515] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:35.763128 20698 raft_consensus.cc:2804] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:35.763737 20698 raft_consensus.cc:697] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:35.764612 20698 consensus_queue.cc:237] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:35.765803 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af265a90671a46cbafb3fced0f952aef" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:35.766469 20236 raft_consensus.cc:3060] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.767416 20818 leader_election.cc:290] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
W20260709 12:24:35.769878 20125 leader_election.cc:336] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:35.772699 20236 raft_consensus.cc:2468] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 2.
I20260709 12:24:35.773901 20124 leader_election.cc:304] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:35.775185 20818 raft_consensus.cc:2804] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:35.775712 20818 raft_consensus.cc:697] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:35.776820 20818 consensus_queue.cc:237] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:35.783897 20816 raft_consensus.cc:493] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.783447 19905 catalog_manager.cc:5697] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 1 to 2, leader changed from 7204c82dd34944818a439bd468a8c410 (127.9.131.65) to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 2 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:35.784484 20816 raft_consensus.cc:515] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
W20260709 12:24:35.795578 20050 leader_election.cc:336] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:35.797859 20816 leader_election.cc:290] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:35.798906 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976741a38d1c42329394a00cbe085319" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:35.804553 20051 leader_election.cc:304] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:35.805637 20816 raft_consensus.cc:2749] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.811676 20822 raft_consensus.cc:493] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.812384 20822 raft_consensus.cc:515] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:35.816803 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976741a38d1c42329394a00cbe085319" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:35.817569 20082 raft_consensus.cc:2468] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:24:35.820222 20126 leader_election.cc:304] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:35.821049 20818 raft_consensus.cc:2804] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:35.821424 20818 raft_consensus.cc:493] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.821772 20818 raft_consensus.cc:3060] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.825552 19905 catalog_manager.cc:5697] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 1 to 2, leader changed from 7204c82dd34944818a439bd468a8c410 (127.9.131.65) to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 2 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:35.828078 20822 leader_election.cc:290] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
W20260709 12:24:35.826397 20125 leader_election.cc:336] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:35.838394 20818 raft_consensus.cc:515] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:35.842180 20818 leader_election.cc:290] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
W20260709 12:24:35.845438 20125 leader_election.cc:336] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:35.845746 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976741a38d1c42329394a00cbe085319" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:35.846367 20084 raft_consensus.cc:3060] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.856510 20084 raft_consensus.cc:2468] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 2.
I20260709 12:24:35.857606 20126 leader_election.cc:304] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:35.859601 20818 raft_consensus.cc:2804] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:35.860960 20818 raft_consensus.cc:697] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:35.861861 20818 consensus_queue.cc:237] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:35.871696 19905 catalog_manager.cc:5697] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 1 to 2, leader changed from 7204c82dd34944818a439bd468a8c410 (127.9.131.65) to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 2 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:35.885752 20818 raft_consensus.cc:493] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.886510 20818 raft_consensus.cc:515] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:35.888792 20818 leader_election.cc:290] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:35.889482 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0da04e85e534d9990213bfdcee4874c" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
W20260709 12:24:35.894212 20125 leader_election.cc:336] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:35.894665 20125 leader_election.cc:304] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:35.895288 20818 raft_consensus.cc:2749] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.903265 20818 raft_consensus.cc:493] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.903720 20818 raft_consensus.cc:515] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:35.905615 20818 leader_election.cc:290] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:35.906781 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1257e7996388445eaa292ac68c3ad0ef" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:35.907485 20084 raft_consensus.cc:2468] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:24:35.908217 20813 raft_consensus.cc:493] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.908759 20813 raft_consensus.cc:515] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:35.910854 20813 leader_election.cc:290] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:35.911809 20126 leader_election.cc:304] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
W20260709 12:24:35.912649 20125 leader_election.cc:336] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:35.913327 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed53455b57840a780d37b1db5103826" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:35.913779 20822 raft_consensus.cc:2804] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:35.913951 20084 raft_consensus.cc:2468] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:35.914211 20822 raft_consensus.cc:493] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.914621 20822 raft_consensus.cc:3060] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.915437 20201 leader_election.cc:304] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:35.917918 20813 raft_consensus.cc:2804] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:35.918282 20813 raft_consensus.cc:493] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.918639 20813 raft_consensus.cc:3060] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.927738 20822 raft_consensus.cc:515] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:35.931098 20819 raft_consensus.cc:493] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.931140 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1257e7996388445eaa292ac68c3ad0ef" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:35.931897 20082 raft_consensus.cc:3060] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.931761 20819 raft_consensus.cc:515] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:35.933974 20819 leader_election.cc:290] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:35.937794 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515975cb81844e8787a53147bb766080" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
W20260709 12:24:35.940603 20050 leader_election.cc:336] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:35.941180 20051 leader_election.cc:304] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:35.942292 20797 raft_consensus.cc:2749] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.944350 20813 raft_consensus.cc:515] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:35.948794 20082 raft_consensus.cc:2468] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 2.
I20260709 12:24:35.949010 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed53455b57840a780d37b1db5103826" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:35.949700 20084 raft_consensus.cc:3060] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.949930 20126 leader_election.cc:304] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:35.951671 20818 raft_consensus.cc:2804] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:35.952200 20818 raft_consensus.cc:697] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:35.953015 20818 consensus_queue.cc:237] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
W20260709 12:24:35.954663 20125 leader_election.cc:336] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:35.958050 20084 raft_consensus.cc:2468] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 2.
I20260709 12:24:35.958508 20813 leader_election.cc:290] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:35.959422 20201 leader_election.cc:304] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
W20260709 12:24:35.950690 20200 leader_election.cc:336] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:35.950428 20822 leader_election.cc:290] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:35.961103 20709 raft_consensus.cc:2804] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:35.961566 20709 raft_consensus.cc:697] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 2 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:35.962260 20709 consensus_queue.cc:237] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:35.966980 20822 raft_consensus.cc:493] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.967686 20822 raft_consensus.cc:515] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:35.972720 20822 leader_election.cc:290] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:35.974570 20805 raft_consensus.cc:493] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:35.975178 20805 raft_consensus.cc:515] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:35.976127 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995e00d57e1040b7b6d193c60fd84405" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:35.977552 20805 leader_election.cc:290] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:36.011073 20822 raft_consensus.cc:493] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:36.011796 20822 raft_consensus.cc:515] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:36.012447 20819 raft_consensus.cc:493] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:36.013026 20819 raft_consensus.cc:515] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:36.015190 20819 leader_election.cc:290] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:36.017654 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0da04e85e534d9990213bfdcee4874c" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:36.018369 20158 raft_consensus.cc:2468] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
W20260709 12:24:36.011253 20200 leader_election.cc:336] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:36.026669 20201 leader_election.cc:304] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:36.027698 19905 catalog_manager.cc:5697] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 1 to 2, leader changed from 7204c82dd34944818a439bd468a8c410 (127.9.131.65) to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 2 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:36.032213 20813 raft_consensus.cc:2804] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:36.033366 20813 raft_consensus.cc:493] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
W20260709 12:24:36.037266 20050 leader_election.cc:336] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
W20260709 12:24:36.038679 20200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 50754.3us
I20260709 12:24:36.038108 20813 raft_consensus.cc:3060] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.041128 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff86d69d6264de598b8dd58012f7904" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:36.041815 20236 raft_consensus.cc:2468] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:24:36.031811 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995e00d57e1040b7b6d193c60fd84405" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:36.045507 20819 raft_consensus.cc:493] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:36.046121 20819 raft_consensus.cc:515] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:36.046010 20159 raft_consensus.cc:2468] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:36.048769 20051 leader_election.cc:304] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:36.048727 20819 leader_election.cc:290] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:36.050341 20819 raft_consensus.cc:2804] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:36.050709 20819 raft_consensus.cc:493] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:36.050817 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5880437f7fb435aafab505023d9f7ae" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:36.051127 20819 raft_consensus.cc:3060] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.058053 20124 leader_election.cc:304] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:36.058957 20750 raft_consensus.cc:2804] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:36.059347 20750 raft_consensus.cc:493] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:36.059677 20750 raft_consensus.cc:3060] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.061954 20698 raft_consensus.cc:493] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:36.062513 20698 raft_consensus.cc:515] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:36.064636 20822 leader_election.cc:290] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:36.065605 20698 leader_election.cc:290] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:36.071730 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515975cb81844e8787a53147bb766080" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:36.069658 20813 raft_consensus.cc:515] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:36.072789 20082 raft_consensus.cc:2468] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:24:36.074257 20126 leader_election.cc:304] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:36.075163 20818 raft_consensus.cc:2804] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:36.075544 20818 raft_consensus.cc:493] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:36.075892 20818 raft_consensus.cc:3060] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.078577 20698 raft_consensus.cc:493] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:36.079171 20698 raft_consensus.cc:515] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:36.082474 20698 leader_election.cc:290] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:36.082612 20750 raft_consensus.cc:515] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:36.074188 20813 leader_election.cc:290] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:36.083765 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5880437f7fb435aafab505023d9f7ae" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:36.084470 20084 raft_consensus.cc:2468] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:24:36.085655 20126 leader_election.cc:304] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:36.087566 20698 raft_consensus.cc:2804] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:36.087970 20698 raft_consensus.cc:493] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:36.088295 20698 raft_consensus.cc:3060] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:36.092203 20125 leader_election.cc:336] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:36.092535 20818 raft_consensus.cc:515] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:36.093250 20125 leader_election.cc:304] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:36.094214 20822 raft_consensus.cc:2749] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.096570 20818 leader_election.cc:290] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:36.096787 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515975cb81844e8787a53147bb766080" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:36.097435 20084 raft_consensus.cc:3060] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:36.099149 20200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 55181.9us
W20260709 12:24:36.102728 20200 leader_election.cc:336] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:36.105501 20084 raft_consensus.cc:2468] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 2.
I20260709 12:24:36.104959 19905 catalog_manager.cc:5697] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 1 to 2, leader changed from 7204c82dd34944818a439bd468a8c410 (127.9.131.65) to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 2 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:36.107949 20698 raft_consensus.cc:515] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:36.108021 20126 leader_election.cc:304] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:36.110999 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5880437f7fb435aafab505023d9f7ae" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:36.111671 20082 raft_consensus.cc:3060] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.111932 20698 leader_election.cc:290] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:36.112643 20698 raft_consensus.cc:2804] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:36.113058 20698 raft_consensus.cc:697] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:36.113828 20698 consensus_queue.cc:237] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
W20260709 12:24:36.118952 20050 leader_election.cc:336] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:36.123808 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff86d69d6264de598b8dd58012f7904" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
W20260709 12:24:36.125895 20200 leader_election.cc:336] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:36.126205 20236 raft_consensus.cc:3060] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.126133 20050 leader_election.cc:304] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:36.122802 20750 leader_election.cc:290] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:36.134282 19905 catalog_manager.cc:5697] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 1 to 2, leader changed from 7204c82dd34944818a439bd468a8c410 (127.9.131.65) to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 2 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:36.135339 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0da04e85e534d9990213bfdcee4874c" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:36.135941 20158 raft_consensus.cc:3060] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.142542 20158 raft_consensus.cc:2468] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 2.
I20260709 12:24:36.141731 20082 raft_consensus.cc:2468] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 2.
W20260709 12:24:36.148272 20125 leader_election.cc:336] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:36.148584 20126 leader_election.cc:304] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
W20260709 12:24:36.149545 20125 leader_election.cc:336] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:36.150832 20818 raft_consensus.cc:2804] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:36.151417 20818 raft_consensus.cc:697] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:36.152431 20833 raft_consensus.cc:2749] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.154368 20818 consensus_queue.cc:237] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
W20260709 12:24:36.157907 20125 leader_election.cc:336] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:36.146672 20236 raft_consensus.cc:2468] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 2.
W20260709 12:24:36.159135 20125 leader_election.cc:336] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:36.125099 20819 raft_consensus.cc:515] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:36.160764 20124 leader_election.cc:304] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:36.162050 20201 leader_election.cc:304] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:36.162370 20750 raft_consensus.cc:2804] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:36.163482 20750 raft_consensus.cc:697] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:36.163727 20709 raft_consensus.cc:2804] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:36.164299 20709 raft_consensus.cc:697] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [term 2 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:36.164441 20750 consensus_queue.cc:237] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:36.165103 20709 consensus_queue.cc:237] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
W20260709 12:24:36.168453 20125 leader_election.cc:336] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:36.173456 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995e00d57e1040b7b6d193c60fd84405" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:36.174157 20159 raft_consensus.cc:3060] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:36.175076 20050 leader_election.cc:336] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
W20260709 12:24:36.176465 20125 leader_election.cc:336] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:36.186194 20159 raft_consensus.cc:2468] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 2.
I20260709 12:24:36.187439 20051 leader_election.cc:304] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:36.188817 20833 raft_consensus.cc:2804] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:36.189363 20833 raft_consensus.cc:697] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 2 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:36.190150 20833 consensus_queue.cc:237] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:36.194927 20819 leader_election.cc:290] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:36.210194 19905 catalog_manager.cc:5697] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 1 to 2, leader changed from 7204c82dd34944818a439bd468a8c410 (127.9.131.65) to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 2 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:36.229413 19908 catalog_manager.cc:5697] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 1 to 2, leader changed from 7204c82dd34944818a439bd468a8c410 (127.9.131.65) to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 2 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:36.237244 19906 catalog_manager.cc:5697] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 1 to 2, leader changed from 7204c82dd34944818a439bd468a8c410 (127.9.131.65) to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 2 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:36.243432 20125 consensus_peers.cc:597] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:36.266601 19908 catalog_manager.cc:5697] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 1 to 2, leader changed from 7204c82dd34944818a439bd468a8c410 (127.9.131.65) to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 2 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:36.326493 20125 consensus_peers.cc:597] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:36.357188 20125 consensus_peers.cc:597] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:36.369590 20236 raft_consensus.cc:1275] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Refusing update from remote peer 45ea8ca532304a8f9ffda636d59f6f0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:36.371250 20818 consensus_queue.cc:1048] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:36.377583 20236 raft_consensus.cc:1275] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Refusing update from remote peer 45ea8ca532304a8f9ffda636d59f6f0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:36.379175 20818 consensus_queue.cc:1048] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:36.385798 20082 raft_consensus.cc:1275] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Refusing update from remote peer 45ea8ca532304a8f9ffda636d59f6f0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:36.388082 20818 consensus_queue.cc:1048] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:36.510740 20125 consensus_peers.cc:597] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:36.511633 20200 consensus_peers.cc:597] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:36.514415 20082 raft_consensus.cc:1275] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Refusing update from remote peer 45ea8ca532304a8f9ffda636d59f6f0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:36.515571 20851 consensus_queue.cc:1048] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:36.523245 20084 raft_consensus.cc:1275] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Refusing update from remote peer 45ea8ca532304a8f9ffda636d59f6f0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:36.524907 20851 consensus_queue.cc:1048] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:36.549557 20125 consensus_peers.cc:597] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:36.552842 20159 raft_consensus.cc:1275] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Refusing update from remote peer c470740d41ee4b9383923d08a87655d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:36.554339 20832 consensus_queue.cc:1048] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:36.562570 20084 raft_consensus.cc:1275] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Refusing update from remote peer c470740d41ee4b9383923d08a87655d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:36.564899 20832 consensus_queue.cc:1048] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:36.565523 20236 raft_consensus.cc:1275] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Refusing update from remote peer 45ea8ca532304a8f9ffda636d59f6f0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:36.567957 20822 consensus_queue.cc:1048] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:36.641528 20050 consensus_peers.cc:597] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:36.650794 20200 consensus_peers.cc:597] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:36.683151 20125 consensus_peers.cc:597] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:36.686586 20159 raft_consensus.cc:1275] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Refusing update from remote peer aac061e592d74289800e4c50cbb4132b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:24:36.687275 20200 consensus_peers.cc:597] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:36.689311 20816 consensus_queue.cc:1048] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:36.698307 20125 consensus_peers.cc:597] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:36.708732 20050 consensus_peers.cc:597] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:36.737329  9741 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 20032)
W20260709 12:24:36.760754 20200 consensus_peers.cc:597] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:36.780009 20084 raft_consensus.cc:1275] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Refusing update from remote peer 45ea8ca532304a8f9ffda636d59f6f0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:36.781567 20822 consensus_queue.cc:1048] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:36.794883 20200 consensus_peers.cc:597] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:36.839020 20050 consensus_peers.cc:597] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:36.851191 20200 consensus_peers.cc:597] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:36.870626 20200 consensus_peers.cc:597] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:36.871171 20200 consensus_peers.cc:597] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:36.876536 20125 consensus_peers.cc:597] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:36.886991 20125 consensus_peers.cc:597] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:36.939097 20050 consensus_peers.cc:597] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:36.960145 20050 consensus_peers.cc:597] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:37.009511 20200 consensus_peers.cc:597] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:37.019728 20050 consensus_peers.cc:597] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:37.083319 20050 consensus_peers.cc:597] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:37.084097 20200 consensus_peers.cc:597] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:37.088675 20125 consensus_peers.cc:597] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:37.106817 20050 consensus_peers.cc:597] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:37.138566 20125 consensus_peers.cc:597] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:37.140708 20200 consensus_peers.cc:597] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:37.143117 20200 consensus_peers.cc:597] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:37.147766 20125 consensus_peers.cc:597] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:37.169123 20050 consensus_peers.cc:597] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:37.230212 20200 consensus_peers.cc:597] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:37.253177 20050 consensus_peers.cc:597] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:37.254765 20200 consensus_peers.cc:597] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:37.268623 20200 consensus_peers.cc:597] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:37.278199 20200 consensus_peers.cc:597] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:37.370330 20050 consensus_peers.cc:597] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:37.375630 20200 consensus_peers.cc:597] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:37.394496 20200 consensus_peers.cc:597] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:37.435336 20125 consensus_peers.cc:597] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:37.532626 20050 consensus_peers.cc:597] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:37.540058 20050 consensus_peers.cc:597] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:37.611521 20833 raft_consensus.cc:493] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.612079 20833 raft_consensus.cc:515] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:37.615235 20848 raft_consensus.cc:493] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.615970 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:37.615795 20848 raft_consensus.cc:515] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
W20260709 12:24:37.617758 20050 leader_election.cc:336] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:37.618369 20159 raft_consensus.cc:2468] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 3.
I20260709 12:24:37.619196 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:37.619903 20084 raft_consensus.cc:2468] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 3.
I20260709 12:24:37.620033 20051 leader_election.cc:304] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:37.618090 20848 leader_election.cc:290] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:37.621527 20833 leader_election.cc:290] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:37.621119 20126 leader_election.cc:304] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:37.621439 20819 raft_consensus.cc:2804] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:37.625253 20819 raft_consensus.cc:493] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.625646 20819 raft_consensus.cc:3060] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:37.625438 20851 raft_consensus.cc:2804] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:37.626631 20851 raft_consensus.cc:493] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.626983 20851 raft_consensus.cc:3060] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:37.630227 20125 leader_election.cc:336] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:37.635255 20819 raft_consensus.cc:515] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:37.637145 20851 raft_consensus.cc:515] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:37.638155 20819 leader_election.cc:290] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 4 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:37.640174 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:37.641063 20159 raft_consensus.cc:2393] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aac061e592d74289800e4c50cbb4132b in current term 4: Already voted for candidate 45ea8ca532304a8f9ffda636d59f6f0f in this term.
W20260709 12:24:37.645850 20050 leader_election.cc:336] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:37.639361 20851 leader_election.cc:290] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 4 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:37.646325 20050 leader_election.cc:304] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:37.647666 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
W20260709 12:24:37.648264 20125 leader_election.cc:336] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:37.648654 20084 raft_consensus.cc:2393] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ea8ca532304a8f9ffda636d59f6f0f in current term 4: Already voted for candidate aac061e592d74289800e4c50cbb4132b in this term.
I20260709 12:24:37.649219 20819 raft_consensus.cc:2749] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:37.650166 20126 leader_election.cc:304] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:37.651101 20851 raft_consensus.cc:2749] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:24:37.737874  9741 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 20032)
W20260709 12:24:38.532488 20125 consensus_peers.cc:597] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:38.606063 20125 consensus_peers.cc:597] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:38.738344  9741 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 20032)
W20260709 12:24:38.759203 20125 consensus_peers.cc:597] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:39.020522 20050 consensus_peers.cc:597] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.029652 20125 consensus_peers.cc:597] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:39.050671 20200 consensus_peers.cc:597] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:39.139964 20200 consensus_peers.cc:597] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:39.140813 20200 consensus_peers.cc:597] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.185647 20125 consensus_peers.cc:597] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.249282 20125 consensus_peers.cc:597] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:39.292316 20050 consensus_peers.cc:597] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:39.308568 20833 raft_consensus.cc:493] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:39.309661 20050 consensus_peers.cc:597] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:39.309933 20833 raft_consensus.cc:515] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
W20260709 12:24:39.313851 20200 consensus_peers.cc:597] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:39.315372 20833 leader_election.cc:290] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:39.318058 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:39.319317 20159 raft_consensus.cc:2468] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 4.
W20260709 12:24:39.321110 20050 leader_election.cc:336] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:39.327824 20051 leader_election.cc:304] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:39.329061 20833 raft_consensus.cc:2804] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:39.329636 20833 raft_consensus.cc:493] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.330029 20833 raft_consensus.cc:3060] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:39.341856 20125 consensus_peers.cc:597] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:39.342828 20833 raft_consensus.cc:515] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:39.344439 20833 leader_election.cc:290] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 5 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:39.345583 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:39.346230 20159 raft_consensus.cc:3060] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:39.348841 20050 leader_election.cc:336] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:24:39.354578 20159 raft_consensus.cc:2468] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 5.
I20260709 12:24:39.356421 20051 leader_election.cc:304] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:39.357827 20862 raft_consensus.cc:2804] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:39.360934 20862 raft_consensus.cc:697] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 5 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:39.363447 20862 consensus_queue.cc:237] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
W20260709 12:24:39.364796 20050 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111) [suppressed 438 similar messages]
W20260709 12:24:39.368466 20050 consensus_peers.cc:597] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:39.381223 19906 catalog_manager.cc:5697] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 2 to 5, leader changed from 7204c82dd34944818a439bd468a8c410 (127.9.131.65) to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 5 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:39.410241 20125 consensus_peers.cc:597] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.424018 20050 consensus_peers.cc:597] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.424672 20050 consensus_peers.cc:597] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.438922 20200 consensus_peers.cc:597] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.440768 20200 consensus_peers.cc:597] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.453572 20125 consensus_peers.cc:597] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.519513 20125 consensus_peers.cc:597] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:39.543641 20200 consensus_peers.cc:597] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.588379 20200 consensus_peers.cc:597] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.601387 20125 consensus_peers.cc:597] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.623847 20200 consensus_peers.cc:597] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.642177 20050 consensus_peers.cc:597] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.700114 20050 consensus_peers.cc:597] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.705812 20200 consensus_peers.cc:597] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.707880 20200 consensus_peers.cc:597] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.714121 20125 consensus_peers.cc:597] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.739058  9741 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 20032)
W20260709 12:24:39.749523 20200 consensus_peers.cc:597] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.776821 20200 consensus_peers.cc:597] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.783600 20050 consensus_peers.cc:597] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.792380 20200 consensus_peers.cc:597] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.817795 20050 consensus_peers.cc:597] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:39.824275 20125 consensus_peers.cc:597] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.847599 20050 consensus_peers.cc:597] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.862811 20200 consensus_peers.cc:597] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.943806 20050 consensus_peers.cc:597] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:39.944837 20200 consensus_peers.cc:597] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:39.959223 20159 raft_consensus.cc:1275] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 5 FOLLOWER]: Refusing update from remote peer aac061e592d74289800e4c50cbb4132b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:39.961591 20833 consensus_queue.cc:1048] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:24:39.963757 20200 consensus_peers.cc:597] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:40.054910 20200 consensus_peers.cc:597] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:40.134176 20050 consensus_peers.cc:597] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:40.152514 20050 consensus_peers.cc:597] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:40.275519  9741 tablet_server.cc:196] TabletServer@127.9.131.65:0 shutdown complete.
I20260709 12:24:40.410501  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:40.420840 20877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:40.420874 20878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:40.422257 20880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:40.425865  9741 server_base.cc:1061] running on GCE node
I20260709 12:24:40.430003  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:40.430333  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:40.430574  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599880430555 us; error 0 us; skew 500 ppm
I20260709 12:24:40.431430  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:40.436244  9741 webserver.cc:533] Webserver started at http://127.9.131.65:41691/ using document root <none> and password file <none>
I20260709 12:24:40.437017  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:40.437318  9741 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:24:40.441514  9741 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:24:40.450673 20885 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:40.452279  9741 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 12:24:40.452620  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-0-root
uuid: "7204c82dd34944818a439bd468a8c410"
format_stamp: "Formatted at 2026-07-09 12:24:21 on dist-test-slave-r7s7"
I20260709 12:24:40.453101  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599527842218-9741-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:40.465214  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:40.466693  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:40.468504  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:40.474741 20892 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 12:24:40.768613  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:24:40.768924  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.295s	user 0.006s	sys 0.005s
I20260709 12:24:40.769287  9741 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:24:40.775470 20892 tablet_bootstrap.cc:492] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:40.796073 20892 tablet_bootstrap.cc:492] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:40.797518 20892 tablet_bootstrap.cc:492] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:40.798666 20892 ts_tablet_manager.cc:1403] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.023s	user 0.021s	sys 0.000s
I20260709 12:24:40.801386 20892 raft_consensus.cc:359] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:40.802127 20892 raft_consensus.cc:740] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.802860 20892 consensus_queue.cc:260] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:40.821187 20892 ts_tablet_manager.cc:1434] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.012s
I20260709 12:24:40.822175 20892 tablet_bootstrap.cc:492] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:40.856611 20892 tablet_bootstrap.cc:492] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:40.857689 20892 tablet_bootstrap.cc:492] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:40.858446 20892 ts_tablet_manager.cc:1403] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.037s	user 0.027s	sys 0.008s
I20260709 12:24:40.861256 20892 raft_consensus.cc:359] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:40.862056 20892 raft_consensus.cc:740] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.862905 20892 consensus_queue.cc:260] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:40.865178 20892 ts_tablet_manager.cc:1434] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 12:24:40.866039 20892 tablet_bootstrap.cc:492] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:40.883472 20892 tablet_bootstrap.cc:492] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:40.884897 20892 tablet_bootstrap.cc:492] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:40.885603 20892 ts_tablet_manager.cc:1403] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 12:24:40.888176 20892 raft_consensus.cc:359] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:40.889137 20892 raft_consensus.cc:740] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.889822 20892 consensus_queue.cc:260] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:40.891536 20892 ts_tablet_manager.cc:1434] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:40.892256 20892 tablet_bootstrap.cc:492] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:40.920652 20892 tablet_bootstrap.cc:492] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:40.922863 20892 tablet_bootstrap.cc:492] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:40.923606 20892 ts_tablet_manager.cc:1403] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.008s
I20260709 12:24:40.926368 20892 raft_consensus.cc:359] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:40.927192 20892 raft_consensus.cc:740] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.928146 20892 consensus_queue.cc:260] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:40.930483 20892 ts_tablet_manager.cc:1434] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:24:40.931453 20892 tablet_bootstrap.cc:492] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:40.948185 20892 tablet_bootstrap.cc:492] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:40.950117 20892 tablet_bootstrap.cc:492] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:40.950873 20892 ts_tablet_manager.cc:1403] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:24:40.953428 20892 raft_consensus.cc:359] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:40.954149 20892 raft_consensus.cc:740] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.954967 20892 consensus_queue.cc:260] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:40.956914 20892 ts_tablet_manager.cc:1434] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:24:40.957664 20892 tablet_bootstrap.cc:492] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:40.972342 20892 tablet_bootstrap.cc:492] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:40.973260 20892 tablet_bootstrap.cc:492] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:40.973820 20892 ts_tablet_manager.cc:1403] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:24:40.976341 20892 raft_consensus.cc:359] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:40.976876 20892 raft_consensus.cc:740] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.977537 20892 consensus_queue.cc:260] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:40.980659 20892 ts_tablet_manager.cc:1434] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:24:40.981766 20892 tablet_bootstrap.cc:492] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:40.995930 20892 tablet_bootstrap.cc:492] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:40.998662 20892 tablet_bootstrap.cc:492] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.000595 20892 ts_tablet_manager.cc:1403] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 12:24:41.003101 20892 raft_consensus.cc:359] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:41.004273 20892 raft_consensus.cc:740] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.005112 20892 consensus_queue.cc:260] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:41.008671 20892 ts_tablet_manager.cc:1434] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:24:41.009346 20892 tablet_bootstrap.cc:492] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.023311 20892 tablet_bootstrap.cc:492] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.024328 20892 tablet_bootstrap.cc:492] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.025014 20892 ts_tablet_manager.cc:1403] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 12:24:41.027590 20892 raft_consensus.cc:359] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:41.028314 20892 raft_consensus.cc:740] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.029044 20892 consensus_queue.cc:260] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:41.031116 20892 ts_tablet_manager.cc:1434] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:24:41.032006 20892 tablet_bootstrap.cc:492] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.048316 20892 tablet_bootstrap.cc:492] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.049355 20892 tablet_bootstrap.cc:492] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.049966 20892 ts_tablet_manager.cc:1403] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 12:24:41.052886 20892 raft_consensus.cc:359] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:41.053539 20892 raft_consensus.cc:740] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.054160 20892 consensus_queue.cc:260] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:41.056293 20892 ts_tablet_manager.cc:1434] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:24:41.056923 20892 tablet_bootstrap.cc:492] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.069465  9741 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:24:41.070007  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.301s	user 0.274s	sys 0.004s
I20260709 12:24:41.074450 20892 tablet_bootstrap.cc:492] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.075798 20892 tablet_bootstrap.cc:492] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.077723 20892 ts_tablet_manager.cc:1403] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 12:24:41.081086 20892 raft_consensus.cc:359] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:41.081692 20892 raft_consensus.cc:740] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.082317 20892 consensus_queue.cc:260] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:41.084444 20892 ts_tablet_manager.cc:1434] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:24:41.085345 20892 tablet_bootstrap.cc:492] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
W20260709 12:24:41.098984 20125 consensus_peers.cc:597] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:41.103025 20892 tablet_bootstrap.cc:492] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.104156 20892 tablet_bootstrap.cc:492] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.104836 20892 ts_tablet_manager.cc:1403] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 12:24:41.107628 20892 raft_consensus.cc:359] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:41.108412 20892 raft_consensus.cc:740] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.110185 20892 consensus_queue.cc:260] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:41.114583 20892 ts_tablet_manager.cc:1434] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:24:41.115458 20892 tablet_bootstrap.cc:492] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.130316 20892 tablet_bootstrap.cc:492] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.131384 20892 tablet_bootstrap.cc:492] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.132189 20892 ts_tablet_manager.cc:1403] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 12:24:41.134188 20892 raft_consensus.cc:359] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:41.134733 20892 raft_consensus.cc:740] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.135818 20892 consensus_queue.cc:260] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:41.138164 20892 ts_tablet_manager.cc:1434] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:41.139997 20892 tablet_bootstrap.cc:492] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
W20260709 12:24:41.146977 20125 consensus_peers.cc:597] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:41.183985 20125 consensus_peers.cc:597] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:41.184397 20200 consensus_peers.cc:597] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:41.189028 20892 tablet_bootstrap.cc:492] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.190091 20892 tablet_bootstrap.cc:492] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.190809 20892 ts_tablet_manager.cc:1403] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.012s
I20260709 12:24:41.194512 20892 raft_consensus.cc:359] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:41.195299 20892 raft_consensus.cc:740] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.196173 20892 consensus_queue.cc:260] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:41.198709 20892 ts_tablet_manager.cc:1434] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:24:41.199698 20892 tablet_bootstrap.cc:492] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.215796  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.65:43339
I20260709 12:24:41.215917 20966 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.65:43339 every 8 connection(s)
I20260709 12:24:41.219000 20892 tablet_bootstrap.cc:492] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.221012 20892 tablet_bootstrap.cc:492] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.221715 20892 ts_tablet_manager.cc:1403] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.001s
I20260709 12:24:41.224715 20892 raft_consensus.cc:359] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:41.225564 20892 raft_consensus.cc:740] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.226405 20892 consensus_queue.cc:260] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:41.228281 20892 ts_tablet_manager.cc:1434] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 12:24:41.229239 20892 tablet_bootstrap.cc:492] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.251219 20892 tablet_bootstrap.cc:492] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.253535 20892 tablet_bootstrap.cc:492] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.254302 20892 ts_tablet_manager.cc:1403] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.004s
I20260709 12:24:41.256727 20967 heartbeater.cc:344] Connected to a master server at 127.9.131.126:36271
I20260709 12:24:41.257273 20967 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:41.257181 20892 raft_consensus.cc:359] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:41.258052 20892 raft_consensus.cc:740] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.258328 20967 heartbeater.cc:507] Master 127.9.131.126:36271 requested a full tablet report, sending...
I20260709 12:24:41.258774 20892 consensus_queue.cc:260] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:41.261237 20892 ts_tablet_manager.cc:1434] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:24:41.262109 20892 tablet_bootstrap.cc:492] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.292438 19905 ts_manager.cc:194] Re-registered known tserver with Master: 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:41.297762 20892 tablet_bootstrap.cc:492] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.298765 20892 tablet_bootstrap.cc:492] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.299480 20892 ts_tablet_manager.cc:1403] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.008s
I20260709 12:24:41.302832 20892 raft_consensus.cc:359] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:41.303954 20892 raft_consensus.cc:740] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.307370 20892 consensus_queue.cc:260] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:41.308938 20892 ts_tablet_manager.cc:1434] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.003s
I20260709 12:24:41.309618 20892 tablet_bootstrap.cc:492] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.321530 20892 tablet_bootstrap.cc:492] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.322332 20892 tablet_bootstrap.cc:492] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.323096 20892 ts_tablet_manager.cc:1403] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 12:24:41.325419 20892 raft_consensus.cc:359] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:41.326083 20892 raft_consensus.cc:740] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.326830 20892 consensus_queue.cc:260] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:41.327210 19905 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59026
I20260709 12:24:41.329026 20892 ts_tablet_manager.cc:1434] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:24:41.329990 20892 tablet_bootstrap.cc:492] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.331664 20967 heartbeater.cc:499] Master 127.9.131.126:36271 was elected leader, sending a full tablet report...
I20260709 12:24:41.352314 20892 tablet_bootstrap.cc:492] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.353219 20892 tablet_bootstrap.cc:492] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.353837 20892 ts_tablet_manager.cc:1403] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.004s
I20260709 12:24:41.355849 20892 raft_consensus.cc:359] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:41.356564 20892 raft_consensus.cc:740] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.357307 20892 consensus_queue.cc:260] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:41.359182 20892 ts_tablet_manager.cc:1434] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:24:41.360069 20892 tablet_bootstrap.cc:492] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.375327 20892 tablet_bootstrap.cc:492] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.376207 20892 tablet_bootstrap.cc:492] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.376885 20892 ts_tablet_manager.cc:1403] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.006s
I20260709 12:24:41.380105 20892 raft_consensus.cc:359] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:41.380882 20892 raft_consensus.cc:740] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.381487 20892 consensus_queue.cc:260] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:41.383035 20892 ts_tablet_manager.cc:1434] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.001s
I20260709 12:24:41.383884 20892 tablet_bootstrap.cc:492] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.421268 20892 tablet_bootstrap.cc:492] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.422070 20892 tablet_bootstrap.cc:492] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.422729 20892 ts_tablet_manager.cc:1403] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.016s
I20260709 12:24:41.424964 20892 raft_consensus.cc:359] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:41.425513 20892 raft_consensus.cc:740] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.426074 20892 consensus_queue.cc:260] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:41.428227 20892 ts_tablet_manager.cc:1434] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:24:41.429752 20892 tablet_bootstrap.cc:492] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.445688 20892 tablet_bootstrap.cc:492] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.446467 20892 tablet_bootstrap.cc:492] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.447037 20892 ts_tablet_manager.cc:1403] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:24:41.449683 20892 raft_consensus.cc:359] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:41.450464 20892 raft_consensus.cc:740] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.451314 20892 consensus_queue.cc:260] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:41.453584 20892 ts_tablet_manager.cc:1434] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:41.463452 20892 tablet_bootstrap.cc:492] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
W20260709 12:24:41.478247 20125 consensus_peers.cc:597] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:41.481436 20892 tablet_bootstrap.cc:492] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.482600 20892 tablet_bootstrap.cc:492] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.483331 20892 ts_tablet_manager.cc:1403] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:24:41.485926 20938 raft_consensus.cc:3060] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:41.486624 20892 raft_consensus.cc:359] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:41.487411 20892 raft_consensus.cc:740] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.488343 20892 consensus_queue.cc:260] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:41.489918 20892 ts_tablet_manager.cc:1434] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 12:24:41.491197 20892 tablet_bootstrap.cc:492] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.506855 20892 tablet_bootstrap.cc:492] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.507591 20892 tablet_bootstrap.cc:492] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.508235 20892 ts_tablet_manager.cc:1403] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.008s
I20260709 12:24:41.510299 20892 raft_consensus.cc:359] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:41.510834 20892 raft_consensus.cc:740] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.511459 20892 consensus_queue.cc:260] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:41.513266 20892 ts_tablet_manager.cc:1434] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:24:41.514109 20892 tablet_bootstrap.cc:492] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
W20260709 12:24:41.518353 20200 consensus_peers.cc:597] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:24:41.532238 20892 tablet_bootstrap.cc:492] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.533110 20892 tablet_bootstrap.cc:492] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.533672 20892 ts_tablet_manager.cc:1403] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 12:24:41.536082 20892 raft_consensus.cc:359] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:41.536631 20892 raft_consensus.cc:740] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.537204 20892 consensus_queue.cc:260] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:41.538887 20892 ts_tablet_manager.cc:1434] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:24:41.539985 20892 tablet_bootstrap.cc:492] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.554005 20892 tablet_bootstrap.cc:492] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.554757 20892 tablet_bootstrap.cc:492] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.555338 20892 ts_tablet_manager.cc:1403] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 12:24:41.557209 20892 raft_consensus.cc:359] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:41.557781 20892 raft_consensus.cc:740] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.558436 20892 consensus_queue.cc:260] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:41.559980 20892 ts_tablet_manager.cc:1434] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.004s	user 0.008s	sys 0.000s
I20260709 12:24:41.561280 20892 tablet_bootstrap.cc:492] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.574225 20892 tablet_bootstrap.cc:492] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.575098 20892 tablet_bootstrap.cc:492] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.575763 20892 ts_tablet_manager.cc:1403] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 12:24:41.578235 20892 raft_consensus.cc:359] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:41.578814 20892 raft_consensus.cc:740] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.579403 20892 consensus_queue.cc:260] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:41.581462 20892 ts_tablet_manager.cc:1434] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:24:41.582151 20892 tablet_bootstrap.cc:492] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.589282 20938 raft_consensus.cc:3060] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:41.606609 20892 tablet_bootstrap.cc:492] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.607604 20892 tablet_bootstrap.cc:492] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.608462 20892 ts_tablet_manager.cc:1403] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.008s
I20260709 12:24:41.611006 20892 raft_consensus.cc:359] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:41.611725 20892 raft_consensus.cc:740] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.612416 20892 consensus_queue.cc:260] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:41.614243 20892 ts_tablet_manager.cc:1434] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:24:41.615088 20892 tablet_bootstrap.cc:492] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.624948 20939 raft_consensus.cc:3060] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:41.653183 20892 tablet_bootstrap.cc:492] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.654284 20892 tablet_bootstrap.cc:492] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.655067 20892 ts_tablet_manager.cc:1403] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.040s	user 0.035s	sys 0.004s
I20260709 12:24:41.657699 20892 raft_consensus.cc:359] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:41.658473 20892 raft_consensus.cc:740] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.659313 20892 consensus_queue.cc:260] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:41.661500 20892 ts_tablet_manager.cc:1434] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:41.662495 20892 tablet_bootstrap.cc:492] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.685099 20892 tablet_bootstrap.cc:492] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.686210 20892 tablet_bootstrap.cc:492] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.686993 20892 ts_tablet_manager.cc:1403] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 12:24:41.689620 20892 raft_consensus.cc:359] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:41.690408 20892 raft_consensus.cc:740] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.691102 20892 consensus_queue.cc:260] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:41.693533 20892 ts_tablet_manager.cc:1434] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:24:41.694478 20892 tablet_bootstrap.cc:492] T 0252a8e0d9ac4440b3affdcbf4cf2246 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.706073 20938 raft_consensus.cc:3060] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:41.747475 20892 tablet_bootstrap.cc:492] T 0252a8e0d9ac4440b3affdcbf4cf2246 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.748636 20892 tablet_bootstrap.cc:492] T 0252a8e0d9ac4440b3affdcbf4cf2246 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.749411 20892 ts_tablet_manager.cc:1403] T 0252a8e0d9ac4440b3affdcbf4cf2246 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.055s	user 0.020s	sys 0.019s
I20260709 12:24:41.752089 20892 raft_consensus.cc:359] T 0252a8e0d9ac4440b3affdcbf4cf2246 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:41.753228 20939 raft_consensus.cc:3060] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:41.755944 20892 raft_consensus.cc:740] T 0252a8e0d9ac4440b3affdcbf4cf2246 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.757699 20892 consensus_queue.cc:260] T 0252a8e0d9ac4440b3affdcbf4cf2246 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:41.760851 20892 ts_tablet_manager.cc:1434] T 0252a8e0d9ac4440b3affdcbf4cf2246 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
W20260709 12:24:41.761237 20200 consensus_peers.cc:597] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:41.761718 20892 tablet_bootstrap.cc:492] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.765390 20936 raft_consensus.cc:3060] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:41.780615 20937 raft_consensus.cc:3060] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:41.812377 20051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40749, user_credentials={real_user=slave}} blocked reactor thread for 90112.9us
I20260709 12:24:41.852732 20892 tablet_bootstrap.cc:492] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.853516 20892 tablet_bootstrap.cc:492] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.854126 20892 ts_tablet_manager.cc:1403] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.093s	user 0.027s	sys 0.014s
I20260709 12:24:41.856889 20892 raft_consensus.cc:359] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:41.857661 20892 raft_consensus.cc:740] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.858397 20892 consensus_queue.cc:260] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:41.860749 20892 ts_tablet_manager.cc:1434] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:24:41.861651 20892 tablet_bootstrap.cc:492] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.904851 20892 tablet_bootstrap.cc:492] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.905879 20892 tablet_bootstrap.cc:492] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.906577 20892 ts_tablet_manager.cc:1403] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.022s
I20260709 12:24:41.909210 20892 raft_consensus.cc:359] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:41.910010 20892 raft_consensus.cc:740] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.910687 20892 consensus_queue.cc:260] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:41.912830 20892 ts_tablet_manager.cc:1434] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:24:41.914057 20892 tablet_bootstrap.cc:492] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.929652 20892 tablet_bootstrap.cc:492] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.930445 20892 tablet_bootstrap.cc:492] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.931064 20892 ts_tablet_manager.cc:1403] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 12:24:41.933712 20892 raft_consensus.cc:359] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:41.934265 20892 raft_consensus.cc:740] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.935009 20892 consensus_queue.cc:260] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:41.938438 20892 ts_tablet_manager.cc:1434] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:24:41.939303 20892 tablet_bootstrap.cc:492] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.955142 20892 tablet_bootstrap.cc:492] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.956092 20892 tablet_bootstrap.cc:492] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.956794 20892 ts_tablet_manager.cc:1403] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 12:24:41.959226 20892 raft_consensus.cc:359] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:41.959997 20892 raft_consensus.cc:740] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.960668 20892 consensus_queue.cc:260] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:41.962895 20892 ts_tablet_manager.cc:1434] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 12:24:41.963711 20892 tablet_bootstrap.cc:492] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:41.979357 20892 tablet_bootstrap.cc:492] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.980474 20892 tablet_bootstrap.cc:492] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:41.982223 20892 ts_tablet_manager.cc:1403] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 12:24:41.985965 20892 raft_consensus.cc:359] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:41.986770 20892 raft_consensus.cc:740] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.987528 20892 consensus_queue.cc:260] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:41.995258 20892 ts_tablet_manager.cc:1434] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.005s
I20260709 12:24:41.996101 20892 tablet_bootstrap.cc:492] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:42.011834 20892 tablet_bootstrap.cc:492] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:42.012830 20892 tablet_bootstrap.cc:492] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:42.013537 20892 ts_tablet_manager.cc:1403] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 12:24:42.016161 20892 raft_consensus.cc:359] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:42.016893 20892 raft_consensus.cc:740] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.017673 20892 consensus_queue.cc:260] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:42.019798 20892 ts_tablet_manager.cc:1434] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:42.023783 20892 tablet_bootstrap.cc:492] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
W20260709 12:24:42.044240 20050 consensus_peers.cc:597] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:24:42.044409 20892 tablet_bootstrap.cc:492] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:42.045454 20892 tablet_bootstrap.cc:492] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:42.046074 20892 ts_tablet_manager.cc:1403] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 12:24:42.048331 20892 raft_consensus.cc:359] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:42.049014 20892 raft_consensus.cc:740] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.049791 20892 consensus_queue.cc:260] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:42.051301 20892 ts_tablet_manager.cc:1434] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:24:42.052191 20892 tablet_bootstrap.cc:492] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:42.069943 20892 tablet_bootstrap.cc:492] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:42.070909 20892 tablet_bootstrap.cc:492] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:42.071624 20892 ts_tablet_manager.cc:1403] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 12:24:42.074172 20892 raft_consensus.cc:359] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:42.074914 20892 raft_consensus.cc:740] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.075608 20892 consensus_queue.cc:260] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:42.077719 20892 ts_tablet_manager.cc:1434] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:42.078584 20892 tablet_bootstrap.cc:492] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:42.093227 20892 tablet_bootstrap.cc:492] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:42.094190 20892 tablet_bootstrap.cc:492] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:42.094903 20892 ts_tablet_manager.cc:1403] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 12:24:42.097554 20892 raft_consensus.cc:359] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:42.098382 20892 raft_consensus.cc:740] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.099040 20892 consensus_queue.cc:260] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:42.100950 20892 ts_tablet_manager.cc:1434] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:24:42.102000 20892 tablet_bootstrap.cc:492] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:42.116338 20892 tablet_bootstrap.cc:492] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:42.117223 20892 tablet_bootstrap.cc:492] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:42.117931 20892 ts_tablet_manager.cc:1403] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
W20260709 12:24:42.118499 20200 consensus_peers.cc:597] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:24:42.120397 20892 raft_consensus.cc:359] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:42.121163 20892 raft_consensus.cc:740] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.122002 20892 consensus_queue.cc:260] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:42.124315 20892 ts_tablet_manager.cc:1434] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:24:42.125052 20892 tablet_bootstrap.cc:492] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:42.141844 20892 tablet_bootstrap.cc:492] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:42.142845 20892 tablet_bootstrap.cc:492] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:42.143548 20892 ts_tablet_manager.cc:1403] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 12:24:42.145746 20892 raft_consensus.cc:359] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:42.146260 20892 raft_consensus.cc:740] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.146814 20892 consensus_queue.cc:260] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:42.148321 20892 ts_tablet_manager.cc:1434] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.004s	user 0.008s	sys 0.000s
I20260709 12:24:42.149524 20892 tablet_bootstrap.cc:492] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:42.164502 20892 tablet_bootstrap.cc:492] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:42.165889 20892 tablet_bootstrap.cc:492] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:42.166661 20892 ts_tablet_manager.cc:1403] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.007s
I20260709 12:24:42.169227 20892 raft_consensus.cc:359] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:42.170004 20892 raft_consensus.cc:740] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.170729 20892 consensus_queue.cc:260] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:42.174379 20892 ts_tablet_manager.cc:1434] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:24:42.178526 20892 tablet_bootstrap.cc:492] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:42.194285 20892 tablet_bootstrap.cc:492] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:42.195075 20892 tablet_bootstrap.cc:492] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:42.195737 20892 ts_tablet_manager.cc:1403] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 12:24:42.198093 20892 raft_consensus.cc:359] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:42.198747 20892 raft_consensus.cc:740] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.199415 20892 consensus_queue.cc:260] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:42.201134 20892 ts_tablet_manager.cc:1434] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:24:42.201846 20892 tablet_bootstrap.cc:492] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
I20260709 12:24:42.219712 20892 tablet_bootstrap.cc:492] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:42.220620 20892 tablet_bootstrap.cc:492] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:42.221323 20892 ts_tablet_manager.cc:1403] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:24:42.224086 20892 raft_consensus.cc:359] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:42.224889 20892 raft_consensus.cc:740] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.225711 20892 consensus_queue.cc:260] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:42.228153 20892 ts_tablet_manager.cc:1434] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:24:42.229214 20892 tablet_bootstrap.cc:492] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410: Bootstrap starting.
W20260709 12:24:42.249595 20050 consensus_peers.cc:597] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:24:42.257133 20892 tablet_bootstrap.cc:492] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:42.258020 20892 tablet_bootstrap.cc:492] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410: Bootstrap complete.
I20260709 12:24:42.258580 20892 ts_tablet_manager.cc:1403] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.014s
I20260709 12:24:42.260787 20892 raft_consensus.cc:359] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:42.261471 20892 raft_consensus.cc:740] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.262107 20892 consensus_queue.cc:260] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:42.265038 20892 ts_tablet_manager.cc:1434] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
I20260709 12:24:42.346071 20939 raft_consensus.cc:3060] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.387089 20938 raft_consensus.cc:3060] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.460918 20938 raft_consensus.cc:3060] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Advancing to term 5
I20260709 12:24:42.463546 20939 raft_consensus.cc:3060] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.225361  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:51.277452 20158 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04cd0aa441274cf38da93eec0bfadeff"
dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
mode: GRACEFUL
new_leader_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:52546
I20260709 12:24:51.278342 20158 raft_consensus.cc:606] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Received request to transfer leadership to TS 7204c82dd34944818a439bd468a8c410
I20260709 12:24:51.281352 20158 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "524118618cf740e9865e397864b56ed2"
dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
mode: GRACEFUL
new_leader_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:52546
I20260709 12:24:51.281966 20158 raft_consensus.cc:606] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Received request to transfer leadership to TS 7204c82dd34944818a439bd468a8c410
I20260709 12:24:51.284335 20158 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0ac5e9dcbf74c29aa24300975246ad3"
dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
mode: GRACEFUL
new_leader_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:52546
I20260709 12:24:51.284819 20158 raft_consensus.cc:606] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Received request to transfer leadership to TS 7204c82dd34944818a439bd468a8c410
I20260709 12:24:51.287683 20158 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf44484d11914a83a44c9a333eed7777"
dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
mode: GRACEFUL
new_leader_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:52546
I20260709 12:24:51.288336 20158 raft_consensus.cc:606] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Received request to transfer leadership to TS 7204c82dd34944818a439bd468a8c410
I20260709 12:24:51.301213 20236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d"
dest_uuid: "c470740d41ee4b9383923d08a87655d6"
mode: GRACEFUL
new_leader_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:47576
I20260709 12:24:51.301712 20236 raft_consensus.cc:606] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Received request to transfer leadership to TS 7204c82dd34944818a439bd468a8c410
I20260709 12:24:51.306900 21045 raft_consensus.cc:993] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f: : Instructing follower 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:51.307296 21045 raft_consensus.cc:1081] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Signalling peer 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:51.309114 20939 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf44484d11914a83a44c9a333eed7777"
dest_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:33000
I20260709 12:24:51.309782 20939 raft_consensus.cc:493] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:51.310186 20939 raft_consensus.cc:3060] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.315260 20082 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8691968cf8f4b04b4ef459bd321e903"
dest_uuid: "aac061e592d74289800e4c50cbb4132b"
mode: GRACEFUL
new_leader_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:54402
I20260709 12:24:51.315944 20082 raft_consensus.cc:606] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Received request to transfer leadership to TS 7204c82dd34944818a439bd468a8c410
I20260709 12:24:51.317239  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:24:51.318111 20939 raft_consensus.cc:515] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:51.318881  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:51.320207  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:51.328223 20939 leader_election.cc:290] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:51.362339 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf44484d11914a83a44c9a333eed7777" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:51.364476 20158 raft_consensus.cc:3055] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:51.367003 20158 raft_consensus.cc:740] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:51.367822 20158 consensus_queue.cc:260] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:51.370016 20158 raft_consensus.cc:3060] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.374202 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf44484d11914a83a44c9a333eed7777" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:51.374923 20236 raft_consensus.cc:3060] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.381337 21045 raft_consensus.cc:993] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f: : Instructing follower 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:51.382036 21047 raft_consensus.cc:1081] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Signalling peer 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:51.384289 20937 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04cd0aa441274cf38da93eec0bfadeff"
dest_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:33000
I20260709 12:24:51.384944 20937 raft_consensus.cc:493] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:51.385354 20937 raft_consensus.cc:3060] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.392923 20236 raft_consensus.cc:2468] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:51.395561 20937 raft_consensus.cc:515] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:51.401325 20886 leader_election.cc:304] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:51.388366 20158 raft_consensus.cc:2468] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:51.403095 20937 leader_election.cc:290] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:51.402962 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04cd0aa441274cf38da93eec0bfadeff" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:51.403891 20159 raft_consensus.cc:3055] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:51.404198 20159 raft_consensus.cc:740] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:51.404910 20159 consensus_queue.cc:260] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:51.405939 20159 raft_consensus.cc:3060] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.415282 21059 raft_consensus.cc:2804] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:51.416281 20159 raft_consensus.cc:2468] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:51.418861 20888 leader_election.cc:304] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: 
I20260709 12:24:51.424994 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04cd0aa441274cf38da93eec0bfadeff" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:51.425702 20236 raft_consensus.cc:3060] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.427732 21059 raft_consensus.cc:697] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:51.428680 21061 raft_consensus.cc:2804] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:51.428977 21059 consensus_queue.cc:237] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:51.435875 20236 raft_consensus.cc:2468] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:51.436088 21061 raft_consensus.cc:697] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:51.437208 21061 consensus_queue.cc:237] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:51.442507 19908 catalog_manager.cc:5697] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 1 to 2, leader changed from 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67) to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:51.469277 21043 raft_consensus.cc:993] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b: : Instructing follower 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:51.469834 21049 raft_consensus.cc:1081] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Signalling peer 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:51.471558 20937 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8691968cf8f4b04b4ef459bd321e903"
dest_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:32998
I20260709 12:24:51.472208 20937 raft_consensus.cc:493] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:51.472549 20937 raft_consensus.cc:3060] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.473170 19908 catalog_manager.cc:5697] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 1 to 2, leader changed from 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67) to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:51.488330 20937 raft_consensus.cc:515] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:51.491350 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8691968cf8f4b04b4ef459bd321e903" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:51.491986 20236 raft_consensus.cc:3060] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.492340 20937 leader_election.cc:290] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:51.498759 20236 raft_consensus.cc:2468] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:51.499992 20886 leader_election.cc:304] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:51.501101 21061 raft_consensus.cc:2804] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:51.501621 21061 raft_consensus.cc:697] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:51.502503 21061 consensus_queue.cc:237] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:51.503168 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8691968cf8f4b04b4ef459bd321e903" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:51.504597 20081 raft_consensus.cc:3055] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:51.504921 20081 raft_consensus.cc:740] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:51.505735 20081 consensus_queue.cc:260] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:51.507175 20081 raft_consensus.cc:3060] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.508882 21045 raft_consensus.cc:993] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f: : Instructing follower 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:51.509460 21045 raft_consensus.cc:1081] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Signalling peer 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:51.510972 20937 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0ac5e9dcbf74c29aa24300975246ad3"
dest_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:33000
I20260709 12:24:51.511992 20937 raft_consensus.cc:493] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:51.512458 20937 raft_consensus.cc:3060] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.519820 19908 catalog_manager.cc:5697] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 1 to 2, leader changed from aac061e592d74289800e4c50cbb4132b (127.9.131.66) to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.522435 20937 raft_consensus.cc:515] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:51.524052 20081 raft_consensus.cc:2468] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:51.524452 20937 leader_election.cc:290] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:51.527066 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac5e9dcbf74c29aa24300975246ad3" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:51.527644 20158 raft_consensus.cc:3055] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:51.527956 20158 raft_consensus.cc:740] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:51.528888 20158 consensus_queue.cc:260] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:51.530215 20158 raft_consensus.cc:3060] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.530216 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac5e9dcbf74c29aa24300975246ad3" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:51.534466 20081 raft_consensus.cc:3060] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.538259 20158 raft_consensus.cc:2468] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:51.539503 20888 leader_election.cc:304] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: 
I20260709 12:24:51.540434 21061 raft_consensus.cc:2804] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:51.541142 21061 raft_consensus.cc:697] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:51.542361 20081 raft_consensus.cc:2468] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:51.542029 21061 consensus_queue.cc:237] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:51.556087 19908 catalog_manager.cc:5697] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 1 to 2, leader changed from 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67) to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.707789 21045 raft_consensus.cc:993] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f: : Instructing follower 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:51.708298 21047 raft_consensus.cc:1081] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Signalling peer 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:51.709935 20937 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "524118618cf740e9865e397864b56ed2"
dest_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:33000
I20260709 12:24:51.710489 20937 raft_consensus.cc:493] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:51.710822 20937 raft_consensus.cc:3060] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.716902 20937 raft_consensus.cc:515] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:51.719035 21051 raft_consensus.cc:993] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6: : Instructing follower 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:51.719280 20937 leader_election.cc:290] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:51.719652 21051 raft_consensus.cc:1081] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Signalling peer 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:51.720317 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524118618cf740e9865e397864b56ed2" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:51.720341 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524118618cf740e9865e397864b56ed2" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:51.721020 20236 raft_consensus.cc:3060] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.721108 20158 raft_consensus.cc:3055] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:51.721494 20158 raft_consensus.cc:740] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:51.721617 20937 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d"
dest_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:33010
I20260709 12:24:51.722360 20937 raft_consensus.cc:493] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:51.722760 20937 raft_consensus.cc:3060] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.722461 20158 consensus_queue.cc:260] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:51.724224 20158 raft_consensus.cc:3060] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.728871 20236 raft_consensus.cc:2468] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:51.730018 20886 leader_election.cc:304] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:51.730931 21061 raft_consensus.cc:2804] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:51.731467 21061 raft_consensus.cc:697] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:51.731904 20937 raft_consensus.cc:515] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:51.732458 21061 consensus_queue.cc:237] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:51.734517 20937 leader_election.cc:290] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:51.737542 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:51.737937 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:51.738236 20082 raft_consensus.cc:3060] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.738559 20236 raft_consensus.cc:3055] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:51.738997 20236 raft_consensus.cc:740] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:51.739962 20236 consensus_queue.cc:260] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:51.741460 20236 raft_consensus.cc:3060] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.750813 20082 raft_consensus.cc:2468] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:51.752025 20158 raft_consensus.cc:2468] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:51.752204 20888 leader_election.cc:304] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:51.753549 21059 raft_consensus.cc:2804] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:51.754038 21059 raft_consensus.cc:697] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:51.755052 21059 consensus_queue.cc:237] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:51.757050 19908 catalog_manager.cc:5697] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 1 to 2, leader changed from 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67) to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:51.758457 20236 raft_consensus.cc:2468] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:51.772702 19908 catalog_manager.cc:5697] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 1 to 2, leader changed from c470740d41ee4b9383923d08a87655d6 (127.9.131.68) to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.845611 20236 raft_consensus.cc:1275] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.846727 21059 consensus_queue.cc:1048] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:51.860118 20159 raft_consensus.cc:1275] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.862304 21059 consensus_queue.cc:1048] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:51.943254 20236 raft_consensus.cc:1275] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.944480 21059 consensus_queue.cc:1048] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:51.956619 20159 raft_consensus.cc:1275] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.958078 21061 consensus_queue.cc:1048] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:51.990830 20232 raft_consensus.cc:1275] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.992340 21060 consensus_queue.cc:1048] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:52.004384 20082 raft_consensus.cc:1275] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:52.006268 21059 consensus_queue.cc:1048] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:52.058295 20082 raft_consensus.cc:1275] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:52.059522 21061 consensus_queue.cc:1048] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:52.076506 20159 raft_consensus.cc:1275] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:52.077919 21061 consensus_queue.cc:1048] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:52.163848 20236 raft_consensus.cc:1275] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:52.165077 21061 consensus_queue.cc:1048] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:52.178349 20159 raft_consensus.cc:1275] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:52.179772 21059 consensus_queue.cc:1048] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:52.193662 20084 raft_consensus.cc:1275] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:52.195006 21080 consensus_queue.cc:1048] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:52.223615 20236 raft_consensus.cc:1275] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:52.232383 21061 consensus_queue.cc:1048] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:52.397369  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:52.438788 20084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30dc0138443e498db94e47c81d5ca81b"
dest_uuid: "aac061e592d74289800e4c50cbb4132b"
mode: GRACEFUL
new_leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
 from {username='slave'} at 127.0.0.1:54402
I20260709 12:24:52.439401 20084 raft_consensus.cc:606] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Received request to transfer leadership to TS 45ea8ca532304a8f9ffda636d59f6f0f
I20260709 12:24:52.442370 20084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57d0409829eb45ff8e1eb6b75796eff9"
dest_uuid: "aac061e592d74289800e4c50cbb4132b"
mode: GRACEFUL
new_leader_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:54402
I20260709 12:24:52.442946 20084 raft_consensus.cc:606] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Received request to transfer leadership to TS 7204c82dd34944818a439bd468a8c410
I20260709 12:24:52.447151 20081 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75e7b860aa254e34a20e8bdae1b626df"
dest_uuid: "aac061e592d74289800e4c50cbb4132b"
mode: GRACEFUL
new_leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
 from {username='slave'} at 127.0.0.1:54402
I20260709 12:24:52.447791 20081 raft_consensus.cc:606] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Received request to transfer leadership to TS 45ea8ca532304a8f9ffda636d59f6f0f
I20260709 12:24:52.452288 20084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba98035197c34fce88758eedbfd23225"
dest_uuid: "aac061e592d74289800e4c50cbb4132b"
mode: GRACEFUL
new_leader_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:54402
I20260709 12:24:52.452824 20084 raft_consensus.cc:606] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Received request to transfer leadership to TS 7204c82dd34944818a439bd468a8c410
I20260709 12:24:52.462399 21049 raft_consensus.cc:993] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b: : Instructing follower 45ea8ca532304a8f9ffda636d59f6f0f to start an election
I20260709 12:24:52.463101 21084 raft_consensus.cc:1081] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Signalling peer 45ea8ca532304a8f9ffda636d59f6f0f to start an election
I20260709 12:24:52.464324 20234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6e608aa894f4f9d96f3e1b9b16fb7cd"
dest_uuid: "c470740d41ee4b9383923d08a87655d6"
mode: GRACEFUL
new_leader_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:47576
I20260709 12:24:52.464803 20158 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75e7b860aa254e34a20e8bdae1b626df"
dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
 from {username='slave'} at 127.0.0.1:57058
I20260709 12:24:52.465030 20234 raft_consensus.cc:606] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Received request to transfer leadership to TS 7204c82dd34944818a439bd468a8c410
I20260709 12:24:52.465380 20158 raft_consensus.cc:493] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:52.465745 20158 raft_consensus.cc:3060] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.467235  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:52.468991  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:52.469775  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:52.472251 20158 raft_consensus.cc:515] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:52.474368 20158 leader_election.cc:290] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:52.475428 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b860aa254e34a20e8bdae1b626df" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:52.475986 20234 raft_consensus.cc:3060] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.477980 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b860aa254e34a20e8bdae1b626df" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:52.478655 20084 raft_consensus.cc:3055] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:52.478950 20084 raft_consensus.cc:740] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:52.479812 20084 consensus_queue.cc:260] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:52.480975 20084 raft_consensus.cc:3060] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.482466 20234 raft_consensus.cc:2468] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 2.
I20260709 12:24:52.483769 20124 leader_election.cc:304] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:52.484635 21045 raft_consensus.cc:2804] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:52.485081 21045 raft_consensus.cc:697] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:52.485877 21045 consensus_queue.cc:237] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:52.492916 20084 raft_consensus.cc:2468] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 2.
I20260709 12:24:52.515513 21043 raft_consensus.cc:993] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b: : Instructing follower 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:52.516309 21043 raft_consensus.cc:1081] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Signalling peer 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:52.518422 20936 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57d0409829eb45ff8e1eb6b75796eff9"
dest_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:32998
I20260709 12:24:52.519026 20936 raft_consensus.cc:493] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:52.519395 20936 raft_consensus.cc:3060] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.537154 19908 catalog_manager.cc:5697] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 1 to 2, leader changed from aac061e592d74289800e4c50cbb4132b (127.9.131.66) to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 2 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:52.538242 20936 raft_consensus.cc:515] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:52.540681 20936 leader_election.cc:290] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:52.541868 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d0409829eb45ff8e1eb6b75796eff9" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:52.542325 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d0409829eb45ff8e1eb6b75796eff9" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:52.542938 20158 raft_consensus.cc:3060] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.542498 20084 raft_consensus.cc:3055] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:52.543503 20084 raft_consensus.cc:740] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:52.544315 20084 consensus_queue.cc:260] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:52.545524 20084 raft_consensus.cc:3060] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.556885 20084 raft_consensus.cc:2468] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:52.560217 20888 leader_election.cc:304] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:52.561192 21059 raft_consensus.cc:2804] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:52.561681 21059 raft_consensus.cc:697] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:52.562659 21059 consensus_queue.cc:237] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:52.565877 20158 raft_consensus.cc:2468] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:52.585678 19907 catalog_manager.cc:5697] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 1 to 2, leader changed from aac061e592d74289800e4c50cbb4132b (127.9.131.66) to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:52.625417 21043 raft_consensus.cc:993] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b: : Instructing follower 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:52.626022 21084 raft_consensus.cc:1081] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Signalling peer 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:52.628005 20937 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba98035197c34fce88758eedbfd23225"
dest_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:32998
I20260709 12:24:52.628628 20937 raft_consensus.cc:493] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:52.628964 20937 raft_consensus.cc:3060] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.634078 20937 raft_consensus.cc:515] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:52.635669 20937 leader_election.cc:290] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:52.636504 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98035197c34fce88758eedbfd23225" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:52.636683 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98035197c34fce88758eedbfd23225" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:52.637085 20084 raft_consensus.cc:3055] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:52.637259 20158 raft_consensus.cc:3060] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.637403 20084 raft_consensus.cc:740] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:52.638095 20084 consensus_queue.cc:260] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:52.639071 20084 raft_consensus.cc:3060] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.643929 20158 raft_consensus.cc:2468] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:52.645653 20888 leader_election.cc:304] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: 
I20260709 12:24:52.647143 21060 raft_consensus.cc:2804] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:52.647364 20084 raft_consensus.cc:2468] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:52.648161 21060 raft_consensus.cc:697] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:52.649782 21060 consensus_queue.cc:237] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:52.662552 19907 catalog_manager.cc:5697] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 1 to 2, leader changed from aac061e592d74289800e4c50cbb4132b (127.9.131.66) to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:52.727602 21084 raft_consensus.cc:993] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b: : Instructing follower 45ea8ca532304a8f9ffda636d59f6f0f to start an election
I20260709 12:24:52.728250 21043 raft_consensus.cc:1081] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Signalling peer 45ea8ca532304a8f9ffda636d59f6f0f to start an election
I20260709 12:24:52.730127 20158 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30dc0138443e498db94e47c81d5ca81b"
dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
 from {username='slave'} at 127.0.0.1:57058
I20260709 12:24:52.730919 20158 raft_consensus.cc:493] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:52.731379 20158 raft_consensus.cc:3060] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.735177 21048 raft_consensus.cc:993] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6: : Instructing follower 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:52.735760 21048 raft_consensus.cc:1081] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Signalling peer 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:52.737316 20937 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6e608aa894f4f9d96f3e1b9b16fb7cd"
dest_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:33010
I20260709 12:24:52.737754 20937 raft_consensus.cc:493] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:52.738054 20937 raft_consensus.cc:3060] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.739034 20158 raft_consensus.cc:515] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:52.741199 20158 leader_election.cc:290] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:52.741925 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc0138443e498db94e47c81d5ca81b" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:52.742552 20084 raft_consensus.cc:3055] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:52.742854 20084 raft_consensus.cc:740] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:52.745169 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc0138443e498db94e47c81d5ca81b" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:52.745813 20236 raft_consensus.cc:3060] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.748232 20084 consensus_queue.cc:260] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:52.750455 20084 raft_consensus.cc:3060] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.756455 20937 raft_consensus.cc:515] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:52.758455 20236 raft_consensus.cc:2468] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 2.
I20260709 12:24:52.759598 20124 leader_election.cc:304] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:52.759668 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e608aa894f4f9d96f3e1b9b16fb7cd" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:52.760608 21090 raft_consensus.cc:2804] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:52.760957 20158 raft_consensus.cc:3060] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.761148 21090 raft_consensus.cc:697] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:52.762399 20084 raft_consensus.cc:2468] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 2.
I20260709 12:24:52.762159 21090 consensus_queue.cc:237] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:52.766197 20937 leader_election.cc:290] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:52.767828 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e608aa894f4f9d96f3e1b9b16fb7cd" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:52.768532 20236 raft_consensus.cc:3055] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:52.768832 20236 raft_consensus.cc:740] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:52.769671 20236 consensus_queue.cc:260] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:52.771552 20236 raft_consensus.cc:3060] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.772058 20158 raft_consensus.cc:2468] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:52.773907 20888 leader_election.cc:304] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: 
I20260709 12:24:52.774690 21060 raft_consensus.cc:2804] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:52.775167 21060 raft_consensus.cc:697] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:52.776456 21060 consensus_queue.cc:237] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:52.780419 20236 raft_consensus.cc:2468] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:52.779410 19907 catalog_manager.cc:5697] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 1 to 2, leader changed from aac061e592d74289800e4c50cbb4132b (127.9.131.66) to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 2 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:52.793629 19908 catalog_manager.cc:5697] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 1 to 2, leader changed from c470740d41ee4b9383923d08a87655d6 (127.9.131.68) to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:52.924588 20236 raft_consensus.cc:1275] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Refusing update from remote peer 45ea8ca532304a8f9ffda636d59f6f0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:52.925755 21090 consensus_queue.cc:1048] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:52.939379 20082 raft_consensus.cc:1275] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Refusing update from remote peer 45ea8ca532304a8f9ffda636d59f6f0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:52.942016 21045 consensus_queue.cc:1048] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:52.972226 20082 raft_consensus.cc:1275] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:52.973559 21060 consensus_queue.cc:1048] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:52.984598 20158 raft_consensus.cc:1275] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:52.987208 21059 consensus_queue.cc:1048] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:53.116060 20082 raft_consensus.cc:1275] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:53.117283 21060 consensus_queue.cc:1048] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:53.129766 20158 raft_consensus.cc:1275] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:53.137205 21061 consensus_queue.cc:1048] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:53.199473 20082 raft_consensus.cc:1275] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Refusing update from remote peer 45ea8ca532304a8f9ffda636d59f6f0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:53.200649 21045 consensus_queue.cc:1048] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:53.210166 20236 raft_consensus.cc:1275] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Refusing update from remote peer 45ea8ca532304a8f9ffda636d59f6f0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:53.211804 21045 consensus_queue.cc:1048] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:53.287633 20158 raft_consensus.cc:1275] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:53.289242 21060 consensus_queue.cc:1048] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:53.298854 20232 raft_consensus.cc:1275] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:53.300382 21059 consensus_queue.cc:1048] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:53.583981  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:53.629611 20158 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1127f55bd43a4c988dfd61547a03b3fa"
dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
mode: GRACEFUL
new_leader_uuid: "aac061e592d74289800e4c50cbb4132b"
 from {username='slave'} at 127.0.0.1:52546
I20260709 12:24:53.630358 20158 raft_consensus.cc:606] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Received request to transfer leadership to TS aac061e592d74289800e4c50cbb4132b
I20260709 12:24:53.633765 20236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a8a2aa61ada477c8750740dcc082235"
dest_uuid: "c470740d41ee4b9383923d08a87655d6"
mode: GRACEFUL
new_leader_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:47576
I20260709 12:24:53.634325 20236 raft_consensus.cc:606] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Received request to transfer leadership to TS 7204c82dd34944818a439bd468a8c410
I20260709 12:24:53.636894 20158 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "976741a38d1c42329394a00cbe085319"
dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
mode: GRACEFUL
new_leader_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:52546
I20260709 12:24:53.637388 20158 raft_consensus.cc:606] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 LEADER]: Received request to transfer leadership to TS 7204c82dd34944818a439bd468a8c410
I20260709 12:24:53.639731 20236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d063c9d79f904091aade12ce2aba8bd1"
dest_uuid: "c470740d41ee4b9383923d08a87655d6"
mode: GRACEFUL
new_leader_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:47576
I20260709 12:24:53.640332 20236 raft_consensus.cc:606] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Received request to transfer leadership to TS 7204c82dd34944818a439bd468a8c410
I20260709 12:24:53.642722 20236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd398fffdf6d468f88108a6a7bec0681"
dest_uuid: "c470740d41ee4b9383923d08a87655d6"
mode: GRACEFUL
new_leader_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:47576
I20260709 12:24:53.643270 20236 raft_consensus.cc:606] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Received request to transfer leadership to TS 7204c82dd34944818a439bd468a8c410
I20260709 12:24:53.644474  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:53.646303  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:53.647068  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:53.748971 21048 raft_consensus.cc:993] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6: : Instructing follower 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:53.749452 21051 raft_consensus.cc:1081] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Signalling peer 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:53.750902 20936 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a8a2aa61ada477c8750740dcc082235"
dest_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:33010
I20260709 12:24:53.751505 20936 raft_consensus.cc:493] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:53.751888 20936 raft_consensus.cc:3060] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:53.758726 20936 raft_consensus.cc:515] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:53.760624 20936 leader_election.cc:290] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:53.761545 20232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8a2aa61ada477c8750740dcc082235" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:53.762073 20232 raft_consensus.cc:3055] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:53.762331 20232 raft_consensus.cc:740] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:53.762298 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8a2aa61ada477c8750740dcc082235" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:53.763511 20158 raft_consensus.cc:3060] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:53.763242 20232 consensus_queue.cc:260] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:53.764397 20232 raft_consensus.cc:3060] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:53.768798 20158 raft_consensus.cc:2468] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:53.769980 20232 raft_consensus.cc:2468] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:53.770681 20888 leader_election.cc:304] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: 
I20260709 12:24:53.771632 21059 raft_consensus.cc:2804] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:53.772197 21059 raft_consensus.cc:697] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:53.773072 21059 consensus_queue.cc:237] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:53.783694 19907 catalog_manager.cc:5697] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 1 to 2, leader changed from c470740d41ee4b9383923d08a87655d6 (127.9.131.68) to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:54.372965 20202 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.000s	sys 0.014s
W20260709 12:24:54.385915 20124 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.000s	sys 0.037s
W20260709 12:24:54.406720 20124 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.000s	sys 0.037s
W20260709 12:24:54.406697 20202 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.000s	sys 0.015s
I20260709 12:24:54.464172 21136 raft_consensus.cc:993] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6: : Instructing follower 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:54.464730 21136 raft_consensus.cc:1081] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Signalling peer 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:54.483531 20162 raft_consensus.cc:1275] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:54.491273 21059 consensus_queue.cc:1048] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:54.492112 20939 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd398fffdf6d468f88108a6a7bec0681"
dest_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:33010
I20260709 12:24:54.492895 20939 raft_consensus.cc:493] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:54.493261 20939 raft_consensus.cc:3060] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:54.504179 20939 raft_consensus.cc:515] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:54.506961 20939 leader_election.cc:290] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:54.576041 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd398fffdf6d468f88108a6a7bec0681" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:54.576797 20085 raft_consensus.cc:3060] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:54.939260 20085 raft_consensus.cc:2468] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:54.953379 21140 raft_consensus.cc:493] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:54.954017 21140 raft_consensus.cc:515] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:54.956188 21140 leader_election.cc:290] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:54.956704 21140 raft_consensus.cc:493] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:54.957140 21140 raft_consensus.cc:515] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:54.959163 21140 leader_election.cc:290] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:54.986222 21154 raft_consensus.cc:493] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:54.986996 21154 raft_consensus.cc:515] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:54.991173 21154 leader_election.cc:290] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.004177 21143 raft_consensus.cc:493] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.004866 21143 raft_consensus.cc:515] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.005630 21155 raft_consensus.cc:493] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.006124 21155 raft_consensus.cc:515] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:55.007913 21143 leader_election.cc:290] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:55.008577 21143 raft_consensus.cc:493] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:55.008987 21155 leader_election.cc:290] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:55.009117 21143 raft_consensus.cc:515] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:55.010823 21155 raft_consensus.cc:493] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:55.011521 21155 raft_consensus.cc:515] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:55.014083 21155 leader_election.cc:290] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.054680 21154 raft_consensus.cc:493] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:55.055455 21154 raft_consensus.cc:515] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.058004 21154 leader_election.cc:290] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.132958 21154 raft_consensus.cc:493] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:55.133643 21154 raft_consensus.cc:515] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.137094 21154 leader_election.cc:290] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.137979 21156 raft_consensus.cc:493] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:55.138738 21156 raft_consensus.cc:515] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.147063 21156 leader_election.cc:290] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:55.177784 21156 raft_consensus.cc:493] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.178617 21156 raft_consensus.cc:515] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.181272 21156 leader_election.cc:290] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
W20260709 12:24:55.205611 20052 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.008s	sys 0.012s
W20260709 12:24:55.285638 20052 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.009s	sys 0.013s
I20260709 12:24:55.229379 21154 raft_consensus.cc:493] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:55.239533 21059 raft_consensus.cc:493] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.240634 21140 raft_consensus.cc:493] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.245082 21136 raft_consensus.cc:993] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6: : Instructing follower 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:55.289949 21157 raft_consensus.cc:493] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.290580 21157 raft_consensus.cc:515] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:55.292340 21150 raft_consensus.cc:493] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:55.292958 21150 raft_consensus.cc:515] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.296238 21122 raft_consensus.cc:1081] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Signalling peer 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:55.297344 21059 raft_consensus.cc:515] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.298503 21122 raft_consensus.cc:493] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:55.299533 21059 leader_election.cc:290] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:55.303351 21153 raft_consensus.cc:493] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:55.302034 21139 raft_consensus.cc:493] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.305310 21151 raft_consensus.cc:493] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:55.288347 21154 raft_consensus.cc:515] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:55.314692 21139 raft_consensus.cc:515] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.316332 21162 raft_consensus.cc:493] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.287986 21084 raft_consensus.cc:493] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:55.316911 21162 raft_consensus.cc:515] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:55.318037 21139 leader_election.cc:290] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:55.318363 21084 raft_consensus.cc:515] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.319923 21162 leader_election.cc:290] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:55.319945 21139 raft_consensus.cc:493] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:55.320891 21139 raft_consensus.cc:515] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:55.299046 21122 raft_consensus.cc:515] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.315052 21159 raft_consensus.cc:493] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.315018 21151 raft_consensus.cc:515] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.321928 21159 raft_consensus.cc:515] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:55.323953 21122 leader_election.cc:290] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:55.321275 21084 leader_election.cc:290] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.324131 21159 leader_election.cc:290] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:55.305367 21127 raft_consensus.cc:493] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:55.288931 21140 raft_consensus.cc:515] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:55.325031 21127 raft_consensus.cc:515] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:55.303493 21150 leader_election.cc:290] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:55.326449 21140 leader_election.cc:290] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:55.327250 21127 leader_election.cc:290] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.320148 21153 raft_consensus.cc:515] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.318095 21154 leader_election.cc:290] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:55.326655 21139 leader_election.cc:290] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:55.314090 21136 raft_consensus.cc:493] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:55.328758 21136 raft_consensus.cc:515] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.330613 21153 leader_election.cc:290] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.331302 21125 raft_consensus.cc:493] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.331842 21125 raft_consensus.cc:515] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.333998 21125 leader_election.cc:290] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:55.328205 21143 leader_election.cc:290] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.338516 21157 leader_election.cc:290] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.330862 21136 leader_election.cc:290] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:55.342160 21047 raft_consensus.cc:493] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.344210 21047 raft_consensus.cc:515] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:55.347780 21047 leader_election.cc:290] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:55.324393 21151 leader_election.cc:290] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.355268 21048 raft_consensus.cc:493] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:55.286808 21156 raft_consensus.cc:493] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.361915 20938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf0d91bbb1d4e40b769bc07ef380517" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.362747 20938 raft_consensus.cc:2468] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:55.362843 20932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d063c9d79f904091aade12ce2aba8bd1" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.363215 20931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05de16433174dc4b33d9fbc6afd9da1" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.364064 20939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd122132f7485fa43d171d8c857d38" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.355844 21048 raft_consensus.cc:515] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:55.366626 21048 leader_election.cc:290] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.357774 21125 raft_consensus.cc:493] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:55.366986  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:55.367535 21125 raft_consensus.cc:515] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.357398 21136 raft_consensus.cc:493] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:55.370088 21156 raft_consensus.cc:515] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.374434 21136 raft_consensus.cc:515] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.370116 21127 raft_consensus.cc:493] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.376080 21048 raft_consensus.cc:493] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:55.376619 21048 raft_consensus.cc:515] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.376916 21122 raft_consensus.cc:493] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.377447 21122 raft_consensus.cc:515] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.378429 21048 leader_election.cc:290] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:55.378578 21136 leader_election.cc:290] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:55.378996 21048 raft_consensus.cc:493] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:55.379161 21136 raft_consensus.cc:493] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.384102 21048 raft_consensus.cc:515] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.379371 21122 leader_election.cc:290] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:55.371449 21153 raft_consensus.cc:493] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:55.385082 21136 raft_consensus.cc:515] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.391614 21136 leader_election.cc:290] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:55.393023 21125 leader_election.cc:290] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:55.393644 21127 raft_consensus.cc:515] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.394042 21156 leader_election.cc:290] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:55.386089 21047 raft_consensus.cc:493] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:55.399479 21047 raft_consensus.cc:515] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:55.399083 21127 leader_election.cc:290] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:55.403072 21047 leader_election.cc:290] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.387521 21143 raft_consensus.cc:493] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.405925 21143 raft_consensus.cc:515] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.398654 21153 raft_consensus.cc:515] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.426887 21153 leader_election.cc:290] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:55.419677 21143 leader_election.cc:290] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:55.436074 21047 raft_consensus.cc:493] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:55.438165 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988f10f24b02449cade652e210ad3b06" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.439674 21132 raft_consensus.cc:493] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:55.435225 21048 leader_election.cc:290] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:55.441660 21132 raft_consensus.cc:515] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.445215 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0126559599b40c5a6447c0648a81268" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.446071 20082 raft_consensus.cc:2468] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:24:55.447078 21132 leader_election.cc:290] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:55.448144 21152 raft_consensus.cc:493] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:55.448701 21152 raft_consensus.cc:515] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.427366 20934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0252a8e0d9ac4440b3affdcbf4cf2246" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.451407 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e740fe60a5fc470d930160cc9445bc05" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.455068 21047 raft_consensus.cc:515] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:55.457428 21047 leader_election.cc:290] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.462462 21151 raft_consensus.cc:493] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:55.462667 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528817cd200941fb84e40c79dbd16261" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.462968 20935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091f47eb9da43e6a24dd1b2bd9e9ce8" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.463232 21151 raft_consensus.cc:515] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.464437 21152 leader_election.cc:290] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.434957 21157 raft_consensus.cc:493] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.465381 21157 raft_consensus.cc:515] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:55.467065 20933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.468003 21157 leader_election.cc:290] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:55.468742 21060 raft_consensus.cc:493] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:55.469269 21060 raft_consensus.cc:515] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:55.469869 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed53455b57840a780d37b1db5103826" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.470641 20079 raft_consensus.cc:2468] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:55.471350 21060 leader_election.cc:290] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:55.471510 21127 raft_consensus.cc:493] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.472137 21127 raft_consensus.cc:515] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.475133 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995e00d57e1040b7b6d193c60fd84405" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.476100 21164 raft_consensus.cc:493] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:55.476354 21160 raft_consensus.cc:493] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.476712 21164 raft_consensus.cc:515] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:55.476974 21151 leader_election.cc:290] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.478137 21127 leader_election.cc:290] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:55.476928 21160 raft_consensus.cc:515] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.476014 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c01d16214bb19000600644b36d1e" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.480362 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3651ee11a6184a34bed06bc86be62c29" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.480832 21160 leader_election.cc:290] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:55.475986 21051 raft_consensus.cc:493] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:55.481290 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.481739 21051 raft_consensus.cc:515] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:55.483879 21051 leader_election.cc:290] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.470196 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515975cb81844e8787a53147bb766080" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.484040 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144ce9a2901342abbabee63851505b75" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.485569 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e740fe60a5fc470d930160cc9445bc05" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.487324 21051 raft_consensus.cc:493] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:55.487830 21051 raft_consensus.cc:515] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:55.488683 21048 raft_consensus.cc:493] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:55.489203 21048 raft_consensus.cc:515] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.489832 21051 leader_election.cc:290] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.491394 21132 raft_consensus.cc:493] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.491509 21051 raft_consensus.cc:493] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.491961 21132 raft_consensus.cc:515] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:55.492587 20933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e740fe60a5fc470d930160cc9445bc05" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.492846 21136 raft_consensus.cc:493] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.493400 21136 raft_consensus.cc:515] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.494077 21132 leader_election.cc:290] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.494611 21132 raft_consensus.cc:493] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.494297 21139 raft_consensus.cc:493] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:55.495052 21132 raft_consensus.cc:515] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.495384 21136 leader_election.cc:290] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:55.495709 21139 raft_consensus.cc:515] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:55.496022 21059 raft_consensus.cc:493] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.492525 21128 raft_consensus.cc:493] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:55.496672 21059 raft_consensus.cc:515] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.496942 21128 raft_consensus.cc:515] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.497802 21139 leader_election.cc:290] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:55.498775 21059 leader_election.cc:290] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:55.490950 21048 leader_election.cc:290] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:55.499076 20933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0da04e85e534d9990213bfdcee4874c" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.501066 21132 leader_election.cc:290] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:55.490329 21151 raft_consensus.cc:493] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:55.502692 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c01d16214bb19000600644b36d1e" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.495949 21122 raft_consensus.cc:493] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:55.492098 21051 raft_consensus.cc:515] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.502692 20934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd4e0295fa48bc8c187c7d421d8f11" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.510736 21151 raft_consensus.cc:515] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.511250 20937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c01d16214bb19000600644b36d1e" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.511710 20939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7527e635cb4c339c05a4b1ea702164" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.508229 21157 raft_consensus.cc:493] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:55.514743 21157 raft_consensus.cc:515] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:55.511850 21155 raft_consensus.cc:493] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.516553 21155 raft_consensus.cc:515] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:55.512014 21045 raft_consensus.cc:493] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.511072 21164 leader_election.cc:290] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.512305 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c5a6e3d37c46f585ebd85003fbe15a" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.523510 20084 raft_consensus.cc:1240] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Rejecting Update request from peer c470740d41ee4b9383923d08a87655d6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:55.524080 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515975cb81844e8787a53147bb766080" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.521642 21151 leader_election.cc:290] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:55.518549 21047 raft_consensus.cc:493] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:55.517923 21045 raft_consensus.cc:515] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:55.499034 21128 leader_election.cc:290] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:55.512001 21122 raft_consensus.cc:515] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:55.533275 21122 leader_election.cc:290] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.533511 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d6ed1f33fa4b73bf5108eb0fec8f88" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.534368 20156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b860aa254e34a20e8bdae1b626df" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.536142 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091f47eb9da43e6a24dd1b2bd9e9ce8" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.536954 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0252a8e0d9ac4440b3affdcbf4cf2246" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.538471 20157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd122132f7485fa43d171d8c857d38" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.538992 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac98768a9a3430a8784fa7995363272" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.539590 20234 raft_consensus.cc:2468] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
I20260709 12:24:55.528960 21047 raft_consensus.cc:515] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:55.543404 21155 leader_election.cc:290] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:55.543848 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.544580 20234 raft_consensus.cc:2468] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 2.
I20260709 12:24:55.545855 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d063c9d79f904091aade12ce2aba8bd1" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.547302 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0988a236f3934f8692fd434098766112" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.548032 20162 raft_consensus.cc:2468] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 1.
I20260709 12:24:55.548110 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05de16433174dc4b33d9fbc6afd9da1" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.551198 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d6ed1f33fa4b73bf5108eb0fec8f88" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.551944 20234 raft_consensus.cc:2468] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 1.
W20260709 12:24:55.553869 20107 debug-util.cc:398] Leaking SignalData structure 0x7b0800299c20 after lost signal to thread 9744
I20260709 12:24:55.554500 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7527e635cb4c339c05a4b1ea702164" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.554994 21045 leader_election.cc:290] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
W20260709 12:24:55.555182 20107 debug-util.cc:398] Leaking SignalData structure 0x7b08002bd8c0 after lost signal to thread 19943
I20260709 12:24:55.555886 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3651ee11a6184a34bed06bc86be62c29" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.556282 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed53455b57840a780d37b1db5103826" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
W20260709 12:24:55.556646 20107 debug-util.cc:398] Leaking SignalData structure 0x7b0800298a80 after lost signal to thread 20110
I20260709 12:24:55.541631 21047 leader_election.cc:290] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
W20260709 12:24:55.558079 20107 debug-util.cc:398] Leaking SignalData structure 0x7b080016f520 after lost signal to thread 20186
I20260709 12:24:55.558015 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b860aa254e34a20e8bdae1b626df" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.558440 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc0138443e498db94e47c81d5ca81b" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.558993 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e740fe60a5fc470d930160cc9445bc05" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.559109 20237 raft_consensus.cc:2468] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 2.
W20260709 12:24:55.559831 20107 debug-util.cc:398] Leaking SignalData structure 0x7b0800256fa0 after lost signal to thread 20261
W20260709 12:24:55.561285 20107 debug-util.cc:398] Leaking SignalData structure 0x7b080012eee0 after lost signal to thread 20966
I20260709 12:24:55.561407 20157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c01d16214bb19000600644b36d1e" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.562026 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2234eae9544c8898b57db26f4533d3" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.558430 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac98768a9a3430a8784fa7995363272" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.564225 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c5a6e3d37c46f585ebd85003fbe15a" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.565128 20232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf0d91bbb1d4e40b769bc07ef380517" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.566720 20935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed53455b57840a780d37b1db5103826" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.567340 21051 leader_election.cc:290] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:55.518738 21157 leader_election.cc:290] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.567602 20935 raft_consensus.cc:2468] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 2.
I20260709 12:24:55.569330 20933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995e00d57e1040b7b6d193c60fd84405" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.569871 20934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9370ed3b42941c683b03215e8ae3344" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.570338 20936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3651ee11a6184a34bed06bc86be62c29" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.572440 20937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72eb35da72b43ecb538c2a240a61646" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.573525 20888 leader_election.cc:304] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:55.574407 21060 raft_consensus.cc:2804] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:55.574925 21060 raft_consensus.cc:697] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:55.576089 21060 consensus_queue.cc:237] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.580353 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac98768a9a3430a8784fa7995363272" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.581118 20084 raft_consensus.cc:2468] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:55.582379 21158 raft_consensus.cc:493] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:55.582971 21158 raft_consensus.cc:515] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:55.584506 20888 leader_election.cc:304] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:55.585350 21158 leader_election.cc:290] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.585819 21059 raft_consensus.cc:2804] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:55.586229 21059 raft_consensus.cc:493] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:55.582033 21051 raft_consensus.cc:493] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:55.586637 21059 raft_consensus.cc:3060] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:55.586973 21051 raft_consensus.cc:515] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.589107 21051 leader_election.cc:290] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:55.595280 21059 raft_consensus.cc:515] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.603318 20939 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d063c9d79f904091aade12ce2aba8bd1"
dest_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:33010
I20260709 12:24:55.604017 20939 raft_consensus.cc:493] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:55.604372 20939 raft_consensus.cc:3060] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.604980 21059 leader_election.cc:290] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 3 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:55.606036 20937 raft_consensus.cc:1240] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Rejecting Update request from peer c470740d41ee4b9383923d08a87655d6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:55.611541 20938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04cd0aa441274cf38da93eec0bfadeff" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.563663 21165 raft_consensus.cc:493] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:55.615751 20938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8691968cf8f4b04b4ef459bd321e903" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.619611 20939 raft_consensus.cc:515] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.624270 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1127f55bd43a4c988dfd61547a03b3fa" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.625202 20931 raft_consensus.cc:1240] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Rejecting Update request from peer c470740d41ee4b9383923d08a87655d6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:55.625663 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988f10f24b02449cade652e210ad3b06" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.626356 20931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.627921 21165 raft_consensus.cc:515] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:55.634217 20934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141c2e84c15e4ad38afc0a52b330f9b9" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.627606 20931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8635d89e903c48a786062efb05feaa75" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.635986 21165 leader_election.cc:290] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.623499 20050 leader_election.cc:304] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:55.637704 21151 raft_consensus.cc:2804] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:55.638074 21151 raft_consensus.cc:493] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:55.638437 21151 raft_consensus.cc:3060] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.639027 20938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff86d69d6264de598b8dd58012f7904" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.640056 20935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073b8908cc1345f3bad72a6d8124df11" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.641057 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc0138443e498db94e47c81d5ca81b" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.642082 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2234eae9544c8898b57db26f4533d3" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.643389 20157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c5a6e3d37c46f585ebd85003fbe15a" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.643563 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04cd0aa441274cf38da93eec0bfadeff" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.644201 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141c2e84c15e4ad38afc0a52b330f9b9" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.644771 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac98768a9a3430a8784fa7995363272" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.646132 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1127f55bd43a4c988dfd61547a03b3fa" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.646297 20938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af265a90671a46cbafb3fced0f952aef" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.648535 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988f10f24b02449cade652e210ad3b06" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.649189 20050 leader_election.cc:304] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:55.649773 20233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0126559599b40c5a6447c0648a81268" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.650215 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988f10f24b02449cade652e210ad3b06" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.651243 20231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c5a6e3d37c46f585ebd85003fbe15a" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.651440 20232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0da04e85e534d9990213bfdcee4874c" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.652431 20235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9370ed3b42941c683b03215e8ae3344" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.652624 21153 raft_consensus.cc:2749] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.654979 20934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.655300 20233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5038da47868e47148f6dda5d135f60fa" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.649796 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd4e0295fa48bc8c187c7d421d8f11" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.658031 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528817cd200941fb84e40c79dbd16261" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.655208 20230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72eb35da72b43ecb538c2a240a61646" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.655725 20934 raft_consensus.cc:2468] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 1.
I20260709 12:24:55.666658 20939 leader_election.cc:290] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:55.668356 20934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144ce9a2901342abbabee63851505b75" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.669646 20935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b588a815a548c8a3f375012fa7e3f6" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.670888 20939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8a2aa61ada477c8750740dcc082235" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.668957 20931 raft_consensus.cc:1240] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Rejecting Update request from peer c470740d41ee4b9383923d08a87655d6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:55.672894 20230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b96b6be45d43b6aceaf2afe76d79e4" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.673596 20050 leader_election.cc:304] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:55.674407 21153 raft_consensus.cc:2804] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:55.674494 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f834f9ccdefc4baebc23e9477701af69" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.674836 21153 raft_consensus.cc:493] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting leader election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:55.675277 21153 raft_consensus.cc:3060] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:55.676563 20051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40749, user_credentials={real_user=slave}} blocked reactor thread for 85725.7us
I20260709 12:24:55.678671 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976741a38d1c42329394a00cbe085319" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.682945 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b588a815a548c8a3f375012fa7e3f6" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.684502 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5038da47868e47148f6dda5d135f60fa" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.681994 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0988a236f3934f8692fd434098766112" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.685655 20232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed53455b57840a780d37b1db5103826" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.685792 20235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd398fffdf6d468f88108a6a7bec0681" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:55.685889 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.686652 20235 raft_consensus.cc:3055] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:55.687033 20235 raft_consensus.cc:740] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:55.687593 20229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144ce9a2901342abbabee63851505b75" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.686681 20234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0126559599b40c5a6447c0648a81268"
dest_uuid: "c470740d41ee4b9383923d08a87655d6"
mode: GRACEFUL
new_leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
 from {username='slave'} at 127.0.0.1:47576
I20260709 12:24:55.687896 20235 consensus_queue.cc:260] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.688539 20234 raft_consensus.cc:606] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Received request to transfer leadership to TS 45ea8ca532304a8f9ffda636d59f6f0f
I20260709 12:24:55.684532 20231 raft_consensus.cc:1275] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:55.689276 20126 leader_election.cc:304] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
W20260709 12:24:55.690213 20126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:38769, user_credentials={real_user=slave}} blocked reactor thread for 71114.9us
I20260709 12:24:55.690359 20233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0988a236f3934f8692fd434098766112" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.690939 20126 leader_election.cc:304] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:55.691644 21045 raft_consensus.cc:2749] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.690114 19908 catalog_manager.cc:5697] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 1 to 2, leader changed from c470740d41ee4b9383923d08a87655d6 (127.9.131.68) to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.694157 20229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed53455b57840a780d37b1db5103826" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:55.690457 21157 raft_consensus.cc:2804] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:55.695851 20229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d063c9d79f904091aade12ce2aba8bd1" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:55.696405 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f834f9ccdefc4baebc23e9477701af69" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.696640 20229 raft_consensus.cc:3055] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:55.697034 20229 raft_consensus.cc:740] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:55.696039 21157 raft_consensus.cc:493] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:55.691731 20231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b588a815a548c8a3f375012fa7e3f6" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:55.698006 21157 raft_consensus.cc:3060] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.697791 20229 consensus_queue.cc:260] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.699041 20229 raft_consensus.cc:3060] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.698832 21151 raft_consensus.cc:515] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.700177 20235 raft_consensus.cc:3060] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.692595 21153 raft_consensus.cc:515] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.703960 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5038da47868e47148f6dda5d135f60fa" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.706271 20938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf44484d11914a83a44c9a333eed7777" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.707907 20935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e608aa894f4f9d96f3e1b9b16fb7cd" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.709076 21165 consensus_queue.cc:1059] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:55.710243 21165 raft_consensus.cc:3055] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:55.710602 21165 raft_consensus.cc:740] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:55.711776 21165 consensus_queue.cc:260] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.692853 20126 leader_election.cc:304] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:55.713057 21165 raft_consensus.cc:3060] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:55.713466 21045 raft_consensus.cc:2749] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.714025 20229 raft_consensus.cc:2468] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
W20260709 12:24:55.715287 20125 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 50592.1us
I20260709 12:24:55.718595 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed53455b57840a780d37b1db5103826" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:55.724169 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8691968cf8f4b04b4ef459bd321e903" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.726195 20125 leader_election.cc:304] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:55.728505 20159 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6d6ed1f33fa4b73bf5108eb0fec8f88"
dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
mode: GRACEFUL
new_leader_uuid: "aac061e592d74289800e4c50cbb4132b"
 from {username='slave'} at 127.0.0.1:52546
I20260709 12:24:55.729198 20159 raft_consensus.cc:606] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Received request to transfer leadership to TS aac061e592d74289800e4c50cbb4132b
I20260709 12:24:55.729312 21151 leader_election.cc:290] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.730957 21045 raft_consensus.cc:2749] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:55.733044 20159 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e71a18e780d74303884e208106817dec"
dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
mode: GRACEFUL
new_leader_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:52546
I20260709 12:24:55.733729 20159 raft_consensus.cc:606] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Received request to transfer leadership to TS 7204c82dd34944818a439bd468a8c410
I20260709 12:24:55.710242 20931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524118618cf740e9865e397864b56ed2" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.724776 21157 raft_consensus.cc:515] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.738981 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.739300 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4d18eda43b4a17bd5b552c4e04225c" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.740563 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8635d89e903c48a786062efb05feaa75" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.741084 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.741346 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073b8908cc1345f3bad72a6d8124df11" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.742560 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d6ed1f33fa4b73bf5108eb0fec8f88" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.745846 20200 leader_election.cc:304] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:55.746151 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d063c9d79f904091aade12ce2aba8bd1" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:55.746778 20081 raft_consensus.cc:3060] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.747373 21167 raft_consensus.cc:2804] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:55.747849 21167 raft_consensus.cc:493] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:55.748248 21167 raft_consensus.cc:3060] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.749348 20229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb7527e635cb4c339c05a4b1ea702164"
dest_uuid: "c470740d41ee4b9383923d08a87655d6"
mode: GRACEFUL
new_leader_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:47576
I20260709 12:24:55.749955 20229 raft_consensus.cc:606] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Received request to transfer leadership to TS 7204c82dd34944818a439bd468a8c410
I20260709 12:24:55.750947 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144ce9a2901342abbabee63851505b75" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.751354 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3651ee11a6184a34bed06bc86be62c29" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.752480 21157 leader_election.cc:290] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:55.752736 20049 leader_election.cc:304] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:55.753726 21151 raft_consensus.cc:2749] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.754207 20049 leader_election.cc:304] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:55.754761 20939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b96b6be45d43b6aceaf2afe76d79e4" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.755481 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b860aa254e34a20e8bdae1b626df" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.755877 20935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0988a236f3934f8692fd434098766112" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.756808 20049 leader_election.cc:304] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f
I20260709 12:24:55.757560 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a53dd7c6fa4a338973463bf3cf0f9c" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.757745 20935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f834f9ccdefc4baebc23e9477701af69" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.758023 21169 raft_consensus.cc:2804] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:55.760721 20938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed53455b57840a780d37b1db5103826" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:55.758477 21169 raft_consensus.cc:493] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:55.763927 20938 raft_consensus.cc:2393] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aac061e592d74289800e4c50cbb4132b in current term 3: Already voted for candidate 7204c82dd34944818a439bd468a8c410 in this term.
I20260709 12:24:55.764209 21169 raft_consensus.cc:3060] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.763620 20935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a53dd7c6fa4a338973463bf3cf0f9c" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.764413 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.765112 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b588a815a548c8a3f375012fa7e3f6" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.760887 20049 leader_election.cc:304] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:55.766014 20939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:55.766795 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f834f9ccdefc4baebc23e9477701af69" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.755831 21151 raft_consensus.cc:2749] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.767441 20159 raft_consensus.cc:2468] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 1.
I20260709 12:24:55.742547 20931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf0d91bbb1d4e40b769bc07ef380517" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:55.768536 20931 raft_consensus.cc:3060] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.769091 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0126559599b40c5a6447c0648a81268" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:55.766731 21166 raft_consensus.cc:2804] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:55.772185 21166 raft_consensus.cc:493] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:55.772605 21166 raft_consensus.cc:3060] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:55.767580 20049 leader_election.cc:304] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:55.772372 20126 leader_election.cc:304] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:55.775256 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976741a38d1c42329394a00cbe085319" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.776039 21045 raft_consensus.cc:2749] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.778280 20049 leader_election.cc:304] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:55.780189 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5038da47868e47148f6dda5d135f60fa" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.785027 20081 raft_consensus.cc:2468] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:55.787425 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4d18eda43b4a17bd5b552c4e04225c" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.789314 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff86d69d6264de598b8dd58012f7904" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.790196 21154 raft_consensus.cc:2749] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.788105 20931 raft_consensus.cc:2468] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 2.
I20260709 12:24:55.788322  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:24:55.793049 21151 raft_consensus.cc:2749] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.793733 20049 leader_election.cc:304] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f
I20260709 12:24:55.794736  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:55.779428 20888 leader_election.cc:304] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: 
I20260709 12:24:55.794942 21151 raft_consensus.cc:2804] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:55.795617 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528817cd200941fb84e40c79dbd16261" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.795835 20049 leader_election.cc:304] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:55.758417 20235 raft_consensus.cc:2468] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:55.797422 20888 leader_election.cc:304] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:55.798192 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d6ed1f33fa4b73bf5108eb0fec8f88" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.798565 20888 leader_election.cc:304] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:55.792131 21166 raft_consensus.cc:515] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.799623 21059 raft_consensus.cc:2804] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:55.799973 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b860aa254e34a20e8bdae1b626df" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.800081 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf44484d11914a83a44c9a333eed7777" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.800697 21060 raft_consensus.cc:2749] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.799453 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8a2aa61ada477c8750740dcc082235" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.799527 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a52c50180741b9a6165c183733f3fa" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:55.800441 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af265a90671a46cbafb3fced0f952aef" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.802132  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:55.800086 21059 raft_consensus.cc:493] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:55.803012 21059 raft_consensus.cc:3060] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.799000 20050 leader_election.cc:304] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
W20260709 12:24:55.799503 20199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.808476 21154 raft_consensus.cc:2804] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:55.807788 20124 leader_election.cc:304] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:55.809017 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e608aa894f4f9d96f3e1b9b16fb7cd" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.809545 21151 raft_consensus.cc:493] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:55.809998 21151 raft_consensus.cc:3060] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.810341 21045 raft_consensus.cc:2749] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.809049 21154 raft_consensus.cc:697] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [term 2 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:55.808975 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528817cd200941fb84e40c79dbd16261" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.739552 21153 leader_election.cc:290] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.812142 21154 consensus_queue.cc:237] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.845187 21162 raft_consensus.cc:2749] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.845598 20124 leader_election.cc:304] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:55.846086 21084 raft_consensus.cc:2749] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.850576 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524118618cf740e9865e397864b56ed2" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.850193 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a52c50180741b9a6165c183733f3fa" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:55.853839 20124 leader_election.cc:304] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:55.854434 21167 raft_consensus.cc:515] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:55.855031 21157 raft_consensus.cc:2749] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.854502 21045 raft_consensus.cc:2749] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:55.855973 20124 leader_election.cc:304] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:55.852634 20886 leader_election.cc:304] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:55.877611 20886 leader_election.cc:304] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:55.879282 21061 raft_consensus.cc:2749] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.880100 21060 raft_consensus.cc:2749] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.880261 21061 consensus_queue.cc:1048] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:55.862911 20888 leader_election.cc:304] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:55.884152 21157 raft_consensus.cc:2749] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.883572 20124 leader_election.cc:304] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:55.886816 20124 leader_election.cc:304] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:55.887701 21047 raft_consensus.cc:2749] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.888427 21047 raft_consensus.cc:2749] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.888834 20124 leader_election.cc:304] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:55.889658 21047 raft_consensus.cc:2749] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.887964 20886 leader_election.cc:304] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:55.890573 21061 raft_consensus.cc:2749] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.890877 21060 raft_consensus.cc:2749] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:55.892115 20888 leader_election.cc:304] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:55.892997 21060 raft_consensus.cc:2749] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:55.864094 20049 leader_election.cc:304] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f
I20260709 12:24:55.845822 21166 leader_election.cc:290] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:55.872045 21151 raft_consensus.cc:515] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.861325 20201 leader_election.cc:304] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:55.894958 21165 raft_consensus.cc:2804] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:55.895381 21165 raft_consensus.cc:493] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:55.895603 20201 leader_election.cc:304] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:55.895541 21166 raft_consensus.cc:2804] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:55.890125 20124 leader_election.cc:304] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:55.896443 21166 raft_consensus.cc:493] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:55.896622 21051 raft_consensus.cc:2749] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:55.897007 20201 leader_election.cc:304] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:55.895910 21165 raft_consensus.cc:3060] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.897847 21051 raft_consensus.cc:2749] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:55.898687 21166 raft_consensus.cc:3060] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:55.898916 20201 leader_election.cc:304] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:55.900549 21051 raft_consensus.cc:2749] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.901196 20201 leader_election.cc:304] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:55.895176 20886 leader_election.cc:304] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:55.902005 21051 raft_consensus.cc:2749] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.902421 20201 leader_election.cc:304] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:55.903281 21157 raft_consensus.cc:2749] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.903976 20201 leader_election.cc:304] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:55.905812 21151 leader_election.cc:290] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
W20260709 12:24:55.913090 20049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:39155, user_credentials={real_user=slave}} blocked reactor thread for 49072.2us
I20260709 12:24:55.916062 21122 raft_consensus.cc:2749] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.916355 21158 raft_consensus.cc:2749] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.918744 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d6ed1f33fa4b73bf5108eb0fec8f88" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:55.849030 21169 raft_consensus.cc:515] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.921808 21169 leader_election.cc:290] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:55.878016 21167 leader_election.cc:290] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:55.856766 21059 raft_consensus.cc:515] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:55.924310 19907 catalog_manager.cc:5697] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 1 to 2, leader changed from c470740d41ee4b9383923d08a87655d6 (127.9.131.68) to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 2 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:55.925734 21059 leader_election.cc:290] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:55.928937 20931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:55.930691 21060 raft_consensus.cc:2749] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.932000 20888 leader_election.cc:304] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: c470740d41ee4b9383923d08a87655d6
I20260709 12:24:55.928313 21166 raft_consensus.cc:515] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:55.932906 21174 raft_consensus.cc:2804] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:55.933876 21167 raft_consensus.cc:993] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6: : Instructing follower 45ea8ca532304a8f9ffda636d59f6f0f to start an election
I20260709 12:24:55.934648 20201 leader_election.cc:304] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:55.933944 20888 leader_election.cc:304] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:55.950073 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac98768a9a3430a8784fa7995363272" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:56.040331 20083 raft_consensus.cc:1240] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Rejecting Update request from peer 45ea8ca532304a8f9ffda636d59f6f0f for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:56.040598 20888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40749, user_credentials={real_user=slave}} blocked reactor thread for 106732us
I20260709 12:24:56.041167 21174 raft_consensus.cc:493] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:24:56.041916 21174 raft_consensus.cc:3060] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.043166 21059 raft_consensus.cc:2749] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:55.994131 20084 raft_consensus.cc:1240] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Rejecting Update request from peer 45ea8ca532304a8f9ffda636d59f6f0f for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:56.046607 20084 raft_consensus.cc:1240] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Rejecting Update request from peer 7204c82dd34944818a439bd468a8c410 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:56.046850 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0988a236f3934f8692fd434098766112" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:56.048177 20083 raft_consensus.cc:1275] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.049031 21157 consensus_queue.cc:1059] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:56.050146 21157 raft_consensus.cc:3055] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:56.050563 21157 raft_consensus.cc:740] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:56.051210 20125 leader_election.cc:304] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
W20260709 12:24:56.020310 20050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 78868.4us
I20260709 12:24:56.038754 20085 raft_consensus.cc:1240] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Rejecting Update request from peer 45ea8ca532304a8f9ffda636d59f6f0f for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:55.960930 21165 raft_consensus.cc:515] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:56.060844 20888 leader_election.cc:304] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:56.069051 21047 raft_consensus.cc:2749] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.061142 21045 consensus_queue.cc:1059] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:24:56.070333 20125 leader_election.cc:304] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:56.070473 21047 raft_consensus.cc:3055] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:56.070920 21047 raft_consensus.cc:740] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:56.057907 20931 raft_consensus.cc:1240] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Rejecting Update request from peer c470740d41ee4b9383923d08a87655d6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:56.071635 21155 raft_consensus.cc:2749] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.072122 21047 consensus_queue.cc:260] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:56.058439 20938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:56.073096 21047 raft_consensus.cc:3060] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.073177 20125 leader_election.cc:304] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:56.057910 20935 raft_consensus.cc:1240] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Rejecting Update request from peer c470740d41ee4b9383923d08a87655d6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:56.073985 21155 raft_consensus.cc:2749] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.070645 21165 leader_election.cc:290] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:56.075350 20125 leader_election.cc:304] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:56.076174 21155 raft_consensus.cc:2749] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:56.077452 20125 leader_election.cc:304] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:56.083266 21155 raft_consensus.cc:2749] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.084064 21051 raft_consensus.cc:1081] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Signalling peer 45ea8ca532304a8f9ffda636d59f6f0f to start an election
W20260709 12:24:56.085899 20201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40749, user_credentials={real_user=slave}} blocked reactor thread for 151323us
I20260709 12:24:56.086649 20201 leader_election.cc:304] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:56.087466 21051 raft_consensus.cc:2749] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:56.088218 20201 leader_election.cc:304] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:56.089003 21158 raft_consensus.cc:2749] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.088099 21051 raft_consensus.cc:2749] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.089444 20201 leader_election.cc:304] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:56.090296 21051 raft_consensus.cc:2749] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:56.090472 21084 raft_consensus.cc:493] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:56.090752 20201 leader_election.cc:304] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:56.091558 21051 raft_consensus.cc:2749] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:56.091094 21084 raft_consensus.cc:515] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:56.093293 20201 leader_election.cc:304] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:56.093777 21084 leader_election.cc:290] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:56.094089 21051 raft_consensus.cc:2749] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.095412 20201 leader_election.cc:304] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:56.051424 21157 consensus_queue.cc:260] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:56.080108 21059 raft_consensus.cc:2804] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:56.081024 21060 consensus_queue.cc:1059] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:56.082075 21162 consensus_queue.cc:1048] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.096750 21061 raft_consensus.cc:3055] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:56.097220 21061 raft_consensus.cc:740] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:56.097072 21059 raft_consensus.cc:697] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:56.098317 21061 consensus_queue.cc:260] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:56.099728 21061 raft_consensus.cc:3060] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:56.100553 21157 raft_consensus.cc:3060] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:56.102344 21051 raft_consensus.cc:2749] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.103838 20201 leader_election.cc:304] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:56.099666 21059 consensus_queue.cc:237] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:56.112123 21051 raft_consensus.cc:2749] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.117523 20201 leader_election.cc:304] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:56.102716 21084 raft_consensus.cc:493] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:56.118301 21084 raft_consensus.cc:515] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:56.121477 21084 leader_election.cc:290] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:56.121697 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98035197c34fce88758eedbfd23225" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:56.124069 21155 consensus_queue.cc:1059] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.125056 21155 raft_consensus.cc:3055] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:56.125160 21051 raft_consensus.cc:2749] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.125440 21155 raft_consensus.cc:740] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:56.126544 21155 consensus_queue.cc:260] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:56.127694 21155 raft_consensus.cc:3060] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.133278 20931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98035197c34fce88758eedbfd23225" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:56.136278 20932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8691968cf8f4b04b4ef459bd321e903" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:56.138943 20050 leader_election.cc:304] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:56.139254 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b860aa254e34a20e8bdae1b626df" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:56.140712 21153 raft_consensus.cc:2749] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:56.136308 21166 leader_election.cc:290] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:56.146956 20201 leader_election.cc:304] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:56.157877 21160 consensus_queue.cc:1059] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.160584 21160 raft_consensus.cc:3055] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:56.160985 21160 raft_consensus.cc:740] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:56.161830 21160 consensus_queue.cc:260] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:56.163300 21160 raft_consensus.cc:3060] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.157526 19907 catalog_manager.cc:5697] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 1 to 2, leader changed from c470740d41ee4b9383923d08a87655d6 (127.9.131.68) to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:56.158174 21167 consensus_queue.cc:1059] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.164870 21167 raft_consensus.cc:3055] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:56.165325 21167 raft_consensus.cc:740] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:56.166297 21167 consensus_queue.cc:260] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:56.158911 21122 raft_consensus.cc:993] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6: : Instructing follower 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:56.167475 21122 raft_consensus.cc:1081] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Signalling peer 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:56.158569 21174 raft_consensus.cc:515] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:56.169382 21167 raft_consensus.cc:3060] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.172144 21174 leader_election.cc:290] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:56.182623 20931 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb7527e635cb4c339c05a4b1ea702164"
dest_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:33010
I20260709 12:24:56.183276 20931 raft_consensus.cc:493] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:56.183692 20931 raft_consensus.cc:3060] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.184811 21051 raft_consensus.cc:2749] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:56.191581 21047 raft_consensus.cc:993] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f: : Instructing follower 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:56.194068 21047 raft_consensus.cc:1081] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Signalling peer 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:56.189544 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f834f9ccdefc4baebc23e9477701af69" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:56.185884 20201 leader_election.cc:304] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:56.195443 20931 raft_consensus.cc:515] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:56.198218 20932 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e71a18e780d74303884e208106817dec"
dest_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:33000
I20260709 12:24:56.198807 20932 raft_consensus.cc:493] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:56.199178 20932 raft_consensus.cc:3060] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.199952 21167 raft_consensus.cc:2749] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:56.201326 20201 leader_election.cc:304] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:56.203326 21167 raft_consensus.cc:2749] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:56.204523 20931 leader_election.cc:290] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:56.204702 20201 leader_election.cc:304] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:56.206808 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7527e635cb4c339c05a4b1ea702164" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:56.207471 20084 raft_consensus.cc:3060] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.207894 21167 raft_consensus.cc:2749] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:56.209299 20201 leader_election.cc:304] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:56.211217 21167 raft_consensus.cc:2749] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:56.213017 20201 leader_election.cc:304] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:56.213222 20159 raft_consensus.cc:2468] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 3.
I20260709 12:24:56.214745 21167 raft_consensus.cc:2749] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.214901 20084 raft_consensus.cc:2468] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:56.216091 20201 leader_election.cc:304] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:56.216737 20888 leader_election.cc:304] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:56.217780 21059 raft_consensus.cc:2804] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:56.218158 21167 raft_consensus.cc:2749] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:56.218622 21059 raft_consensus.cc:697] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:56.219487 20201 leader_election.cc:304] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:56.219712 21059 consensus_queue.cc:237] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:56.221027 21160 raft_consensus.cc:2749] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.222364 20201 leader_election.cc:304] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:24:56.223088 21160 raft_consensus.cc:2749] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:56.224498 20201 leader_election.cc:304] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:56.225239 21160 raft_consensus.cc:2749] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.226068 20051 leader_election.cc:304] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:56.227118 21166 raft_consensus.cc:2804] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:56.227626 21166 raft_consensus.cc:697] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 3 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:56.226096 20932 raft_consensus.cc:515] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:56.228520 21166 consensus_queue.cc:237] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:56.236698 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71a18e780d74303884e208106817dec" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:56.237411 20083 raft_consensus.cc:3060] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.238044 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71a18e780d74303884e208106817dec" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:56.238891 20159 raft_consensus.cc:3055] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:56.239288 20159 raft_consensus.cc:740] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:56.240238 20159 consensus_queue.cc:260] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:56.242197 20932 leader_election.cc:290] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:56.242393 20931 raft_consensus.cc:1275] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Refusing update from remote peer aac061e592d74289800e4c50cbb4132b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.241945 20159 raft_consensus.cc:3060] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.244797 21084 consensus_queue.cc:1048] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.231164 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:56.254251 20159 raft_consensus.cc:2468] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:56.267091 20084 raft_consensus.cc:1240] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [term 2 LEADER]: Rejecting Update request from peer c470740d41ee4b9383923d08a87655d6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:56.269057 20888 leader_election.cc:304] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: 
I20260709 12:24:56.269490 19907 catalog_manager.cc:5697] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 1 to 2, leader changed from c470740d41ee4b9383923d08a87655d6 (127.9.131.68) to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:56.272126 20085 raft_consensus.cc:1240] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Rejecting Update request from peer c470740d41ee4b9383923d08a87655d6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:56.271606 19908 catalog_manager.cc:5697] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 2 to 3, leader changed from 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67) to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 3 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:56.275278 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac98768a9a3430a8784fa7995363272" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:56.276257 20161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0126559599b40c5a6447c0648a81268"
dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
 from {username='slave'} at 127.0.0.1:57064
I20260709 12:24:56.276882 20161 raft_consensus.cc:493] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:56.277253 20161 raft_consensus.cc:3060] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:56.277695 20083 raft_consensus.cc:2468] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:56.280478 21174 raft_consensus.cc:2804] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:56.281047 21174 raft_consensus.cc:697] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:56.281898 21174 consensus_queue.cc:237] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:56.269538 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac98768a9a3430a8784fa7995363272" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:56.291610 20154 raft_consensus.cc:2468] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 2.
I20260709 12:24:56.293814 20161 raft_consensus.cc:515] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:56.305660 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0126559599b40c5a6447c0648a81268" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:56.306334 20084 raft_consensus.cc:3060] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:56.307519 20931 raft_consensus.cc:1240] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Rejecting Update request from peer c470740d41ee4b9383923d08a87655d6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:56.307967 20158 raft_consensus.cc:1240] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Rejecting Update request from peer c470740d41ee4b9383923d08a87655d6 for earlier term 1. Current term is 3. Ops: []
I20260709 12:24:56.310377 20161 leader_election.cc:290] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:56.310979 21167 consensus_queue.cc:1059] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.315469 21167 raft_consensus.cc:3055] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:56.315893 21167 raft_consensus.cc:740] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:56.316766 21167 consensus_queue.cc:260] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:56.317986 21167 raft_consensus.cc:3060] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.321735 20084 raft_consensus.cc:2468] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 3.
I20260709 12:24:56.325106 20126 leader_election.cc:304] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:56.327208 21180 raft_consensus.cc:2804] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:56.327741 21180 raft_consensus.cc:697] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:56.328805 21180 consensus_queue.cc:237] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:56.333078 20229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0988a236f3934f8692fd434098766112" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:56.341962 20233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f834f9ccdefc4baebc23e9477701af69" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:56.339605 19908 catalog_manager.cc:5697] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 1 to 2, leader changed from 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67) to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:56.344254 20230 raft_consensus.cc:1275] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.343036 20231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0126559599b40c5a6447c0648a81268" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:56.354929 20233 raft_consensus.cc:2468] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:56.367659 20229 raft_consensus.cc:2468] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:56.373598 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0126559599b40c5a6447c0648a81268" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:56.374284 20236 raft_consensus.cc:3055] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:56.374709 20236 raft_consensus.cc:740] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:56.375291 20230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf0d91bbb1d4e40b769bc07ef380517" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:56.377285 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b860aa254e34a20e8bdae1b626df" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:56.378396 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac98768a9a3430a8784fa7995363272" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:56.379347 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:56.360986 20232 raft_consensus.cc:1240] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Rejecting Update request from peer 45ea8ca532304a8f9ffda636d59f6f0f for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:56.343024 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7527e635cb4c339c05a4b1ea702164" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:56.382184 20234 raft_consensus.cc:3055] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:56.382577 20234 raft_consensus.cc:740] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:56.383054 20124 leader_election.cc:304] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:56.383285 20234 consensus_queue.cc:260] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:56.374159 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8691968cf8f4b04b4ef459bd321e903" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:56.384868 20234 raft_consensus.cc:3060] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.385361 20232 raft_consensus.cc:1240] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Rejecting Update request from peer aac061e592d74289800e4c50cbb4132b for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:56.382071 21139 consensus_queue.cc:1048] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:24:56.390497 20886 leader_election.cc:304] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f
I20260709 12:24:56.391894 21139 raft_consensus.cc:2804] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:56.392417 21139 raft_consensus.cc:697] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:56.393236 21139 consensus_queue.cc:237] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:56.375460 20236 consensus_queue.cc:260] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:56.394516 20236 raft_consensus.cc:3060] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:56.402498 20233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d6ed1f33fa4b73bf5108eb0fec8f88" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:56.405519 20201 leader_election.cc:304] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:56.407006 20236 raft_consensus.cc:2468] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 3.
I20260709 12:24:56.407454 21160 raft_consensus.cc:2804] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:56.408033 21160 raft_consensus.cc:697] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 2 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:56.408936 21160 consensus_queue.cc:237] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:56.417500 20201 leader_election.cc:304] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:24:56.417263 19907 catalog_manager.cc:5697] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 1 to 2, leader changed from c470740d41ee4b9383923d08a87655d6 (127.9.131.68) to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:56.418294 21167 raft_consensus.cc:2749] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.420605 20234 raft_consensus.cc:2468] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:56.430938 20049 leader_election.cc:304] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:56.431912 21154 raft_consensus.cc:2749] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.434769 20049 leader_election.cc:304] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:56.432237 20886 leader_election.cc:304] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f
I20260709 12:24:56.435989 21139 raft_consensus.cc:2804] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:56.436120 21166 raft_consensus.cc:2749] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:56.436543 21139 raft_consensus.cc:697] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:56.437690 21139 consensus_queue.cc:237] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:56.438772 20229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed53455b57840a780d37b1db5103826" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:56.444170 21166 consensus_queue.cc:1059] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.453631 20049 leader_election.cc:304] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:56.453233 19907 catalog_manager.cc:5697] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 1 to 2, leader changed from c470740d41ee4b9383923d08a87655d6 (127.9.131.68) to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:56.475296 21154 raft_consensus.cc:3055] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:56.475806 21154 raft_consensus.cc:740] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:56.476450 20049 leader_election.cc:304] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6
I20260709 12:24:56.476883 21154 consensus_queue.cc:260] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:56.478387 21176 raft_consensus.cc:2749] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.479146 21154 raft_consensus.cc:3060] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.478123 21153 raft_consensus.cc:2749] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:56.523324 21155 raft_consensus.cc:2749] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.532354 20229 raft_consensus.cc:2468] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 3.
I20260709 12:24:56.532678 19907 catalog_manager.cc:5697] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 1 to 3, leader changed from c470740d41ee4b9383923d08a87655d6 (127.9.131.68) to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 3 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:56.533793 20049 leader_election.cc:304] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:24:56.534983 21154 raft_consensus.cc:2804] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:56.535547 21154 raft_consensus.cc:697] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 3 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:56.536607 20230 raft_consensus.cc:2468] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 2.
I20260709 12:24:56.536444 21154 consensus_queue.cc:237] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:56.537567 20228 raft_consensus.cc:1275] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Refusing update from remote peer aac061e592d74289800e4c50cbb4132b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.546368 19908 catalog_manager.cc:5697] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 1 to 2, leader changed from 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67) to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 2 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:56.548175 21166 consensus_queue.cc:1048] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.557337 19907 catalog_manager.cc:5697] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 2 to 3, leader changed from c470740d41ee4b9383923d08a87655d6 (127.9.131.68) to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 3 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:56.670872 20084 raft_consensus.cc:1275] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.672345 21061 consensus_queue.cc:1048] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.677346 20085 raft_consensus.cc:1275] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.679209 21059 consensus_queue.cc:1048] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.683084 20154 raft_consensus.cc:1275] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.692727 20228 raft_consensus.cc:1275] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.696291 21059 consensus_queue.cc:1048] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:56.702512 21174 consensus_queue.cc:1048] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.710966 20085 raft_consensus.cc:1275] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.714525 20230 raft_consensus.cc:1275] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.716588 21059 consensus_queue.cc:1048] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.719718 21162 consensus_queue.cc:1048] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.751384 20228 raft_consensus.cc:1275] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Refusing update from remote peer 45ea8ca532304a8f9ffda636d59f6f0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:56.754132 21155 consensus_queue.cc:1048] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.782370 20161 raft_consensus.cc:1275] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Refusing update from remote peer aac061e592d74289800e4c50cbb4132b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:56.784566 21166 consensus_queue.cc:1048] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:56.866961 20154 raft_consensus.cc:3060] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.873082 20228 raft_consensus.cc:1275] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.875618 20230 raft_consensus.cc:3060] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:56.877032 21174 consensus_queue.cc:1048] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.903303 20228 raft_consensus.cc:1275] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.907584 21174 consensus_queue.cc:1048] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.920477 20230 raft_consensus.cc:1275] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Refusing update from remote peer aac061e592d74289800e4c50cbb4132b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:56.935355 20085 raft_consensus.cc:1275] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Refusing update from remote peer 45ea8ca532304a8f9ffda636d59f6f0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:56.966449 21155 consensus_queue.cc:1048] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.938831 20161 raft_consensus.cc:3060] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.982074 20161 raft_consensus.cc:1275] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.987087 20085 raft_consensus.cc:1275] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Refusing update from remote peer c470740d41ee4b9383923d08a87655d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:57.005486 21154 consensus_queue.cc:1048] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:57.017802  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:57.030658 21160 consensus_queue.cc:1048] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:56.961356 20154 raft_consensus.cc:1275] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:57.052773 20229 raft_consensus.cc:1275] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Refusing update from remote peer aac061e592d74289800e4c50cbb4132b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:57.057075 21139 consensus_queue.cc:1048] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:57.068007 21139 consensus_queue.cc:1048] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:57.072798 20154 raft_consensus.cc:1275] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Refusing update from remote peer c470740d41ee4b9383923d08a87655d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:57.081250 20935 raft_consensus.cc:1275] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Refusing update from remote peer aac061e592d74289800e4c50cbb4132b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:57.082986 21166 consensus_queue.cc:1048] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:57.086272 21166 consensus_queue.cc:1048] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:57.105158 21051 consensus_queue.cc:1048] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:57.154726 20085 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "995e00d57e1040b7b6d193c60fd84405"
dest_uuid: "aac061e592d74289800e4c50cbb4132b"
mode: GRACEFUL
new_leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
 from {username='slave'} at 127.0.0.1:54402
I20260709 12:24:57.155325 20085 raft_consensus.cc:606] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 2 LEADER]: Received request to transfer leadership to TS 45ea8ca532304a8f9ffda636d59f6f0f
I20260709 12:24:57.167466 20085 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608"
dest_uuid: "aac061e592d74289800e4c50cbb4132b"
mode: GRACEFUL
new_leader_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:54402
I20260709 12:24:57.168087 20085 raft_consensus.cc:606] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 5 LEADER]: Received request to transfer leadership to TS 7204c82dd34944818a439bd468a8c410
I20260709 12:24:57.182510 20084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029"
dest_uuid: "aac061e592d74289800e4c50cbb4132b"
mode: GRACEFUL
new_leader_uuid: "c470740d41ee4b9383923d08a87655d6"
 from {username='slave'} at 127.0.0.1:54402
I20260709 12:24:57.183178 20084 raft_consensus.cc:606] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Received request to transfer leadership to TS c470740d41ee4b9383923d08a87655d6
I20260709 12:24:57.183558 20084 raft_consensus.cc:614] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:57.276870 20932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f834f9ccdefc4baebc23e9477701af69"
dest_uuid: "7204c82dd34944818a439bd468a8c410"
mode: GRACEFUL
new_leader_uuid: "c470740d41ee4b9383923d08a87655d6"
 from {username='slave'} at 127.0.0.1:43484
I20260709 12:24:57.277556 20932 raft_consensus.cc:606] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Received request to transfer leadership to TS c470740d41ee4b9383923d08a87655d6
I20260709 12:24:57.279198  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:24:57.281041  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:57.281836  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:57.294834 21176 raft_consensus.cc:993] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b: : Instructing follower 45ea8ca532304a8f9ffda636d59f6f0f to start an election
I20260709 12:24:57.295324 21176 raft_consensus.cc:1081] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 2 LEADER]: Signalling peer 45ea8ca532304a8f9ffda636d59f6f0f to start an election
I20260709 12:24:57.300834 20159 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "995e00d57e1040b7b6d193c60fd84405"
dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
 from {username='slave'} at 127.0.0.1:57058
I20260709 12:24:57.301451 20159 raft_consensus.cc:493] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:57.302953 20159 raft_consensus.cc:3060] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:57.325105 20159 raft_consensus.cc:515] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:57.329212 20935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995e00d57e1040b7b6d193c60fd84405" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:57.329869 20935 raft_consensus.cc:3060] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:57.329375 20159 leader_election.cc:290] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:57.339280 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995e00d57e1040b7b6d193c60fd84405" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:57.340051 20083 raft_consensus.cc:3055] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:57.340893 20083 raft_consensus.cc:740] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:57.342003 20083 consensus_queue.cc:260] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:57.342618 20935 raft_consensus.cc:2468] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 3.
I20260709 12:24:57.346187 20083 raft_consensus.cc:3060] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:57.347096 20125 leader_election.cc:304] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: 
I20260709 12:24:57.348045 21045 raft_consensus.cc:2804] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:57.348516 21045 raft_consensus.cc:697] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:57.349303 21045 consensus_queue.cc:237] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:57.362790 20083 raft_consensus.cc:2468] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 3.
I20260709 12:24:57.373651 19905 catalog_manager.cc:5697] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 2 to 3, leader changed from aac061e592d74289800e4c50cbb4132b (127.9.131.66) to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 3 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:57.539721 21139 raft_consensus.cc:993] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410: : Instructing follower c470740d41ee4b9383923d08a87655d6 to start an election
I20260709 12:24:57.540201 21059 raft_consensus.cc:1081] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Signalling peer c470740d41ee4b9383923d08a87655d6 to start an election
I20260709 12:24:57.541877 20230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f834f9ccdefc4baebc23e9477701af69"
dest_uuid: "c470740d41ee4b9383923d08a87655d6"
 from {username='slave'} at 127.0.0.1:47590
I20260709 12:24:57.542500 20230 raft_consensus.cc:493] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:57.542868 20230 raft_consensus.cc:3060] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:57.547168 21154 raft_consensus.cc:993] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b: : Instructing follower 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:57.547715 21166 raft_consensus.cc:1081] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 5 LEADER]: Signalling peer 7204c82dd34944818a439bd468a8c410 to start an election
I20260709 12:24:57.551594 20932 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608"
dest_uuid: "7204c82dd34944818a439bd468a8c410"
 from {username='slave'} at 127.0.0.1:32998
I20260709 12:24:57.552286 20932 raft_consensus.cc:493] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:57.552716 20932 raft_consensus.cc:3060] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:57.554378 20230 raft_consensus.cc:515] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:57.557909 20230 leader_election.cc:290] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:57.560642 20935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f834f9ccdefc4baebc23e9477701af69" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:57.561159 20935 raft_consensus.cc:3055] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:57.561399 20935 raft_consensus.cc:740] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:57.562247 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f834f9ccdefc4baebc23e9477701af69" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:57.562124 20935 consensus_queue.cc:260] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:57.562914 20159 raft_consensus.cc:3060] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:57.563498 20935 raft_consensus.cc:3060] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:57.570937 20159 raft_consensus.cc:2468] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 3.
I20260709 12:24:57.581233 20201 leader_election.cc:304] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:57.582044 21160 raft_consensus.cc:2804] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:57.582528 21160 raft_consensus.cc:697] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [term 3 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:57.577225 20935 raft_consensus.cc:2468] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 3.
I20260709 12:24:57.583343 21160 consensus_queue.cc:237] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:57.576268 20932 raft_consensus.cc:515] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:57.585839 20932 leader_election.cc:290] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 6 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:57.587102 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:57.587818 20083 raft_consensus.cc:3055] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:57.588186 20083 raft_consensus.cc:740] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:24:57.589541 20083 consensus_queue.cc:260] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:57.590907 20083 raft_consensus.cc:3060] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:57.592067 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:57.592832 20159 raft_consensus.cc:3060] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:57.599961 19905 catalog_manager.cc:5697] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 2 to 3, leader changed from 7204c82dd34944818a439bd468a8c410 (127.9.131.65) to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 3 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.600940 20159 raft_consensus.cc:2468] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 6.
I20260709 12:24:57.602221 20888 leader_election.cc:304] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410; no voters: 
I20260709 12:24:57.603404 21139 raft_consensus.cc:2804] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:57.614089 20083 raft_consensus.cc:2468] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 6.
I20260709 12:24:57.615566 21139 raft_consensus.cc:697] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 6 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:57.616781 21139 consensus_queue.cc:237] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:57.627204 19905 catalog_manager.cc:5697] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 5 to 6, leader changed from aac061e592d74289800e4c50cbb4132b (127.9.131.66) to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 6 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.719800 21227 raft_consensus.cc:493] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.720412 21227 raft_consensus.cc:515] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:57.722932 21227 leader_election.cc:290] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:57.725968 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:57.726897 20083 raft_consensus.cc:2468] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 3.
I20260709 12:24:57.728282 20888 leader_election.cc:304] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:57.728947 20230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:57.729161 21227 raft_consensus.cc:2804] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:57.729743 21227 raft_consensus.cc:493] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.730436 21227 raft_consensus.cc:3060] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:57.738916 21227 raft_consensus.cc:515] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:57.741238 21227 leader_election.cc:290] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 4 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:57.741947 20230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:57.742731 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:57.743430 20083 raft_consensus.cc:3060] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:57.772130 20083 raft_consensus.cc:2468] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 4.
I20260709 12:24:57.773559 20888 leader_election.cc:304] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: c470740d41ee4b9383923d08a87655d6
I20260709 12:24:57.775120 21139 raft_consensus.cc:2804] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:57.775691 21139 raft_consensus.cc:697] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 4 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:57.776715 21139 consensus_queue.cc:237] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:57.790433 20932 raft_consensus.cc:1275] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Refusing update from remote peer 45ea8ca532304a8f9ffda636d59f6f0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:57.792006 21045 consensus_queue.cc:1048] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:57.792937 19905 catalog_manager.cc:5697] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.794868 20083 raft_consensus.cc:1275] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Refusing update from remote peer 45ea8ca532304a8f9ffda636d59f6f0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:57.797693 21045 consensus_queue.cc:1048] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:57.799981 21045 raft_consensus.cc:493] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.800390 21045 raft_consensus.cc:515] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:57.803965 20229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d6ed1f33fa4b73bf5108eb0fec8f88" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:57.803254 21045 leader_election.cc:290] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:57.807330 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d6ed1f33fa4b73bf5108eb0fec8f88" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:57.808154 20085 raft_consensus.cc:2468] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 2.
I20260709 12:24:57.810168 20126 leader_election.cc:304] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: c470740d41ee4b9383923d08a87655d6
I20260709 12:24:57.811590 21045 raft_consensus.cc:2804] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:57.812036 21045 raft_consensus.cc:493] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.812302 21045 raft_consensus.cc:3060] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:57.820928 21059 raft_consensus.cc:493] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:57.821509 21059 raft_consensus.cc:515] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:57.828495 21059 leader_election.cc:290] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:57.829990 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:57.830651 20230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:24:57.830722 20085 raft_consensus.cc:2468] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:57.831525 20230 raft_consensus.cc:2393] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7204c82dd34944818a439bd468a8c410 in current term 2: Already voted for candidate c470740d41ee4b9383923d08a87655d6 in this term.
I20260709 12:24:57.832760 20888 leader_election.cc:304] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:57.833985 21139 raft_consensus.cc:2804] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:57.834357 21139 raft_consensus.cc:493] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:24:57.834719 21139 raft_consensus.cc:3060] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.838047 21205 raft_consensus.cc:493] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:24:57.838636 21205 raft_consensus.cc:515] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:57.841341 21205 leader_election.cc:290] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:57.842159 20938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7204c82dd34944818a439bd468a8c410" is_pre_election: true
I20260709 12:24:57.850900 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:57.851563 20085 raft_consensus.cc:2368] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c470740d41ee4b9383923d08a87655d6 for earlier term 3. Current term is 4.
I20260709 12:24:57.847429 21139 raft_consensus.cc:515] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:57.852777 20201 leader_election.cc:400] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769) with higher term. Message: Invalid argument: T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c470740d41ee4b9383923d08a87655d6 for earlier term 3. Current term is 4.
I20260709 12:24:57.853083 20201 leader_election.cc:403] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:57.854028 21160 raft_consensus.cc:3060] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:57.854803 21045 raft_consensus.cc:515] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:57.859100 21045 leader_election.cc:290] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:24:57.861337 20229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d6ed1f33fa4b73bf5108eb0fec8f88" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:57.865221 21160 raft_consensus.cc:2749] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769) with higher term. Message: Invalid argument: T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c470740d41ee4b9383923d08a87655d6 for earlier term 3. Current term is 4.
I20260709 12:24:57.870028 20229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:24:57.870994 20229 raft_consensus.cc:2393] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7204c82dd34944818a439bd468a8c410 in current term 2: Already voted for candidate c470740d41ee4b9383923d08a87655d6 in this term.
I20260709 12:24:57.872387 21139 leader_election.cc:290] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:57.888134 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:57.889870 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d6ed1f33fa4b73bf5108eb0fec8f88" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:57.890544 20085 raft_consensus.cc:3060] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:57.893392 21160 raft_consensus.cc:493] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:24:57.894009 21160 raft_consensus.cc:515] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:57.895134 20083 raft_consensus.cc:2468] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:24:57.896193 21160 leader_election.cc:290] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:57.899937 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d6ed1f33fa4b73bf5108eb0fec8f88" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:24:57.900681 20161 raft_consensus.cc:2368] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c470740d41ee4b9383923d08a87655d6 for earlier term 2. Current term is 3.
I20260709 12:24:57.901100 20085 raft_consensus.cc:2468] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 3.
I20260709 12:24:57.902534 20201 leader_election.cc:400] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749) with higher term. Message: Invalid argument: T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c470740d41ee4b9383923d08a87655d6 for earlier term 2. Current term is 3.
I20260709 12:24:57.902895 20201 leader_election.cc:403] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:57.903499 21205 raft_consensus.cc:3060] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:57.904438 20888 leader_election.cc:304] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: c470740d41ee4b9383923d08a87655d6
I20260709 12:24:57.904592 20126 leader_election.cc:304] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: c470740d41ee4b9383923d08a87655d6
I20260709 12:24:57.905629 21211 raft_consensus.cc:2804] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:57.906117 21211 raft_consensus.cc:697] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:57.906881 21211 consensus_queue.cc:237] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:57.911548 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d6ed1f33fa4b73bf5108eb0fec8f88" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:24:57.913157 20083 raft_consensus.cc:2368] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c470740d41ee4b9383923d08a87655d6 for earlier term 2. Current term is 3.
I20260709 12:24:57.913865 21227 raft_consensus.cc:2804] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:57.913729 21205 raft_consensus.cc:2749] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749) with higher term. Message: Invalid argument: T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c470740d41ee4b9383923d08a87655d6 for earlier term 2. Current term is 3.
I20260709 12:24:57.914842 21227 raft_consensus.cc:697] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Becoming Leader. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:57.915823 21227 consensus_queue.cc:237] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:24:57.916549 20201 leader_election.cc:400] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769) with higher term. Message: Invalid argument: T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c470740d41ee4b9383923d08a87655d6 for earlier term 2. Current term is 3.
I20260709 12:24:57.936825 19905 catalog_manager.cc:5697] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.955216 19908 catalog_manager.cc:5697] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 reported cstate change: term changed from 1 to 2, leader changed from aac061e592d74289800e4c50cbb4132b (127.9.131.66) to 7204c82dd34944818a439bd468a8c410 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "7204c82dd34944818a439bd468a8c410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.990712 20932 raft_consensus.cc:1275] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Refusing update from remote peer c470740d41ee4b9383923d08a87655d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:57.992256 21205 consensus_queue.cc:1048] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:58.018502 20161 raft_consensus.cc:1275] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Refusing update from remote peer c470740d41ee4b9383923d08a87655d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:58.023104 21242 consensus_queue.cc:1048] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:58.156946 20085 raft_consensus.cc:1275] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 6 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:58.158092 21059 consensus_queue.cc:1048] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:58.163163 20161 raft_consensus.cc:1275] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 6 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:58.164976 21059 consensus_queue.cc:1048] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:58.252898 20230 raft_consensus.cc:1275] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 4 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:58.254241 21227 consensus_queue.cc:1048] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:58.256691 21239 raft_consensus.cc:476] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: Not starting pre-election -- already a leader
I20260709 12:24:58.268689 20083 raft_consensus.cc:1275] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 4 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:58.270663 21227 consensus_queue.cc:1048] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:58.320645 20085 raft_consensus.cc:1275] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.329075 21139 consensus_queue.cc:1048] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.352780 20230 raft_consensus.cc:1275] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Refusing update from remote peer 7204c82dd34944818a439bd468a8c410: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.356688 21227 consensus_queue.cc:1048] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.367699  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:58.372320 20233 raft_consensus.cc:1275] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Refusing update from remote peer 45ea8ca532304a8f9ffda636d59f6f0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:58.374161 21180 consensus_queue.cc:1048] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.421275 20085 raft_consensus.cc:1275] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Refusing update from remote peer 45ea8ca532304a8f9ffda636d59f6f0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:58.427222 21239 consensus_queue.cc:1048] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.458143 20161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20a52c50180741b9a6165c183733f3fa"
dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
mode: GRACEFUL
new_leader_uuid: "c470740d41ee4b9383923d08a87655d6"
 from {username='slave'} at 127.0.0.1:52546
I20260709 12:24:58.458752 20161 raft_consensus.cc:606] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Received request to transfer leadership to TS c470740d41ee4b9383923d08a87655d6
I20260709 12:24:58.461786 20932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57d0409829eb45ff8e1eb6b75796eff9"
dest_uuid: "7204c82dd34944818a439bd468a8c410"
mode: GRACEFUL
new_leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
 from {username='slave'} at 127.0.0.1:43484
I20260709 12:24:58.462359 20932 raft_consensus.cc:606] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Received request to transfer leadership to TS 45ea8ca532304a8f9ffda636d59f6f0f
I20260709 12:24:58.465029 20932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6e608aa894f4f9d96f3e1b9b16fb7cd"
dest_uuid: "7204c82dd34944818a439bd468a8c410"
mode: GRACEFUL
new_leader_uuid: "c470740d41ee4b9383923d08a87655d6"
 from {username='slave'} at 127.0.0.1:43484
I20260709 12:24:58.466099 20932 raft_consensus.cc:606] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Received request to transfer leadership to TS c470740d41ee4b9383923d08a87655d6
I20260709 12:24:58.467630  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:58.470042  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:58.470854  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:58.572033 21211 raft_consensus.cc:993] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f: : Instructing follower c470740d41ee4b9383923d08a87655d6 to start an election
I20260709 12:24:58.572548 21211 raft_consensus.cc:1081] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Signalling peer c470740d41ee4b9383923d08a87655d6 to start an election
I20260709 12:24:58.574774 20230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20a52c50180741b9a6165c183733f3fa"
dest_uuid: "c470740d41ee4b9383923d08a87655d6"
 from {username='slave'} at 127.0.0.1:32990
I20260709 12:24:58.575402 20230 raft_consensus.cc:493] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:58.575815 20230 raft_consensus.cc:3060] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:58.582823 20230 raft_consensus.cc:515] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:58.584544 20230 leader_election.cc:290] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:24:58.585510 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a52c50180741b9a6165c183733f3fa" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:58.586229 20085 raft_consensus.cc:3060] T 20a52c50180741b9a6165c183733f3fa P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:58.586104 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a52c50180741b9a6165c183733f3fa" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:58.589902 20161 raft_consensus.cc:3055] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:58.590413 20161 raft_consensus.cc:740] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:58.591198 20161 consensus_queue.cc:260] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:58.592549 20161 raft_consensus.cc:3060] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:58.600078 20161 raft_consensus.cc:2468] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 2.
I20260709 12:24:58.601517 20201 leader_election.cc:304] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:58.601801 20085 raft_consensus.cc:2468] T 20a52c50180741b9a6165c183733f3fa P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 2.
I20260709 12:24:58.602205 21205 raft_consensus.cc:2804] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:58.603420 21205 raft_consensus.cc:697] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [term 2 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:58.604209 21205 consensus_queue.cc:237] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:24:58.615669 19907 catalog_manager.cc:5697] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 1 to 2, leader changed from 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67) to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 2 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:58.711151 21162 raft_consensus.cc:993] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410: : Instructing follower 45ea8ca532304a8f9ffda636d59f6f0f to start an election
I20260709 12:24:58.711699 21139 raft_consensus.cc:1081] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Signalling peer 45ea8ca532304a8f9ffda636d59f6f0f to start an election
I20260709 12:24:58.713230 20161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57d0409829eb45ff8e1eb6b75796eff9"
dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
 from {username='slave'} at 127.0.0.1:52554
I20260709 12:24:58.713747 20161 raft_consensus.cc:493] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:58.714107 20161 raft_consensus.cc:3060] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:58.719201 20161 raft_consensus.cc:515] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:58.721822 20161 leader_election.cc:290] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:24:58.722782 20938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d0409829eb45ff8e1eb6b75796eff9" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:58.722822 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d0409829eb45ff8e1eb6b75796eff9" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:24:58.723615 20938 raft_consensus.cc:3055] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:58.723925 20084 raft_consensus.cc:3060] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:58.723966 20938 raft_consensus.cc:740] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:58.725322 20938 consensus_queue.cc:260] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:58.726348 20938 raft_consensus.cc:3060] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:58.731694 20084 raft_consensus.cc:2468] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 3.
W20260709 12:24:58.777964 20886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:39155, user_credentials={real_user=slave}} blocked reactor thread for 45507.4us
I20260709 12:24:58.788718 20126 leader_election.cc:304] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:24:58.789172 20938 raft_consensus.cc:2468] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 3.
I20260709 12:24:58.790634 21180 raft_consensus.cc:2804] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:58.791249 21180 raft_consensus.cc:697] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:24:58.792189 21180 consensus_queue.cc:237] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:24:58.796376 21139 raft_consensus.cc:993] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410: : Instructing follower c470740d41ee4b9383923d08a87655d6 to start an election
I20260709 12:24:58.797518 21227 raft_consensus.cc:1081] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Signalling peer c470740d41ee4b9383923d08a87655d6 to start an election
I20260709 12:24:58.799424 20233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6e608aa894f4f9d96f3e1b9b16fb7cd"
dest_uuid: "c470740d41ee4b9383923d08a87655d6"
 from {username='slave'} at 127.0.0.1:47590
I20260709 12:24:58.800112 20233 raft_consensus.cc:493] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:58.800536 20233 raft_consensus.cc:3060] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:58.816123 20233 raft_consensus.cc:515] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:58.822167 20233 leader_election.cc:290] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:24:58.827105 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e608aa894f4f9d96f3e1b9b16fb7cd" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:24:58.827790 20161 raft_consensus.cc:3060] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:58.828224 20938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e608aa894f4f9d96f3e1b9b16fb7cd" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7204c82dd34944818a439bd468a8c410"
I20260709 12:24:58.828778 20938 raft_consensus.cc:3055] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:58.829044 20938 raft_consensus.cc:740] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7204c82dd34944818a439bd468a8c410, State: Running, Role: LEADER
I20260709 12:24:58.827790 19907 catalog_manager.cc:5697] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 2 to 3, leader changed from 7204c82dd34944818a439bd468a8c410 (127.9.131.65) to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 3 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:58.830691 20938 consensus_queue.cc:260] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:58.835098 20938 raft_consensus.cc:3060] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:58.859198 20938 raft_consensus.cc:2468] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 3.
I20260709 12:24:58.861910 20161 raft_consensus.cc:2468] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 3.
I20260709 12:24:58.862033 20200 leader_election.cc:304] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:24:58.862983 21242 raft_consensus.cc:2804] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:58.863477 21242 raft_consensus.cc:697] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 3 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:24:58.864841 21242 consensus_queue.cc:237] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:24:58.875017 19908 catalog_manager.cc:5697] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 2 to 3, leader changed from 7204c82dd34944818a439bd468a8c410 (127.9.131.65) to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 3 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:59.016908 20154 raft_consensus.cc:1275] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Refusing update from remote peer c470740d41ee4b9383923d08a87655d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:59.018292 21242 consensus_queue.cc:1048] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:59.032130 20084 raft_consensus.cc:1275] T 20a52c50180741b9a6165c183733f3fa P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Refusing update from remote peer c470740d41ee4b9383923d08a87655d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:59.033886 21242 consensus_queue.cc:1048] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:59.339534 20084 raft_consensus.cc:1275] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Refusing update from remote peer 45ea8ca532304a8f9ffda636d59f6f0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:59.344790 21211 consensus_queue.cc:1048] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
W20260709 12:24:59.352253 20888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:38769, user_credentials={real_user=slave}} blocked reactor thread for 68590.8us
I20260709 12:24:59.367136 20932 raft_consensus.cc:1275] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Refusing update from remote peer 45ea8ca532304a8f9ffda636d59f6f0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:24:59.352988 20886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.68:39155, user_credentials={real_user=slave}} blocked reactor thread for 51283.4us
I20260709 12:24:59.409950 20938 raft_consensus.cc:1275] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Refusing update from remote peer c470740d41ee4b9383923d08a87655d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:59.431469 21266 consensus_queue.cc:1048] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:59.436096 21274 consensus_queue.cc:1048] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:59.573179 20161 raft_consensus.cc:1275] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Refusing update from remote peer c470740d41ee4b9383923d08a87655d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:59.589020  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:59.643818 21242 consensus_queue.cc:1048] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
W20260709 12:24:59.740216 20050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 126186us
I20260709 12:24:59.885114 20159 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd4d18eda43b4a17bd5b552c4e04225c"
dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
mode: GRACEFUL
new_leader_uuid: "c470740d41ee4b9383923d08a87655d6"
 from {username='slave'} at 127.0.0.1:52546
I20260709 12:24:59.885970 20159 raft_consensus.cc:606] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Received request to transfer leadership to TS c470740d41ee4b9383923d08a87655d6
I20260709 12:24:59.900069  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:59.902588  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:59.903848  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:00.126888 21271 raft_consensus.cc:993] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f: : Instructing follower c470740d41ee4b9383923d08a87655d6 to start an election
I20260709 12:25:00.127421 21211 raft_consensus.cc:1081] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Signalling peer c470740d41ee4b9383923d08a87655d6 to start an election
I20260709 12:25:00.128929 20228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd4d18eda43b4a17bd5b552c4e04225c"
dest_uuid: "c470740d41ee4b9383923d08a87655d6"
 from {username='slave'} at 127.0.0.1:32990
I20260709 12:25:00.129434 20228 raft_consensus.cc:493] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:00.129717 20228 raft_consensus.cc:3060] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:00.136531 20228 raft_consensus.cc:515] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:00.138192 20228 leader_election.cc:290] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:00.139276 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4d18eda43b4a17bd5b552c4e04225c" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:25:00.140012 20159 raft_consensus.cc:3055] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:00.140005 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4d18eda43b4a17bd5b552c4e04225c" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:25:00.140537 20159 raft_consensus.cc:740] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:25:00.140829 20081 raft_consensus.cc:3060] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:00.141415 20159 consensus_queue.cc:260] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:00.142442 20159 raft_consensus.cc:3060] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:00.149188 20159 raft_consensus.cc:2468] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 2.
I20260709 12:25:00.150569 20201 leader_election.cc:304] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:25:00.151139 20081 raft_consensus.cc:2468] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 2.
I20260709 12:25:00.151432 21279 raft_consensus.cc:2804] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:00.152153 21279 raft_consensus.cc:697] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 2 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:25:00.153299 21279 consensus_queue.cc:237] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:00.167959 19905 catalog_manager.cc:5697] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 1 to 2, leader changed from 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67) to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 2 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:00.654557 20159 raft_consensus.cc:1275] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Refusing update from remote peer c470740d41ee4b9383923d08a87655d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:00.656795 21274 consensus_queue.cc:1048] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:00.685365 20081 raft_consensus.cc:1275] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Refusing update from remote peer c470740d41ee4b9383923d08a87655d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:00.702335 21274 consensus_queue.cc:1048] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:25:00.955703  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:01.081995  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:01.083210  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:01.083711  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:01.123435  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:01.165091  9741 tablet_server.cc:179] TabletServer@127.9.131.65:43339 shutting down...
W20260709 12:25:01.186033 20200 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 172 similar messages]
W20260709 12:25:01.206058 20200 consensus_peers.cc:597] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:01.206923 20200 consensus_peers.cc:597] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:01.223104  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:01.224249  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:01.225423  9741 raft_consensus.cc:2243] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:01.226773  9741 raft_consensus.cc:2272] T d45bea543fc142ee90510d18e0d7c029 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:01.229938 20200 consensus_peers.cc:597] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:01.230441  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:01.231408  9741 raft_consensus.cc:2243] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:01.232015  9741 raft_consensus.cc:2272] T d2a53dd7c6fa4a338973463bf3cf0f9c P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:01.235735  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:01.236907  9741 raft_consensus.cc:2243] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:01.237561  9741 raft_consensus.cc:2272] T a72eb35da72b43ecb538c2a240a61646 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:01.242575 20050 consensus_peers.cc:597] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:01.247102  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:01.249418  9741 raft_consensus.cc:2243] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:01.250123  9741 raft_consensus.cc:2272] T 073b8908cc1345f3bad72a6d8124df11 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:01.251538 20050 consensus_peers.cc:597] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:01.256536  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:01.257688  9741 raft_consensus.cc:2243] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:01.259099  9741 raft_consensus.cc:2272] T 04cd0aa441274cf38da93eec0bfadeff P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:01.265684  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:01.272146  9741 raft_consensus.cc:2243] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:01.275341 20200 consensus_peers.cc:597] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:01.290691 20125 consensus_peers.cc:597] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:01.291538 20125 consensus_peers.cc:597] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:01.294373 20125 consensus_peers.cc:597] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:01.296950  9741 raft_consensus.cc:2272] T b0da04e85e534d9990213bfdcee4874c P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:01.311367  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:01.312366  9741 raft_consensus.cc:2243] T 0252a8e0d9ac4440b3affdcbf4cf2246 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:01.314409  9741 raft_consensus.cc:2272] T 0252a8e0d9ac4440b3affdcbf4cf2246 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:01.327174  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:01.329470  9741 raft_consensus.cc:2243] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:01.330845  9741 raft_consensus.cc:2272] T 144ce9a2901342abbabee63851505b75 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:01.519640  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:01.520566  9741 raft_consensus.cc:2243] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:01.521270  9741 raft_consensus.cc:2272] T 1257e7996388445eaa292ac68c3ad0ef P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:01.827916  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:01.829804  9741 raft_consensus.cc:2243] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:01.831125  9741 raft_consensus.cc:2272] T dd398fffdf6d468f88108a6a7bec0681 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.065768 21272 raft_consensus.cc:493] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:02.066452 21272 raft_consensus.cc:515] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:02.069206 21272 leader_election.cc:290] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:02.076416  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.077564  9741 raft_consensus.cc:2243] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.078428  9741 raft_consensus.cc:2272] T af265a90671a46cbafb3fced0f952aef P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.082296  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.162801 21272 raft_consensus.cc:493] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:02.165293 21273 raft_consensus.cc:493] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:25:02.204557 21272 raft_consensus.cc:515] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:02.206995 21272 leader_election.cc:290] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:02.207556 21272 raft_consensus.cc:493] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:02.204602 21273 raft_consensus.cc:515] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:02.210390 21273 leader_election.cc:290] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:02.211117 21272 raft_consensus.cc:515] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:02.213563 21272 leader_election.cc:290] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:02.214484  9741 raft_consensus.cc:2243] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.214979  9741 raft_consensus.cc:2272] T d5e9c01d16214bb19000600644b36d1e P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.220319  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.221203  9741 raft_consensus.cc:2243] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.223137  9741 raft_consensus.cc:2272] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.226382  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.227402  9741 raft_consensus.cc:2243] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.228077  9741 raft_consensus.cc:2272] T 94b96b6be45d43b6aceaf2afe76d79e4 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.231381  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.232460  9741 raft_consensus.cc:2243] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:02.245719  9741 raft_consensus.cc:2272] T cb8871be082b42e1b4cb33626f240b8d P 7204c82dd34944818a439bd468a8c410 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.249765  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.250522  9741 raft_consensus.cc:2243] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.251138  9741 raft_consensus.cc:2272] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.255550  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.256541  9741 raft_consensus.cc:2243] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.257354  9741 raft_consensus.cc:2272] T 3651ee11a6184a34bed06bc86be62c29 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.261677  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.262472  9741 raft_consensus.cc:2243] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:02.263648  9741 raft_consensus.cc:2272] T e8691968cf8f4b04b4ef459bd321e903 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.267028  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.268018  9741 raft_consensus.cc:2243] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.268731  9741 raft_consensus.cc:2272] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.272104  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.273159  9741 raft_consensus.cc:2243] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.273833  9741 raft_consensus.cc:2272] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.277465  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.278404  9741 raft_consensus.cc:2243] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.279129  9741 raft_consensus.cc:2272] T abf0d91bbb1d4e40b769bc07ef380517 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.283030  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.283958  9741 raft_consensus.cc:2243] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.284662  9741 raft_consensus.cc:2272] T 57d0409829eb45ff8e1eb6b75796eff9 P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.321532  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.322553  9741 raft_consensus.cc:2243] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.323284  9741 raft_consensus.cc:2272] T 141c2e84c15e4ad38afc0a52b330f9b9 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.326629  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.327497  9741 raft_consensus.cc:2243] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.328250  9741 raft_consensus.cc:2272] T 8ed53455b57840a780d37b1db5103826 P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.331310  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.332166  9741 raft_consensus.cc:2243] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.332705  9741 raft_consensus.cc:2272] T e740fe60a5fc470d930160cc9445bc05 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.335880  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.336697  9741 raft_consensus.cc:2243] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:02.337466  9741 raft_consensus.cc:2272] T 0988a236f3934f8692fd434098766112 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.340847  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.341774  9741 raft_consensus.cc:2243] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.342429  9741 raft_consensus.cc:2272] T 6ff86d69d6264de598b8dd58012f7904 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.346292  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.347160  9741 raft_consensus.cc:2243] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.347764  9741 raft_consensus.cc:2272] T b5b588a815a548c8a3f375012fa7e3f6 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.351034  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.351960  9741 raft_consensus.cc:2243] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:25:02.352769  9741 raft_consensus.cc:2272] T c084bfebf47c4ede978b6da72f620608 P 7204c82dd34944818a439bd468a8c410 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.355985  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.356858  9741 raft_consensus.cc:2243] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:02.357692  9741 raft_consensus.cc:2272] T bf44484d11914a83a44c9a333eed7777 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.360798  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.361655  9741 raft_consensus.cc:2243] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.362320  9741 raft_consensus.cc:2272] T 995e00d57e1040b7b6d193c60fd84405 P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.365651  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.366549  9741 raft_consensus.cc:2243] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.367239  9741 raft_consensus.cc:2272] T 976741a38d1c42329394a00cbe085319 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.371088  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.371940  9741 raft_consensus.cc:2243] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:02.372969  9741 raft_consensus.cc:2272] T b0ac5e9dcbf74c29aa24300975246ad3 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.376432  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.377421  9741 raft_consensus.cc:2243] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.378166  9741 raft_consensus.cc:2272] T f834f9ccdefc4baebc23e9477701af69 P 7204c82dd34944818a439bd468a8c410 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.381560  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.382509  9741 raft_consensus.cc:2243] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.383216  9741 raft_consensus.cc:2272] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.386670  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.387616  9741 raft_consensus.cc:2243] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.388307  9741 raft_consensus.cc:2272] T d5bd4e0295fa48bc8c187c7d421d8f11 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.391551  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.392907  9741 raft_consensus.cc:2243] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:02.393566  9741 raft_consensus.cc:2272] T e05de16433174dc4b33d9fbc6afd9da1 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.583684  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.670610  9741 raft_consensus.cc:2243] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:02.671816  9741 raft_consensus.cc:2272] T 4a8a2aa61ada477c8750740dcc082235 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.675393  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:02.894604  9741 raft_consensus.cc:2243] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:02.895644  9741 raft_consensus.cc:2272] T fb7527e635cb4c339c05a4b1ea702164 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:02.950683 21302 raft_consensus.cc:493] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:02.951524 21302 raft_consensus.cc:515] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:02.954219 21302 leader_election.cc:290] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
W20260709 12:25:02.956395 20201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:38769, user_credentials={real_user=slave}} blocked reactor thread for 1.66364e+06us
W20260709 12:25:02.969595 20887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.951407 21303 raft_consensus.cc:493] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:02.990629 21306 raft_consensus.cc:493] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:03.021216 21309 raft_consensus.cc:493] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:25:03.025218 21311 raft_consensus.cc:493] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
W20260709 12:25:03.028066 20886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:03.115635 20886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.031685 21310 raft_consensus.cc:493] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:02.899093  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:03.125680  9741 raft_consensus.cc:2243] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:25:03.116946 20887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.124720 21310 raft_consensus.cc:515] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:03.116672 21313 raft_consensus.cc:493] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:03.118213 21305 raft_consensus.cc:493] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:03.149825 21330 raft_consensus.cc:493] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:03.167276 21330 raft_consensus.cc:515] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.153640 21332 raft_consensus.cc:493] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.171530 21332 raft_consensus.cc:515] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
W20260709 12:25:03.148044 20887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.157325 21315 raft_consensus.cc:493] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
W20260709 12:25:03.174365 20887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:03.174917 20887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.174400 21315 raft_consensus.cc:515] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:03.159257 21321 raft_consensus.cc:493] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:03.175750 21321 raft_consensus.cc:515] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.117049 21306 raft_consensus.cc:515] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:03.160715 21310 leader_election.cc:290] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:03.129513 21317 raft_consensus.cc:493] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:03.179032 21317 raft_consensus.cc:515] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
W20260709 12:25:03.161741 20889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.162313 21305 raft_consensus.cc:515] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:03.114878 21303 raft_consensus.cc:515] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:03.165010 21312 raft_consensus.cc:493] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:03.181628 21312 raft_consensus.cc:515] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:03.146559 21313 raft_consensus.cc:515] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:03.165995  9741 raft_consensus.cc:2272] T d063c9d79f904091aade12ce2aba8bd1 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.151268 21331 raft_consensus.cc:493] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:03.156031 21333 raft_consensus.cc:493] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:03.157130 21316 raft_consensus.cc:493] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:03.127645 21309 raft_consensus.cc:515] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:03.127935 21311 raft_consensus.cc:515] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:03.200328 21308 raft_consensus.cc:493] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:25:03.200888 21272 raft_consensus.cc:493] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:25:03.201524 21272 raft_consensus.cc:515] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:03.200958 21308 raft_consensus.cc:515] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
W20260709 12:25:03.226748 19940 debug-util.cc:398] Leaking SignalData structure 0x7b080005c580 after lost signal to thread 9744
I20260709 12:25:03.227082 21319 raft_consensus.cc:493] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.227705 21319 raft_consensus.cc:515] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
W20260709 12:25:03.228241 19940 debug-util.cc:398] Leaking SignalData structure 0x7b080034ca40 after lost signal to thread 19943
I20260709 12:25:03.228538 21318 raft_consensus.cc:493] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:25:03.229039 21318 raft_consensus.cc:515] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
W20260709 12:25:03.229705 19940 debug-util.cc:398] Leaking SignalData structure 0x7b080039a140 after lost signal to thread 20110
W20260709 12:25:03.231005 19940 debug-util.cc:398] Leaking SignalData structure 0x7b0800108a80 after lost signal to thread 20186
I20260709 12:25:03.188197 21331 raft_consensus.cc:515] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
W20260709 12:25:03.232304 19940 debug-util.cc:398] Leaking SignalData structure 0x7b08003486e0 after lost signal to thread 20261
W20260709 12:25:03.212783 20889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:03.234019 20201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40749, user_credentials={real_user=slave}} blocked reactor thread for 129008us
I20260709 12:25:03.208534 21304 raft_consensus.cc:493] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:25:03.203804 21272 leader_election.cc:290] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:03.232933 21310 raft_consensus.cc:493] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:03.208784 21316 raft_consensus.cc:515] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:03.244292 21335 raft_consensus.cc:493] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
W20260709 12:25:03.237382 20889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:03.237509 19940 debug-util.cc:398] Leaking SignalData structure 0x7b08000466c0 after lost signal to thread 20966
I20260709 12:25:03.191802 21333 raft_consensus.cc:515] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:03.261487 21324 raft_consensus.cc:493] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:25:03.244191 21334 raft_consensus.cc:493] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:03.244300 21310 raft_consensus.cc:515] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:03.245707 21272 raft_consensus.cc:493] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
W20260709 12:25:03.263979 20889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.260582 21302 raft_consensus.cc:493] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:03.261674 21307 raft_consensus.cc:493] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.271181 21334 raft_consensus.cc:515] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.252357 21304 raft_consensus.cc:515] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
W20260709 12:25:03.277354 20889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.279425 21326 raft_consensus.cc:493] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:03.318540 21303 leader_election.cc:290] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.319259 21313 leader_election.cc:290] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:03.319448 21309 leader_election.cc:290] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:03.320086 21327 raft_consensus.cc:493] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.281719 21338 raft_consensus.cc:493] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:25:03.281313 21336 raft_consensus.cc:493] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:03.322319 21306 leader_election.cc:290] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:03.281760 21325 raft_consensus.cc:493] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.322865 21311 leader_election.cc:290] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.323370 21317 leader_election.cc:290] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.318662 21305 leader_election.cc:290] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.319442 21315 leader_election.cc:290] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.318255 21326 raft_consensus.cc:515] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.281554 21340 raft_consensus.cc:493] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:03.320595 21333 leader_election.cc:290] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.332320 21323 raft_consensus.cc:493] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.333149 21342 raft_consensus.cc:493] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.333370 21325 raft_consensus.cc:515] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:03.333869 21311 raft_consensus.cc:493] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:03.334082 21316 leader_election.cc:290] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.323961 21312 leader_election.cc:290] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:03.322114 21336 raft_consensus.cc:515] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
W20260709 12:25:03.344013 20888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.284399 21310 leader_election.cc:290] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.282133 21328 raft_consensus.cc:493] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
W20260709 12:25:03.324450 20889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.321126 21338 raft_consensus.cc:515] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.333287 21331 leader_election.cc:290] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.317193 21279 raft_consensus.cc:493] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.276677 21272 raft_consensus.cc:515] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:03.332237 21308 leader_election.cc:290] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.318444 21314 raft_consensus.cc:493] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.278788 21302 raft_consensus.cc:515] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.261703 21335 raft_consensus.cc:515] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:03.332151 21303 raft_consensus.cc:493] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:25:03.333280 21321 leader_election.cc:290] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
W20260709 12:25:03.352216 20200 consensus_peers.cc:597] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:03.351263 21342 raft_consensus.cc:515] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:03.333814 21330 leader_election.cc:290] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.273460 21324 raft_consensus.cc:515] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.398896 21303 raft_consensus.cc:515] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.321949 21318 leader_election.cc:290] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:03.279518 21307 raft_consensus.cc:515] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:03.349771 21332 leader_election.cc:290] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.360810 21316 raft_consensus.cc:493] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:25:03.361043 21313 raft_consensus.cc:493] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.361243 21305 raft_consensus.cc:493] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:03.346109 21315 raft_consensus.cc:493] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:25:03.320691 21327 raft_consensus.cc:515] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:03.359090 21311 raft_consensus.cc:515] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.418594 21345 raft_consensus.cc:493] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:03.420858 21306 raft_consensus.cc:493] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:03.421353 21311 leader_election.cc:290] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.388831 21279 raft_consensus.cc:515] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:03.422200 21325 leader_election.cc:290] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:03.422616 21338 leader_election.cc:290] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:03.419848 21326 leader_election.cc:290] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:03.398411 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091f47eb9da43e6a24dd1b2bd9e9ce8" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.423251 21279 leader_election.cc:290] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:03.365383 21323 raft_consensus.cc:515] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:03.423658 20085 raft_consensus.cc:2468] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 1.
I20260709 12:25:03.419749 21350 raft_consensus.cc:493] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:03.411092 21318 raft_consensus.cc:493] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:03.425277 21350 raft_consensus.cc:515] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.425604 21318 raft_consensus.cc:515] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.423671 21304 leader_election.cc:290] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:03.348711 21340 raft_consensus.cc:515] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.424408 21336 leader_election.cc:290] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:03.386500 21314 raft_consensus.cc:515] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:03.428045 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8635d89e903c48a786062efb05feaa75" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.429198 21313 raft_consensus.cc:515] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:03.412444 21347 raft_consensus.cc:493] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:03.427596 21350 leader_election.cc:290] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.430190 21347 raft_consensus.cc:515] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:03.431277 21313 leader_election.cc:290] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:03.431890 21305 raft_consensus.cc:515] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:03.432554 21347 leader_election.cc:290] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.412712 21302 leader_election.cc:290] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.412947 21349 raft_consensus.cc:493] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:03.408802 21317 raft_consensus.cc:493] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:25:03.413681 21360 raft_consensus.cc:493] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:25:03.410081 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515975cb81844e8787a53147bb766080" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.413906 21329 raft_consensus.cc:493] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.415395 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd122132f7485fa43d171d8c857d38" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.415746 21307 leader_election.cc:290] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:03.412644 21272 leader_election.cc:290] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:03.435137 20081 raft_consensus.cc:2468] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:25:03.418289 21324 leader_election.cc:290] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:03.420524 21345 raft_consensus.cc:515] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.436043 21360 raft_consensus.cc:515] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:03.429526 21314 leader_election.cc:290] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.425200 21323 leader_election.cc:290] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:03.411777 21343 raft_consensus.cc:493] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:03.433705 21349 raft_consensus.cc:515] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.436513 21305 leader_election.cc:290] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:03.417373 21316 raft_consensus.cc:515] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.437758 21323 raft_consensus.cc:493] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:25:03.435153 21329 raft_consensus.cc:515] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:03.438331 21323 raft_consensus.cc:515] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.439221 21343 raft_consensus.cc:515] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.388355 21328 raft_consensus.cc:515] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.433730 21317 raft_consensus.cc:515] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:03.440618 21329 leader_election.cc:290] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:03.441953  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:03.442301 21317 leader_election.cc:290] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:03.421381 21306 raft_consensus.cc:515] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.442891 21360 leader_election.cc:290] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:03.444324 21306 leader_election.cc:290] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:03.414281 21359 raft_consensus.cc:493] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.445072 21359 raft_consensus.cc:515] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:03.396962 21319 leader_election.cc:290] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:03.437924 21345 leader_election.cc:290] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.436506 21334 leader_election.cc:290] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:03.438720 21349 leader_election.cc:290] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:03.433867 21315 raft_consensus.cc:515] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.448024 21349 raft_consensus.cc:493] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.422255 21346 raft_consensus.cc:493] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.448565 21349 raft_consensus.cc:515] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:03.448855 21346 raft_consensus.cc:515] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:03.435673 20083 raft_consensus.cc:2468] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 1.
I20260709 12:25:03.450776 21349 leader_election.cc:290] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.450955 21346 leader_election.cc:290] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:03.440505 21323 leader_election.cc:290] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:03.442847  9741 raft_consensus.cc:2243] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:03.453320  9741 raft_consensus.cc:2272] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.453758 21343 leader_election.cc:290] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.455152 21315 leader_election.cc:290] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.447130 21335 leader_election.cc:290] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:03.460276  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:03.455108 21318 leader_election.cc:290] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.461294  9741 raft_consensus.cc:2243] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:03.461603 21328 leader_election.cc:290] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.462947 21342 leader_election.cc:290] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.464215 21340 leader_election.cc:290] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.464504 21303 leader_election.cc:290] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.465600 21359 leader_election.cc:290] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.466451 21319 raft_consensus.cc:493] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:03.467170 21319 raft_consensus.cc:515] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.467695 21316 leader_election.cc:290] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.467778 21327 leader_election.cc:290] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.466362 21305 raft_consensus.cc:493] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.471848 21305 raft_consensus.cc:515] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:03.474160 21305 leader_election.cc:290] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:03.475198 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3651ee11a6184a34bed06bc86be62c29" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.471274 21319 leader_election.cc:290] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.476248 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5880437f7fb435aafab505023d9f7ae" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.476941 20084 raft_consensus.cc:2468] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 2.
I20260709 12:25:03.477578 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e740fe60a5fc470d930160cc9445bc05" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.477849 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a52c50180741b9a6165c183733f3fa" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.478454 20083 raft_consensus.cc:2468] T 20a52c50180741b9a6165c183733f3fa P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 2.
I20260709 12:25:03.482810 21335 raft_consensus.cc:493] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:03.483430 21335 raft_consensus.cc:515] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:03.485306 20888 leader_election.cc:304] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:25:03.458101 21323 raft_consensus.cc:493] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:25:03.486411  9741 raft_consensus.cc:2272] T ba98035197c34fce88758eedbfd23225 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:03.486006 20888 raft_consensus.cc:2686] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P 7204c82dd34944818a439bd468a8c410: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:25:03.490489 20888 leader_election.cc:304] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:25:03.485970 21335 leader_election.cc:290] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:03.492826 21323 raft_consensus.cc:515] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:03.494953 21319 raft_consensus.cc:493] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.492143 21314 raft_consensus.cc:493] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:03.495594 21319 raft_consensus.cc:515] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:03.495723 21334 raft_consensus.cc:493] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:03.496584 21323 leader_election.cc:290] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.496948 21334 raft_consensus.cc:515] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:03.498046 21319 leader_election.cc:290] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:03.499186 21334 leader_election.cc:290] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:03.496300 21314 raft_consensus.cc:515] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:03.502334 21314 leader_election.cc:290] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:03.503062 21335 raft_consensus.cc:493] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:25:03.503636 21348 raft_consensus.cc:493] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.504282 21348 raft_consensus.cc:515] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:03.506469 21348 leader_election.cc:290] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.506963 21348 raft_consensus.cc:493] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.507385 21348 raft_consensus.cc:515] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:03.509859 21348 leader_election.cc:290] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.510414 21348 raft_consensus.cc:493] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:25:03.511719 21361 raft_consensus.cc:493] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.512391 21361 raft_consensus.cc:515] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:03.512748 21314 raft_consensus.cc:493] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:03.513433 21314 raft_consensus.cc:515] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.514698 21361 leader_election.cc:290] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:03.515298 21361 raft_consensus.cc:493] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.515959 21327 raft_consensus.cc:493] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:25:03.516604 21327 raft_consensus.cc:515] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:03.518327 21364 raft_consensus.cc:493] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:03.515998 21324 raft_consensus.cc:493] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.518981 21364 raft_consensus.cc:515] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:03.519345 21324 raft_consensus.cc:515] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:03.520016 21305 raft_consensus.cc:493] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:03.520545 21305 raft_consensus.cc:515] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.521505 21324 leader_election.cc:290] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:03.515781 21361 raft_consensus.cc:515] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:03.527211 21327 leader_election.cc:290] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
W20260709 12:25:03.492975 20888 raft_consensus.cc:2686] T 515975cb81844e8787a53147bb766080 P 7204c82dd34944818a439bd468a8c410: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:25:03.522265 21314 leader_election.cc:290] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:03.511061 21348 raft_consensus.cc:515] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
W20260709 12:25:03.530539 20200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 137102us
I20260709 12:25:03.525504 21361 leader_election.cc:290] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.535707 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98035197c34fce88758eedbfd23225" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.536195 20888 leader_election.cc:304] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:25:03.538363 21272 raft_consensus.cc:2804] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:03.538748 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988f10f24b02449cade652e210ad3b06" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.538764 21272 raft_consensus.cc:493] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ea8ca532304a8f9ffda636d59f6f0f)
I20260709 12:25:03.539744 21272 raft_consensus.cc:3060] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:03.540130 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5038da47868e47148f6dda5d135f60fa" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.542466 20229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091f47eb9da43e6a24dd1b2bd9e9ce8" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.503686 21335 raft_consensus.cc:515] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:03.543903 21345 raft_consensus.cc:493] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.544502 21345 raft_consensus.cc:515] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:03.547462 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9370ed3b42941c683b03215e8ae3344" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.551842  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:03.554193 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c5a6e3d37c46f585ebd85003fbe15a" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.556481 20888 leader_election.cc:304] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:25:03.560248 20080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac5e9dcbf74c29aa24300975246ad3" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.560212 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac98768a9a3430a8784fa7995363272" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.561292 20083 raft_consensus.cc:2468] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 2.
I20260709 12:25:03.556174 21335 leader_election.cc:290] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.563041 21345 leader_election.cc:290] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.563139 20126 leader_election.cc:304] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:25:03.564113 21319 raft_consensus.cc:2804] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:03.564626 21319 raft_consensus.cc:493] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting leader election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:03.552284 20229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8635d89e903c48a786062efb05feaa75" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.565174 21319 raft_consensus.cc:3060] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:03.565351 20229 raft_consensus.cc:2468] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7204c82dd34944818a439bd468a8c410 in term 1.
I20260709 12:25:03.560675 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a53dd7c6fa4a338973463bf3cf0f9c" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.558054 21305 leader_election.cc:290] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.557662  9741 raft_consensus.cc:2243] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:03.568796 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528817cd200941fb84e40c79dbd16261" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.570461 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995e00d57e1040b7b6d193c60fd84405" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.571343 21348 leader_election.cc:290] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
W20260709 12:25:03.571525 20886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.572649 20157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98035197c34fce88758eedbfd23225" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.573323 20157 raft_consensus.cc:2468] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 2.
I20260709 12:25:03.573966  9741 raft_consensus.cc:2272] T e71a18e780d74303884e208106817dec P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.574404 20160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5880437f7fb435aafab505023d9f7ae" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.574868 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0126559599b40c5a6447c0648a81268" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.571251 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1127f55bd43a4c988dfd61547a03b3fa" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.574152 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515975cb81844e8787a53147bb766080" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
W20260709 12:25:03.575932 20888 raft_consensus.cc:2686] T e5880437f7fb435aafab505023d9f7ae P 7204c82dd34944818a439bd468a8c410: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:25:03.577350  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:03.578043 21305 raft_consensus.cc:493] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:03.578801 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4d18eda43b4a17bd5b552c4e04225c" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.579538 20153 raft_consensus.cc:2468] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 2.
I20260709 12:25:03.578764 21305 raft_consensus.cc:515] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:03.589052 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac98768a9a3430a8784fa7995363272" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.589052 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.590524 20079 raft_consensus.cc:2468] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 2.
W20260709 12:25:03.591104 20887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.589728 20153 raft_consensus.cc:2468] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 2.
I20260709 12:25:03.592371 21305 leader_election.cc:290] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.596596 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71a18e780d74303884e208106817dec" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.596796 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.599038 20229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04cd0aa441274cf38da93eec0bfadeff" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.599807 20229 raft_consensus.cc:2468] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 2.
I20260709 12:25:03.599081 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4d18eda43b4a17bd5b552c4e04225c" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.578183  9741 raft_consensus.cc:2243] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:03.600896 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.600596 20084 raft_consensus.cc:2468] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 2.
I20260709 12:25:03.577104 21364 leader_election.cc:290] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.564381 21363 raft_consensus.cc:493] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.604836 20233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72eb35da72b43ecb538c2a240a61646" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.599476 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc0138443e498db94e47c81d5ca81b" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.605311 21363 raft_consensus.cc:515] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:03.601508 20159 raft_consensus.cc:2468] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 6.
I20260709 12:25:03.607432 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.607811 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9370ed3b42941c683b03215e8ae3344" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.608130 20159 raft_consensus.cc:2468] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 2.
I20260709 12:25:03.609350 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2234eae9544c8898b57db26f4533d3" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.609375 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e608aa894f4f9d96f3e1b9b16fb7cd" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.610908 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d0409829eb45ff8e1eb6b75796eff9" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.610934 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524118618cf740e9865e397864b56ed2" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.607494 20126 leader_election.cc:304] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
W20260709 12:25:03.612164 20886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.612864 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0da04e85e534d9990213bfdcee4874c" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.614547 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a52c50180741b9a6165c183733f3fa" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.607488 21363 leader_election.cc:290] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.616235 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5038da47868e47148f6dda5d135f60fa" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.615800 21319 raft_consensus.cc:515] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.617053 20228 raft_consensus.cc:2468] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:25:03.616971 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976741a38d1c42329394a00cbe085319" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.618463 21319 leader_election.cc:290] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.619917 20230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988f10f24b02449cade652e210ad3b06" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.620563 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac98768a9a3430a8784fa7995363272" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.620684 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d6ed1f33fa4b73bf5108eb0fec8f88" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.620779 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf44484d11914a83a44c9a333eed7777" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.620950 20229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c5a6e3d37c46f585ebd85003fbe15a" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.620579 20230 raft_consensus.cc:2468] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:25:03.621714 20229 raft_consensus.cc:2468] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:25:03.622457 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71a18e780d74303884e208106817dec" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.622790 20229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.622697 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528817cd200941fb84e40c79dbd16261" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.623903 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd4e0295fa48bc8c187c7d421d8f11" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.624328 20234 raft_consensus.cc:2468] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 1.
I20260709 12:25:03.624311 20153 raft_consensus.cc:2468] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 2.
I20260709 12:25:03.626786 20161 raft_consensus.cc:1240] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Rejecting Update request from peer c470740d41ee4b9383923d08a87655d6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:03.626989 21363 raft_consensus.cc:2804] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:03.627447 21363 raft_consensus.cc:493] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting leader election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:03.627789 21363 raft_consensus.cc:3060] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:03.628530 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988f10f24b02449cade652e210ad3b06" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.629370 20157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2234eae9544c8898b57db26f4533d3" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.630595 20126 leader_election.cc:304] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:25:03.630784 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c5a6e3d37c46f585ebd85003fbe15a" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.630955 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5038da47868e47148f6dda5d135f60fa" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.631999 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff86d69d6264de598b8dd58012f7904" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.632247 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0988a236f3934f8692fd434098766112" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.632853 20154 raft_consensus.cc:2468] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 2.
I20260709 12:25:03.624398 21272 raft_consensus.cc:515] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:03.631954 21364 raft_consensus.cc:2804] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:03.634068 21364 raft_consensus.cc:493] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting leader election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:03.634460 21364 raft_consensus.cc:3060] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:03.635419 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0252a8e0d9ac4440b3affdcbf4cf2246" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.636442 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d6ed1f33fa4b73bf5108eb0fec8f88" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.637089 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d063c9d79f904091aade12ce2aba8bd1" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.637708 20160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf44484d11914a83a44c9a333eed7777" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.638335 20160 raft_consensus.cc:2468] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 2.
I20260709 12:25:03.638568 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091f47eb9da43e6a24dd1b2bd9e9ce8" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.633366 20156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc0138443e498db94e47c81d5ca81b" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.639343 20157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528817cd200941fb84e40c79dbd16261" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.641419 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1127f55bd43a4c988dfd61547a03b3fa" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.642174 20126 leader_election.cc:304] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:25:03.642993 21305 raft_consensus.cc:2804] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:03.643373 21305 raft_consensus.cc:493] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting leader election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:03.643688 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05de16433174dc4b33d9fbc6afd9da1" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.643812 21305 raft_consensus.cc:3060] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:03.644200 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a52c50180741b9a6165c183733f3fa" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:25:03.649407 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0126559599b40c5a6447c0648a81268" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.651190 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8691968cf8f4b04b4ef459bd321e903" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.652901 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.653609 20228 raft_consensus.cc:2468] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 4.
I20260709 12:25:03.654745 21305 raft_consensus.cc:515] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.655009 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.642493 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1257e7996388445eaa292ac68c3ad0ef" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
W20260709 12:25:03.643325 20886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.658354 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4d18eda43b4a17bd5b552c4e04225c" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.659934 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d6ed1f33fa4b73bf5108eb0fec8f88" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.660635 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073b8908cc1345f3bad72a6d8124df11" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.662609 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ed53455b57840a780d37b1db5103826" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.663390 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac98768a9a3430a8784fa7995363272" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.665043 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.665545 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.665710 20236 raft_consensus.cc:2468] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 2.
I20260709 12:25:03.666219 20083 raft_consensus.cc:2468] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 2.
I20260709 12:25:03.667476 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2234eae9544c8898b57db26f4533d3" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.668262 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988f10f24b02449cade652e210ad3b06" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.625296  9741 raft_consensus.cc:2272] T 524118618cf740e9865e397864b56ed2 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.669185 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2234eae9544c8898b57db26f4533d3" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.639600 21363 raft_consensus.cc:515] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.672567 20159 raft_consensus.cc:1240] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Rejecting Update request from peer c470740d41ee4b9383923d08a87655d6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:03.672899 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d6ed1f33fa4b73bf5108eb0fec8f88" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.672550 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc0138443e498db94e47c81d5ca81b" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.672561  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:03.674547  9741 raft_consensus.cc:2243] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:03.675088 20886 leader_election.cc:304] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:25:03.675884 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.676119 21363 leader_election.cc:290] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.677380 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8691968cf8f4b04b4ef459bd321e903" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.677387 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf0d91bbb1d4e40b769bc07ef380517" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.677788 20080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d063c9d79f904091aade12ce2aba8bd1" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.680490 20080 raft_consensus.cc:2468] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 2.
I20260709 12:25:03.680763 20083 raft_consensus.cc:2468] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 2.
I20260709 12:25:03.679206 20051 leader_election.cc:304] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
W20260709 12:25:03.679945 20886 raft_consensus.cc:2686] T 8635d89e903c48a786062efb05feaa75 P 7204c82dd34944818a439bd468a8c410: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:25:03.681140 21364 raft_consensus.cc:515] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.682157 21327 raft_consensus.cc:2804] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:03.682582 21327 raft_consensus.cc:493] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.682945 21327 raft_consensus.cc:3060] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:03.675034  9741 raft_consensus.cc:2272] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.669224 21272 leader_election.cc:290] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:03.689127 21364 leader_election.cc:290] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.691171 21327 raft_consensus.cc:515] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:03.692487 20049 leader_election.cc:304] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:25:03.692998 20080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c5a6e3d37c46f585ebd85003fbe15a" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.693218 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5038da47868e47148f6dda5d135f60fa" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.693624 20159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04cd0aa441274cf38da93eec0bfadeff" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.705962 20159 raft_consensus.cc:2468] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 2.
I20260709 12:25:03.693863 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc0138443e498db94e47c81d5ca81b" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.707569 21316 raft_consensus.cc:2804] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:03.708021 21316 raft_consensus.cc:493] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.708324 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8635d89e903c48a786062efb05feaa75" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.709635 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144ce9a2901342abbabee63851505b75" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.711958 20085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7527e635cb4c339c05a4b1ea702164" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.712445 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd398fffdf6d468f88108a6a7bec0681" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.712357 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b860aa254e34a20e8bdae1b626df" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.711820 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b588a815a548c8a3f375012fa7e3f6" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.708391 21316 raft_consensus.cc:3060] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:03.704200 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f834f9ccdefc4baebc23e9477701af69" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.704628 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd122132f7485fa43d171d8c857d38" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.695091 20160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b860aa254e34a20e8bdae1b626df" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.726923 21316 raft_consensus.cc:515] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:03.696215 20158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af265a90671a46cbafb3fced0f952aef" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.698410 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515975cb81844e8787a53147bb766080" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.698572 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9370ed3b42941c683b03215e8ae3344" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.695830 20157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8a2aa61ada477c8750740dcc082235" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.700217 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4d18eda43b4a17bd5b552c4e04225c" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.700433 20162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5880437f7fb435aafab505023d9f7ae" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.701265 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0988a236f3934f8692fd434098766112" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.703225 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528817cd200941fb84e40c79dbd16261" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b" is_pre_election: true
I20260709 12:25:03.694757 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524118618cf740e9865e397864b56ed2" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.707031 20049 leader_election.cc:304] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:25:03.722510 20201 leader_election.cc:304] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:25:03.732057 21348 raft_consensus.cc:2804] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:03.732514 21348 raft_consensus.cc:493] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.695725 20156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141c2e84c15e4ad38afc0a52b330f9b9" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:03.732873 21348 raft_consensus.cc:3060] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:03.733821 21365 raft_consensus.cc:2804] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:03.734318 21365 raft_consensus.cc:493] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.734730 21365 raft_consensus.cc:3060] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:03.694021 20051 leader_election.cc:304] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:03.736225 21359 raft_consensus.cc:2749] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:03.737030 20051 leader_election.cc:304] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:03.737577 21361 consensus_queue.cc:1059] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:03.738632 21335 raft_consensus.cc:3055] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:03.738826 21359 raft_consensus.cc:2749] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:03.739056 21335 raft_consensus.cc:740] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:25:03.739754 20051 leader_election.cc:304] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: c470740d41ee4b9383923d08a87655d6
I20260709 12:25:03.733852 21316 leader_election.cc:290] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 5 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.740020 21335 consensus_queue.cc:260] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.741091 21359 raft_consensus.cc:2804] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:03.741178 21335 raft_consensus.cc:3060] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:03.741523 21359 raft_consensus.cc:493] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting leader election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:03.741987 21359 raft_consensus.cc:3060] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:03.728780 21305 leader_election.cc:290] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
W20260709 12:25:03.745492 20889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.731232 21327 leader_election.cc:290] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:03.749389 21365 raft_consensus.cc:515] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:03.751219 21359 raft_consensus.cc:515] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.752379 21365 leader_election.cc:290] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.753736 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd122132f7485fa43d171d8c857d38" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:25:03.754069 20124 leader_election.cc:304] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:25:03.754817 21305 raft_consensus.cc:2804] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:03.755249 21305 raft_consensus.cc:493] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.755654 21305 raft_consensus.cc:3060] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:03.756560 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8871be082b42e1b4cb33626f240b8d" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:25:03.756750 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b96b6be45d43b6aceaf2afe76d79e4" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.757174 20236 raft_consensus.cc:3060] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:03.757524 20230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac98768a9a3430a8784fa7995363272" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:25:03.758358 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8a2aa61ada477c8750740dcc082235" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:03.759027 20234 raft_consensus.cc:2468] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 2.
I20260709 12:25:03.760033 20233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a52c50180741b9a6165c183733f3fa" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:25:03.764323 20229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
W20260709 12:25:03.766067 20200 consensus_peers.cc:597] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.766816 20200 consensus_peers.cc:597] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.767329 20200 consensus_peers.cc:597] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.767843 20200 consensus_peers.cc:597] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.768414 20200 consensus_peers.cc:597] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.768919 20200 leader_election.cc:336] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:03.769474 20200 leader_election.cc:336] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:03.770951 21305 raft_consensus.cc:515] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:03.763500 20124 leader_election.cc:304] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:25:03.772377 21364 raft_consensus.cc:2804] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:03.772740 21364 raft_consensus.cc:493] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:03.773058 21364 raft_consensus.cc:3060] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:03.773904 20233 raft_consensus.cc:2468] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 3.
I20260709 12:25:03.776223 20236 raft_consensus.cc:2468] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 5.
I20260709 12:25:03.777671 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac98768a9a3430a8784fa7995363272" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:25:03.779246 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:25:03.755765 21348 raft_consensus.cc:515] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:03.780705 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4d18eda43b4a17bd5b552c4e04225c" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:25:03.781754 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4d18eda43b4a17bd5b552c4e04225c" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:25:03.781847 21364 raft_consensus.cc:515] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.783193 20233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45bea543fc142ee90510d18e0d7c029" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:25:03.783794 20229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4d18eda43b4a17bd5b552c4e04225c" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:25:03.785609 20049 leader_election.cc:304] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:25:03.783952 20051 leader_election.cc:304] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: c470740d41ee4b9383923d08a87655d6
I20260709 12:25:03.784402 21359 leader_election.cc:290] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.786389 21365 raft_consensus.cc:2804] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:03.786700 21348 leader_election.cc:290] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.786947 21365 raft_consensus.cc:697] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 5 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:25:03.787137 20233 raft_consensus.cc:3060] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:03.788012 21365 consensus_queue.cc:237] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
W20260709 12:25:03.790889 20202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.786191 20201 leader_election.cc:304] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:25:03.790891 21327 raft_consensus.cc:2804] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:03.791827 21335 raft_consensus.cc:2804] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:03.791945 21327 raft_consensus.cc:493] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting leader election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:03.792371 21335 raft_consensus.cc:493] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.792517 21327 raft_consensus.cc:3060] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:03.792806 21335 raft_consensus.cc:3060] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:03.793155 21361 consensus_queue.cc:1059] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:03.793408 20124 leader_election.cc:304] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: aac061e592d74289800e4c50cbb4132b
W20260709 12:25:03.794764 20887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.794453 21314 raft_consensus.cc:3055] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:03.795162 21314 raft_consensus.cc:740] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:25:03.795662 21363 raft_consensus.cc:2804] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:03.796092 21363 raft_consensus.cc:493] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:03.796454 21363 raft_consensus.cc:3060] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:03.797490 20201 leader_election.cc:304] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:03.796105 21314 consensus_queue.cc:260] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.801921 21314 raft_consensus.cc:3060] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:03.804033 21363 raft_consensus.cc:515] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.794535 21364 leader_election.cc:290] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.807193 20124 leader_election.cc:304] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:25:03.792898 21305 leader_election.cc:290] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.809871 21363 leader_election.cc:290] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.812141 21334 raft_consensus.cc:2749] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:03.813020 21347 raft_consensus.cc:2804] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:03.813452 21347 raft_consensus.cc:493] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:03.813819 21347 raft_consensus.cc:3060] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:03.818131 20051 leader_election.cc:304] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:03.822062 20201 leader_election.cc:304] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:03.821887 21347 raft_consensus.cc:515] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.822767 21316 raft_consensus.cc:2749] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:03.822991 21362 raft_consensus.cc:2749] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:03.825289 20201 leader_election.cc:304] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:25:03.820546 21327 raft_consensus.cc:515] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.825683 21347 leader_election.cc:290] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.825476 20051 leader_election.cc:304] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:25:03.826603 20201 leader_election.cc:304] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:03.826824 20124 leader_election.cc:304] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:25:03.827201 21316 raft_consensus.cc:2804] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:03.827700 21316 raft_consensus.cc:493] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.827927 20201 leader_election.cc:304] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:03.828205 21316 raft_consensus.cc:3060] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:03.829108 20201 leader_election.cc:304] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:03.829840 21334 raft_consensus.cc:2749] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:03.829928 21364 raft_consensus.cc:2804] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:03.830437 21364 raft_consensus.cc:493] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting leader election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:03.830526 21334 raft_consensus.cc:2749] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:03.830839 21364 raft_consensus.cc:3060] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:03.831246 21348 raft_consensus.cc:2749] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:03.839138 20201 leader_election.cc:304] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:25:03.840052 21348 raft_consensus.cc:2804] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:03.840739 21348 raft_consensus.cc:493] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.841205 21348 raft_consensus.cc:3060] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:03.840159 20201 leader_election.cc:304] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:25:03.829187 20124 leader_election.cc:304] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:25:03.847086 21334 raft_consensus.cc:2804] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:03.847587 21334 raft_consensus.cc:493] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.848110 21334 raft_consensus.cc:3060] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:03.848214 21363 raft_consensus.cc:2804] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:03.848702 21363 raft_consensus.cc:493] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.849093 21363 raft_consensus.cc:3060] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:03.847291 20201 leader_election.cc:304] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:03.851882 21361 raft_consensus.cc:2749] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:03.852741 20124 leader_election.cc:304] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:25:03.853179 20201 leader_election.cc:304] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:03.853960 21361 raft_consensus.cc:2749] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:03.857149 21334 raft_consensus.cc:515] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:03.857558 20201 leader_election.cc:304] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:03.859624 21347 raft_consensus.cc:2804] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:03.859899 21361 raft_consensus.cc:2749] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:03.860205 21347 raft_consensus.cc:697] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:25:03.861325 20201 leader_election.cc:304] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:03.861399 21347 consensus_queue.cc:237] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.825294 21335 raft_consensus.cc:515] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:03.865976 21335 leader_election.cc:290] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.866142 21316 raft_consensus.cc:515] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
W20260709 12:25:03.867129 20200 leader_election.cc:336] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:03.867301 20051 leader_election.cc:304] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: c470740d41ee4b9383923d08a87655d6
I20260709 12:25:03.868223 21359 raft_consensus.cc:2804] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:25:03.868784 20200 leader_election.cc:336] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:03.869249 20200 leader_election.cc:304] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:03.869294 21359 raft_consensus.cc:493] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting leader election (detected failure of leader c470740d41ee4b9383923d08a87655d6)
I20260709 12:25:03.869966 21359 raft_consensus.cc:3060] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:03.876156 21361 raft_consensus.cc:2749] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:03.877117 21363 raft_consensus.cc:515] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:03.878398 20229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04cd0aa441274cf38da93eec0bfadeff" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
W20260709 12:25:03.878568 20200 leader_election.cc:336] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:03.878943 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988f10f24b02449cade652e210ad3b06" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:25:03.879045 20229 raft_consensus.cc:3060] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:03.879788 20201 leader_election.cc:304] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:25:03.880601 20156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98035197c34fce88758eedbfd23225" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:25:03.879042 20200 leader_election.cc:304] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:03.879498 20230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c5a6e3d37c46f585ebd85003fbe15a" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:25:03.846509 21364 raft_consensus.cc:515] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.884290 21361 raft_consensus.cc:2749] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:03.885393 21324 raft_consensus.cc:2749] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:25:03.885793 20200 leader_election.cc:336] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:03.884341 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5038da47868e47148f6dda5d135f60fa" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:25:03.890338 20051 leader_election.cc:304] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6
W20260709 12:25:03.891166 20200 leader_election.cc:336] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:03.892413 20200 leader_election.cc:336] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:03.893239 20200 leader_election.cc:336] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:03.894234 20233 raft_consensus.cc:2468] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 3.
I20260709 12:25:03.894549 20201 leader_election.cc:304] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
W20260709 12:25:03.896215 20889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.896322 21362 raft_consensus.cc:2764] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:25:03.897289 20051 leader_election.cc:304] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:03.901641 20051 leader_election.cc:304] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
W20260709 12:25:03.897420 20200 leader_election.cc:336] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:03.903339 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd122132f7485fa43d171d8c857d38" candidate_uuid: "7204c82dd34944818a439bd468a8c410" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:25:03.902917 20200 leader_election.cc:304] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:03.906798 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4d18eda43b4a17bd5b552c4e04225c" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:25:03.907994 21308 raft_consensus.cc:2804] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:03.908413 20157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0988a236f3934f8692fd434098766112" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:25:03.908414 21308 raft_consensus.cc:493] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:03.908887 19908 catalog_manager.cc:5697] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 2 to 3, leader changed from c470740d41ee4b9383923d08a87655d6 (127.9.131.68) to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 3 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:03.910341 20162 raft_consensus.cc:1240] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Rejecting Update request from peer c470740d41ee4b9383923d08a87655d6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:03.905372 20126 leader_election.cc:304] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:03.909513 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf44484d11914a83a44c9a333eed7777" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:25:03.912873 20126 leader_election.cc:304] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:03.922410 20126 leader_election.cc:304] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:03.907827 21362 raft_consensus.cc:2749] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:03.912971 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac98768a9a3430a8784fa7995363272" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:25:03.896981 21327 leader_election.cc:290] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.900704 21303 raft_consensus.cc:2749] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:03.930651 20200 leader_election.cc:336] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:03.905337 21342 raft_consensus.cc:2749] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:03.939606 20200 leader_election.cc:304] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:25:03.942035 20888 leader_election.cc:304] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:03.943228 20162 raft_consensus.cc:1240] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Rejecting Update request from peer aac061e592d74289800e4c50cbb4132b for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:03.921293 21347 raft_consensus.cc:2749] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:25:03.929798 21311 raft_consensus.cc:2749] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:25:03.947288 20888 raft_consensus.cc:2686] T c9370ed3b42941c683b03215e8ae3344 P 7204c82dd34944818a439bd468a8c410: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:25:03.938482 21334 leader_election.cc:290] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:03.937799 21364 leader_election.cc:290] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:03.948351 21316 leader_election.cc:290] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 7 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:03.949434 21362 raft_consensus.cc:2749] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:03.953677 20081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5038da47868e47148f6dda5d135f60fa" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
W20260709 12:25:03.952595 20200 leader_election.cc:336] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:03.958091 20200 leader_election.cc:304] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:03.946337 21359 raft_consensus.cc:515] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:03.956614 20080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988f10f24b02449cade652e210ad3b06" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:25:03.935505 21357 raft_consensus.cc:2749] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:03.959756 20051 leader_election.cc:304] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:03.961634 20084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c5a6e3d37c46f585ebd85003fbe15a" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:25:03.961766 20161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c084bfebf47c4ede978b6da72f620608" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
W20260709 12:25:03.963083 20200 leader_election.cc:336] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:03.965782 20200 leader_election.cc:304] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:03.932128 21344 consensus_queue.cc:1059] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
W20260709 12:25:03.968971 20200 leader_election.cc:336] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:03.969863 20200 leader_election.cc:336] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:03.970276 20050 consensus_peers.cc:597] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:03.970307 20200 leader_election.cc:304] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:25:03.955231 21350 raft_consensus.cc:2749] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:25:03.909833 21308 raft_consensus.cc:3060] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:03.959246 20157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac98768a9a3430a8784fa7995363272" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:25:03.990585 20157 raft_consensus.cc:2393] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aac061e592d74289800e4c50cbb4132b in current term 3: Already voted for candidate 45ea8ca532304a8f9ffda636d59f6f0f in this term.
I20260709 12:25:03.972136 20229 raft_consensus.cc:2468] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 3.
I20260709 12:25:03.991580 21361 raft_consensus.cc:2764] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:25:03.971837 21363 leader_election.cc:290] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:03.993167 20234 raft_consensus.cc:2468] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 3.
I20260709 12:25:03.965111 21334 raft_consensus.cc:2749] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:04.000013 21324 raft_consensus.cc:2749] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:03.995693 21348 raft_consensus.cc:515] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:04.002570 21348 leader_election.cc:290] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:03.983143 21359 leader_election.cc:290] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
W20260709 12:25:04.005038 20200 leader_election.cc:336] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:03.987591 20888 leader_election.cc:304] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7204c82dd34944818a439bd468a8c410; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
W20260709 12:25:04.007148 20051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.67:40749, user_credentials={real_user=slave}} blocked reactor thread for 47454.8us
W20260709 12:25:04.007494 20888 raft_consensus.cc:2686] T 24bd122132f7485fa43d171d8c857d38 P 7204c82dd34944818a439bd468a8c410: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:25:04.007141 20200 leader_election.cc:304] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
W20260709 12:25:04.006074 20050 consensus_peers.cc:597] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.013006 20200 leader_election.cc:336] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.013504 20200 leader_election.cc:304] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
W20260709 12:25:04.020053 20200 leader_election.cc:336] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:04.013665 20050 consensus_peers.cc:597] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.023461 20050 consensus_peers.cc:597] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.026515 20126 leader_election.cc:304] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:04.028846 21346 consensus_queue.cc:1059] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:04.030061 21346 raft_consensus.cc:3055] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:04.029136 21350 raft_consensus.cc:2749] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:25:04.030440 21346 raft_consensus.cc:740] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:25:04.031042 20126 leader_election.cc:304] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:04.032290 20157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:25:04.032568 21363 raft_consensus.cc:2749] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:25:04.012356 21360 raft_consensus.cc:2749] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.012699 21344 raft_consensus.cc:2749] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.034049 20126 leader_election.cc:304] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:04.015957 21335 raft_consensus.cc:2749] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.018082 21348 raft_consensus.cc:2749] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.020622 20200 leader_election.cc:304] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
W20260709 12:25:04.051623 20888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.66:38769, user_credentials={real_user=slave}} blocked reactor thread for 64136.9us
W20260709 12:25:04.055418 20200 leader_election.cc:336] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.050019 21363 raft_consensus.cc:2749] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:25:04.056200 20200 leader_election.cc:304] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:25:04.058132 20049 leader_election.cc:304] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
W20260709 12:25:04.058801 20200 leader_election.cc:336] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.059420 20200 leader_election.cc:304] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:25:04.031344 21346 consensus_queue.cc:260] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:04.064965 20124 leader_election.cc:304] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:25:04.068389 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:25:04.059368 20080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528817cd200941fb84e40c79dbd16261" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:25:04.069746 20153 raft_consensus.cc:1240] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Rejecting Update request from peer aac061e592d74289800e4c50cbb4132b for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:04.072679 21324 raft_consensus.cc:2749] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.061235 21340 raft_consensus.cc:2804] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:04.075947 21340 raft_consensus.cc:697] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 3 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:25:04.085038 21340 consensus_queue.cc:237] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:04.069974 20157 raft_consensus.cc:1240] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Rejecting Update request from peer c470740d41ee4b9383923d08a87655d6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:04.061050 21362 raft_consensus.cc:2749] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.054925 21349 raft_consensus.cc:2749] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.078562 21308 raft_consensus.cc:515] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:04.089872 21306 raft_consensus.cc:3055] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:04.076694 21302 raft_consensus.cc:2804] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:04.113579 21302 raft_consensus.cc:697] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:25:04.114566 21302 consensus_queue.cc:237] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:04.082255 21346 raft_consensus.cc:3060] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:04.090160 21308 leader_election.cc:290] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:04.066958 20049 leader_election.cc:304] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
W20260709 12:25:04.120446 20049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:39155, user_credentials={real_user=slave}} blocked reactor thread for 53571.9us
I20260709 12:25:04.091720 20157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71a18e780d74303884e208106817dec" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
W20260709 12:25:04.100421 20125 leader_election.cc:336] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:04.121883 20125 consensus_peers.cc:597] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.122534 20125 consensus_peers.cc:597] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.123062 20125 consensus_peers.cc:597] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.107509 19905 catalog_manager.cc:5697] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 4 to 5, leader changed from 7204c82dd34944818a439bd468a8c410 (127.9.131.65) to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 5 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:04.120605 21308 raft_consensus.cc:2804] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:04.109797 20155 raft_consensus.cc:1240] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Rejecting Update request from peer aac061e592d74289800e4c50cbb4132b for earlier term 1. Current term is 2. Ops: []
W20260709 12:25:04.123769 20125 leader_election.cc:336] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.126792 20125 leader_election.cc:304] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
W20260709 12:25:04.127835 20125 consensus_peers.cc:597] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.128067 21308 raft_consensus.cc:697] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 3 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:25:04.129587 21305 raft_consensus.cc:2749] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:04.129280 21304 consensus_queue.cc:1059] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:25:04.128379 20125 consensus_peers.cc:597] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.130782 21308 consensus_queue.cc:237] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
W20260709 12:25:04.131775 20125 leader_election.cc:336] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.132185 20125 leader_election.cc:304] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:04.132835 21305 raft_consensus.cc:2749] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:04.128749 21365 consensus_queue.cc:1059] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
W20260709 12:25:04.135522 20125 leader_election.cc:336] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.136065 20125 leader_election.cc:304] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:04.131255 21304 raft_consensus.cc:3055] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:25:04.144714 20125 leader_election.cc:336] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.145262 20125 leader_election.cc:304] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
W20260709 12:25:04.147185 20125 leader_election.cc:336] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.147729 20125 leader_election.cc:304] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
W20260709 12:25:04.136490 20050 consensus_peers.cc:597] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.148834 20050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 124502us
W20260709 12:25:04.149422 20125 leader_election.cc:336] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.149837 20125 leader_election.cc:304] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
W20260709 12:25:04.146049 20200 leader_election.cc:336] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.150650 20200 leader_election.cc:304] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
W20260709 12:25:04.152959 20050 consensus_peers.cc:597] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.153103 20125 leader_election.cc:336] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.153573 20125 leader_election.cc:304] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
W20260709 12:25:04.153653 20050 leader_election.cc:336] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.154134 20050 leader_election.cc:304] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
W20260709 12:25:04.154783 20125 leader_election.cc:336] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.155244 20125 leader_election.cc:304] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
W20260709 12:25:04.156503 20050 leader_election.cc:336] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.157015 20050 leader_election.cc:304] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:25:04.135232 21306 raft_consensus.cc:740] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
W20260709 12:25:04.156404 20200 leader_election.cc:336] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:04.158851 20201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:40749, user_credentials={real_user=slave}} blocked reactor thread for 90027.9us
W20260709 12:25:04.159425 20125 leader_election.cc:336] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.148996 21345 raft_consensus.cc:2749] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:04.146026 21304 raft_consensus.cc:740] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:25:04.159881 20125 leader_election.cc:304] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
W20260709 12:25:04.161096 20050 leader_election.cc:336] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.148795 21305 raft_consensus.cc:2749] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:04.161731 20233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8a2aa61ada477c8750740dcc082235" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
W20260709 12:25:04.158463 20200 leader_election.cc:336] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.150540 21364 raft_consensus.cc:2749] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.164098 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528817cd200941fb84e40c79dbd16261" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:25:04.163086 20233 raft_consensus.cc:3060] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:04.181011 20233 raft_consensus.cc:2468] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 3.
I20260709 12:25:04.163874 20050 leader_election.cc:304] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:04.160421 21365 raft_consensus.cc:2749] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:04.158062 21350 raft_consensus.cc:2749] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.155254 21330 raft_consensus.cc:2749] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:04.163157 20200 leader_election.cc:304] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
W20260709 12:25:04.183619 20125 leader_election.cc:336] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:04.192405 20050 leader_election.cc:336] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.160251 21361 raft_consensus.cc:2749] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.161727 21302 raft_consensus.cc:2749] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.182418 21340 raft_consensus.cc:3055] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:04.200877 20124 leader_election.cc:304] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:04.199844 20049 leader_election.cc:304] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:04.163983 21308 raft_consensus.cc:2749] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:04.163074 21323 consensus_queue.cc:1059] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:25:04.195070 20125 leader_election.cc:304] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:04.223626 21350 raft_consensus.cc:2749] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.223604 21323 raft_consensus.cc:3055] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:04.224392 21323 raft_consensus.cc:740] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
W20260709 12:25:04.224802 20125 consensus_peers.cc:597] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.225478 20125 leader_election.cc:336] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.225939 20125 leader_election.cc:304] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
W20260709 12:25:04.226999 20125 leader_election.cc:336] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.227391 20125 leader_election.cc:304] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:04.182929 21305 raft_consensus.cc:2749] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.206035 20124 leader_election.cc:304] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:25:04.196887 20050 leader_election.cc:304] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:25:04.208072 21342 raft_consensus.cc:2749] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.203811 21340 raft_consensus.cc:740] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
W20260709 12:25:04.232712 20050 leader_election.cc:336] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.232637 21365 raft_consensus.cc:2749] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.233330 20050 leader_election.cc:304] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:04.233608 21340 consensus_queue.cc:260] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:04.225371 21323 consensus_queue.cc:260] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
W20260709 12:25:04.234690 20050 leader_election.cc:336] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.235093 21323 raft_consensus.cc:3060] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:04.232990 21330 raft_consensus.cc:2804] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:04.212359 21304 consensus_queue.cc:260] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:04.166039 21306 consensus_queue.cc:260] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:04.235946 21330 raft_consensus.cc:697] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:25:04.235119 20050 leader_election.cc:304] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:04.236581 21306 raft_consensus.cc:3060] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:04.237120 21342 raft_consensus.cc:2749] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:04.236907 21330 consensus_queue.cc:237] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:04.193017 21360 raft_consensus.cc:2749] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:25:04.244289 20125 leader_election.cc:336] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.193961 21357 raft_consensus.cc:2749] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.218924 21364 raft_consensus.cc:2749] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:25:04.244911 20125 leader_election.cc:304] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:04.245720 21364 raft_consensus.cc:2749] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:25:04.246150 20125 consensus_peers.cc:597] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.238382 20050 leader_election.cc:336] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.238996 21304 raft_consensus.cc:3060] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:04.235122 21340 raft_consensus.cc:3060] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:04.243809 21350 raft_consensus.cc:2749] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:04.235258 21365 raft_consensus.cc:2749] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:04.248031 20050 leader_election.cc:336] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.257679 20050 leader_election.cc:304] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:25:04.247159 21302 raft_consensus.cc:2749] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:04.246933 20125 leader_election.cc:336] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.258912 20125 leader_election.cc:304] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:04.259589 21340 raft_consensus.cc:2749] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:25:04.258831 20050 consensus_peers.cc:597] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.262580 21350 raft_consensus.cc:2749] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:04.262883 20200 leader_election.cc:336] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:04.261234 20050 consensus_peers.cc:597] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.272317 20050 leader_election.cc:336] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:04.273288 20050 leader_election.cc:336] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.273711 20050 leader_election.cc:304] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
W20260709 12:25:04.274828 20050 leader_election.cc:336] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.275274 20050 leader_election.cc:304] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
W20260709 12:25:04.262153 20125 leader_election.cc:336] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.276077 20125 leader_election.cc:304] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:04.276844 21302 raft_consensus.cc:2749] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:25:04.277261 20125 leader_election.cc:336] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.277781 20125 leader_election.cc:304] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:04.278505 21302 raft_consensus.cc:2749] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:25:04.278918 20125 leader_election.cc:336] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.279397 20125 leader_election.cc:304] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:04.280153 21302 raft_consensus.cc:2749] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:04.280530 20125 leader_election.cc:336] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.277168 21340 raft_consensus.cc:2749] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:25:04.281992 20125 leader_election.cc:336] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.294646 21304 raft_consensus.cc:2749] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:25:04.295593 20050 leader_election.cc:336] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:04.296680 20050 leader_election.cc:336] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:04.303308 20050 leader_election.cc:336] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:04.304217 20050 leader_election.cc:336] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.304541 20050 leader_election.cc:304] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
W20260709 12:25:04.305845 20125 leader_election.cc:336] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.313285 19908 catalog_manager.cc:5697] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 2 to 3, leader changed from 7204c82dd34944818a439bd468a8c410 (127.9.131.65) to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 3 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:04.316848 19908 catalog_manager.cc:5697] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 2 to 3, leader changed from 7204c82dd34944818a439bd468a8c410 (127.9.131.65) to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 3 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:04.322484 19905 catalog_manager.cc:5697] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 2 to 3, leader changed from c470740d41ee4b9383923d08a87655d6 (127.9.131.68) to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 3 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:04.325762 19905 catalog_manager.cc:5697] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b reported cstate change: term changed from 2 to 3, leader changed from 7204c82dd34944818a439bd468a8c410 (127.9.131.65) to aac061e592d74289800e4c50cbb4132b (127.9.131.66). New cstate: current_term: 3 leader_uuid: "aac061e592d74289800e4c50cbb4132b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:04.334450 21340 raft_consensus.cc:2749] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.350821 20233 raft_consensus.cc:1275] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Refusing update from remote peer 45ea8ca532304a8f9ffda636d59f6f0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:25:04.346100 20050 connection.cc:769] client connection to 127.9.131.65:43339 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:25:04.352825 20050 leader_election.cc:336] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:25:04.353847 20050 leader_election.cc:304] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:25:04.355582 21340 raft_consensus.cc:2749] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.356154 21330 consensus_queue.cc:1048] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:25:04.347316 20200 connection.cc:769] client connection to 127.9.131.65:43339 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:25:04.377673 20083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8691968cf8f4b04b4ef459bd321e903" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:25:04.378201 20082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d063c9d79f904091aade12ce2aba8bd1" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aac061e592d74289800e4c50cbb4132b"
I20260709 12:25:04.378779 20082 raft_consensus.cc:3060] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:04.378286 20083 raft_consensus.cc:3060] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:04.390947 20083 raft_consensus.cc:2468] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 3.
I20260709 12:25:04.392231 20082 raft_consensus.cc:2468] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 3.
I20260709 12:25:04.393136 20083 raft_consensus.cc:1240] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Rejecting Update request from peer c470740d41ee4b9383923d08a87655d6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:04.395246 20084 raft_consensus.cc:1240] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Rejecting Update request from peer c470740d41ee4b9383923d08a87655d6 for earlier term 2. Current term is 3. Ops: []
W20260709 12:25:04.396740 20050 leader_election.cc:336] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:25:04.397255 20050 leader_election.cc:304] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:25:04.398032 20233 raft_consensus.cc:1275] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 5 FOLLOWER]: Refusing update from remote peer aac061e592d74289800e4c50cbb4132b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:04.398075 21340 raft_consensus.cc:2749] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:04.391297  9741 tablet_server.cc:196] TabletServer@127.9.131.65:43339 shutdown complete.
I20260709 12:25:04.406946 21340 consensus_queue.cc:1048] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:25:04.412184 20050 leader_election.cc:336] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
W20260709 12:25:04.413039 20050 leader_election.cc:336] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
W20260709 12:25:04.413771 20050 leader_election.cc:336] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:25:04.414148 20050 leader_election.cc:304] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:25:04.414866 21340 raft_consensus.cc:2749] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.416785 20201 leader_election.cc:304] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:25:04.417596 21323 raft_consensus.cc:2804] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:04.418125 21323 raft_consensus.cc:697] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 3 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:25:04.418372 20201 leader_election.cc:304] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:25:04.419169 21306 raft_consensus.cc:2804] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:04.418953 21323 consensus_queue.cc:237] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:04.419659 21306 raft_consensus.cc:697] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 3 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:25:04.420569 21306 consensus_queue.cc:237] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
W20260709 12:25:04.432833 20050 leader_election.cc:336] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:25:04.433411 20050 leader_election.cc:304] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, 7204c82dd34944818a439bd468a8c410
I20260709 12:25:04.436766 21340 raft_consensus.cc:2749] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:25:04.439826 20050 consensus_peers.cc:597] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.462515 20082 raft_consensus.cc:3060] T 20a52c50180741b9a6165c183733f3fa P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:04.471421 19905 catalog_manager.cc:5697] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 2 to 3, leader changed from 7204c82dd34944818a439bd468a8c410 (127.9.131.65) to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 3 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:04.477178 19905 catalog_manager.cc:5697] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 2 to 3, leader changed from 7204c82dd34944818a439bd468a8c410 (127.9.131.65) to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 3 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:04.480870 20082 raft_consensus.cc:1275] T 20a52c50180741b9a6165c183733f3fa P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Refusing update from remote peer 45ea8ca532304a8f9ffda636d59f6f0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:04.483512 21305 consensus_queue.cc:1048] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:25:04.551425 20050 consensus_peers.cc:597] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.557683 20233 raft_consensus.cc:1275] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Refusing update from remote peer aac061e592d74289800e4c50cbb4132b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:04.561267 21316 consensus_queue.cc:1048] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:04.602130 20153 raft_consensus.cc:1275] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Refusing update from remote peer aac061e592d74289800e4c50cbb4132b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:04.603897 21360 consensus_queue.cc:1048] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:04.616757 20234 raft_consensus.cc:1275] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Refusing update from remote peer aac061e592d74289800e4c50cbb4132b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:04.620424 21340 consensus_queue.cc:1048] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:04.680629 20234 raft_consensus.cc:1275] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Refusing update from remote peer 45ea8ca532304a8f9ffda636d59f6f0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:25:04.680680 20125 consensus_peers.cc:597] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.682365 21305 consensus_queue.cc:1048] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:04.725780 20157 raft_consensus.cc:1240] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Rejecting Update request from peer aac061e592d74289800e4c50cbb4132b for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:04.731175 21365 consensus_queue.cc:1059] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:04.733276 21346 raft_consensus.cc:3055] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:04.733773 21346 raft_consensus.cc:740] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:25:04.734818 21346 consensus_queue.cc:260] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:04.751030 21346 raft_consensus.cc:3060] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:04.778729 20125 consensus_peers.cc:597] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.808367  9741 tablet_server.cc:179] TabletServer@127.9.131.66:0 shutting down...
W20260709 12:25:04.823417 20126 consensus_peers.cc:597] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.824541 20200 consensus_peers.cc:597] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.833788 20234 raft_consensus.cc:1275] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Refusing update from remote peer 45ea8ca532304a8f9ffda636d59f6f0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:04.836319 21350 consensus_queue.cc:1048] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:04.894230 21346 raft_consensus.cc:493] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:04.895301 21346 raft_consensus.cc:515] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:04.897459 21346 leader_election.cc:290] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:04.898388 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd398fffdf6d468f88108a6a7bec0681" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:04.898981 21340 raft_consensus.cc:493] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:04.899173 20236 raft_consensus.cc:2468] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 2.
I20260709 12:25:04.900082 21365 raft_consensus.cc:493] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:04.900096 21340 raft_consensus.cc:515] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:04.901208 21365 raft_consensus.cc:515] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:04.903265 21340 leader_election.cc:290] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:04.904182 20157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac5e9dcbf74c29aa24300975246ad3" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:04.904628 20049 leader_election.cc:304] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:25:04.905038 20157 raft_consensus.cc:2468] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 2.
I20260709 12:25:04.905668 21340 raft_consensus.cc:2804] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:04.906030 21340 raft_consensus.cc:493] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:04.906327 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7527e635cb4c339c05a4b1ea702164" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:04.906571  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:04.906914 21365 leader_election.cc:290] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:04.906527 20051 leader_election.cc:304] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 
I20260709 12:25:04.906383 21340 raft_consensus.cc:3060] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:04.908185 21365 raft_consensus.cc:2804] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:04.908542 21365 raft_consensus.cc:493] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:04.908895 21365 raft_consensus.cc:3060] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:25:04.909699 20050 leader_election.cc:336] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:25:04.910712  9741 tablet_replica.cc:333] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:04.914248  9741 raft_consensus.cc:2243] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.915377  9741 raft_consensus.cc:2272] T 8ed53455b57840a780d37b1db5103826 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.917519 21340 raft_consensus.cc:515] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
W20260709 12:25:04.918569 20126 consensus_peers.cc:597] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.920572 20050 leader_election.cc:336] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
W20260709 12:25:04.922740 20050 leader_election.cc:336] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:25:04.921806 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd398fffdf6d468f88108a6a7bec0681" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:25:04.923166 20050 leader_election.cc:304] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:04.923609 20236 raft_consensus.cc:3060] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:04.924278 21308 raft_consensus.cc:2749] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.919278  9741 tablet_replica.cc:333] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:04.926306  9741 raft_consensus.cc:2243] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.929682  9741 raft_consensus.cc:2272] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.932931 20236 raft_consensus.cc:2468] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 3.
I20260709 12:25:04.936018 21340 leader_election.cc:290] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Requested vote from peers c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
W20260709 12:25:04.936584 20200 consensus_peers.cc:597] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.940904 20126 consensus_peers.cc:597] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.926431 20050 leader_election.cc:336] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:25:04.944355  9741 tablet_replica.cc:333] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:04.944319 20049 leader_election.cc:304] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:25:04.945446 21340 raft_consensus.cc:2804] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:04.945977 21340 raft_consensus.cc:697] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [term 3 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:25:04.946344  9741 raft_consensus.cc:2243] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.947037  9741 raft_consensus.cc:2272] T 1257e7996388445eaa292ac68c3ad0ef P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.946838 21340 consensus_queue.cc:237] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:04.950433  9741 tablet_replica.cc:333] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:04.949822 21365 raft_consensus.cc:515] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:04.951467  9741 raft_consensus.cc:2243] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.952204  9741 raft_consensus.cc:2272] T ffa0a444b80347b0b9adc37ad505b0c5 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:04.954982 20126 consensus_peers.cc:597] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.956022  9741 tablet_replica.cc:333] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:04.957074  9741 raft_consensus.cc:2243] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.957727  9741 raft_consensus.cc:2272] T d063c9d79f904091aade12ce2aba8bd1 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:04.964986 20126 consensus_peers.cc:597] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:05.014569 20050 leader_election.cc:336] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
W20260709 12:25:05.015390 20125 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 45129.6us
W20260709 12:25:05.017450 20050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 46338.3us
W20260709 12:25:05.018074 20200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:43339, user_credentials={real_user=slave}} blocked reactor thread for 47703.1us
I20260709 12:25:05.022110 21365 leader_election.cc:290] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Requested vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:05.024132 20157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ac5e9dcbf74c29aa24300975246ad3" candidate_uuid: "aac061e592d74289800e4c50cbb4132b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:25:05.024802 20157 raft_consensus.cc:3060] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:05.027967  9741 tablet_replica.cc:333] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.034409  9741 raft_consensus.cc:2243] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.039794 20157 raft_consensus.cc:2468] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac061e592d74289800e4c50cbb4132b in term 3.
W20260709 12:25:05.047088 20126 consensus_peers.cc:597] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.050611 20051 leader_election.cc:304] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:25:05.051353  9741 raft_consensus.cc:2272] T d45bea543fc142ee90510d18e0d7c029 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.051719 21365 raft_consensus.cc:2804] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:05.052345 21365 raft_consensus.cc:697] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [term 3 LEADER]: Becoming Leader. State: Replica: aac061e592d74289800e4c50cbb4132b, State: Running, Role: LEADER
I20260709 12:25:05.053308 21365 consensus_queue.cc:237] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:05.054908  9741 tablet_replica.cc:333] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.055931  9741 raft_consensus.cc:2243] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.056775  9741 pending_rounds.cc:70] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b: Trying to abort 1 pending ops.
I20260709 12:25:05.057030  9741 pending_rounds.cc:77] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305625210672738304 op_type: NO_OP noop_request { }
I20260709 12:25:05.057418  9741 raft_consensus.cc:2889] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:05.057758  9741 raft_consensus.cc:2272] T dd398fffdf6d468f88108a6a7bec0681 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:05.060082 20126 consensus_peers.cc:597] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:05.061600 20201 consensus_peers.cc:597] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:05.065750 20201 consensus_peers.cc:597] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.067725  9741 tablet_replica.cc:333] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.068763  9741 raft_consensus.cc:2243] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.069324  9741 raft_consensus.cc:2272] T 1127f55bd43a4c988dfd61547a03b3fa P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:05.072314 20201 consensus_peers.cc:597] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:05.073067 20126 consensus_peers.cc:597] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.072376  9741 tablet_replica.cc:333] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.080919  9741 raft_consensus.cc:2243] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.082060  9741 raft_consensus.cc:2272] T 8635d89e903c48a786062efb05feaa75 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.085108  9741 tablet_replica.cc:333] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.086009  9741 raft_consensus.cc:2243] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.087137  9741 raft_consensus.cc:2272] T cb8871be082b42e1b4cb33626f240b8d P aac061e592d74289800e4c50cbb4132b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.091333  9741 tablet_replica.cc:333] T 20a52c50180741b9a6165c183733f3fa P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.092237  9741 raft_consensus.cc:2243] T 20a52c50180741b9a6165c183733f3fa P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.092778  9741 raft_consensus.cc:2272] T 20a52c50180741b9a6165c183733f3fa P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.096287  9741 tablet_replica.cc:333] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.097182  9741 raft_consensus.cc:2243] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.097739  9741 raft_consensus.cc:2272] T 36c5a6e3d37c46f585ebd85003fbe15a P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.100713  9741 tablet_replica.cc:333] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.101555  9741 raft_consensus.cc:2243] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.102157  9741 raft_consensus.cc:2272] T fb2234eae9544c8898b57db26f4533d3 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.105427  9741 tablet_replica.cc:333] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.106282  9741 raft_consensus.cc:2243] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.106897  9741 raft_consensus.cc:2272] T 0252a8e0d9ac4440b3affdcbf4cf2246 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.109925  9741 tablet_replica.cc:333] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.110685  9741 raft_consensus.cc:2243] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.111270  9741 raft_consensus.cc:2272] T c084bfebf47c4ede978b6da72f620608 P aac061e592d74289800e4c50cbb4132b [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.131497  9741 tablet_replica.cc:333] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.132433  9741 raft_consensus.cc:2243] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.133046  9741 raft_consensus.cc:2272] T 995e00d57e1040b7b6d193c60fd84405 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.136672  9741 tablet_replica.cc:333] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
W20260709 12:25:05.137336 20126 consensus_peers.cc:597] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.137455  9741 raft_consensus.cc:2243] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.139318  9741 raft_consensus.cc:2272] T 976741a38d1c42329394a00cbe085319 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:05.152724 20126 consensus_peers.cc:597] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:05.153491 20201 consensus_peers.cc:597] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:05.162734 20126 consensus_peers.cc:597] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.168433  9741 tablet_replica.cc:333] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.170642  9741 raft_consensus.cc:2243] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.171537  9741 pending_rounds.cc:70] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b: Trying to abort 1 pending ops.
I20260709 12:25:05.171833  9741 pending_rounds.cc:77] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305625211149905920 op_type: NO_OP noop_request { }
I20260709 12:25:05.172219  9741 raft_consensus.cc:2889] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:05.172561  9741 raft_consensus.cc:2272] T b0ac5e9dcbf74c29aa24300975246ad3 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.186787  9741 tablet_replica.cc:333] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.187671  9741 raft_consensus.cc:2243] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.188308  9741 raft_consensus.cc:2272] T 24bd122132f7485fa43d171d8c857d38 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:05.192890 20201 consensus_peers.cc:597] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.193043  9741 tablet_replica.cc:333] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.194324  9741 raft_consensus.cc:2243] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.194939  9741 raft_consensus.cc:2272] T dd4d18eda43b4a17bd5b552c4e04225c P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.197850  9741 tablet_replica.cc:333] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.198654  9741 raft_consensus.cc:2243] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.199263  9741 raft_consensus.cc:2272] T e71a18e780d74303884e208106817dec P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.202179  9741 tablet_replica.cc:333] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.203014  9741 raft_consensus.cc:2243] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.203645  9741 raft_consensus.cc:2272] T ba98035197c34fce88758eedbfd23225 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.206517  9741 tablet_replica.cc:333] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.207330  9741 raft_consensus.cc:2243] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.207834  9741 raft_consensus.cc:2272] T 528817cd200941fb84e40c79dbd16261 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.210552  9741 tablet_replica.cc:333] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.211326  9741 raft_consensus.cc:2243] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.212378  9741 raft_consensus.cc:2272] T bac98768a9a3430a8784fa7995363272 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.218705  9741 tablet_replica.cc:333] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.219664  9741 raft_consensus.cc:2243] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.221165  9741 raft_consensus.cc:2272] T 3651ee11a6184a34bed06bc86be62c29 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.226828  9741 tablet_replica.cc:333] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.227686  9741 raft_consensus.cc:2243] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.228284  9741 raft_consensus.cc:2272] T fb7527e635cb4c339c05a4b1ea702164 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.231232  9741 tablet_replica.cc:333] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.232036  9741 raft_consensus.cc:2243] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.232573  9741 raft_consensus.cc:2272] T 5038da47868e47148f6dda5d135f60fa P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.237736  9741 tablet_replica.cc:333] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.238618  9741 raft_consensus.cc:2243] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.239928  9741 raft_consensus.cc:2272] T 57d0409829eb45ff8e1eb6b75796eff9 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.242956  9741 tablet_replica.cc:333] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.243782  9741 raft_consensus.cc:2243] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.245020  9741 raft_consensus.cc:2272] T abf0d91bbb1d4e40b769bc07ef380517 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.248339  9741 tablet_replica.cc:333] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.249133  9741 raft_consensus.cc:2243] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.249778  9741 raft_consensus.cc:2272] T e0126559599b40c5a6447c0648a81268 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.253048  9741 tablet_replica.cc:333] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.253885  9741 raft_consensus.cc:2243] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.254487  9741 raft_consensus.cc:2272] T e5880437f7fb435aafab505023d9f7ae P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.257761  9741 tablet_replica.cc:333] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.258543  9741 raft_consensus.cc:2243] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.259752  9741 raft_consensus.cc:2272] T e740fe60a5fc470d930160cc9445bc05 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.262768  9741 tablet_replica.cc:333] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.263594  9741 raft_consensus.cc:2243] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.264160  9741 raft_consensus.cc:2272] T 515975cb81844e8787a53147bb766080 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.267125  9741 tablet_replica.cc:333] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.267906  9741 raft_consensus.cc:2243] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.268991  9741 raft_consensus.cc:2272] T d5e9c01d16214bb19000600644b36d1e P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.272010  9741 tablet_replica.cc:333] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.272792  9741 raft_consensus.cc:2243] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.273355  9741 raft_consensus.cc:2272] T e8691968cf8f4b04b4ef459bd321e903 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.276161  9741 tablet_replica.cc:333] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.276968  9741 raft_consensus.cc:2243] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.278013  9741 raft_consensus.cc:2272] T 75e7b860aa254e34a20e8bdae1b626df P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.281056  9741 tablet_replica.cc:333] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.281949  9741 raft_consensus.cc:2243] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.282526  9741 raft_consensus.cc:2272] T 30dc0138443e498db94e47c81d5ca81b P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:05.285240 20200 consensus_peers.cc:597] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:05.285645  9741 tablet_replica.cc:333] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.287343  9741 raft_consensus.cc:2243] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.289855  9741 raft_consensus.cc:2272] T 144ce9a2901342abbabee63851505b75 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.292900  9741 tablet_replica.cc:333] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.293715  9741 raft_consensus.cc:2243] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.294799  9741 raft_consensus.cc:2272] T b5b588a815a548c8a3f375012fa7e3f6 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.298925  9741 tablet_replica.cc:333] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.299786  9741 raft_consensus.cc:2243] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.300390  9741 raft_consensus.cc:2272] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P aac061e592d74289800e4c50cbb4132b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.303244  9741 tablet_replica.cc:333] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.304183  9741 raft_consensus.cc:2243] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.304751  9741 raft_consensus.cc:2272] T 988f10f24b02449cade652e210ad3b06 P aac061e592d74289800e4c50cbb4132b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.307540  9741 tablet_replica.cc:333] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.308300  9741 raft_consensus.cc:2243] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.308879  9741 raft_consensus.cc:2272] T e05de16433174dc4b33d9fbc6afd9da1 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.311446  9741 tablet_replica.cc:333] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.312147  9741 raft_consensus.cc:2243] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.314364  9741 raft_consensus.cc:2272] T 073b8908cc1345f3bad72a6d8124df11 P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.317364  9741 tablet_replica.cc:333] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b: stopping tablet replica
I20260709 12:25:05.318034  9741 raft_consensus.cc:2243] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.319106  9741 raft_consensus.cc:2272] T d2a53dd7c6fa4a338973463bf3cf0f9c P aac061e592d74289800e4c50cbb4132b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:05.343293 20126 consensus_peers.cc:597] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:05.373006 20126 consensus_peers.cc:597] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.400952 21314 raft_consensus.cc:493] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:05.401599 21314 raft_consensus.cc:515] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:05.412135 21314 leader_election.cc:290] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:05.414397 21314 raft_consensus.cc:493] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:05.416826 21314 raft_consensus.cc:515] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:05.419198 21314 leader_election.cc:290] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:05.422901 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988f10f24b02449cade652e210ad3b06" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:05.423764 20155 raft_consensus.cc:2393] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c470740d41ee4b9383923d08a87655d6 in current term 2: Already voted for candidate 45ea8ca532304a8f9ffda636d59f6f0f in this term.
I20260709 12:25:05.425052 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528817cd200941fb84e40c79dbd16261" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:05.425926 20153 raft_consensus.cc:2393] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c470740d41ee4b9383923d08a87655d6 in current term 2: Already voted for candidate 45ea8ca532304a8f9ffda636d59f6f0f in this term.
W20260709 12:25:05.429726 20201 leader_election.cc:336] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
I20260709 12:25:05.431895 20201 leader_election.cc:304] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:05.432695 21314 raft_consensus.cc:3060] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:05.448673 20201 leader_election.cc:336] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
I20260709 12:25:05.449193 20201 leader_election.cc:304] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:05.449895 21399 raft_consensus.cc:3060] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:05.455260 21314 raft_consensus.cc:2749] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:05.457759 21399 raft_consensus.cc:2749] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:05.543802 20200 consensus_peers.cc:597] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:05.586813 21399 raft_consensus.cc:493] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.587445 21399 raft_consensus.cc:515] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:05.589887 21399 leader_election.cc:290] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:05.594108 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:05.594818 20153 raft_consensus.cc:2468] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 3.
I20260709 12:25:05.596527 20201 leader_election.cc:304] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
W20260709 12:25:05.597366 20201 leader_election.cc:336] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
I20260709 12:25:05.597379 21399 raft_consensus.cc:2804] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:05.598004 21399 raft_consensus.cc:493] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.598338 21399 raft_consensus.cc:3060] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:05.613375 21399 raft_consensus.cc:515] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:05.621430 21399 leader_election.cc:290] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
W20260709 12:25:05.624126 20125 consensus_peers.cc:597] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:05.627604 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa0a444b80347b0b9adc37ad505b0c5" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:25:05.628270 20155 raft_consensus.cc:3060] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:25:05.635556 20201 leader_election.cc:336] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
I20260709 12:25:05.640998 20155 raft_consensus.cc:2468] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 4.
I20260709 12:25:05.644140 21306 raft_consensus.cc:493] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:05.644716 21306 raft_consensus.cc:515] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:05.646972 21306 leader_election.cc:290] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:05.650864 20201 leader_election.cc:304] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:25:05.651718 21306 raft_consensus.cc:2804] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:05.652251 21306 raft_consensus.cc:697] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 4 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:25:05.653049 21306 consensus_queue.cc:237] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:05.656586 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5038da47868e47148f6dda5d135f60fa" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:05.657492 20155 raft_consensus.cc:2393] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c470740d41ee4b9383923d08a87655d6 in current term 2: Already voted for candidate 45ea8ca532304a8f9ffda636d59f6f0f in this term.
W20260709 12:25:05.663524 20201 leader_election.cc:336] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
W20260709 12:25:05.664913 20200 consensus_peers.cc:597] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:05.667984 20201 leader_election.cc:304] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:05.668991 21314 raft_consensus.cc:3060] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:05.706825 20200 consensus_peers.cc:597] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:05.709983 21404 raft_consensus.cc:493] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.711275 21404 raft_consensus.cc:515] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
W20260709 12:25:05.718971 20201 leader_election.cc:336] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
I20260709 12:25:05.722849 21404 leader_election.cc:290] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:05.723485 21314 raft_consensus.cc:2749] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:05.738152 21404 raft_consensus.cc:493] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:05.738862 21404 raft_consensus.cc:515] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:05.741180 21404 leader_election.cc:290] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
W20260709 12:25:05.753667 20200 leader_election.cc:336] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:25:05.760294 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4d18eda43b4a17bd5b552c4e04225c" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:05.761059 20155 raft_consensus.cc:2468] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 3.
I20260709 12:25:05.768059 19908 catalog_manager.cc:5697] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:05.773195 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524118618cf740e9865e397864b56ed2" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:05.773934 20155 raft_consensus.cc:2468] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 2.
I20260709 12:25:05.776759 20201 leader_election.cc:304] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:25:05.777856 21314 raft_consensus.cc:2804] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:05.778225 21314 raft_consensus.cc:493] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.780628 21314 raft_consensus.cc:3060] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:05.785828 20201 leader_election.cc:304] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:25:05.787264 21306 raft_consensus.cc:2804] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:05.787714 21306 raft_consensus.cc:493] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:05.788129 21306 raft_consensus.cc:3060] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:05.796643 21306 raft_consensus.cc:515] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:05.799997 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524118618cf740e9865e397864b56ed2" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:25:05.800299 21314 raft_consensus.cc:515] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:05.800697 20155 raft_consensus.cc:3060] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:05.804775 21306 leader_election.cc:290] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
W20260709 12:25:05.807034 20200 leader_election.cc:336] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:25:05.810868 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4d18eda43b4a17bd5b552c4e04225c" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:25:05.811559 20153 raft_consensus.cc:3060] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:05.815163 20155 raft_consensus.cc:2468] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 3.
I20260709 12:25:05.817320 20201 leader_election.cc:304] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:25:05.822290 20153 raft_consensus.cc:2468] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 4.
I20260709 12:25:05.822925 21306 raft_consensus.cc:2804] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:05.824441 21306 raft_consensus.cc:697] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 3 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
W20260709 12:25:05.824157 20201 leader_election.cc:336] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
I20260709 12:25:05.809350 21314 leader_election.cc:290] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
I20260709 12:25:05.825426 21306 consensus_queue.cc:237] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:05.826452 20201 leader_election.cc:304] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:25:05.834692 21404 raft_consensus.cc:2804] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:05.835248 21404 raft_consensus.cc:697] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 4 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:25:05.836138 21404 consensus_queue.cc:237] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:05.850068 21404 raft_consensus.cc:493] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.850632 21404 raft_consensus.cc:515] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:05.852896 21404 leader_election.cc:290] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
W20260709 12:25:05.858734 20200 leader_election.cc:336] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:25:05.860857 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf44484d11914a83a44c9a333eed7777" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:05.861667 20153 raft_consensus.cc:2468] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 2.
I20260709 12:25:05.864852 20201 leader_election.cc:304] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:25:05.865761 21404 raft_consensus.cc:2804] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:05.866127 21404 raft_consensus.cc:493] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.866474 21404 raft_consensus.cc:3060] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:05.875485 19908 catalog_manager.cc:5697] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 2 to 3, leader changed from 7204c82dd34944818a439bd468a8c410 (127.9.131.65) to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 3 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:05.877261 19908 catalog_manager.cc:5697] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:05.882782 21404 raft_consensus.cc:515] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
W20260709 12:25:05.885685 20125 consensus_peers.cc:597] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:05.887527 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf44484d11914a83a44c9a333eed7777" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:25:05.888134 20153 raft_consensus.cc:3060] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:25:05.890872 20200 leader_election.cc:336] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:25:05.890975 21314 raft_consensus.cc:493] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:05.893496 21314 raft_consensus.cc:515] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:05.895581 21314 leader_election.cc:290] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:05.901253 20153 raft_consensus.cc:2468] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 4.
W20260709 12:25:05.905562 20200 leader_election.cc:336] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
W20260709 12:25:05.910117 20201 leader_election.cc:336] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
W20260709 12:25:05.912026 20200 consensus_peers.cc:597] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:05.912274 20201 leader_election.cc:304] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:05.913161 21314 raft_consensus.cc:2749] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:05.913619 21404 leader_election.cc:290] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:05.914402 20201 leader_election.cc:304] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:25:05.915086 21404 raft_consensus.cc:2804] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:05.915627 21404 raft_consensus.cc:697] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 4 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:25:05.917061 21404 consensus_queue.cc:237] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:05.919997 21314 raft_consensus.cc:493] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:05.920639 21314 raft_consensus.cc:515] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:05.923311 21314 leader_election.cc:290] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
W20260709 12:25:05.930219 20200 leader_election.cc:336] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
W20260709 12:25:05.931253 20201 leader_election.cc:336] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
I20260709 12:25:05.931668 20201 leader_election.cc:304] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
W20260709 12:25:05.933892 20200 consensus_peers.cc:597] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:05.934710 21314 raft_consensus.cc:2749] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:05.941747 21330 raft_consensus.cc:493] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.942348 21330 raft_consensus.cc:515] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:05.943446 19908 catalog_manager.cc:5697] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 2 to 4, leader changed from 7204c82dd34944818a439bd468a8c410 (127.9.131.65) to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 4 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:05.945947 21330 leader_election.cc:290] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:05.947256 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528817cd200941fb84e40c79dbd16261" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:05.947957 20234 raft_consensus.cc:2468] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 2.
W20260709 12:25:05.949612 20126 leader_election.cc:336] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
I20260709 12:25:05.953951 21404 raft_consensus.cc:493] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.954581 21404 raft_consensus.cc:515] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:05.958102 21404 leader_election.cc:290] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:05.959267 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0988a236f3934f8692fd434098766112" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" is_pre_election: true
I20260709 12:25:05.960042 20153 raft_consensus.cc:2468] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 2.
I20260709 12:25:05.961359 20201 leader_election.cc:304] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:25:05.962147 21404 raft_consensus.cc:2804] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:05.962502 21404 raft_consensus.cc:493] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.962821 21404 raft_consensus.cc:3060] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:25:05.964126 20200 leader_election.cc:336] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:25:05.968168 21305 raft_consensus.cc:493] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:05.968753 21305 raft_consensus.cc:515] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:05.968196 20124 leader_election.cc:304] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:25:05.970830 21305 leader_election.cc:290] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:05.971383 21330 raft_consensus.cc:2804] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:05.971900 21330 raft_consensus.cc:493] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.973296 21330 raft_consensus.cc:3060] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:25:05.978688 20125 leader_election.cc:336] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:25:05.982365  9741 tablet_server.cc:196] TabletServer@127.9.131.66:0 shutdown complete.
I20260709 12:25:05.986184 21330 raft_consensus.cc:515] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
W20260709 12:25:05.986610 20200 consensus_peers.cc:597] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:05.987972 21404 raft_consensus.cc:515] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:05.990931 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528817cd200941fb84e40c79dbd16261" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:25:05.991544 20234 raft_consensus.cc:3060] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:05.992447 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0988a236f3934f8692fd434098766112" candidate_uuid: "c470740d41ee4b9383923d08a87655d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ea8ca532304a8f9ffda636d59f6f0f"
I20260709 12:25:05.993078 20153 raft_consensus.cc:3060] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:25:05.996276 21404 leader_election.cc:290] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 election: Requested vote from peers 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
W20260709 12:25:06.000490 20126 leader_election.cc:336] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
I20260709 12:25:06.001044 20126 leader_election.cc:304] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:06.001878 21311 raft_consensus.cc:2749] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:06.006956 20234 raft_consensus.cc:2468] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 3.
I20260709 12:25:05.990302 21330 leader_election.cc:290] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:06.008106 20153 raft_consensus.cc:2468] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470740d41ee4b9383923d08a87655d6 in term 4.
I20260709 12:25:06.013226 20124 leader_election.cc:304] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:25:06.014222 21330 raft_consensus.cc:2804] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:06.014748 21330 raft_consensus.cc:697] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
W20260709 12:25:06.015899 20200 leader_election.cc:336] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:25:06.015741 21330 consensus_queue.cc:237] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
W20260709 12:25:06.016986 20126 leader_election.cc:336] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
I20260709 12:25:06.017598 20201 leader_election.cc:304] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410
I20260709 12:25:06.039934 21314 raft_consensus.cc:2804] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:06.040553 21314 raft_consensus.cc:697] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 4 LEADER]: Becoming Leader. State: Replica: c470740d41ee4b9383923d08a87655d6, State: Running, Role: LEADER
I20260709 12:25:06.041498 21314 consensus_queue.cc:237] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:06.049577 19908 catalog_manager.cc:5697] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 1 to 3, leader changed from aac061e592d74289800e4c50cbb4132b (127.9.131.66) to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 3 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:06.064119 21305 raft_consensus.cc:493] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.064777 21305 raft_consensus.cc:515] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:06.067112 21305 leader_election.cc:290] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:06.068960 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c5a6e3d37c46f585ebd85003fbe15a" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
W20260709 12:25:06.070008 20200 consensus_peers.cc:597] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:06.074361 20200 consensus_peers.cc:597] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:06.076182 21305 raft_consensus.cc:493] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:06.076789 21305 raft_consensus.cc:515] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:06.079087 21305 leader_election.cc:290] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
W20260709 12:25:06.084983 20125 leader_election.cc:336] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:25:06.084906 19908 catalog_manager.cc:5697] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 reported cstate change: term changed from 2 to 4, leader changed from 7204c82dd34944818a439bd468a8c410 (127.9.131.65) to c470740d41ee4b9383923d08a87655d6 (127.9.131.68). New cstate: current_term: 4 leader_uuid: "c470740d41ee4b9383923d08a87655d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:06.088682 21305 raft_consensus.cc:493] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.089303 21305 raft_consensus.cc:515] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:06.092463 21305 leader_election.cc:290] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:06.092705 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988f10f24b02449cade652e210ad3b06" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
W20260709 12:25:06.092919 20126 leader_election.cc:336] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
I20260709 12:25:06.093413 20126 leader_election.cc:304] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: aac061e592d74289800e4c50cbb4132b, c470740d41ee4b9383923d08a87655d6
I20260709 12:25:06.093442 20234 raft_consensus.cc:2468] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 2.
I20260709 12:25:06.094403 21305 raft_consensus.cc:2749] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:06.095502 20124 leader_election.cc:304] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:25:06.096776 21305 raft_consensus.cc:2804] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:06.097357 21305 raft_consensus.cc:493] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.097750 21305 raft_consensus.cc:3060] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:25:06.113495 20126 leader_election.cc:336] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
I20260709 12:25:06.113329 21305 raft_consensus.cc:515] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:06.114822 20126 leader_election.cc:304] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:06.117317 21311 raft_consensus.cc:2749] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:06.117403 21305 leader_election.cc:290] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:06.117642 20234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988f10f24b02449cade652e210ad3b06" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:25:06.118391 20234 raft_consensus.cc:3060] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:25:06.123072 20126 leader_election.cc:336] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
W20260709 12:25:06.126374 20126 leader_election.cc:336] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
I20260709 12:25:06.127775 21305 raft_consensus.cc:493] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.128422 21305 raft_consensus.cc:515] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:06.131134  9741 tablet_server.cc:179] TabletServer@127.9.131.67:0 shutting down...
I20260709 12:25:06.133510 20234 raft_consensus.cc:2468] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 3.
I20260709 12:25:06.136371 21305 leader_election.cc:290] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
I20260709 12:25:06.136997 20124 leader_election.cc:304] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:25:06.139402 21305 raft_consensus.cc:2804] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:06.140975 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5038da47868e47148f6dda5d135f60fa" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6" is_pre_election: true
I20260709 12:25:06.141666 20236 raft_consensus.cc:2468] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 2.
I20260709 12:25:06.142905 20124 leader_election.cc:304] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: 
I20260709 12:25:06.146060 21330 raft_consensus.cc:2804] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:06.146538 21330 raft_consensus.cc:493] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.146898 21330 raft_consensus.cc:3060] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:06.143894 21314 raft_consensus.cc:493] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:06.145408 21305 raft_consensus.cc:697] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
W20260709 12:25:06.153867 20126 leader_election.cc:336] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
I20260709 12:25:06.149295 21314 raft_consensus.cc:515] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:06.171051 21314 leader_election.cc:290] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:06.172225 21305 consensus_queue.cc:237] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:06.172878 21330 raft_consensus.cc:515] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
W20260709 12:25:06.177011 20201 leader_election.cc:336] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
I20260709 12:25:06.181408 21330 leader_election.cc:290] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Requested vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), c470740d41ee4b9383923d08a87655d6 (127.9.131.68:39155)
W20260709 12:25:06.182859 20200 leader_election.cc:336] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:25:06.183496 20200 leader_election.cc:304] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:06.185552 21404 raft_consensus.cc:2749] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:06.186278 21404 raft_consensus.cc:493] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:06.186756 21404 raft_consensus.cc:515] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:06.189036 21404 leader_election.cc:290] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
W20260709 12:25:06.192198 20201 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111) [suppressed 310 similar messages]
W20260709 12:25:06.196036 20201 leader_election.cc:336] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
W20260709 12:25:06.197747 20124 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.131.68:39155, user_credentials={real_user=slave}} blocked reactor thread for 54925us
W20260709 12:25:06.199467 20126 leader_election.cc:336] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
I20260709 12:25:06.203914 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5038da47868e47148f6dda5d135f60fa" candidate_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c470740d41ee4b9383923d08a87655d6"
I20260709 12:25:06.204640 20236 raft_consensus.cc:3060] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:25:06.209805 20201 consensus_peers.cc:597] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 -> Peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Couldn't send request to peer 45ea8ca532304a8f9ffda636d59f6f0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:06.212446 20125 consensus_peers.cc:597] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:06.219453 20236 raft_consensus.cc:2468] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ea8ca532304a8f9ffda636d59f6f0f in term 3.
W20260709 12:25:06.221570 20201 consensus_peers.cc:597] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 -> Peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Couldn't send request to peer 45ea8ca532304a8f9ffda636d59f6f0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:06.222680 20124 leader_election.cc:304] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f, c470740d41ee4b9383923d08a87655d6; no voters: aac061e592d74289800e4c50cbb4132b
I20260709 12:25:06.226287 21311 raft_consensus.cc:2804] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:06.226840 21311 raft_consensus.cc:697] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: Becoming Leader. State: Replica: 45ea8ca532304a8f9ffda636d59f6f0f, State: Running, Role: LEADER
I20260709 12:25:06.227885 21311 consensus_queue.cc:237] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
W20260709 12:25:06.231763 20200 leader_election.cc:336] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:25:06.232498 20200 leader_election.cc:304] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:06.235273 21404 raft_consensus.cc:493] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:06.235899 21404 raft_consensus.cc:515] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:06.237912 21404 leader_election.cc:290] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
W20260709 12:25:06.241539 20125 consensus_peers.cc:597] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:06.242211 20125 consensus_peers.cc:597] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:06.242385 21404 raft_consensus.cc:2749] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:06.251560 20201 leader_election.cc:336] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
I20260709 12:25:06.251890 21306 raft_consensus.cc:493] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:06.264719 21306 raft_consensus.cc:515] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:06.270550 21306 leader_election.cc:290] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
W20260709 12:25:06.270779 20200 consensus_peers.cc:597] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:06.266907 20201 leader_election.cc:336] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:06.283142 20125 consensus_peers.cc:597] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:06.280257 20201 leader_election.cc:304] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:06.284044 21306 raft_consensus.cc:2749] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:06.286514 19908 catalog_manager.cc:5697] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 1 to 3, leader changed from aac061e592d74289800e4c50cbb4132b (127.9.131.66) to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 3 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:06.294750 20201 consensus_peers.cc:597] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:06.295223 20201 leader_election.cc:336] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
W20260709 12:25:06.296896 20201 leader_election.cc:336] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:06.297519 20201 leader_election.cc:304] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:06.298382 21306 raft_consensus.cc:2749] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:06.301046 21417 raft_consensus.cc:493] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7204c82dd34944818a439bd468a8c410)
I20260709 12:25:06.301576 21417 raft_consensus.cc:515] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:06.307349 19908 catalog_manager.cc:5697] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f reported cstate change: term changed from 1 to 3, leader changed from aac061e592d74289800e4c50cbb4132b (127.9.131.66) to 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67). New cstate: current_term: 3 leader_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:06.310704 20126 leader_election.cc:336] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
I20260709 12:25:06.310781 21417 leader_election.cc:290] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
W20260709 12:25:06.317538 20200 consensus_peers.cc:597] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:06.322196 20200 consensus_peers.cc:597] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:06.324132 20125 leader_election.cc:336] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:25:06.324750 20125 leader_election.cc:304] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:06.325788 21305 raft_consensus.cc:2749] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:06.328181  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:25:06.328848 20201 consensus_peers.cc:597] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 -> Peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Couldn't send request to peer 45ea8ca532304a8f9ffda636d59f6f0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:06.329315  9741 tablet_replica.cc:333] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.330330  9741 raft_consensus.cc:2243] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.331070  9741 raft_consensus.cc:2272] T f834f9ccdefc4baebc23e9477701af69 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.333591  9741 tablet_replica.cc:333] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.334203  9741 raft_consensus.cc:2243] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.334653  9741 raft_consensus.cc:2272] T ffa0a444b80347b0b9adc37ad505b0c5 P 45ea8ca532304a8f9ffda636d59f6f0f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.336779  9741 tablet_replica.cc:333] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.337350  9741 raft_consensus.cc:2243] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.338145  9741 raft_consensus.cc:2272] T 1257e7996388445eaa292ac68c3ad0ef P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.340364  9741 tablet_replica.cc:333] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.340988  9741 raft_consensus.cc:2243] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.341955  9741 raft_consensus.cc:2272] T 1127f55bd43a4c988dfd61547a03b3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.342423 21305 raft_consensus.cc:493] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:06.342795 21305 raft_consensus.cc:515] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } }
I20260709 12:25:06.344942 21305 leader_election.cc:290] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:06.345631  9741 tablet_replica.cc:333] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.346597  9741 raft_consensus.cc:2243] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.347705  9741 raft_consensus.cc:2272] T fb2234eae9544c8898b57db26f4533d3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:06.348730 20201 consensus_peers.cc:597] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 -> Peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Couldn't send request to peer aac061e592d74289800e4c50cbb4132b. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:06.350709  9741 tablet_replica.cc:333] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.351709  9741 raft_consensus.cc:2243] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:25:06.351787 20126 leader_election.cc:336] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
I20260709 12:25:06.352643  9741 pending_rounds.cc:70] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f: Trying to abort 1 pending ops.
I20260709 12:25:06.352875  9741 pending_rounds.cc:77] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f: Aborting op as it isn't in flight: id { term: 3 index: 2 } timestamp: 7305625215919296512 op_type: NO_OP noop_request { }
I20260709 12:25:06.353154  9741 raft_consensus.cc:2889] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:06.353433  9741 raft_consensus.cc:2272] T 5038da47868e47148f6dda5d135f60fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.356839  9741 tablet_replica.cc:333] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.357602  9741 raft_consensus.cc:2243] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:25:06.358359 20201 consensus_peers.cc:597] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 -> Peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Couldn't send request to peer 45ea8ca532304a8f9ffda636d59f6f0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:06.358517  9741 raft_consensus.cc:2272] T 20a52c50180741b9a6165c183733f3fa P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:06.359036 20125 leader_election.cc:336] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:25:06.359532 20125 leader_election.cc:304] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:06.360416 21305 raft_consensus.cc:2749] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:06.361532  9741 tablet_replica.cc:333] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.362321  9741 raft_consensus.cc:2243] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.362916  9741 raft_consensus.cc:2272] T 36c5a6e3d37c46f585ebd85003fbe15a P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.365469  9741 tablet_replica.cc:333] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.366199  9741 raft_consensus.cc:2243] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.367295  9741 raft_consensus.cc:2272] T 141c2e84c15e4ad38afc0a52b330f9b9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.370002  9741 tablet_replica.cc:333] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
W20260709 12:25:06.370141 20201 consensus_peers.cc:597] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 -> Peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Couldn't send request to peer 45ea8ca532304a8f9ffda636d59f6f0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:06.370836  9741 raft_consensus.cc:2243] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.371325  9741 raft_consensus.cc:2272] T 94b96b6be45d43b6aceaf2afe76d79e4 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.373693  9741 tablet_replica.cc:333] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.374316  9741 raft_consensus.cc:2243] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.374782  9741 raft_consensus.cc:2272] T bf44484d11914a83a44c9a333eed7777 P 45ea8ca532304a8f9ffda636d59f6f0f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.377163  9741 tablet_replica.cc:333] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.377871  9741 raft_consensus.cc:2243] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.378376  9741 raft_consensus.cc:2272] T c084bfebf47c4ede978b6da72f620608 P 45ea8ca532304a8f9ffda636d59f6f0f [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.380505  9741 tablet_replica.cc:333] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.381083  9741 raft_consensus.cc:2243] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.381906  9741 raft_consensus.cc:2272] T 995e00d57e1040b7b6d193c60fd84405 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.384084  9741 tablet_replica.cc:333] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.384630  9741 raft_consensus.cc:2243] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.385426  9741 raft_consensus.cc:2272] T 976741a38d1c42329394a00cbe085319 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.387749  9741 tablet_replica.cc:333] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.388346  9741 raft_consensus.cc:2243] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.388826  9741 raft_consensus.cc:2272] T b0ac5e9dcbf74c29aa24300975246ad3 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.391005  9741 tablet_replica.cc:333] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.391609  9741 raft_consensus.cc:2243] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.392194  9741 raft_consensus.cc:2272] T 3651ee11a6184a34bed06bc86be62c29 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.394531  9741 tablet_replica.cc:333] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.395267  9741 raft_consensus.cc:2243] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.395752  9741 raft_consensus.cc:2272] T bac98768a9a3430a8784fa7995363272 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.398496  9741 tablet_replica.cc:333] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.399369  9741 raft_consensus.cc:2243] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.400326  9741 raft_consensus.cc:2272] T 04cd0aa441274cf38da93eec0bfadeff P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:06.401069 20201 consensus_peers.cc:597] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 -> Peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Couldn't send request to peer 45ea8ca532304a8f9ffda636d59f6f0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:06.402577  9741 tablet_replica.cc:333] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.403457  9741 raft_consensus.cc:2243] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.403977  9741 raft_consensus.cc:2272] T b0da04e85e534d9990213bfdcee4874c P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.406617  9741 tablet_replica.cc:333] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.407263  9741 raft_consensus.cc:2243] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.407752  9741 raft_consensus.cc:2272] T 524118618cf740e9865e397864b56ed2 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.410051  9741 tablet_replica.cc:333] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.410810  9741 raft_consensus.cc:2243] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.411886  9741 raft_consensus.cc:2272] T 24bd122132f7485fa43d171d8c857d38 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.414680  9741 tablet_replica.cc:333] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.415589  9741 raft_consensus.cc:2243] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.416154  9741 raft_consensus.cc:2272] T d2a53dd7c6fa4a338973463bf3cf0f9c P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.418994  9741 tablet_replica.cc:333] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.419775  9741 raft_consensus.cc:2243] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.420378  9741 raft_consensus.cc:2272] T a72eb35da72b43ecb538c2a240a61646 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.422958  9741 tablet_replica.cc:333] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.423144 21305 raft_consensus.cc:493] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:06.423718  9741 raft_consensus.cc:2243] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.423720 21305 raft_consensus.cc:515] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } }
I20260709 12:25:06.424538  9741 raft_consensus.cc:2272] T e740fe60a5fc470d930160cc9445bc05 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:06.425340 20201 consensus_peers.cc:597] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 -> Peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Couldn't send request to peer 45ea8ca532304a8f9ffda636d59f6f0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:06.425911 21305 leader_election.cc:290] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339)
I20260709 12:25:06.427380  9741 tablet_replica.cc:333] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.428277  9741 raft_consensus.cc:2243] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.429059  9741 pending_rounds.cc:70] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f: Trying to abort 1 pending ops.
I20260709 12:25:06.429277  9741 pending_rounds.cc:77] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f: Aborting op as it isn't in flight: id { term: 3 index: 2 } timestamp: 7305625215801643008 op_type: NO_OP noop_request { }
I20260709 12:25:06.429548  9741 raft_consensus.cc:2889] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:06.429908  9741 raft_consensus.cc:2272] T 988f10f24b02449cade652e210ad3b06 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:06.432034 20126 leader_election.cc:336] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
W20260709 12:25:06.432955 20125 leader_election.cc:336] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:25:06.433393 20125 leader_election.cc:304] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ea8ca532304a8f9ffda636d59f6f0f; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:06.433992 21305 raft_consensus.cc:2749] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:06.434558  9741 tablet_replica.cc:333] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.436245  9741 raft_consensus.cc:2243] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.436905  9741 raft_consensus.cc:2272] T 0988a236f3934f8692fd434098766112 P 45ea8ca532304a8f9ffda636d59f6f0f [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:06.437022 20201 consensus_peers.cc:597] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 -> Peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Couldn't send request to peer 45ea8ca532304a8f9ffda636d59f6f0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:06.439504 21404 raft_consensus.cc:493] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:06.440232  9741 tablet_replica.cc:333] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.440047 21404 raft_consensus.cc:515] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:06.441159  9741 raft_consensus.cc:2243] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.442332  9741 raft_consensus.cc:2272] T 6ff86d69d6264de598b8dd58012f7904 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.442397 21404 leader_election.cc:290] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:06.445468  9741 tablet_replica.cc:333] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.446439  9741 raft_consensus.cc:2243] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:25:06.446897 20200 leader_election.cc:336] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:25:06.447541  9741 raft_consensus.cc:2272] T e5880437f7fb435aafab505023d9f7ae P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:06.448446 20201 leader_election.cc:336] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
I20260709 12:25:06.448848 20201 leader_election.cc:304] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:06.449414 21404 raft_consensus.cc:2749] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:06.450650  9741 tablet_replica.cc:333] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.451519  9741 raft_consensus.cc:2243] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.452152  9741 raft_consensus.cc:2272] T f6e608aa894f4f9d96f3e1b9b16fb7cd P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.454888  9741 tablet_replica.cc:333] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.455650  9741 raft_consensus.cc:2243] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.456735  9741 raft_consensus.cc:2272] T e0126559599b40c5a6447c0648a81268 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.459935  9741 tablet_replica.cc:333] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.460762  9741 raft_consensus.cc:2243] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.461756  9741 raft_consensus.cc:2272] T af265a90671a46cbafb3fced0f952aef P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.464706  9741 tablet_replica.cc:333] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.465473  9741 raft_consensus.cc:2243] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.465993  9741 raft_consensus.cc:2272] T dd4d18eda43b4a17bd5b552c4e04225c P 45ea8ca532304a8f9ffda636d59f6f0f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.468695  9741 tablet_replica.cc:333] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.469432  9741 raft_consensus.cc:2243] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.470002  9741 raft_consensus.cc:2272] T e71a18e780d74303884e208106817dec P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.472891  9741 tablet_replica.cc:333] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.473734  9741 raft_consensus.cc:2243] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.474347  9741 raft_consensus.cc:2272] T ba98035197c34fce88758eedbfd23225 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.477113  9741 tablet_replica.cc:333] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.478060  9741 raft_consensus.cc:2243] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:25:06.478302 20200 consensus_peers.cc:597] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 -> Peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Couldn't send request to peer 7204c82dd34944818a439bd468a8c410. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:06.478837  9741 pending_rounds.cc:70] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f: Trying to abort 1 pending ops.
I20260709 12:25:06.479156  9741 pending_rounds.cc:77] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f: Aborting op as it isn't in flight: id { term: 3 index: 2 } timestamp: 7305625215053856768 op_type: NO_OP noop_request { }
I20260709 12:25:06.479488  9741 raft_consensus.cc:2889] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:06.479811  9741 raft_consensus.cc:2272] T 528817cd200941fb84e40c79dbd16261 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.482843  9741 tablet_replica.cc:333] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.483647  9741 raft_consensus.cc:2243] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.484777  9741 raft_consensus.cc:2272] T 4a8a2aa61ada477c8750740dcc082235 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.487979  9741 tablet_replica.cc:333] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.488785  9741 raft_consensus.cc:2243] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.489337  9741 raft_consensus.cc:2272] T d5bd4e0295fa48bc8c187c7d421d8f11 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.492266  9741 tablet_replica.cc:333] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.493046  9741 raft_consensus.cc:2243] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.493662  9741 raft_consensus.cc:2272] T c9370ed3b42941c683b03215e8ae3344 P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.496536  9741 tablet_replica.cc:333] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.497282  9741 raft_consensus.cc:2243] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.498304  9741 raft_consensus.cc:2272] T 57d0409829eb45ff8e1eb6b75796eff9 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.501112  9741 tablet_replica.cc:333] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.502334  9741 raft_consensus.cc:2243] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.502949  9741 raft_consensus.cc:2272] T 75e7b860aa254e34a20e8bdae1b626df P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.505741  9741 tablet_replica.cc:333] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.506450  9741 raft_consensus.cc:2243] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.507468  9741 raft_consensus.cc:2272] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P 45ea8ca532304a8f9ffda636d59f6f0f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.510123  9741 tablet_replica.cc:333] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.510808  9741 raft_consensus.cc:2243] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.511848  9741 raft_consensus.cc:2272] T 30dc0138443e498db94e47c81d5ca81b P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.514432  9741 tablet_replica.cc:333] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.515101  9741 raft_consensus.cc:2243] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.516180  9741 raft_consensus.cc:2272] T 515975cb81844e8787a53147bb766080 P 45ea8ca532304a8f9ffda636d59f6f0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.517879 21404 raft_consensus.cc:493] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:06.518415 21404 raft_consensus.cc:515] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:06.518961  9741 tablet_replica.cc:333] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f: stopping tablet replica
I20260709 12:25:06.519752  9741 raft_consensus.cc:2243] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.520360  9741 raft_consensus.cc:2272] T d5e9c01d16214bb19000600644b36d1e P 45ea8ca532304a8f9ffda636d59f6f0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.520471 21404 leader_election.cc:290] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
W20260709 12:25:06.526297 20201 leader_election.cc:336] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
W20260709 12:25:06.527622 20200 leader_election.cc:336] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:25:06.527989 20200 leader_election.cc:304] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:06.528584 21404 raft_consensus.cc:2749] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:06.530716 21404 raft_consensus.cc:493] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:06.531276 21404 raft_consensus.cc:515] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:06.532481 21306 raft_consensus.cc:493] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:06.533056 21306 raft_consensus.cc:515] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:06.533667 21404 leader_election.cc:290] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
I20260709 12:25:06.534945 21306 leader_election.cc:290] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
W20260709 12:25:06.541386 20201 leader_election.cc:336] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
W20260709 12:25:06.541842 20201 leader_election.cc:336] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
W20260709 12:25:06.543277 20200 leader_election.cc:336] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:25:06.543761 20200 leader_election.cc:304] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:06.544389 21306 raft_consensus.cc:2749] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:06.544565 20200 leader_election.cc:336] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
I20260709 12:25:06.545033 20200 leader_election.cc:304] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:06.545624 21306 raft_consensus.cc:2749] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:25:06.549876 20201 consensus_peers.cc:597] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 -> Peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Couldn't send request to peer 45ea8ca532304a8f9ffda636d59f6f0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:06.563558 20201 consensus_peers.cc:597] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 -> Peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Couldn't send request to peer 45ea8ca532304a8f9ffda636d59f6f0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:06.581017 20201 consensus_peers.cc:597] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 -> Peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Couldn't send request to peer 45ea8ca532304a8f9ffda636d59f6f0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:06.616343  9741 tablet_server.cc:196] TabletServer@127.9.131.67:0 shutdown complete.
I20260709 12:25:06.616660 21306 raft_consensus.cc:493] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:06.617249 21306 raft_consensus.cc:515] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } } peers { permanent_uuid: "45ea8ca532304a8f9ffda636d59f6f0f" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 40749 } } peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } }
I20260709 12:25:06.619270 21306 leader_election.cc:290] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769), 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749)
W20260709 12:25:06.624439 20201 leader_election.cc:336] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Network error: Client connection negotiation failed: client connection to 127.9.131.67:40749: connect: Connection refused (error 111)
W20260709 12:25:06.625299 20201 leader_election.cc:336] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
I20260709 12:25:06.625718 20201 leader_election.cc:304] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 45ea8ca532304a8f9ffda636d59f6f0f, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:06.626423 21306 raft_consensus.cc:2749] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:25:06.628556 20201 consensus_peers.cc:597] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 -> Peer 45ea8ca532304a8f9ffda636d59f6f0f (127.9.131.67:40749): Couldn't send request to peer 45ea8ca532304a8f9ffda636d59f6f0f. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.67:40749: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:06.649367 21306 raft_consensus.cc:493] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac061e592d74289800e4c50cbb4132b)
I20260709 12:25:06.650210 21306 raft_consensus.cc:515] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c470740d41ee4b9383923d08a87655d6" member_type: VOTER last_known_addr { host: "127.9.131.68" port: 39155 } } peers { permanent_uuid: "7204c82dd34944818a439bd468a8c410" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43339 } } peers { permanent_uuid: "aac061e592d74289800e4c50cbb4132b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38769 } }
I20260709 12:25:06.653110 21306 leader_election.cc:290] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339), aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769)
W20260709 12:25:06.660061 20200 leader_election.cc:336] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7204c82dd34944818a439bd468a8c410 (127.9.131.65:43339): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43339: connect: Connection refused (error 111)
W20260709 12:25:06.660741 20201 leader_election.cc:336] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aac061e592d74289800e4c50cbb4132b (127.9.131.66:38769): Network error: Client connection negotiation failed: client connection to 127.9.131.66:38769: connect: Connection refused (error 111)
I20260709 12:25:06.661253 20201 leader_election.cc:304] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c470740d41ee4b9383923d08a87655d6; no voters: 7204c82dd34944818a439bd468a8c410, aac061e592d74289800e4c50cbb4132b
I20260709 12:25:06.662019 21306 raft_consensus.cc:2749] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:06.704758  9741 tablet_server.cc:179] TabletServer@127.9.131.68:0 shutting down...
I20260709 12:25:06.753433  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:06.755366  9741 tablet_replica.cc:333] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.756307  9741 raft_consensus.cc:2243] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.757386  9741 raft_consensus.cc:2272] T f834f9ccdefc4baebc23e9477701af69 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.760126  9741 tablet_replica.cc:333] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.760736  9741 raft_consensus.cc:2243] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.761476  9741 pending_rounds.cc:70] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6: Trying to abort 1 pending ops.
I20260709 12:25:06.761646  9741 pending_rounds.cc:77] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305625208515579904 op_type: NO_OP noop_request { }
I20260709 12:25:06.761901  9741 raft_consensus.cc:2889] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:06.762148  9741 raft_consensus.cc:2272] T d063c9d79f904091aade12ce2aba8bd1 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.764237  9741 tablet_replica.cc:333] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.764780  9741 raft_consensus.cc:2243] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.765542  9741 raft_consensus.cc:2272] T b091f47eb9da43e6a24dd1b2bd9e9ce8 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.767692  9741 tablet_replica.cc:333] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.768464  9741 raft_consensus.cc:2243] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.769445  9741 pending_rounds.cc:70] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6: Trying to abort 1 pending ops.
I20260709 12:25:06.769714  9741 pending_rounds.cc:77] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6: Aborting op as it isn't in flight: id { term: 4 index: 3 } timestamp: 7305625214643490816 op_type: NO_OP noop_request { }
I20260709 12:25:06.770018  9741 raft_consensus.cc:2889] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:06.770323  9741 raft_consensus.cc:2272] T bf44484d11914a83a44c9a333eed7777 P c470740d41ee4b9383923d08a87655d6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.775220  9741 tablet_replica.cc:333] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.776023  9741 raft_consensus.cc:2243] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.776760  9741 pending_rounds.cc:70] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6: Trying to abort 1 pending ops.
I20260709 12:25:06.776930  9741 pending_rounds.cc:77] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6: Aborting op as it isn't in flight: id { term: 4 index: 2 } timestamp: 7305625213563764736 op_type: NO_OP noop_request { }
I20260709 12:25:06.777192  9741 raft_consensus.cc:2889] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:06.777446  9741 raft_consensus.cc:2272] T ffa0a444b80347b0b9adc37ad505b0c5 P c470740d41ee4b9383923d08a87655d6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.779444  9741 tablet_replica.cc:333] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.780072  9741 raft_consensus.cc:2243] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.780575  9741 raft_consensus.cc:2272] T fb2234eae9544c8898b57db26f4533d3 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.782570  9741 tablet_replica.cc:333] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.783102  9741 raft_consensus.cc:2243] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.783493  9741 raft_consensus.cc:2272] T d45bea543fc142ee90510d18e0d7c029 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.785423  9741 tablet_replica.cc:333] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.785982  9741 raft_consensus.cc:2243] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.786399  9741 raft_consensus.cc:2272] T 8ed53455b57840a780d37b1db5103826 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.788466  9741 tablet_replica.cc:333] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.789009  9741 raft_consensus.cc:2243] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.789436  9741 raft_consensus.cc:2272] T 141c2e84c15e4ad38afc0a52b330f9b9 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.791549  9741 tablet_replica.cc:333] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.792179  9741 raft_consensus.cc:2243] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.792975  9741 raft_consensus.cc:2272] T 94b96b6be45d43b6aceaf2afe76d79e4 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.794973  9741 tablet_replica.cc:333] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.795521  9741 raft_consensus.cc:2243] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.795989  9741 raft_consensus.cc:2272] T 8635d89e903c48a786062efb05feaa75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.797901  9741 tablet_replica.cc:333] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.798430  9741 raft_consensus.cc:2243] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.798869  9741 raft_consensus.cc:2272] T cb8871be082b42e1b4cb33626f240b8d P c470740d41ee4b9383923d08a87655d6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.800841  9741 tablet_replica.cc:333] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.801364  9741 raft_consensus.cc:2243] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.802074  9741 pending_rounds.cc:70] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6: Trying to abort 1 pending ops.
I20260709 12:25:06.802234  9741 pending_rounds.cc:77] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6: Aborting op as it isn't in flight: id { term: 4 index: 3 } timestamp: 7305625214315286528 op_type: NO_OP noop_request { }
I20260709 12:25:06.802486  9741 raft_consensus.cc:2889] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:06.802748  9741 raft_consensus.cc:2272] T dd4d18eda43b4a17bd5b552c4e04225c P c470740d41ee4b9383923d08a87655d6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.805262  9741 tablet_replica.cc:333] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.805886  9741 raft_consensus.cc:2243] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.806327  9741 raft_consensus.cc:2272] T 528817cd200941fb84e40c79dbd16261 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.808439  9741 tablet_replica.cc:333] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.809192  9741 raft_consensus.cc:2243] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.809643  9741 raft_consensus.cc:2272] T 20a52c50180741b9a6165c183733f3fa P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.811559  9741 tablet_replica.cc:333] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.812296  9741 raft_consensus.cc:2243] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.812752  9741 raft_consensus.cc:2272] T 36c5a6e3d37c46f585ebd85003fbe15a P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.815246  9741 tablet_replica.cc:333] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.815893  9741 raft_consensus.cc:2243] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.816401  9741 raft_consensus.cc:2272] T 1127f55bd43a4c988dfd61547a03b3fa P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.818943  9741 tablet_replica.cc:333] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.819568  9741 raft_consensus.cc:2243] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.820402  9741 raft_consensus.cc:2272] T 0252a8e0d9ac4440b3affdcbf4cf2246 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.822934  9741 tablet_replica.cc:333] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.823506  9741 raft_consensus.cc:2243] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.824047  9741 raft_consensus.cc:2272] T dd398fffdf6d468f88108a6a7bec0681 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.826547  9741 tablet_replica.cc:333] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.827149  9741 raft_consensus.cc:2243] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.827569  9741 raft_consensus.cc:2272] T af265a90671a46cbafb3fced0f952aef P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.829632  9741 tablet_replica.cc:333] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.830173  9741 raft_consensus.cc:2243] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.830590  9741 raft_consensus.cc:2272] T 04cd0aa441274cf38da93eec0bfadeff P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.832598  9741 tablet_replica.cc:333] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.833132  9741 raft_consensus.cc:2243] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.833532  9741 raft_consensus.cc:2272] T 073b8908cc1345f3bad72a6d8124df11 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.835525  9741 tablet_replica.cc:333] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.836108  9741 raft_consensus.cc:2243] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.836917  9741 raft_consensus.cc:2272] T b0da04e85e534d9990213bfdcee4874c P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.839023  9741 tablet_replica.cc:333] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.839545  9741 raft_consensus.cc:2243] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.840051  9741 raft_consensus.cc:2272] T fb7527e635cb4c339c05a4b1ea702164 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.842882  9741 tablet_replica.cc:333] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.843575  9741 raft_consensus.cc:2243] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.844220  9741 raft_consensus.cc:2272] T 5038da47868e47148f6dda5d135f60fa P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.846884  9741 tablet_replica.cc:333] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.847455  9741 raft_consensus.cc:2243] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.848320  9741 raft_consensus.cc:2272] T c9370ed3b42941c683b03215e8ae3344 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.850351  9741 tablet_replica.cc:333] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.850893  9741 raft_consensus.cc:2243] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.851346  9741 raft_consensus.cc:2272] T abf0d91bbb1d4e40b769bc07ef380517 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.853396  9741 tablet_replica.cc:333] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.853937  9741 raft_consensus.cc:2243] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.854696  9741 raft_consensus.cc:2272] T f6e608aa894f4f9d96f3e1b9b16fb7cd P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.856737  9741 tablet_replica.cc:333] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.857293  9741 raft_consensus.cc:2243] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.857761  9741 raft_consensus.cc:2272] T e0126559599b40c5a6447c0648a81268 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.859757  9741 tablet_replica.cc:333] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.860352  9741 raft_consensus.cc:2243] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.860772  9741 raft_consensus.cc:2272] T bac98768a9a3430a8784fa7995363272 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.862871  9741 tablet_replica.cc:333] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.863435  9741 raft_consensus.cc:2243] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.864272  9741 raft_consensus.cc:2272] T e05de16433174dc4b33d9fbc6afd9da1 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.866182  9741 tablet_replica.cc:333] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.866750  9741 raft_consensus.cc:2243] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.867183  9741 raft_consensus.cc:2272] T 4a8a2aa61ada477c8750740dcc082235 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.869230  9741 tablet_replica.cc:333] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.869748  9741 raft_consensus.cc:2243] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.870527  9741 raft_consensus.cc:2272] T d5bd4e0295fa48bc8c187c7d421d8f11 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.872489  9741 tablet_replica.cc:333] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.873013  9741 raft_consensus.cc:2243] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.873735  9741 pending_rounds.cc:70] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6: Trying to abort 1 pending ops.
I20260709 12:25:06.873894  9741 pending_rounds.cc:77] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305625214291263488 op_type: NO_OP noop_request { }
I20260709 12:25:06.874152  9741 raft_consensus.cc:2889] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:06.874413  9741 raft_consensus.cc:2272] T 524118618cf740e9865e397864b56ed2 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.876456  9741 tablet_replica.cc:333] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.876991  9741 raft_consensus.cc:2243] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.877707  9741 raft_consensus.cc:2272] T a72eb35da72b43ecb538c2a240a61646 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.879583  9741 tablet_replica.cc:333] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.880151  9741 raft_consensus.cc:2243] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.880554  9741 raft_consensus.cc:2272] T 75e7b860aa254e34a20e8bdae1b626df P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.882398  9741 tablet_replica.cc:333] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.882906  9741 raft_consensus.cc:2243] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.883291  9741 raft_consensus.cc:2272] T 30dc0138443e498db94e47c81d5ca81b P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.885226  9741 tablet_replica.cc:333] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.885725  9741 raft_consensus.cc:2243] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.886138  9741 raft_consensus.cc:2272] T 144ce9a2901342abbabee63851505b75 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.888170  9741 tablet_replica.cc:333] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.888664  9741 raft_consensus.cc:2243] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.889429  9741 pending_rounds.cc:70] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6: Trying to abort 1 pending ops.
I20260709 12:25:06.889611  9741 pending_rounds.cc:77] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6: Aborting op as it isn't in flight: id { term: 4 index: 3 } timestamp: 7305625215208108032 op_type: NO_OP noop_request { }
I20260709 12:25:06.889886  9741 raft_consensus.cc:2889] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:06.890143  9741 raft_consensus.cc:2272] T 0988a236f3934f8692fd434098766112 P c470740d41ee4b9383923d08a87655d6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.892541  9741 tablet_replica.cc:333] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.893074  9741 raft_consensus.cc:2243] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.893507  9741 raft_consensus.cc:2272] T b5b588a815a548c8a3f375012fa7e3f6 P c470740d41ee4b9383923d08a87655d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.895457  9741 tablet_replica.cc:333] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.895991  9741 raft_consensus.cc:2243] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.896395  9741 raft_consensus.cc:2272] T 6ff86d69d6264de598b8dd58012f7904 P c470740d41ee4b9383923d08a87655d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.898365  9741 tablet_replica.cc:333] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.898834  9741 raft_consensus.cc:2243] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.899550  9741 pending_rounds.cc:70] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6: Trying to abort 1 pending ops.
I20260709 12:25:06.899745  9741 pending_rounds.cc:77] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305625208510738432 op_type: NO_OP noop_request { }
I20260709 12:25:06.900027  9741 raft_consensus.cc:2889] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:06.900290  9741 raft_consensus.cc:2272] T e8691968cf8f4b04b4ef459bd321e903 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.902158  9741 tablet_replica.cc:333] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.902629  9741 raft_consensus.cc:2243] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.903049  9741 raft_consensus.cc:2272] T e6d6ed1f33fa4b73bf5108eb0fec8f88 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.905136  9741 tablet_replica.cc:333] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6: stopping tablet replica
I20260709 12:25:06.905616  9741 raft_consensus.cc:2243] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:06.906021  9741 raft_consensus.cc:2272] T 988f10f24b02449cade652e210ad3b06 P c470740d41ee4b9383923d08a87655d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.977620  9741 tablet_server.cc:196] TabletServer@127.9.131.68:0 shutdown complete.
I20260709 12:25:07.052219  9741 master.cc:562] Master@127.9.131.126:36271 shutting down...
I20260709 12:25:07.093036  9741 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:07.093773  9741 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:07.094209  9741 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5907f62d19ad4f6aa4da9f20e59cca3a: stopping tablet replica
W20260709 12:25:08.116151  9741 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 19940)
I20260709 12:25:09.025497  9741 master.cc:584] Master@127.9.131.126:36271 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (48329 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:25:09.113009  9741 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.131.126:33573
I20260709 12:25:09.114187  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:09.120646 21418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:09.120812 21421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:09.120774 21419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:09.122018  9741 server_base.cc:1061] running on GCE node
I20260709 12:25:09.123229  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:09.123418  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:09.123534  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599909123523 us; error 0 us; skew 500 ppm
I20260709 12:25:09.124081  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:09.126505  9741 webserver.cc:533] Webserver started at http://127.9.131.126:44623/ using document root <none> and password file <none>
I20260709 12:25:09.126973  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:09.127139  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:09.127362  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:09.128489  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/master-0-root/instance:
uuid: "7c62880afbaa46fc853dae972bce023e"
format_stamp: "Formatted at 2026-07-09 12:25:09 on dist-test-slave-r7s7"
I20260709 12:25:09.133056  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:25:09.136762 21426 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:09.137533  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:25:09.137823  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/master-0-root
uuid: "7c62880afbaa46fc853dae972bce023e"
format_stamp: "Formatted at 2026-07-09 12:25:09 on dist-test-slave-r7s7"
I20260709 12:25:09.138111  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:09.167718  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:09.168995  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:09.209820  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.126:33573
I20260709 12:25:09.210283 21477 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.126:33573 every 8 connection(s)
I20260709 12:25:09.214227 21478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.225274 21478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e: Bootstrap starting.
I20260709 12:25:09.230055 21478 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.234411 21478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e: No bootstrap required, opened a new log
I20260709 12:25:09.236775 21478 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c62880afbaa46fc853dae972bce023e" member_type: VOTER }
I20260709 12:25:09.237192 21478 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.237370 21478 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c62880afbaa46fc853dae972bce023e, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.237931 21478 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c62880afbaa46fc853dae972bce023e" member_type: VOTER }
I20260709 12:25:09.238356 21478 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:09.238545 21478 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:09.238750 21478 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:09.243548 21478 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c62880afbaa46fc853dae972bce023e" member_type: VOTER }
I20260709 12:25:09.244091 21478 leader_election.cc:304] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c62880afbaa46fc853dae972bce023e; no voters: 
I20260709 12:25:09.245190 21478 leader_election.cc:290] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:09.245518 21481 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:09.246840 21481 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e [term 1 LEADER]: Becoming Leader. State: Replica: 7c62880afbaa46fc853dae972bce023e, State: Running, Role: LEADER
I20260709 12:25:09.247531 21481 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c62880afbaa46fc853dae972bce023e" member_type: VOTER }
I20260709 12:25:09.248099 21478 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:09.251641 21482 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7c62880afbaa46fc853dae972bce023e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c62880afbaa46fc853dae972bce023e" member_type: VOTER } }
I20260709 12:25:09.252111 21483 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c62880afbaa46fc853dae972bce023e. Latest consensus state: current_term: 1 leader_uuid: "7c62880afbaa46fc853dae972bce023e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c62880afbaa46fc853dae972bce023e" member_type: VOTER } }
I20260709 12:25:09.252445 21482 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:09.252902 21483 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:09.256721 21487 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:09.264571 21487 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:09.265758  9741 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:09.274185 21487 catalog_manager.cc:1383] Generated new cluster ID: 91bb7e546a084abc887bf2b0f4c0d366
I20260709 12:25:09.274489 21487 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:09.335954 21487 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:09.337754 21487 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:09.350818 21487 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e: Generated new TSK 0
I20260709 12:25:09.351428 21487 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:09.416914  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:09.424798 21500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:09.426054 21501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:09.427762  9741 server_base.cc:1061] running on GCE node
W20260709 12:25:09.427959 21503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:09.430002  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:09.430228  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:09.430397  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599909430379 us; error 0 us; skew 500 ppm
I20260709 12:25:09.430967  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:09.433780  9741 webserver.cc:533] Webserver started at http://127.9.131.65:35975/ using document root <none> and password file <none>
I20260709 12:25:09.434314  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:09.434522  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:09.434849  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:09.436293  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/ts-0-root/instance:
uuid: "ffb77abd008a4b5f90930139e5dca14a"
format_stamp: "Formatted at 2026-07-09 12:25:09 on dist-test-slave-r7s7"
I20260709 12:25:09.441424  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.005s
I20260709 12:25:09.445215 21508 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:09.446033  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:25:09.446357  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/ts-0-root
uuid: "ffb77abd008a4b5f90930139e5dca14a"
format_stamp: "Formatted at 2026-07-09 12:25:09 on dist-test-slave-r7s7"
I20260709 12:25:09.446650  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:09.461970  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:09.463323  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:09.464944  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:09.467628  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:09.467846  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:09.468132  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:09.468294  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:09.510478  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.65:43797
I20260709 12:25:09.510579 21570 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.65:43797 every 8 connection(s)
I20260709 12:25:09.516337  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:09.524104 21575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:09.526403 21576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:09.528007  9741 server_base.cc:1061] running on GCE node
W20260709 12:25:09.528219 21578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:09.529300  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:09.529584  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:09.529793  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599909529776 us; error 0 us; skew 500 ppm
I20260709 12:25:09.530439  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:09.533776  9741 webserver.cc:533] Webserver started at http://127.9.131.66:34305/ using document root <none> and password file <none>
I20260709 12:25:09.533775 21571 heartbeater.cc:344] Connected to a master server at 127.9.131.126:33573
I20260709 12:25:09.534353 21571 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:09.534395  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:09.534735  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:09.535018  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:09.535280 21571 heartbeater.cc:507] Master 127.9.131.126:33573 requested a full tablet report, sending...
I20260709 12:25:09.536449  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/ts-1-root/instance:
uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
format_stamp: "Formatted at 2026-07-09 12:25:09 on dist-test-slave-r7s7"
I20260709 12:25:09.537808 21443 ts_manager.cc:194] Registered new tserver with Master: ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797)
I20260709 12:25:09.539984 21443 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57332
I20260709 12:25:09.541836  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:25:09.545773 21583 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:09.546641  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:25:09.546916  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/ts-1-root
uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
format_stamp: "Formatted at 2026-07-09 12:25:09 on dist-test-slave-r7s7"
I20260709 12:25:09.547179  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:09.563285  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:09.564571  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:09.566042  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:09.568529  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:09.568742  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:09.568971  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:09.569130  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:09.610457  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.66:38981
I20260709 12:25:09.610559 21645 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.66:38981 every 8 connection(s)
I20260709 12:25:09.615696  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:09.622941 21649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:09.625608 21650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:09.628576  9741 server_base.cc:1061] running on GCE node
I20260709 12:25:09.629041 21646 heartbeater.cc:344] Connected to a master server at 127.9.131.126:33573
W20260709 12:25:09.629287 21652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:09.629561 21646 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:09.630290  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:09.630601  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:09.630472 21646 heartbeater.cc:507] Master 127.9.131.126:33573 requested a full tablet report, sending...
I20260709 12:25:09.630875  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599909630856 us; error 0 us; skew 500 ppm
I20260709 12:25:09.631560  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:09.632936 21443 ts_manager.cc:194] Registered new tserver with Master: f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981)
I20260709 12:25:09.634275  9741 webserver.cc:533] Webserver started at http://127.9.131.67:46835/ using document root <none> and password file <none>
I20260709 12:25:09.634764 21443 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57336
I20260709 12:25:09.634842  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:09.635237  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:09.635512  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:09.637391  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/ts-2-root/instance:
uuid: "f962f677972e4a4ab0f9eb083052a1ab"
format_stamp: "Formatted at 2026-07-09 12:25:09 on dist-test-slave-r7s7"
I20260709 12:25:09.642288  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:25:09.645925 21657 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:09.646700  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:25:09.646981  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/ts-2-root
uuid: "f962f677972e4a4ab0f9eb083052a1ab"
format_stamp: "Formatted at 2026-07-09 12:25:09 on dist-test-slave-r7s7"
I20260709 12:25:09.647274  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:09.665140  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:09.666414  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:09.668222  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:09.670603  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:09.670809  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:09.671078  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:09.671231  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:09.713723  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.67:36465
I20260709 12:25:09.713943 21719 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.67:36465 every 8 connection(s)
I20260709 12:25:09.728876 21720 heartbeater.cc:344] Connected to a master server at 127.9.131.126:33573
I20260709 12:25:09.729352 21720 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:09.730294 21720 heartbeater.cc:507] Master 127.9.131.126:33573 requested a full tablet report, sending...
I20260709 12:25:09.732966 21443 ts_manager.cc:194] Registered new tserver with Master: f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:09.733314  9741 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016122599s
I20260709 12:25:09.734643 21443 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57338
I20260709 12:25:09.761428 21443 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57348:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:09.764469 21443 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:09.864914 21611 tablet_service.cc:1511] Processing CreateTablet for tablet a47d3188c0e34a9eb5c5305a2a7974a7 (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:09.865327 21610 tablet_service.cc:1511] Processing CreateTablet for tablet ff34e8501cec4f95b61a5f71c1232420 (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:09.866843 21611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a47d3188c0e34a9eb5c5305a2a7974a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.868273 21609 tablet_service.cc:1511] Processing CreateTablet for tablet 9805ee3b0b9842169c095a6f9145a92f (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:09.869863 21609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9805ee3b0b9842169c095a6f9145a92f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.873172 21608 tablet_service.cc:1511] Processing CreateTablet for tablet 982e043bb9104e98aaacc88810913fa9 (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:09.874292 21535 tablet_service.cc:1511] Processing CreateTablet for tablet ff34e8501cec4f95b61a5f71c1232420 (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:09.874923 21608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982e043bb9104e98aaacc88810913fa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.875982 21535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff34e8501cec4f95b61a5f71c1232420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.877271 21536 tablet_service.cc:1511] Processing CreateTablet for tablet a47d3188c0e34a9eb5c5305a2a7974a7 (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:09.879189 21536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a47d3188c0e34a9eb5c5305a2a7974a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.881141 21607 tablet_service.cc:1511] Processing CreateTablet for tablet a1c788ea1eb1437dba03fabd1d26fb4d (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:09.882726 21607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1c788ea1eb1437dba03fabd1d26fb4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.883162 21533 tablet_service.cc:1511] Processing CreateTablet for tablet 982e043bb9104e98aaacc88810913fa9 (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:09.884727 21533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982e043bb9104e98aaacc88810913fa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.885100 21606 tablet_service.cc:1511] Processing CreateTablet for tablet 0f8690e3310b48c8b1423e5e0fce5d64 (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:09.886835 21606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f8690e3310b48c8b1423e5e0fce5d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.889112 21605 tablet_service.cc:1511] Processing CreateTablet for tablet de2b92c279e6439fb4f68aaa5b0351f3 (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:09.891772 21604 tablet_service.cc:1511] Processing CreateTablet for tablet de19482ce51d4ba5a2588085bd6f2d54 (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:09.894459 21603 tablet_service.cc:1511] Processing CreateTablet for tablet 441470dd550541cf888bdd60da1f1db6 (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:09.898175 21532 tablet_service.cc:1511] Processing CreateTablet for tablet a1c788ea1eb1437dba03fabd1d26fb4d (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:09.899734 21685 tablet_service.cc:1511] Processing CreateTablet for tablet a47d3188c0e34a9eb5c5305a2a7974a7 (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:09.901285 21685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a47d3188c0e34a9eb5c5305a2a7974a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.901085 21530 tablet_service.cc:1511] Processing CreateTablet for tablet de2b92c279e6439fb4f68aaa5b0351f3 (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:09.881193 21534 tablet_service.cc:1511] Processing CreateTablet for tablet 9805ee3b0b9842169c095a6f9145a92f (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:09.903508 21680 tablet_service.cc:1511] Processing CreateTablet for tablet 0f8690e3310b48c8b1423e5e0fce5d64 (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:09.905086 21684 tablet_service.cc:1511] Processing CreateTablet for tablet ff34e8501cec4f95b61a5f71c1232420 (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:09.906424 21679 tablet_service.cc:1511] Processing CreateTablet for tablet de2b92c279e6439fb4f68aaa5b0351f3 (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:09.907568 21683 tablet_service.cc:1511] Processing CreateTablet for tablet 9805ee3b0b9842169c095a6f9145a92f (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:09.909096 21677 tablet_service.cc:1511] Processing CreateTablet for tablet 441470dd550541cf888bdd60da1f1db6 (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:09.910087 21682 tablet_service.cc:1511] Processing CreateTablet for tablet 982e043bb9104e98aaacc88810913fa9 (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:09.911528 21531 tablet_service.cc:1511] Processing CreateTablet for tablet 0f8690e3310b48c8b1423e5e0fce5d64 (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:09.912587 21681 tablet_service.cc:1511] Processing CreateTablet for tablet a1c788ea1eb1437dba03fabd1d26fb4d (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:09.913997 21678 tablet_service.cc:1511] Processing CreateTablet for tablet de19482ce51d4ba5a2588085bd6f2d54 (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:09.899746 21532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1c788ea1eb1437dba03fabd1d26fb4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.898176 21602 tablet_service.cc:1511] Processing CreateTablet for tablet 36e09f17621b4023aad1c84e0d33340f (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:09.916736 21534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9805ee3b0b9842169c095a6f9145a92f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.917609 21530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de2b92c279e6439fb4f68aaa5b0351f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.918280 21605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de2b92c279e6439fb4f68aaa5b0351f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.920284 21531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f8690e3310b48c8b1423e5e0fce5d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.921737 21529 tablet_service.cc:1511] Processing CreateTablet for tablet de19482ce51d4ba5a2588085bd6f2d54 (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:09.922542 21602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36e09f17621b4023aad1c84e0d33340f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.923234 21529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de19482ce51d4ba5a2588085bd6f2d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.904981 21680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f8690e3310b48c8b1423e5e0fce5d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.923877 21604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de19482ce51d4ba5a2588085bd6f2d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.924209 21681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1c788ea1eb1437dba03fabd1d26fb4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.925127 21610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff34e8501cec4f95b61a5f71c1232420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.925380 21682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982e043bb9104e98aaacc88810913fa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.926358 21603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 441470dd550541cf888bdd60da1f1db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.926626 21683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9805ee3b0b9842169c095a6f9145a92f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.927851 21677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 441470dd550541cf888bdd60da1f1db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.929066 21679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de2b92c279e6439fb4f68aaa5b0351f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.929735 21678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de19482ce51d4ba5a2588085bd6f2d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.930853 21684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff34e8501cec4f95b61a5f71c1232420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.976019 21676 tablet_service.cc:1511] Processing CreateTablet for tablet 36e09f17621b4023aad1c84e0d33340f (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:09.977615 21676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36e09f17621b4023aad1c84e0d33340f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.990074 21528 tablet_service.cc:1511] Processing CreateTablet for tablet 441470dd550541cf888bdd60da1f1db6 (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:09.991681 21528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 441470dd550541cf888bdd60da1f1db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.006274 21527 tablet_service.cc:1511] Processing CreateTablet for tablet 36e09f17621b4023aad1c84e0d33340f (DEFAULT_TABLE table=test-workload [id=57a8b5ec13ab4d0ba503e88a6e0f25cd]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:10.008015 21527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36e09f17621b4023aad1c84e0d33340f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:10.044548 21735 tablet_bootstrap.cc:492] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e: Bootstrap starting.
I20260709 12:25:10.143756 21737 tablet_bootstrap.cc:492] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap starting.
I20260709 12:25:10.174836 21735 tablet_bootstrap.cc:654] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.175477 21736 tablet_bootstrap.cc:492] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab: Bootstrap starting.
I20260709 12:25:10.181389 21735 tablet_bootstrap.cc:492] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e: No bootstrap required, opened a new log
I20260709 12:25:10.182036 21735 ts_tablet_manager.cc:1403] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e: Time spent bootstrapping tablet: real 0.138s	user 0.002s	sys 0.013s
I20260709 12:25:10.182503 21736 tablet_bootstrap.cc:654] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.187309 21735 raft_consensus.cc:359] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } } peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } }
I20260709 12:25:10.189399 21735 raft_consensus.cc:385] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.189764 21735 raft_consensus.cc:740] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.190932 21735 consensus_queue.cc:260] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } } peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } }
I20260709 12:25:10.195676 21646 heartbeater.cc:499] Master 127.9.131.126:33573 was elected leader, sending a full tablet report...
I20260709 12:25:10.196349 21736 tablet_bootstrap.cc:492] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab: No bootstrap required, opened a new log
I20260709 12:25:10.196943 21735 ts_tablet_manager.cc:1434] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.007s
I20260709 12:25:10.198098 21735 tablet_bootstrap.cc:492] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e: Bootstrap starting.
I20260709 12:25:10.196964 21736 ts_tablet_manager.cc:1403] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 12:25:10.203094 21736 raft_consensus.cc:359] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.205262 21735 tablet_bootstrap.cc:654] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.209657 21737 tablet_bootstrap.cc:654] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.220395 21736 raft_consensus.cc:385] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.220808 21736 raft_consensus.cc:740] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.221674 21736 consensus_queue.cc:260] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.228343 21736 ts_tablet_manager.cc:1434] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab: Time spent starting tablet: real 0.028s	user 0.012s	sys 0.000s
I20260709 12:25:10.228741 21735 tablet_bootstrap.cc:492] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e: No bootstrap required, opened a new log
I20260709 12:25:10.229128 21720 heartbeater.cc:499] Master 127.9.131.126:33573 was elected leader, sending a full tablet report...
I20260709 12:25:10.228562 21737 tablet_bootstrap.cc:492] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a: No bootstrap required, opened a new log
I20260709 12:25:10.229377 21735 ts_tablet_manager.cc:1403] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.009s
I20260709 12:25:10.229902 21737 ts_tablet_manager.cc:1403] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a: Time spent bootstrapping tablet: real 0.087s	user 0.008s	sys 0.013s
I20260709 12:25:10.232797 21735 raft_consensus.cc:359] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.233637 21735 raft_consensus.cc:385] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.233953 21735 raft_consensus.cc:740] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.234045 21736 tablet_bootstrap.cc:492] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab: Bootstrap starting.
I20260709 12:25:10.234136 21737 raft_consensus.cc:359] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.235329 21737 raft_consensus.cc:385] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.234992 21735 consensus_queue.cc:260] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.235798 21737 raft_consensus.cc:740] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.236922 21737 consensus_queue.cc:260] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.237540 21735 ts_tablet_manager.cc:1434] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:25:10.238797 21735 tablet_bootstrap.cc:492] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e: Bootstrap starting.
I20260709 12:25:10.244952 21736 tablet_bootstrap.cc:654] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.245766 21735 tablet_bootstrap.cc:654] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.256247 21571 heartbeater.cc:499] Master 127.9.131.126:33573 was elected leader, sending a full tablet report...
I20260709 12:25:10.256994 21737 ts_tablet_manager.cc:1434] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a: Time spent starting tablet: real 0.027s	user 0.021s	sys 0.003s
I20260709 12:25:10.258452 21737 tablet_bootstrap.cc:492] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap starting.
I20260709 12:25:10.260218 21735 tablet_bootstrap.cc:492] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e: No bootstrap required, opened a new log
I20260709 12:25:10.260820 21735 ts_tablet_manager.cc:1403] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 12:25:10.264101 21735 raft_consensus.cc:359] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.264906 21735 raft_consensus.cc:385] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.265221 21735 raft_consensus.cc:740] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Initialized, Role: FOLLOWER
W20260709 12:25:10.265758 21572 tablet.cc:2406] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:25:10.266286 21735 consensus_queue.cc:260] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.268087 21737 tablet_bootstrap.cc:654] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.268808 21735 ts_tablet_manager.cc:1434] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:25:10.269884 21735 tablet_bootstrap.cc:492] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e: Bootstrap starting.
W20260709 12:25:10.268177 21491 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:10.276712 21735 tablet_bootstrap.cc:654] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.281194 21737 tablet_bootstrap.cc:492] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a: No bootstrap required, opened a new log
I20260709 12:25:10.281948 21737 ts_tablet_manager.cc:1403] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.005s
I20260709 12:25:10.285728 21737 raft_consensus.cc:359] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } } peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } }
I20260709 12:25:10.286818 21737 raft_consensus.cc:385] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.287214 21737 raft_consensus.cc:740] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.288367 21737 consensus_queue.cc:260] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } } peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } }
I20260709 12:25:10.291293 21737 ts_tablet_manager.cc:1434] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 12:25:10.292588 21737 tablet_bootstrap.cc:492] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap starting.
I20260709 12:25:10.296679 21744 raft_consensus.cc:493] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.297439 21744 raft_consensus.cc:515] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } } peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } }
I20260709 12:25:10.303154 21744 leader_election.cc:290] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:10.307073 21735 tablet_bootstrap.cc:492] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e: No bootstrap required, opened a new log
I20260709 12:25:10.307847 21735 ts_tablet_manager.cc:1403] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.016s
I20260709 12:25:10.309288 21737 tablet_bootstrap.cc:654] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.311360 21735 raft_consensus.cc:359] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.312258 21735 raft_consensus.cc:385] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.312619 21735 raft_consensus.cc:740] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.313763 21735 consensus_queue.cc:260] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.312793 21736 tablet_bootstrap.cc:492] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab: No bootstrap required, opened a new log
I20260709 12:25:10.315027 21736 ts_tablet_manager.cc:1403] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab: Time spent bootstrapping tablet: real 0.081s	user 0.027s	sys 0.036s
I20260709 12:25:10.316380 21735 ts_tablet_manager.cc:1434] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:25:10.317694 21735 tablet_bootstrap.cc:492] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e: Bootstrap starting.
I20260709 12:25:10.325361 21735 tablet_bootstrap.cc:654] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.319686 21736 raft_consensus.cc:359] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.329262 21736 raft_consensus.cc:385] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.329758 21736 raft_consensus.cc:740] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.330766 21736 consensus_queue.cc:260] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.334689 21737 tablet_bootstrap.cc:492] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a: No bootstrap required, opened a new log
I20260709 12:25:10.335376 21737 ts_tablet_manager.cc:1403] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a: Time spent bootstrapping tablet: real 0.043s	user 0.005s	sys 0.019s
I20260709 12:25:10.338893 21695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47d3188c0e34a9eb5c5305a2a7974a7" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab" is_pre_election: true
I20260709 12:25:10.339064 21737 raft_consensus.cc:359] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.340020 21737 raft_consensus.cc:385] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.340363 21737 raft_consensus.cc:740] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.340586 21736 ts_tablet_manager.cc:1434] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
W20260709 12:25:10.341009 21511 leader_election.cc:343] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.341337 21737 consensus_queue.cc:260] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.344779 21735 tablet_bootstrap.cc:492] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e: No bootstrap required, opened a new log
I20260709 12:25:10.345374 21735 ts_tablet_manager.cc:1403] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.009s
I20260709 12:25:10.348347 21621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47d3188c0e34a9eb5c5305a2a7974a7" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" is_pre_election: true
I20260709 12:25:10.349337 21736 tablet_bootstrap.cc:492] T 982e043bb9104e98aaacc88810913fa9 P f962f677972e4a4ab0f9eb083052a1ab: Bootstrap starting.
I20260709 12:25:10.349447 21621 raft_consensus.cc:2468] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffb77abd008a4b5f90930139e5dca14a in term 0.
I20260709 12:25:10.348752 21735 raft_consensus.cc:359] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.350453 21737 ts_tablet_manager.cc:1434] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 12:25:10.350600 21735 raft_consensus.cc:385] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.350940 21735 raft_consensus.cc:740] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.351253 21510 leader_election.cc:304] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, ffb77abd008a4b5f90930139e5dca14a; no voters: f962f677972e4a4ab0f9eb083052a1ab
I20260709 12:25:10.352699 21735 consensus_queue.cc:260] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.351624 21737 tablet_bootstrap.cc:492] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a: Bootstrap starting.
I20260709 12:25:10.353052 21744 raft_consensus.cc:2804] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.354745 21744 raft_consensus.cc:493] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.355108 21744 raft_consensus.cc:3060] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.357555 21736 tablet_bootstrap.cc:654] T 982e043bb9104e98aaacc88810913fa9 P f962f677972e4a4ab0f9eb083052a1ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.357731 21735 ts_tablet_manager.cc:1434] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:25:10.358991 21735 tablet_bootstrap.cc:492] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e: Bootstrap starting.
I20260709 12:25:10.366072 21737 tablet_bootstrap.cc:654] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.367210 21743 raft_consensus.cc:493] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.367671 21735 tablet_bootstrap.cc:654] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.367820 21743 raft_consensus.cc:515] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.383792 21743 leader_election.cc:290] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981)
I20260709 12:25:10.369978 21744 raft_consensus.cc:515] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } } peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } }
I20260709 12:25:10.396152 21744 leader_election.cc:290] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 election: Requested vote from peers f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:10.396325 21735 tablet_bootstrap.cc:492] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e: No bootstrap required, opened a new log
I20260709 12:25:10.396873 21735 ts_tablet_manager.cc:1403] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.018s
I20260709 12:25:10.397854 21695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47d3188c0e34a9eb5c5305a2a7974a7" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
W20260709 12:25:10.399403 21511 leader_election.cc:343] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.401147 21621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47d3188c0e34a9eb5c5305a2a7974a7" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
I20260709 12:25:10.401850 21621 raft_consensus.cc:3060] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.401538 21735 raft_consensus.cc:359] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.402292 21735 raft_consensus.cc:385] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.402582 21735 raft_consensus.cc:740] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.403334 21735 consensus_queue.cc:260] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.409410 21735 ts_tablet_manager.cc:1434] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:25:10.410531 21735 tablet_bootstrap.cc:492] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e: Bootstrap starting.
I20260709 12:25:10.410602 21621 raft_consensus.cc:2468] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffb77abd008a4b5f90930139e5dca14a in term 1.
I20260709 12:25:10.412089 21510 leader_election.cc:304] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, ffb77abd008a4b5f90930139e5dca14a; no voters: f962f677972e4a4ab0f9eb083052a1ab
I20260709 12:25:10.413316 21744 raft_consensus.cc:2804] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:10.414108 21740 raft_consensus.cc:493] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.414698 21740 raft_consensus.cc:515] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.369206 21753 raft_consensus.cc:493] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.415597 21753 raft_consensus.cc:515] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.419562 21620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b92c279e6439fb4f68aaa5b0351f3" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" is_pre_election: true
I20260709 12:25:10.423892 21695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b92c279e6439fb4f68aaa5b0351f3" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab" is_pre_election: true
W20260709 12:25:10.425457 21511 leader_election.cc:343] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.427505 21735 tablet_bootstrap.cc:654] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.427955 21753 leader_election.cc:290] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
W20260709 12:25:10.428618 21510 leader_election.cc:343] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.429632 21510 leader_election.cc:304] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ffb77abd008a4b5f90930139e5dca14a; no voters: f3a50d2d282f42b3ae9718061e4ea56e, f962f677972e4a4ab0f9eb083052a1ab
I20260709 12:25:10.434469 21753 raft_consensus.cc:2749] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:10.436640 21744 raft_consensus.cc:697] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [term 1 LEADER]: Becoming Leader. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Running, Role: LEADER
I20260709 12:25:10.438102 21744 consensus_queue.cc:237] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } } peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } }
I20260709 12:25:10.438599 21761 raft_consensus.cc:493] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.455374 21766 raft_consensus.cc:493] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.456132 21766 raft_consensus.cc:515] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.458755 21766 leader_election.cc:290] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:10.439877 21740 leader_election.cc:290] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:10.446280 21761 raft_consensus.cc:515] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.472582 21761 leader_election.cc:290] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:10.477371 21736 tablet_bootstrap.cc:492] T 982e043bb9104e98aaacc88810913fa9 P f962f677972e4a4ab0f9eb083052a1ab: No bootstrap required, opened a new log
I20260709 12:25:10.480641 21736 ts_tablet_manager.cc:1403] T 982e043bb9104e98aaacc88810913fa9 P f962f677972e4a4ab0f9eb083052a1ab: Time spent bootstrapping tablet: real 0.132s	user 0.016s	sys 0.021s
I20260709 12:25:10.485332 21736 raft_consensus.cc:359] T 982e043bb9104e98aaacc88810913fa9 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.493247 21735 tablet_bootstrap.cc:492] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e: No bootstrap required, opened a new log
I20260709 12:25:10.494262 21546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e09f17621b4023aad1c84e0d33340f" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffb77abd008a4b5f90930139e5dca14a" is_pre_election: true
I20260709 12:25:10.495083 21621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de19482ce51d4ba5a2588085bd6f2d54" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" is_pre_election: true
I20260709 12:25:10.495208 21545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9805ee3b0b9842169c095a6f9145a92f" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffb77abd008a4b5f90930139e5dca14a" is_pre_election: true
I20260709 12:25:10.500605 21735 ts_tablet_manager.cc:1403] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e: Time spent bootstrapping tablet: real 0.090s	user 0.017s	sys 0.050s
W20260709 12:25:10.500533 21587 leader_election.cc:343] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.495471 21544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c788ea1eb1437dba03fabd1d26fb4d" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffb77abd008a4b5f90930139e5dca14a" is_pre_election: true
I20260709 12:25:10.498049 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de19482ce51d4ba5a2588085bd6f2d54" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffb77abd008a4b5f90930139e5dca14a" is_pre_election: true
I20260709 12:25:10.501170 21621 raft_consensus.cc:2468] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 0.
W20260709 12:25:10.502619 21661 leader_election.cc:343] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.498617 21737 tablet_bootstrap.cc:492] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a: No bootstrap required, opened a new log
I20260709 12:25:10.503784 21659 leader_election.cc:304] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, f962f677972e4a4ab0f9eb083052a1ab; no voters: ffb77abd008a4b5f90930139e5dca14a
I20260709 12:25:10.504397 21737 ts_tablet_manager.cc:1403] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a: Time spent bootstrapping tablet: real 0.153s	user 0.037s	sys 0.062s
I20260709 12:25:10.504846 21736 raft_consensus.cc:385] T 982e043bb9104e98aaacc88810913fa9 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.504052 21735 raft_consensus.cc:359] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.505153 21743 raft_consensus.cc:2804] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.505342 21735 raft_consensus.cc:385] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.504555 21443 catalog_manager.cc:5697] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a reported cstate change: term changed from 0 to 1, leader changed from <none> to ffb77abd008a4b5f90930139e5dca14a (127.9.131.65). New cstate: current_term: 1 leader_uuid: "ffb77abd008a4b5f90930139e5dca14a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:10.505735 21735 raft_consensus.cc:740] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.506575 21735 consensus_queue.cc:260] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
W20260709 12:25:10.507071 21587 leader_election.cc:343] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:10.507845 21587 leader_election.cc:343] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.505647 21743 raft_consensus.cc:493] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.508900 21743 raft_consensus.cc:3060] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.508164 21737 raft_consensus.cc:359] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.509516 21737 raft_consensus.cc:385] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.509929 21737 raft_consensus.cc:740] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.510294 21744 raft_consensus.cc:493] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.510846 21744 raft_consensus.cc:515] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.510915 21737 consensus_queue.cc:260] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.513566 21737 ts_tablet_manager.cc:1434] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:25:10.514436 21621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f8690e3310b48c8b1423e5e0fce5d64" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" is_pre_election: true
I20260709 12:25:10.514730 21737 tablet_bootstrap.cc:492] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap starting.
I20260709 12:25:10.509058 21735 ts_tablet_manager.cc:1434] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
W20260709 12:25:10.516173 21510 leader_election.cc:343] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.516342 21735 tablet_bootstrap.cc:492] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e: Bootstrap starting.
I20260709 12:25:10.518594 21695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f8690e3310b48c8b1423e5e0fce5d64" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab" is_pre_election: true
W20260709 12:25:10.520308 21511 leader_election.cc:343] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.520789 21511 leader_election.cc:304] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ffb77abd008a4b5f90930139e5dca14a; no voters: f3a50d2d282f42b3ae9718061e4ea56e, f962f677972e4a4ab0f9eb083052a1ab
I20260709 12:25:10.505204 21736 raft_consensus.cc:740] T 982e043bb9104e98aaacc88810913fa9 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.521736 21753 raft_consensus.cc:2749] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:10.522274 21694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9805ee3b0b9842169c095a6f9145a92f" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab" is_pre_election: true
I20260709 12:25:10.522464 21736 consensus_queue.cc:260] T 982e043bb9104e98aaacc88810913fa9 P f962f677972e4a4ab0f9eb083052a1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.522886 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c788ea1eb1437dba03fabd1d26fb4d" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab" is_pre_election: true
I20260709 12:25:10.523200 21744 leader_election.cc:290] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:10.522756 21737 tablet_bootstrap.cc:654] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.524739 21695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e09f17621b4023aad1c84e0d33340f" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab" is_pre_election: true
I20260709 12:25:10.525481 21695 raft_consensus.cc:2468] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a50d2d282f42b3ae9718061e4ea56e in term 0.
I20260709 12:25:10.531651 21735 tablet_bootstrap.cc:654] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:10.524142 21586 leader_election.cc:343] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.536239 21586 leader_election.cc:304] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e; no voters: f962f677972e4a4ab0f9eb083052a1ab, ffb77abd008a4b5f90930139e5dca14a
I20260709 12:25:10.537441 21761 raft_consensus.cc:2749] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:10.537473 21737 tablet_bootstrap.cc:492] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a: No bootstrap required, opened a new log
W20260709 12:25:10.538276 21586 leader_election.cc:343] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.538671 21737 ts_tablet_manager.cc:1403] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.009s
I20260709 12:25:10.538841 21586 leader_election.cc:304] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e; no voters: f962f677972e4a4ab0f9eb083052a1ab, ffb77abd008a4b5f90930139e5dca14a
I20260709 12:25:10.543308 21737 raft_consensus.cc:359] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.544853 21737 raft_consensus.cc:385] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.544935 21761 raft_consensus.cc:2749] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:10.545358 21737 raft_consensus.cc:740] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.546916 21586 leader_election.cc:304] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, f962f677972e4a4ab0f9eb083052a1ab; no voters: ffb77abd008a4b5f90930139e5dca14a
I20260709 12:25:10.546720 21737 consensus_queue.cc:260] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.547963 21761 raft_consensus.cc:2804] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.548411 21761 raft_consensus.cc:493] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.548786 21761 raft_consensus.cc:3060] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.550601 21737 ts_tablet_manager.cc:1434] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:25:10.550211 21743 raft_consensus.cc:515] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.548709 21744 raft_consensus.cc:493] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.552237 21740 raft_consensus.cc:493] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.552206 21744 raft_consensus.cc:515] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.552865 21737 tablet_bootstrap.cc:492] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap starting.
I20260709 12:25:10.552804 21740 raft_consensus.cc:515] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.554858 21740 leader_election.cc:290] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:10.557053 21545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de19482ce51d4ba5a2588085bd6f2d54" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffb77abd008a4b5f90930139e5dca14a"
I20260709 12:25:10.558238 21544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982e043bb9104e98aaacc88810913fa9" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffb77abd008a4b5f90930139e5dca14a" is_pre_election: true
I20260709 12:25:10.558804 21621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e09f17621b4023aad1c84e0d33340f" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" is_pre_election: true
W20260709 12:25:10.560145 21661 leader_election.cc:343] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.561058 21695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e09f17621b4023aad1c84e0d33340f" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab" is_pre_election: true
W20260709 12:25:10.561686 21587 leader_election.cc:343] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.561691 21695 raft_consensus.cc:2468] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffb77abd008a4b5f90930139e5dca14a in term 0.
I20260709 12:25:10.564924 21511 leader_election.cc:304] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f962f677972e4a4ab0f9eb083052a1ab, ffb77abd008a4b5f90930139e5dca14a; no voters: 
I20260709 12:25:10.566018 21753 raft_consensus.cc:2804] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.566453 21753 raft_consensus.cc:493] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.566802 21753 raft_consensus.cc:3060] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.566689 21737 tablet_bootstrap.cc:654] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.554858 21744 leader_election.cc:290] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:10.577618 21620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de19482ce51d4ba5a2588085bd6f2d54" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
I20260709 12:25:10.578469 21620 raft_consensus.cc:3060] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.584518 21695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982e043bb9104e98aaacc88810913fa9" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab" is_pre_election: true
I20260709 12:25:10.585451 21695 raft_consensus.cc:2468] T 982e043bb9104e98aaacc88810913fa9 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a50d2d282f42b3ae9718061e4ea56e in term 0.
I20260709 12:25:10.587378 21586 leader_election.cc:304] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, f962f677972e4a4ab0f9eb083052a1ab; no voters: ffb77abd008a4b5f90930139e5dca14a
I20260709 12:25:10.587740 21620 raft_consensus.cc:2468] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 1.
I20260709 12:25:10.588447 21740 raft_consensus.cc:2804] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.588939 21740 raft_consensus.cc:493] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.589298 21740 raft_consensus.cc:3060] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.589726 21659 leader_election.cc:304] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, f962f677972e4a4ab0f9eb083052a1ab; no voters: ffb77abd008a4b5f90930139e5dca14a
I20260709 12:25:10.575672 21743 leader_election.cc:290] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 1 election: Requested vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981)
I20260709 12:25:10.600636 21743 raft_consensus.cc:2804] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:10.601256 21743 raft_consensus.cc:697] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 1 LEADER]: Becoming Leader. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Running, Role: LEADER
I20260709 12:25:10.602151 21743 consensus_queue.cc:237] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.603297 21753 raft_consensus.cc:515] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.606478 21761 raft_consensus.cc:515] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.606952 21620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e09f17621b4023aad1c84e0d33340f" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
I20260709 12:25:10.609922 21621 raft_consensus.cc:2393] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ffb77abd008a4b5f90930139e5dca14a in current term 1: Already voted for candidate f3a50d2d282f42b3ae9718061e4ea56e in this term.
I20260709 12:25:10.610550 21695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e09f17621b4023aad1c84e0d33340f" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
I20260709 12:25:10.611214 21695 raft_consensus.cc:3060] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.612107 21735 tablet_bootstrap.cc:492] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e: No bootstrap required, opened a new log
I20260709 12:25:10.612633 21735 ts_tablet_manager.cc:1403] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e: Time spent bootstrapping tablet: real 0.097s	user 0.024s	sys 0.049s
I20260709 12:25:10.615572 21735 raft_consensus.cc:359] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.616231 21735 raft_consensus.cc:385] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.616489 21735 raft_consensus.cc:740] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.616907 21544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e09f17621b4023aad1c84e0d33340f" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffb77abd008a4b5f90930139e5dca14a"
I20260709 12:25:10.617210 21735 consensus_queue.cc:260] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.617749 21544 raft_consensus.cc:2393] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f3a50d2d282f42b3ae9718061e4ea56e in current term 1: Already voted for candidate ffb77abd008a4b5f90930139e5dca14a in this term.
I20260709 12:25:10.618677 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e09f17621b4023aad1c84e0d33340f" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
I20260709 12:25:10.618156 21761 leader_election.cc:290] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 election: Requested vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:10.620440 21753 leader_election.cc:290] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 election: Requested vote from peers f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:10.621230 21740 raft_consensus.cc:515] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.621914 21586 leader_election.cc:304] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e; no voters: f962f677972e4a4ab0f9eb083052a1ab, ffb77abd008a4b5f90930139e5dca14a
I20260709 12:25:10.623844 21735 ts_tablet_manager.cc:1434] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:25:10.625195 21761 raft_consensus.cc:2749] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:10.625653 21735 tablet_bootstrap.cc:492] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e: Bootstrap starting.
I20260709 12:25:10.629490 21740 leader_election.cc:290] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 election: Requested vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:10.630441 21544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982e043bb9104e98aaacc88810913fa9" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffb77abd008a4b5f90930139e5dca14a"
I20260709 12:25:10.631312 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982e043bb9104e98aaacc88810913fa9" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
I20260709 12:25:10.632035 21693 raft_consensus.cc:3060] T 982e043bb9104e98aaacc88810913fa9 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.632426 21735 tablet_bootstrap.cc:654] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.633330 21737 tablet_bootstrap.cc:492] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a: No bootstrap required, opened a new log
I20260709 12:25:10.633895 21737 ts_tablet_manager.cc:1403] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a: Time spent bootstrapping tablet: real 0.081s	user 0.008s	sys 0.022s
I20260709 12:25:10.629433 21695 raft_consensus.cc:2468] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffb77abd008a4b5f90930139e5dca14a in term 1.
I20260709 12:25:10.634085 21736 ts_tablet_manager.cc:1434] T 982e043bb9104e98aaacc88810913fa9 P f962f677972e4a4ab0f9eb083052a1ab: Time spent starting tablet: real 0.152s	user 0.025s	sys 0.014s
W20260709 12:25:10.636310 21587 leader_election.cc:343] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.637214 21737 raft_consensus.cc:359] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.637537 21511 leader_election.cc:304] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f962f677972e4a4ab0f9eb083052a1ab, ffb77abd008a4b5f90930139e5dca14a; no voters: f3a50d2d282f42b3ae9718061e4ea56e
I20260709 12:25:10.637979 21737 raft_consensus.cc:385] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.638314 21737 raft_consensus.cc:740] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.639204 21737 consensus_queue.cc:260] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.640333 21744 raft_consensus.cc:2804] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:10.640830 21744 raft_consensus.cc:697] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [term 1 LEADER]: Becoming Leader. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Running, Role: LEADER
I20260709 12:25:10.641848 21737 ts_tablet_manager.cc:1434] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.007s
I20260709 12:25:10.641700 21744 consensus_queue.cc:237] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.642499 21693 raft_consensus.cc:2468] T 982e043bb9104e98aaacc88810913fa9 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a50d2d282f42b3ae9718061e4ea56e in term 1.
I20260709 12:25:10.642926 21737 tablet_bootstrap.cc:492] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a: Bootstrap starting.
I20260709 12:25:10.643818 21586 leader_election.cc:304] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, f962f677972e4a4ab0f9eb083052a1ab; no voters: ffb77abd008a4b5f90930139e5dca14a
I20260709 12:25:10.645188 21740 raft_consensus.cc:2804] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:10.636353 21736 tablet_bootstrap.cc:492] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab: Bootstrap starting.
I20260709 12:25:10.646400 21740 raft_consensus.cc:697] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 LEADER]: Becoming Leader. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Running, Role: LEADER
I20260709 12:25:10.648869 21740 consensus_queue.cc:237] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.658080 21442 catalog_manager.cc:5697] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab reported cstate change: term changed from 0 to 1, leader changed from <none> to f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67). New cstate: current_term: 1 leader_uuid: "f962f677972e4a4ab0f9eb083052a1ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:10.667565 21737 tablet_bootstrap.cc:654] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.676133 21735 tablet_bootstrap.cc:492] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e: No bootstrap required, opened a new log
I20260709 12:25:10.676690 21735 ts_tablet_manager.cc:1403] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.014s
I20260709 12:25:10.678870 21736 tablet_bootstrap.cc:654] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.684224 21735 raft_consensus.cc:359] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.684954 21735 raft_consensus.cc:385] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.685254 21735 raft_consensus.cc:740] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.686071 21735 consensus_queue.cc:260] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.686476 21737 tablet_bootstrap.cc:492] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a: No bootstrap required, opened a new log
I20260709 12:25:10.687147 21737 ts_tablet_manager.cc:1403] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.004s
I20260709 12:25:10.688458 21735 ts_tablet_manager.cc:1434] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:25:10.689514 21735 tablet_bootstrap.cc:492] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e: Bootstrap starting.
I20260709 12:25:10.689332 21443 catalog_manager.cc:5697] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e reported cstate change: term changed from 0 to 1, leader changed from <none> to f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66). New cstate: current_term: 1 leader_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:10.690788 21744 raft_consensus.cc:493] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.691366 21744 raft_consensus.cc:515] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.694586 21620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff34e8501cec4f95b61a5f71c1232420" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" is_pre_election: true
I20260709 12:25:10.695406 21620 raft_consensus.cc:2468] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffb77abd008a4b5f90930139e5dca14a in term 0.
I20260709 12:25:10.696117 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff34e8501cec4f95b61a5f71c1232420" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab" is_pre_election: true
I20260709 12:25:10.696754 21510 leader_election.cc:304] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, ffb77abd008a4b5f90930139e5dca14a; no voters: 
W20260709 12:25:10.697767 21511 leader_election.cc:343] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.698423 21744 leader_election.cc:290] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:10.697916 21753 raft_consensus.cc:2804] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.699338 21737 raft_consensus.cc:359] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.700129 21753 raft_consensus.cc:493] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.700273 21737 raft_consensus.cc:385] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.700470 21735 tablet_bootstrap.cc:654] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.700662 21753 raft_consensus.cc:3060] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.700860 21737 raft_consensus.cc:740] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.701969 21737 consensus_queue.cc:260] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.704772 21737 ts_tablet_manager.cc:1434] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:25:10.706193 21737 tablet_bootstrap.cc:492] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap starting.
I20260709 12:25:10.710280 21753 raft_consensus.cc:515] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.712158 21735 tablet_bootstrap.cc:492] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e: No bootstrap required, opened a new log
I20260709 12:25:10.712730 21735 ts_tablet_manager.cc:1403] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.009s
I20260709 12:25:10.694572 21442 catalog_manager.cc:5697] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a reported cstate change: term changed from 0 to 1, leader changed from <none> to ffb77abd008a4b5f90930139e5dca14a (127.9.131.65). New cstate: current_term: 1 leader_uuid: "ffb77abd008a4b5f90930139e5dca14a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:10.713708 21737 tablet_bootstrap.cc:654] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.715633 21735 raft_consensus.cc:359] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.716382 21735 raft_consensus.cc:385] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.716670 21735 raft_consensus.cc:740] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.717839 21735 consensus_queue.cc:260] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.722258 21735 ts_tablet_manager.cc:1434] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:25:10.728093 21737 tablet_bootstrap.cc:492] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a: No bootstrap required, opened a new log
I20260709 12:25:10.728883 21737 ts_tablet_manager.cc:1403] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.001s
I20260709 12:25:10.732398 21737 raft_consensus.cc:359] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.733059 21737 raft_consensus.cc:385] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.733291 21737 raft_consensus.cc:740] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.733906 21737 consensus_queue.cc:260] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.736109 21737 ts_tablet_manager.cc:1434] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:10.737128 21737 tablet_bootstrap.cc:492] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a: Bootstrap starting.
I20260709 12:25:10.741736 21737 tablet_bootstrap.cc:654] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.744338 21620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff34e8501cec4f95b61a5f71c1232420" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
I20260709 12:25:10.744661 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff34e8501cec4f95b61a5f71c1232420" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
I20260709 12:25:10.745158 21620 raft_consensus.cc:3060] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:10.746539 21511 leader_election.cc:343] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.747251 21753 leader_election.cc:290] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 election: Requested vote from peers f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:10.748899 21740 raft_consensus.cc:493] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.749588 21740 raft_consensus.cc:515] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.754988 21737 tablet_bootstrap.cc:492] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a: No bootstrap required, opened a new log
I20260709 12:25:10.755582 21737 ts_tablet_manager.cc:1403] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 12:25:10.756791 21740 leader_election.cc:290] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:10.758564 21544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b92c279e6439fb4f68aaa5b0351f3" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffb77abd008a4b5f90930139e5dca14a" is_pre_election: true
I20260709 12:25:10.759302 21544 raft_consensus.cc:2468] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a50d2d282f42b3ae9718061e4ea56e in term 0.
I20260709 12:25:10.760759 21587 leader_election.cc:304] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, ffb77abd008a4b5f90930139e5dca14a; no voters: 
I20260709 12:25:10.760856 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b92c279e6439fb4f68aaa5b0351f3" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab" is_pre_election: true
I20260709 12:25:10.761735 21740 raft_consensus.cc:2804] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.762112 21740 raft_consensus.cc:493] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.762431 21740 raft_consensus.cc:3060] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:10.762518 21586 leader_election.cc:343] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.760762 21620 raft_consensus.cc:2468] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffb77abd008a4b5f90930139e5dca14a in term 1.
I20260709 12:25:10.764698 21510 leader_election.cc:304] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, ffb77abd008a4b5f90930139e5dca14a; no voters: f962f677972e4a4ab0f9eb083052a1ab
I20260709 12:25:10.766759 21753 raft_consensus.cc:2804] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:10.767545 21753 raft_consensus.cc:697] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [term 1 LEADER]: Becoming Leader. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Running, Role: LEADER
I20260709 12:25:10.768474 21753 consensus_queue.cc:237] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.758561 21737 raft_consensus.cc:359] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.772800 21737 raft_consensus.cc:385] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.773068 21737 raft_consensus.cc:740] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.773763 21737 consensus_queue.cc:260] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.774345 21736 tablet_bootstrap.cc:492] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab: No bootstrap required, opened a new log
I20260709 12:25:10.775038 21736 ts_tablet_manager.cc:1403] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab: Time spent bootstrapping tablet: real 0.139s	user 0.048s	sys 0.050s
I20260709 12:25:10.775200 21740 raft_consensus.cc:515] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.778179 21544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b92c279e6439fb4f68aaa5b0351f3" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffb77abd008a4b5f90930139e5dca14a"
I20260709 12:25:10.777781 21440 catalog_manager.cc:5697] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a reported cstate change: term changed from 0 to 1, leader changed from <none> to ffb77abd008a4b5f90930139e5dca14a (127.9.131.65). New cstate: current_term: 1 leader_uuid: "ffb77abd008a4b5f90930139e5dca14a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:10.778384 21736 raft_consensus.cc:359] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.778858 21544 raft_consensus.cc:3060] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.779206 21736 raft_consensus.cc:385] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.779531 21736 raft_consensus.cc:740] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.780350 21736 consensus_queue.cc:260] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.780964 21737 ts_tablet_manager.cc:1434] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 12:25:10.783555 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b92c279e6439fb4f68aaa5b0351f3" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
I20260709 12:25:10.782570 21736 ts_tablet_manager.cc:1434] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:25:10.783083 21740 leader_election.cc:290] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 election: Requested vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:10.785643 21736 tablet_bootstrap.cc:492] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab: Bootstrap starting.
W20260709 12:25:10.785316 21586 leader_election.cc:343] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.784605 21737 tablet_bootstrap.cc:492] T 982e043bb9104e98aaacc88810913fa9 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap starting.
I20260709 12:25:10.788515 21544 raft_consensus.cc:2468] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a50d2d282f42b3ae9718061e4ea56e in term 1.
I20260709 12:25:10.789881 21587 leader_election.cc:304] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, ffb77abd008a4b5f90930139e5dca14a; no voters: f962f677972e4a4ab0f9eb083052a1ab
I20260709 12:25:10.791251 21740 raft_consensus.cc:2804] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:10.792656 21740 raft_consensus.cc:697] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 LEADER]: Becoming Leader. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Running, Role: LEADER
I20260709 12:25:10.793231 21737 tablet_bootstrap.cc:654] T 982e043bb9104e98aaacc88810913fa9 P ffb77abd008a4b5f90930139e5dca14a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.793255 21736 tablet_bootstrap.cc:654] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.793568 21740 consensus_queue.cc:237] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.812145 21443 catalog_manager.cc:5697] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e reported cstate change: term changed from 0 to 1, leader changed from <none> to f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66). New cstate: current_term: 1 leader_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:10.820533 21736 tablet_bootstrap.cc:492] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab: No bootstrap required, opened a new log
I20260709 12:25:10.821168 21736 ts_tablet_manager.cc:1403] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.012s
I20260709 12:25:10.821780 21737 tablet_bootstrap.cc:492] T 982e043bb9104e98aaacc88810913fa9 P ffb77abd008a4b5f90930139e5dca14a: No bootstrap required, opened a new log
I20260709 12:25:10.822321 21737 ts_tablet_manager.cc:1403] T 982e043bb9104e98aaacc88810913fa9 P ffb77abd008a4b5f90930139e5dca14a: Time spent bootstrapping tablet: real 0.038s	user 0.023s	sys 0.010s
I20260709 12:25:10.824262 21736 raft_consensus.cc:359] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.825052 21736 raft_consensus.cc:385] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.825091 21737 raft_consensus.cc:359] T 982e043bb9104e98aaacc88810913fa9 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.825453 21736 raft_consensus.cc:740] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.825852 21737 raft_consensus.cc:385] T 982e043bb9104e98aaacc88810913fa9 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.826133 21737 raft_consensus.cc:740] T 982e043bb9104e98aaacc88810913fa9 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.826332 21736 consensus_queue.cc:260] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.826856 21737 consensus_queue.cc:260] T 982e043bb9104e98aaacc88810913fa9 P ffb77abd008a4b5f90930139e5dca14a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.828722 21736 ts_tablet_manager.cc:1434] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:10.829319 21737 ts_tablet_manager.cc:1434] T 982e043bb9104e98aaacc88810913fa9 P ffb77abd008a4b5f90930139e5dca14a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:25:10.829833 21736 tablet_bootstrap.cc:492] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab: Bootstrap starting.
I20260709 12:25:10.836215 21736 tablet_bootstrap.cc:654] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.836136 21753 raft_consensus.cc:493] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.837890 21753 raft_consensus.cc:515] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.841636 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c788ea1eb1437dba03fabd1d26fb4d" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab" is_pre_election: true
I20260709 12:25:10.842516 21620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c788ea1eb1437dba03fabd1d26fb4d" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" is_pre_election: true
W20260709 12:25:10.843058 21511 leader_election.cc:343] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.843192 21620 raft_consensus.cc:2468] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffb77abd008a4b5f90930139e5dca14a in term 0.
I20260709 12:25:10.843390 21753 leader_election.cc:290] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:10.844436 21510 leader_election.cc:304] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, ffb77abd008a4b5f90930139e5dca14a; no voters: f962f677972e4a4ab0f9eb083052a1ab
I20260709 12:25:10.845120 21753 raft_consensus.cc:2804] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.845430 21753 raft_consensus.cc:493] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.845697 21753 raft_consensus.cc:3060] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.846110 21736 tablet_bootstrap.cc:492] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab: No bootstrap required, opened a new log
I20260709 12:25:10.846556 21736 ts_tablet_manager.cc:1403] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.008s
I20260709 12:25:10.849288 21736 raft_consensus.cc:359] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } } peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } }
I20260709 12:25:10.849936 21736 raft_consensus.cc:385] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.850133 21736 raft_consensus.cc:740] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.850683 21736 consensus_queue.cc:260] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } } peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } }
I20260709 12:25:10.851894 21753 raft_consensus.cc:515] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.852638 21736 ts_tablet_manager.cc:1434] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:25:10.853765 21736 tablet_bootstrap.cc:492] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab: Bootstrap starting.
I20260709 12:25:10.854557 21620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c788ea1eb1437dba03fabd1d26fb4d" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
I20260709 12:25:10.855208 21620 raft_consensus.cc:3060] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.855160 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c788ea1eb1437dba03fabd1d26fb4d" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
W20260709 12:25:10.856951 21511 leader_election.cc:343] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.857543 21753 leader_election.cc:290] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 election: Requested vote from peers f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:10.860008 21736 tablet_bootstrap.cc:654] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.863171 21620 raft_consensus.cc:2468] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffb77abd008a4b5f90930139e5dca14a in term 1.
I20260709 12:25:10.864326 21510 leader_election.cc:304] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, ffb77abd008a4b5f90930139e5dca14a; no voters: f962f677972e4a4ab0f9eb083052a1ab
I20260709 12:25:10.865049 21753 raft_consensus.cc:2804] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:10.865554 21753 raft_consensus.cc:697] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [term 1 LEADER]: Becoming Leader. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Running, Role: LEADER
I20260709 12:25:10.865803 21736 tablet_bootstrap.cc:492] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab: No bootstrap required, opened a new log
I20260709 12:25:10.866328 21736 ts_tablet_manager.cc:1403] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.005s
I20260709 12:25:10.866359 21753 consensus_queue.cc:237] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.869681 21736 raft_consensus.cc:359] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.870545 21736 raft_consensus.cc:385] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.870805 21736 raft_consensus.cc:740] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.871480 21736 consensus_queue.cc:260] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.871886 21774 raft_consensus.cc:493] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.872449 21774 raft_consensus.cc:515] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.874189 21736 ts_tablet_manager.cc:1434] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:10.874665 21774 leader_election.cc:290] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981)
I20260709 12:25:10.875298 21736 tablet_bootstrap.cc:492] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab: Bootstrap starting.
I20260709 12:25:10.876012 21443 catalog_manager.cc:5697] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a reported cstate change: term changed from 0 to 1, leader changed from <none> to ffb77abd008a4b5f90930139e5dca14a (127.9.131.65). New cstate: current_term: 1 leader_uuid: "ffb77abd008a4b5f90930139e5dca14a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:10.880363 21620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff34e8501cec4f95b61a5f71c1232420" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" is_pre_election: true
I20260709 12:25:10.880965 21736 tablet_bootstrap.cc:654] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.881194 21620 raft_consensus.cc:2393] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f962f677972e4a4ab0f9eb083052a1ab in current term 1: Already voted for candidate ffb77abd008a4b5f90930139e5dca14a in this term.
I20260709 12:25:10.880991 21544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff34e8501cec4f95b61a5f71c1232420" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffb77abd008a4b5f90930139e5dca14a" is_pre_election: true
I20260709 12:25:10.882949 21661 leader_election.cc:304] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f962f677972e4a4ab0f9eb083052a1ab; no voters: f3a50d2d282f42b3ae9718061e4ea56e, ffb77abd008a4b5f90930139e5dca14a
I20260709 12:25:10.884166 21743 raft_consensus.cc:493] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.884624 21743 raft_consensus.cc:515] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.886214 21774 raft_consensus.cc:3060] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.886847 21743 leader_election.cc:290] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981)
I20260709 12:25:10.888130 21620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9805ee3b0b9842169c095a6f9145a92f" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" is_pre_election: true
I20260709 12:25:10.888715 21544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9805ee3b0b9842169c095a6f9145a92f" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffb77abd008a4b5f90930139e5dca14a" is_pre_election: true
I20260709 12:25:10.888934 21620 raft_consensus.cc:2468] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 0.
I20260709 12:25:10.889402 21544 raft_consensus.cc:2468] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 0.
I20260709 12:25:10.890348 21659 leader_election.cc:304] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, f962f677972e4a4ab0f9eb083052a1ab; no voters: 
I20260709 12:25:10.891323 21743 raft_consensus.cc:2804] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.891780 21743 raft_consensus.cc:493] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.892201 21743 raft_consensus.cc:3060] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.902879 21744 raft_consensus.cc:493] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.903561 21744 raft_consensus.cc:515] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.907310 21693 raft_consensus.cc:3060] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.915041 21744 leader_election.cc:290] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:10.916280 21621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de19482ce51d4ba5a2588085bd6f2d54" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" is_pre_election: true
I20260709 12:25:10.917157 21736 tablet_bootstrap.cc:492] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab: No bootstrap required, opened a new log
I20260709 12:25:10.917184 21774 raft_consensus.cc:2749] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:10.916435 21695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de19482ce51d4ba5a2588085bd6f2d54" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab" is_pre_election: true
I20260709 12:25:10.919096 21736 ts_tablet_manager.cc:1403] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab: Time spent bootstrapping tablet: real 0.044s	user 0.027s	sys 0.016s
I20260709 12:25:10.919091 21621 raft_consensus.cc:2393] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ffb77abd008a4b5f90930139e5dca14a in current term 1: Already voted for candidate f962f677972e4a4ab0f9eb083052a1ab in this term.
I20260709 12:25:10.922364 21511 leader_election.cc:304] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ffb77abd008a4b5f90930139e5dca14a; no voters: f3a50d2d282f42b3ae9718061e4ea56e, f962f677972e4a4ab0f9eb083052a1ab
I20260709 12:25:10.922652 21736 raft_consensus.cc:359] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.923524 21736 raft_consensus.cc:385] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.923852 21736 raft_consensus.cc:740] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.923703 21744 raft_consensus.cc:3060] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.924088 21743 raft_consensus.cc:515] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.924961 21736 consensus_queue.cc:260] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.926373 21743 leader_election.cc:290] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 1 election: Requested vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981)
I20260709 12:25:10.927214 21544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9805ee3b0b9842169c095a6f9145a92f" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffb77abd008a4b5f90930139e5dca14a"
I20260709 12:25:10.927847 21544 raft_consensus.cc:3060] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.928261 21736 ts_tablet_manager.cc:1434] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:10.928553 21753 consensus_queue.cc:1048] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:10.930003 21753 raft_consensus.cc:493] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.930542 21753 raft_consensus.cc:515] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.931746 21736 tablet_bootstrap.cc:492] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab: Bootstrap starting.
I20260709 12:25:10.932238 21621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9805ee3b0b9842169c095a6f9145a92f" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
I20260709 12:25:10.932898 21621 raft_consensus.cc:3060] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.935078 21744 raft_consensus.cc:2749] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:10.938512 21753 leader_election.cc:290] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:10.938750 21736 tablet_bootstrap.cc:654] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.939816 21695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441470dd550541cf888bdd60da1f1db6" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab" is_pre_election: true
I20260709 12:25:10.940764 21695 raft_consensus.cc:2468] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffb77abd008a4b5f90930139e5dca14a in term 0.
I20260709 12:25:10.939810 21620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441470dd550541cf888bdd60da1f1db6" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" is_pre_election: true
I20260709 12:25:10.942020 21620 raft_consensus.cc:2468] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffb77abd008a4b5f90930139e5dca14a in term 0.
I20260709 12:25:10.943296 21510 leader_election.cc:304] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, ffb77abd008a4b5f90930139e5dca14a; no voters: 
I20260709 12:25:10.944741 21621 raft_consensus.cc:2468] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 1.
I20260709 12:25:10.946164 21659 leader_election.cc:304] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, f962f677972e4a4ab0f9eb083052a1ab; no voters: 
I20260709 12:25:10.947257 21743 raft_consensus.cc:2804] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:10.948028 21743 raft_consensus.cc:697] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 1 LEADER]: Becoming Leader. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Running, Role: LEADER
I20260709 12:25:10.947424 21744 raft_consensus.cc:2804] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.948589 21744 raft_consensus.cc:493] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.949270 21744 raft_consensus.cc:3060] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.949044 21743 consensus_queue.cc:237] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.952317 21753 consensus_queue.cc:1048] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:10.947184 21544 raft_consensus.cc:2468] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 1.
I20260709 12:25:10.962430 21736 tablet_bootstrap.cc:492] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab: No bootstrap required, opened a new log
I20260709 12:25:10.963128 21736 ts_tablet_manager.cc:1403] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.013s
I20260709 12:25:10.962518 21744 raft_consensus.cc:515] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.966017 21736 raft_consensus.cc:359] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.966799 21736 raft_consensus.cc:385] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.967080 21736 raft_consensus.cc:740] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.967443 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441470dd550541cf888bdd60da1f1db6" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
I20260709 12:25:10.967324 21619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441470dd550541cf888bdd60da1f1db6" candidate_uuid: "ffb77abd008a4b5f90930139e5dca14a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
I20260709 12:25:10.968246 21693 raft_consensus.cc:3060] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.967831 21736 consensus_queue.cc:260] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.968353 21619 raft_consensus.cc:3060] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.970266 21736 ts_tablet_manager.cc:1434] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.004s
I20260709 12:25:10.971304 21736 tablet_bootstrap.cc:492] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab: Bootstrap starting.
I20260709 12:25:10.979135 21736 tablet_bootstrap.cc:654] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.979490 21774 raft_consensus.cc:493] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.980139 21774 raft_consensus.cc:515] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:10.983248 21544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f8690e3310b48c8b1423e5e0fce5d64" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffb77abd008a4b5f90930139e5dca14a" is_pre_election: true
I20260709 12:25:10.983994 21544 raft_consensus.cc:2468] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 0.
I20260709 12:25:10.984197 21774 leader_election.cc:290] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981)
I20260709 12:25:10.983835 21620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f8690e3310b48c8b1423e5e0fce5d64" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" is_pre_election: true
I20260709 12:25:10.985564 21620 raft_consensus.cc:2468] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 0.
I20260709 12:25:10.985642 21661 leader_election.cc:304] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f962f677972e4a4ab0f9eb083052a1ab, ffb77abd008a4b5f90930139e5dca14a; no voters: 
I20260709 12:25:10.986761 21774 raft_consensus.cc:2804] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.987167 21774 raft_consensus.cc:493] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.987531 21774 raft_consensus.cc:3060] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.988493 21744 leader_election.cc:290] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 election: Requested vote from peers f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:11.005988 21619 raft_consensus.cc:2468] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffb77abd008a4b5f90930139e5dca14a in term 1.
I20260709 12:25:11.007678 21510 leader_election.cc:304] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, ffb77abd008a4b5f90930139e5dca14a; no voters: 
I20260709 12:25:11.011175 21753 raft_consensus.cc:2804] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:11.019426 21443 catalog_manager.cc:5697] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab reported cstate change: term changed from 0 to 1, leader changed from <none> to f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67). New cstate: current_term: 1 leader_uuid: "f962f677972e4a4ab0f9eb083052a1ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:11.028000 21693 raft_consensus.cc:2468] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffb77abd008a4b5f90930139e5dca14a in term 1.
I20260709 12:25:11.028540 21774 raft_consensus.cc:515] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:11.029857 21743 consensus_queue.cc:1048] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:11.033456 21619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f8690e3310b48c8b1423e5e0fce5d64" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
I20260709 12:25:11.034191 21619 raft_consensus.cc:3060] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.034698 21544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f8690e3310b48c8b1423e5e0fce5d64" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffb77abd008a4b5f90930139e5dca14a"
I20260709 12:25:11.035398 21544 raft_consensus.cc:3060] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.042487 21619 raft_consensus.cc:2468] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 1.
I20260709 12:25:11.043936 21659 leader_election.cc:304] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, f962f677972e4a4ab0f9eb083052a1ab; no voters: 
I20260709 12:25:11.044874 21774 leader_election.cc:290] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 1 election: Requested vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981)
I20260709 12:25:11.045516 21774 raft_consensus.cc:2804] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:11.045980 21774 raft_consensus.cc:697] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [term 1 LEADER]: Becoming Leader. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Running, Role: LEADER
I20260709 12:25:11.046728 21744 consensus_queue.cc:1048] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:11.046878 21774 consensus_queue.cc:237] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:11.053509 21743 raft_consensus.cc:493] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.054826 21743 raft_consensus.cc:515] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:11.057898 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c788ea1eb1437dba03fabd1d26fb4d" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffb77abd008a4b5f90930139e5dca14a" is_pre_election: true
I20260709 12:25:11.060366 21743 leader_election.cc:290] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981)
I20260709 12:25:11.061985 21620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c788ea1eb1437dba03fabd1d26fb4d" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" is_pre_election: true
I20260709 12:25:11.062584 21744 consensus_queue.cc:1048] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:11.063277 21620 raft_consensus.cc:2393] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f962f677972e4a4ab0f9eb083052a1ab in current term 1: Already voted for candidate ffb77abd008a4b5f90930139e5dca14a in this term.
I20260709 12:25:11.064769 21659 leader_election.cc:304] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f962f677972e4a4ab0f9eb083052a1ab; no voters: f3a50d2d282f42b3ae9718061e4ea56e, ffb77abd008a4b5f90930139e5dca14a
I20260709 12:25:11.066236 21743 raft_consensus.cc:3060] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.091975 21753 raft_consensus.cc:697] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [term 1 LEADER]: Becoming Leader. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Running, Role: LEADER
I20260709 12:25:11.098390 21736 tablet_bootstrap.cc:492] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab: No bootstrap required, opened a new log
I20260709 12:25:11.099115 21736 ts_tablet_manager.cc:1403] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab: Time spent bootstrapping tablet: real 0.128s	user 0.028s	sys 0.022s
I20260709 12:25:11.100842 21544 raft_consensus.cc:2468] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 1.
I20260709 12:25:11.102128 21736 raft_consensus.cc:359] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:11.102883 21736 raft_consensus.cc:385] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:11.103156 21736 raft_consensus.cc:740] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Initialized, Role: FOLLOWER
I20260709 12:25:11.104143 21736 consensus_queue.cc:260] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:11.106161 21736 ts_tablet_manager.cc:1434] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:11.113930 21743 raft_consensus.cc:2749] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:11.106273 21769 consensus_queue.cc:1048] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:25:11.112835 21740 consensus_queue.cc:1048] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:25:11.104710 21753 consensus_queue.cc:237] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:11.135627 21544 raft_consensus.cc:3060] T 982e043bb9104e98aaacc88810913fa9 P ffb77abd008a4b5f90930139e5dca14a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.115127 21442 catalog_manager.cc:5697] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab reported cstate change: term changed from 0 to 1, leader changed from <none> to f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67). New cstate: current_term: 1 leader_uuid: "f962f677972e4a4ab0f9eb083052a1ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:11.155040 21740 consensus_queue.cc:1048] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:11.163919 21441 catalog_manager.cc:5697] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a reported cstate change: term changed from 0 to 1, leader changed from <none> to ffb77abd008a4b5f90930139e5dca14a (127.9.131.65). New cstate: current_term: 1 leader_uuid: "ffb77abd008a4b5f90930139e5dca14a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:11.184616 21769 raft_consensus.cc:493] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.185209 21769 raft_consensus.cc:515] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:11.187531 21769 leader_election.cc:290] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981)
I20260709 12:25:11.189077 21544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b92c279e6439fb4f68aaa5b0351f3" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffb77abd008a4b5f90930139e5dca14a" is_pre_election: true
I20260709 12:25:11.189956 21544 raft_consensus.cc:2393] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f962f677972e4a4ab0f9eb083052a1ab in current term 1: Already voted for candidate f3a50d2d282f42b3ae9718061e4ea56e in this term.
I20260709 12:25:11.191293 21621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b92c279e6439fb4f68aaa5b0351f3" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" is_pre_election: true
I20260709 12:25:11.192565 21659 leader_election.cc:304] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f962f677972e4a4ab0f9eb083052a1ab; no voters: f3a50d2d282f42b3ae9718061e4ea56e, ffb77abd008a4b5f90930139e5dca14a
I20260709 12:25:11.193306 21743 raft_consensus.cc:3060] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:11.200089 21743 raft_consensus.cc:2749] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:11.253822  9741 ts_manager.cc:295] Set tserver state for ffb77abd008a4b5f90930139e5dca14a to MAINTENANCE_MODE
I20260709 12:25:11.254660  9741 tablet_server.cc:179] TabletServer@127.9.131.65:0 shutting down...
I20260709 12:25:11.261255 21753 consensus_queue.cc:1048] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:11.275722 21744 consensus_queue.cc:1048] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:11.276772 21491 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:11.292853  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:11.295161  9741 tablet_replica.cc:333] T 982e043bb9104e98aaacc88810913fa9 P ffb77abd008a4b5f90930139e5dca14a: stopping tablet replica
I20260709 12:25:11.296062  9741 raft_consensus.cc:2243] T 982e043bb9104e98aaacc88810913fa9 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:11.296638  9741 raft_consensus.cc:2272] T 982e043bb9104e98aaacc88810913fa9 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:11.299633  9741 tablet_replica.cc:333] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a: stopping tablet replica
I20260709 12:25:11.300271  9741 raft_consensus.cc:2243] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:11.300678  9741 raft_consensus.cc:2272] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:11.302676  9741 tablet_replica.cc:333] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a: stopping tablet replica
I20260709 12:25:11.303243  9741 raft_consensus.cc:2243] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:11.303658  9741 raft_consensus.cc:2272] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:11.306047  9741 tablet_replica.cc:333] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a: stopping tablet replica
I20260709 12:25:11.306666  9741 raft_consensus.cc:2243] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:11.307550  9741 raft_consensus.cc:2272] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:11.309736  9741 tablet_replica.cc:333] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a: stopping tablet replica
I20260709 12:25:11.310448  9741 raft_consensus.cc:2243] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:11.311177  9741 raft_consensus.cc:2272] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:11.313297  9741 tablet_replica.cc:333] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a: stopping tablet replica
I20260709 12:25:11.313800  9741 raft_consensus.cc:2243] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:11.314345  9741 pending_rounds.cc:70] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a: Trying to abort 1 pending ops.
I20260709 12:25:11.314495  9741 pending_rounds.cc:77] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305625234517598208 op_type: NO_OP noop_request { }
I20260709 12:25:11.314738  9741 raft_consensus.cc:2889] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:11.314949  9741 raft_consensus.cc:2272] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:11.317230  9741 tablet_replica.cc:333] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a: stopping tablet replica
I20260709 12:25:11.317955  9741 raft_consensus.cc:2243] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:11.318396  9741 raft_consensus.cc:2272] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:11.320250  9741 tablet_replica.cc:333] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a: stopping tablet replica
I20260709 12:25:11.320780  9741 raft_consensus.cc:2243] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:11.321553  9741 raft_consensus.cc:2272] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:11.323773  9741 tablet_replica.cc:333] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a: stopping tablet replica
I20260709 12:25:11.324358  9741 raft_consensus.cc:2243] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:11.324920  9741 pending_rounds.cc:70] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a: Trying to abort 1 pending ops.
I20260709 12:25:11.325073  9741 pending_rounds.cc:77] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305625236003782656 op_type: NO_OP noop_request { }
I20260709 12:25:11.325309  9741 raft_consensus.cc:2889] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:11.325539  9741 raft_consensus.cc:2272] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:11.327597  9741 tablet_replica.cc:333] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a: stopping tablet replica
I20260709 12:25:11.328133  9741 raft_consensus.cc:2243] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:11.328508  9741 raft_consensus.cc:2272] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:11.357013  9741 tablet_server.cc:196] TabletServer@127.9.131.65:0 shutdown complete.
W20260709 12:25:11.363101 21587 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111) [suppressed 79 similar messages]
W20260709 12:25:11.366654 21587 consensus_peers.cc:597] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:11.405604 21740 consensus_queue.cc:1048] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:11.490008 21661 consensus_peers.cc:597] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:11.515050 21743 consensus_queue.cc:1048] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:11.528844 21661 consensus_peers.cc:597] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:11.578238 21769 consensus_queue.cc:1048] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:11.624222 21661 consensus_peers.cc:597] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:11.705832 21587 consensus_peers.cc:597] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:12.277755 21491 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:12.433842 21824 raft_consensus.cc:493] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.434515 21824 raft_consensus.cc:515] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:12.436393 21824 leader_election.cc:290] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981)
I20260709 12:25:12.437512 21619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff34e8501cec4f95b61a5f71c1232420" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" is_pre_election: true
I20260709 12:25:12.438254 21619 raft_consensus.cc:2468] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 1.
I20260709 12:25:12.439406 21659 leader_election.cc:304] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, f962f677972e4a4ab0f9eb083052a1ab; no voters: 
W20260709 12:25:12.440024 21661 leader_election.cc:336] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111)
I20260709 12:25:12.440166 21824 raft_consensus.cc:2804] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:12.440631 21824 raft_consensus.cc:493] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.440888 21824 raft_consensus.cc:3060] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.446157 21824 raft_consensus.cc:515] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:12.447950 21824 leader_election.cc:290] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 2 election: Requested vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981)
I20260709 12:25:12.449069 21619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff34e8501cec4f95b61a5f71c1232420" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
I20260709 12:25:12.449781 21619 raft_consensus.cc:3060] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:12.451644 21661 leader_election.cc:336] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111)
I20260709 12:25:12.455392 21619 raft_consensus.cc:2468] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 2.
I20260709 12:25:12.456629 21659 leader_election.cc:304] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, f962f677972e4a4ab0f9eb083052a1ab; no voters: ffb77abd008a4b5f90930139e5dca14a
I20260709 12:25:12.457383 21824 raft_consensus.cc:2804] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:12.457798 21824 raft_consensus.cc:697] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 2 LEADER]: Becoming Leader. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Running, Role: LEADER
I20260709 12:25:12.458647 21824 consensus_queue.cc:237] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:12.466068 21442 catalog_manager.cc:5697] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab reported cstate change: term changed from 1 to 2, leader changed from ffb77abd008a4b5f90930139e5dca14a (127.9.131.65) to f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67). New cstate: current_term: 2 leader_uuid: "f962f677972e4a4ab0f9eb083052a1ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:12.500458 21824 raft_consensus.cc:493] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ffb77abd008a4b5f90930139e5dca14a)
I20260709 12:25:12.500946 21824 raft_consensus.cc:515] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } } peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } }
I20260709 12:25:12.502681 21824 leader_election.cc:290] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981), ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797)
I20260709 12:25:12.503630 21619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47d3188c0e34a9eb5c5305a2a7974a7" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" is_pre_election: true
W20260709 12:25:12.506357 21661 leader_election.cc:336] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111)
I20260709 12:25:12.506713 21661 leader_election.cc:304] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f962f677972e4a4ab0f9eb083052a1ab; no voters: f3a50d2d282f42b3ae9718061e4ea56e, ffb77abd008a4b5f90930139e5dca14a
I20260709 12:25:12.507316 21824 raft_consensus.cc:2749] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:12.515726 21826 raft_consensus.cc:493] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ffb77abd008a4b5f90930139e5dca14a)
I20260709 12:25:12.516384 21826 raft_consensus.cc:515] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } } peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } }
I20260709 12:25:12.518172 21826 leader_election.cc:290] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465), ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797)
I20260709 12:25:12.518919 21694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47d3188c0e34a9eb5c5305a2a7974a7" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab" is_pre_election: true
I20260709 12:25:12.519534 21694 raft_consensus.cc:2468] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a50d2d282f42b3ae9718061e4ea56e in term 1.
I20260709 12:25:12.520586 21586 leader_election.cc:304] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, f962f677972e4a4ab0f9eb083052a1ab; no voters: 
I20260709 12:25:12.521225 21826 raft_consensus.cc:2804] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:12.521517 21826 raft_consensus.cc:493] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ffb77abd008a4b5f90930139e5dca14a)
I20260709 12:25:12.521795 21826 raft_consensus.cc:3060] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:12.521864 21587 leader_election.cc:336] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111)
I20260709 12:25:12.527284 21826 raft_consensus.cc:515] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } } peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } }
I20260709 12:25:12.529091 21826 leader_election.cc:290] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 election: Requested vote from peers f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465), ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797)
I20260709 12:25:12.529814 21694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47d3188c0e34a9eb5c5305a2a7974a7" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
I20260709 12:25:12.530314 21694 raft_consensus.cc:3060] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:12.532860 21587 leader_election.cc:336] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111)
I20260709 12:25:12.535915 21694 raft_consensus.cc:2468] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a50d2d282f42b3ae9718061e4ea56e in term 2.
I20260709 12:25:12.537005 21586 leader_election.cc:304] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, f962f677972e4a4ab0f9eb083052a1ab; no voters: ffb77abd008a4b5f90930139e5dca14a
I20260709 12:25:12.537735 21826 raft_consensus.cc:2804] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:12.538170 21826 raft_consensus.cc:697] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Becoming Leader. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Running, Role: LEADER
I20260709 12:25:12.538898 21826 consensus_queue.cc:237] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } } peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } }
I20260709 12:25:12.545825 21442 catalog_manager.cc:5697] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e reported cstate change: term changed from 1 to 2, leader changed from ffb77abd008a4b5f90930139e5dca14a (127.9.131.65) to f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66). New cstate: current_term: 2 leader_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.609222 21824 raft_consensus.cc:493] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ffb77abd008a4b5f90930139e5dca14a)
I20260709 12:25:12.609757 21824 raft_consensus.cc:515] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:12.611259 21824 leader_election.cc:290] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981)
I20260709 12:25:12.612397 21619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e09f17621b4023aad1c84e0d33340f" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" is_pre_election: true
W20260709 12:25:12.615022 21661 leader_election.cc:336] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111)
I20260709 12:25:12.615406 21661 leader_election.cc:304] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f962f677972e4a4ab0f9eb083052a1ab; no voters: f3a50d2d282f42b3ae9718061e4ea56e, ffb77abd008a4b5f90930139e5dca14a
I20260709 12:25:12.616014 21824 raft_consensus.cc:2749] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:12.637269 21826 raft_consensus.cc:493] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ffb77abd008a4b5f90930139e5dca14a)
I20260709 12:25:12.637854 21826 raft_consensus.cc:515] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:12.639966 21826 leader_election.cc:290] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:12.641081 21694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e09f17621b4023aad1c84e0d33340f" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab" is_pre_election: true
I20260709 12:25:12.641726 21694 raft_consensus.cc:2468] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a50d2d282f42b3ae9718061e4ea56e in term 1.
I20260709 12:25:12.642709 21586 leader_election.cc:304] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, f962f677972e4a4ab0f9eb083052a1ab; no voters: 
W20260709 12:25:12.643227 21587 leader_election.cc:336] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111)
I20260709 12:25:12.643407 21826 raft_consensus.cc:2804] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:12.643844 21826 raft_consensus.cc:493] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ffb77abd008a4b5f90930139e5dca14a)
I20260709 12:25:12.644176 21826 raft_consensus.cc:3060] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.652057 21826 raft_consensus.cc:515] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:12.654574 21826 leader_election.cc:290] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 election: Requested vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:12.655689 21694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e09f17621b4023aad1c84e0d33340f" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
I20260709 12:25:12.656391 21694 raft_consensus.cc:3060] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:12.657838 21587 leader_election.cc:336] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111)
I20260709 12:25:12.661970 21694 raft_consensus.cc:2468] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a50d2d282f42b3ae9718061e4ea56e in term 2.
I20260709 12:25:12.663118 21586 leader_election.cc:304] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, f962f677972e4a4ab0f9eb083052a1ab; no voters: ffb77abd008a4b5f90930139e5dca14a
I20260709 12:25:12.663816 21826 raft_consensus.cc:2804] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:12.664281 21826 raft_consensus.cc:697] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Becoming Leader. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Running, Role: LEADER
I20260709 12:25:12.664980 21826 consensus_queue.cc:237] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:12.672667 21442 catalog_manager.cc:5697] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e reported cstate change: term changed from 1 to 2, leader changed from ffb77abd008a4b5f90930139e5dca14a (127.9.131.65) to f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66). New cstate: current_term: 2 leader_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.775408 21824 raft_consensus.cc:493] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ffb77abd008a4b5f90930139e5dca14a)
I20260709 12:25:12.776011 21824 raft_consensus.cc:515] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:12.777637 21824 leader_election.cc:290] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981)
I20260709 12:25:12.778808 21619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c788ea1eb1437dba03fabd1d26fb4d" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" is_pre_election: true
I20260709 12:25:12.779948 21826 raft_consensus.cc:493] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ffb77abd008a4b5f90930139e5dca14a)
I20260709 12:25:12.780431 21826 raft_consensus.cc:515] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
W20260709 12:25:12.781426 21661 leader_election.cc:336] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111)
I20260709 12:25:12.781864 21661 leader_election.cc:304] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f962f677972e4a4ab0f9eb083052a1ab; no voters: f3a50d2d282f42b3ae9718061e4ea56e, ffb77abd008a4b5f90930139e5dca14a
I20260709 12:25:12.782193 21826 leader_election.cc:290] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:12.782686 21824 raft_consensus.cc:2749] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:12.784557 21694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c788ea1eb1437dba03fabd1d26fb4d" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab" is_pre_election: true
I20260709 12:25:12.785172 21694 raft_consensus.cc:2468] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a50d2d282f42b3ae9718061e4ea56e in term 1.
W20260709 12:25:12.785794 21587 leader_election.cc:336] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111)
I20260709 12:25:12.786412 21586 leader_election.cc:304] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, f962f677972e4a4ab0f9eb083052a1ab; no voters: ffb77abd008a4b5f90930139e5dca14a
I20260709 12:25:12.787062 21826 raft_consensus.cc:2804] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:12.787357 21826 raft_consensus.cc:493] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ffb77abd008a4b5f90930139e5dca14a)
I20260709 12:25:12.787587 21826 raft_consensus.cc:3060] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.792843 21826 raft_consensus.cc:515] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:12.794543 21826 leader_election.cc:290] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 election: Requested vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:12.795679 21694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c788ea1eb1437dba03fabd1d26fb4d" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
I20260709 12:25:12.796377 21694 raft_consensus.cc:3060] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:12.798334 21587 leader_election.cc:336] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111)
I20260709 12:25:12.801561 21694 raft_consensus.cc:2468] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a50d2d282f42b3ae9718061e4ea56e in term 2.
I20260709 12:25:12.802656 21586 leader_election.cc:304] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, f962f677972e4a4ab0f9eb083052a1ab; no voters: ffb77abd008a4b5f90930139e5dca14a
I20260709 12:25:12.803318 21826 raft_consensus.cc:2804] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:12.803740 21826 raft_consensus.cc:697] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Becoming Leader. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Running, Role: LEADER
I20260709 12:25:12.804473 21826 consensus_queue.cc:237] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:12.811681 21442 catalog_manager.cc:5697] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e reported cstate change: term changed from 1 to 2, leader changed from ffb77abd008a4b5f90930139e5dca14a (127.9.131.65) to f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66). New cstate: current_term: 2 leader_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.834352 21826 raft_consensus.cc:493] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.834903 21826 raft_consensus.cc:515] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:12.836822 21826 leader_election.cc:290] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:12.837918 21694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441470dd550541cf888bdd60da1f1db6" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab" is_pre_election: true
I20260709 12:25:12.838685 21694 raft_consensus.cc:2468] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a50d2d282f42b3ae9718061e4ea56e in term 1.
I20260709 12:25:12.839639 21586 leader_election.cc:304] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, f962f677972e4a4ab0f9eb083052a1ab; no voters: 
I20260709 12:25:12.840382 21826 raft_consensus.cc:2804] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:25:12.840442 21587 leader_election.cc:336] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111)
I20260709 12:25:12.840721 21826 raft_consensus.cc:493] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.841028 21826 raft_consensus.cc:3060] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.846159 21826 raft_consensus.cc:515] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:12.847762 21826 leader_election.cc:290] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 election: Requested vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:12.848909 21694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441470dd550541cf888bdd60da1f1db6" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
I20260709 12:25:12.849547 21694 raft_consensus.cc:3060] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:12.852006 21587 leader_election.cc:336] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111)
I20260709 12:25:12.855515 21694 raft_consensus.cc:2468] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a50d2d282f42b3ae9718061e4ea56e in term 2.
I20260709 12:25:12.856685 21586 leader_election.cc:304] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, f962f677972e4a4ab0f9eb083052a1ab; no voters: ffb77abd008a4b5f90930139e5dca14a
I20260709 12:25:12.857405 21826 raft_consensus.cc:2804] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:12.857862 21826 raft_consensus.cc:697] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Becoming Leader. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Running, Role: LEADER
I20260709 12:25:12.858647 21826 consensus_queue.cc:237] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:12.865726 21442 catalog_manager.cc:5697] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e reported cstate change: term changed from 1 to 2, leader changed from ffb77abd008a4b5f90930139e5dca14a (127.9.131.65) to f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66). New cstate: current_term: 2 leader_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.934326 21619 raft_consensus.cc:1275] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Refusing update from remote peer f962f677972e4a4ab0f9eb083052a1ab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:25:12.935791 21824 consensus_queue.cc:1048] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:12.950085 21661 consensus_peers.cc:597] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:13.066255 21694 raft_consensus.cc:1275] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Refusing update from remote peer f3a50d2d282f42b3ae9718061e4ea56e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:13.067754 21826 consensus_queue.cc:1048] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:13.081406 21587 consensus_peers.cc:597] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:13.160676 21587 consensus_peers.cc:597] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:13.212232 21587 consensus_peers.cc:597] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:13.255765 21694 raft_consensus.cc:1275] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Refusing update from remote peer f3a50d2d282f42b3ae9718061e4ea56e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:13.257203 21840 consensus_queue.cc:1048] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:13.269997 21694 raft_consensus.cc:1275] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Refusing update from remote peer f3a50d2d282f42b3ae9718061e4ea56e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:13.271361 21840 consensus_queue.cc:1048] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:13.278710 21491 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:25:13.369921 21587 consensus_peers.cc:597] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:13.395205 21694 raft_consensus.cc:1275] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Refusing update from remote peer f3a50d2d282f42b3ae9718061e4ea56e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:25:13.396787 21826 consensus_queue.cc:1048] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:13.617184 21587 consensus_peers.cc:597] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:13.912067 21661 consensus_peers.cc:597] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:14.052713 21661 consensus_peers.cc:597] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:14.064930 21587 consensus_peers.cc:597] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:14.280025 21491 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:25:14.316550 21661 consensus_peers.cc:597] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:15.281073 21491 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:25:15.369972 21587 consensus_peers.cc:597] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:15.484267 21587 consensus_peers.cc:597] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:15.664095 21661 consensus_peers.cc:597] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:15.785159 21587 consensus_peers.cc:597] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:16.022991 21587 consensus_peers.cc:597] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:16.276504 21587 consensus_peers.cc:597] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:16.282053 21491 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:16.378103  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:16.384438 21847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:16.386016 21850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:16.385954 21848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:16.388808  9741 server_base.cc:1061] running on GCE node
I20260709 12:25:16.391050  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:16.391261  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:16.391402  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599916391389 us; error 0 us; skew 500 ppm
I20260709 12:25:16.391934  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:16.394342  9741 webserver.cc:533] Webserver started at http://127.9.131.65:35975/ using document root <none> and password file <none>
I20260709 12:25:16.394804  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:16.394946  9741 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 12:25:16.398617 21587 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111) [suppressed 96 similar messages]
I20260709 12:25:16.401264  9741 fs_manager.cc:714] Time spent opening directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:25:16.405182 21855 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:16.405964  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:25:16.406262  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/ts-0-root
uuid: "ffb77abd008a4b5f90930139e5dca14a"
format_stamp: "Formatted at 2026-07-09 12:25:09 on dist-test-slave-r7s7"
I20260709 12:25:16.406553  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599527842218-9741-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:25:16.421586 21587 consensus_peers.cc:597] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:16.425668  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:16.426819  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:16.428251  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:16.432374 21862 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 12:25:16.449437 21661 consensus_peers.cc:597] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:16.488925  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:25:16.489305  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.058s	user 0.000s	sys 0.003s
I20260709 12:25:16.489568  9741 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:25:16.494406 21862 tablet_bootstrap.cc:492] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap starting.
I20260709 12:25:16.507151 21862 tablet_bootstrap.cc:492] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:16.508028 21862 tablet_bootstrap.cc:492] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap complete.
I20260709 12:25:16.508625 21862 ts_tablet_manager.cc:1403] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 12:25:16.510809 21862 raft_consensus.cc:359] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:16.511411 21862 raft_consensus.cc:740] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.512085 21862 consensus_queue.cc:260] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:16.514356 21862 ts_tablet_manager.cc:1434] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:25:16.515100 21862 tablet_bootstrap.cc:492] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap starting.
I20260709 12:25:16.527321 21862 tablet_bootstrap.cc:492] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:16.528151 21862 tablet_bootstrap.cc:492] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap complete.
I20260709 12:25:16.528702 21862 ts_tablet_manager.cc:1403] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 12:25:16.530897  9741 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:25:16.530750 21862 raft_consensus.cc:359] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } } peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } }
I20260709 12:25:16.531194  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.042s	user 0.038s	sys 0.001s
I20260709 12:25:16.531335 21862 raft_consensus.cc:740] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.532145 21862 consensus_queue.cc:260] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } } peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } }
I20260709 12:25:16.533854 21862 ts_tablet_manager.cc:1434] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:16.534549 21862 tablet_bootstrap.cc:492] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a: Bootstrap starting.
I20260709 12:25:16.550836 21862 tablet_bootstrap.cc:492] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:16.551983 21862 tablet_bootstrap.cc:492] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a: Bootstrap complete.
I20260709 12:25:16.552784 21862 ts_tablet_manager.cc:1403] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 12:25:16.555744 21862 raft_consensus.cc:359] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:16.556551 21862 raft_consensus.cc:740] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.557422 21862 consensus_queue.cc:260] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:16.559502 21862 ts_tablet_manager.cc:1434] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:16.560479 21862 tablet_bootstrap.cc:492] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap starting.
I20260709 12:25:16.574824 21862 tablet_bootstrap.cc:492] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:25:16.576421 21862 tablet_bootstrap.cc:492] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap complete.
I20260709 12:25:16.576984 21862 ts_tablet_manager.cc:1403] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 12:25:16.578759 21862 raft_consensus.cc:359] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:16.579511 21862 raft_consensus.cc:740] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.580327 21862 consensus_queue.cc:260] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:16.581890 21862 ts_tablet_manager.cc:1434] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:16.582617 21862 tablet_bootstrap.cc:492] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap starting.
I20260709 12:25:16.585687  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.65:43797
I20260709 12:25:16.585805 21923 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.65:43797 every 8 connection(s)
I20260709 12:25:16.591831  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:16.596403 21862 tablet_bootstrap.cc:492] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:16.597384 21862 tablet_bootstrap.cc:492] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap complete.
I20260709 12:25:16.598124 21862 ts_tablet_manager.cc:1403] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:25:16.600665 21862 raft_consensus.cc:359] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:16.601370 21862 raft_consensus.cc:740] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.602097 21862 consensus_queue.cc:260] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:16.603665 21862 ts_tablet_manager.cc:1434] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:16.604357 21862 tablet_bootstrap.cc:492] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap starting.
I20260709 12:25:16.612512 21924 heartbeater.cc:344] Connected to a master server at 127.9.131.126:33573
I20260709 12:25:16.613025 21924 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:16.614009 21924 heartbeater.cc:507] Master 127.9.131.126:33573 requested a full tablet report, sending...
I20260709 12:25:16.618250 21862 tablet_bootstrap.cc:492] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:16.619835 21862 tablet_bootstrap.cc:492] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap complete.
I20260709 12:25:16.620649 21862 ts_tablet_manager.cc:1403] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:25:16.621450 21442 ts_manager.cc:194] Re-registered known tserver with Master: ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797)
I20260709 12:25:16.623250 21862 raft_consensus.cc:359] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:16.624074 21862 raft_consensus.cc:740] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.625159 21862 consensus_queue.cc:260] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:16.625403 21619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "441470dd550541cf888bdd60da1f1db6"
dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
mode: GRACEFUL
new_leader_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
 from {username='slave'} at 127.0.0.1:50404
I20260709 12:25:16.626783 21619 raft_consensus.cc:606] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Received request to transfer leadership to TS f962f677972e4a4ab0f9eb083052a1ab
I20260709 12:25:16.627709 21862 ts_tablet_manager.cc:1434] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:16.628679 21862 tablet_bootstrap.cc:492] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap starting.
I20260709 12:25:16.629863 21619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a47d3188c0e34a9eb5c5305a2a7974a7"
dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
mode: GRACEFUL
new_leader_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
 from {username='slave'} at 127.0.0.1:50404
I20260709 12:25:16.630535 21619 raft_consensus.cc:606] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Received request to transfer leadership to TS f962f677972e4a4ab0f9eb083052a1ab
I20260709 12:25:16.632117  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:16.632782  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:16.633545  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:16.636457 21442 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39226
I20260709 12:25:16.639752 21924 heartbeater.cc:499] Master 127.9.131.126:33573 was elected leader, sending a full tablet report...
W20260709 12:25:16.648715 21661 consensus_peers.cc:597] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:16.654206 21862 tablet_bootstrap.cc:492] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:25:16.655359 21862 tablet_bootstrap.cc:492] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap complete.
I20260709 12:25:16.655537 21898 raft_consensus.cc:3060] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.656057 21862 ts_tablet_manager.cc:1403] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.003s
I20260709 12:25:16.658762 21862 raft_consensus.cc:359] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:16.659598 21862 raft_consensus.cc:740] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.660307 21862 consensus_queue.cc:260] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:16.662245 21862 ts_tablet_manager.cc:1434] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:25:16.663116 21862 tablet_bootstrap.cc:492] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a: Bootstrap starting.
I20260709 12:25:16.663708 21898 pending_rounds.cc:85] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a: Aborting all ops after (but not including) 0
I20260709 12:25:16.664116 21898 pending_rounds.cc:107] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:25:16.664407 21898 raft_consensus.cc:2889] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:16.677815 21862 tablet_bootstrap.cc:492] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:16.678762 21862 tablet_bootstrap.cc:492] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a: Bootstrap complete.
I20260709 12:25:16.679323 21862 ts_tablet_manager.cc:1403] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.001s
I20260709 12:25:16.681085 21862 raft_consensus.cc:359] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:16.681607 21862 raft_consensus.cc:740] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.682209 21862 consensus_queue.cc:260] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:16.683733 21862 ts_tablet_manager.cc:1434] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20260709 12:25:16.684525 21862 tablet_bootstrap.cc:492] T 982e043bb9104e98aaacc88810913fa9 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap starting.
I20260709 12:25:16.696063 21862 tablet_bootstrap.cc:492] T 982e043bb9104e98aaacc88810913fa9 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:16.696774 21862 tablet_bootstrap.cc:492] T 982e043bb9104e98aaacc88810913fa9 P ffb77abd008a4b5f90930139e5dca14a: Bootstrap complete.
I20260709 12:25:16.697327 21862 ts_tablet_manager.cc:1403] T 982e043bb9104e98aaacc88810913fa9 P ffb77abd008a4b5f90930139e5dca14a: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:25:16.699196 21862 raft_consensus.cc:359] T 982e043bb9104e98aaacc88810913fa9 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:16.699689 21862 raft_consensus.cc:740] T 982e043bb9104e98aaacc88810913fa9 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.700342 21862 consensus_queue.cc:260] T 982e043bb9104e98aaacc88810913fa9 P ffb77abd008a4b5f90930139e5dca14a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:16.701730 21898 raft_consensus.cc:3060] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.702049 21862 ts_tablet_manager.cc:1434] T 982e043bb9104e98aaacc88810913fa9 P ffb77abd008a4b5f90930139e5dca14a: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:25:16.703207 21862 tablet_bootstrap.cc:492] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a: Bootstrap starting.
I20260709 12:25:16.719079 21862 tablet_bootstrap.cc:492] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:16.719952 21862 tablet_bootstrap.cc:492] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a: Bootstrap complete.
I20260709 12:25:16.720505 21862 ts_tablet_manager.cc:1403] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 12:25:16.722319 21862 raft_consensus.cc:359] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:16.722874 21862 raft_consensus.cc:740] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb77abd008a4b5f90930139e5dca14a, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.723490 21862 consensus_queue.cc:260] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:16.724928 21862 ts_tablet_manager.cc:1434] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:25:16.858090 21846 raft_consensus.cc:993] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e: : Instructing follower f962f677972e4a4ab0f9eb083052a1ab to start an election
I20260709 12:25:16.858551 21942 raft_consensus.cc:1081] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Signalling peer f962f677972e4a4ab0f9eb083052a1ab to start an election
I20260709 12:25:16.860163 21693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a47d3188c0e34a9eb5c5305a2a7974a7"
dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
 from {username='slave'} at 127.0.0.1:51998
I20260709 12:25:16.860803 21693 raft_consensus.cc:493] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:16.861140 21693 raft_consensus.cc:3060] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:16.866541 21693 raft_consensus.cc:515] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } } peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } }
I20260709 12:25:16.868454 21693 leader_election.cc:290] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 3 election: Requested vote from peers f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981), ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797)
I20260709 12:25:16.869293 21619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47d3188c0e34a9eb5c5305a2a7974a7" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
I20260709 12:25:16.869520 21898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47d3188c0e34a9eb5c5305a2a7974a7" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ffb77abd008a4b5f90930139e5dca14a"
I20260709 12:25:16.869992 21619 raft_consensus.cc:3055] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:16.870170 21898 raft_consensus.cc:3060] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:25:16.870328 21619 raft_consensus.cc:740] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Running, Role: LEADER
I20260709 12:25:16.871229 21619 consensus_queue.cc:260] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } } peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } }
I20260709 12:25:16.872453 21619 raft_consensus.cc:3060] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:16.875710 21898 raft_consensus.cc:2468] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 3.
I20260709 12:25:16.877061 21661 leader_election.cc:304] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f962f677972e4a4ab0f9eb083052a1ab, ffb77abd008a4b5f90930139e5dca14a; no voters: 
I20260709 12:25:16.878072 21824 raft_consensus.cc:2804] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:16.878104 21619 raft_consensus.cc:2468] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 3.
I20260709 12:25:16.879498 21824 raft_consensus.cc:697] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [term 3 LEADER]: Becoming Leader. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Running, Role: LEADER
I20260709 12:25:16.880362 21824 consensus_queue.cc:237] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } } peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } }
I20260709 12:25:16.887265 21442 catalog_manager.cc:5697] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab reported cstate change: term changed from 2 to 3, leader changed from f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66) to f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67). New cstate: current_term: 3 leader_uuid: "f962f677972e4a4ab0f9eb083052a1ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.012944 21898 raft_consensus.cc:3060] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:17.037405 21846 raft_consensus.cc:993] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e: : Instructing follower f962f677972e4a4ab0f9eb083052a1ab to start an election
I20260709 12:25:17.037823 21942 raft_consensus.cc:1081] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Signalling peer f962f677972e4a4ab0f9eb083052a1ab to start an election
I20260709 12:25:17.039158 21693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "441470dd550541cf888bdd60da1f1db6"
dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
 from {username='slave'} at 127.0.0.1:51998
I20260709 12:25:17.039608 21693 raft_consensus.cc:493] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:17.039947 21693 raft_consensus.cc:3060] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:17.045543 21693 raft_consensus.cc:515] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:17.047441 21693 leader_election.cc:290] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 3 election: Requested vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981)
I20260709 12:25:17.048218 21898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441470dd550541cf888bdd60da1f1db6" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ffb77abd008a4b5f90930139e5dca14a"
I20260709 12:25:17.048452 21619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441470dd550541cf888bdd60da1f1db6" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
I20260709 12:25:17.048920 21898 raft_consensus.cc:3060] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:17.049062 21619 raft_consensus.cc:3055] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:17.049495 21619 raft_consensus.cc:740] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Running, Role: LEADER
I20260709 12:25:17.050243 21619 consensus_queue.cc:260] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:17.051281 21619 raft_consensus.cc:3060] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:17.055946 21898 raft_consensus.cc:2468] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 3.
I20260709 12:25:17.056373 21619 raft_consensus.cc:2468] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 3.
I20260709 12:25:17.057117 21661 leader_election.cc:304] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f962f677972e4a4ab0f9eb083052a1ab, ffb77abd008a4b5f90930139e5dca14a; no voters: 
I20260709 12:25:17.057803 21824 raft_consensus.cc:2804] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:17.058224 21824 raft_consensus.cc:697] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab [term 3 LEADER]: Becoming Leader. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Running, Role: LEADER
I20260709 12:25:17.058945 21824 consensus_queue.cc:237] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:17.067407 21442 catalog_manager.cc:5697] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab reported cstate change: term changed from 2 to 3, leader changed from f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66) to f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67). New cstate: current_term: 3 leader_uuid: "f962f677972e4a4ab0f9eb083052a1ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:17.080052 21898 raft_consensus.cc:3060] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:17.085664 21898 pending_rounds.cc:85] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a: Aborting all ops after (but not including) 0
I20260709 12:25:17.085881 21898 pending_rounds.cc:107] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:25:17.086053 21898 raft_consensus.cc:2889] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:17.282953 21491 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:17.343724 21898 raft_consensus.cc:1275] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Refusing update from remote peer f962f677972e4a4ab0f9eb083052a1ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:17.345137 21824 consensus_queue.cc:1048] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:17.359818 21619 raft_consensus.cc:1275] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [term 3 FOLLOWER]: Refusing update from remote peer f962f677972e4a4ab0f9eb083052a1ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:17.361264 21943 consensus_queue.cc:1048] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:17.461699 21898 raft_consensus.cc:1275] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Refusing update from remote peer f962f677972e4a4ab0f9eb083052a1ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:17.462845 21943 consensus_queue.cc:1048] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:17.473439 21619 raft_consensus.cc:1275] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [term 3 FOLLOWER]: Refusing update from remote peer f962f677972e4a4ab0f9eb083052a1ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:17.475214 21960 consensus_queue.cc:1048] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:17.648579  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:17.666260 21693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de19482ce51d4ba5a2588085bd6f2d54"
dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
mode: GRACEFUL
new_leader_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
 from {username='slave'} at 127.0.0.1:59732
I20260709 12:25:17.666891 21693 raft_consensus.cc:606] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 1 LEADER]: Received request to transfer leadership to TS f3a50d2d282f42b3ae9718061e4ea56e
I20260709 12:25:17.669950 21693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff34e8501cec4f95b61a5f71c1232420"
dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
mode: GRACEFUL
new_leader_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
 from {username='slave'} at 127.0.0.1:59732
I20260709 12:25:17.670490 21693 raft_consensus.cc:606] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 2 LEADER]: Received request to transfer leadership to TS f3a50d2d282f42b3ae9718061e4ea56e
I20260709 12:25:17.671554  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:17.672112  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:17.672699  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:17.686185 21824 raft_consensus.cc:993] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab: : Instructing follower f3a50d2d282f42b3ae9718061e4ea56e to start an election
I20260709 12:25:17.686808 21943 raft_consensus.cc:1081] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 1 LEADER]: Signalling peer f3a50d2d282f42b3ae9718061e4ea56e to start an election
I20260709 12:25:17.688607 21619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de19482ce51d4ba5a2588085bd6f2d54"
dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
 from {username='slave'} at 127.0.0.1:38634
I20260709 12:25:17.689232 21619 raft_consensus.cc:493] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:17.689615 21619 raft_consensus.cc:3060] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:17.695034 21619 raft_consensus.cc:515] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:17.696645 21619 leader_election.cc:290] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 election: Requested vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:17.697525 21898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de19482ce51d4ba5a2588085bd6f2d54" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ffb77abd008a4b5f90930139e5dca14a"
I20260709 12:25:17.697885 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de19482ce51d4ba5a2588085bd6f2d54" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
I20260709 12:25:17.698230 21898 raft_consensus.cc:3060] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:17.698506 21693 raft_consensus.cc:3055] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:17.698835 21693 raft_consensus.cc:740] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Running, Role: LEADER
I20260709 12:25:17.699656 21693 consensus_queue.cc:260] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:17.700999 21693 raft_consensus.cc:3060] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:17.705955 21898 raft_consensus.cc:2468] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a50d2d282f42b3ae9718061e4ea56e in term 2.
I20260709 12:25:17.707286 21587 leader_election.cc:304] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, ffb77abd008a4b5f90930139e5dca14a; no voters: 
I20260709 12:25:17.708058 21846 raft_consensus.cc:2804] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:17.708041 21693 raft_consensus.cc:2468] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a50d2d282f42b3ae9718061e4ea56e in term 2.
I20260709 12:25:17.708794 21846 raft_consensus.cc:697] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Becoming Leader. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Running, Role: LEADER
I20260709 12:25:17.709631 21846 consensus_queue.cc:237] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:17.716879 21441 catalog_manager.cc:5697] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e reported cstate change: term changed from 1 to 2, leader changed from f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67) to f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66). New cstate: current_term: 2 leader_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.774567 21824 raft_consensus.cc:993] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab: : Instructing follower f3a50d2d282f42b3ae9718061e4ea56e to start an election
I20260709 12:25:17.775017 21943 raft_consensus.cc:1081] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 2 LEADER]: Signalling peer f3a50d2d282f42b3ae9718061e4ea56e to start an election
I20260709 12:25:17.776531 21619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff34e8501cec4f95b61a5f71c1232420"
dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
 from {username='slave'} at 127.0.0.1:38634
I20260709 12:25:17.777050 21619 raft_consensus.cc:493] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:17.777347 21619 raft_consensus.cc:3060] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:17.782459 21619 raft_consensus.cc:515] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:17.784003 21619 leader_election.cc:290] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 3 election: Requested vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:17.784874 21898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff34e8501cec4f95b61a5f71c1232420" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ffb77abd008a4b5f90930139e5dca14a"
I20260709 12:25:17.785174 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff34e8501cec4f95b61a5f71c1232420" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
I20260709 12:25:17.785521 21898 raft_consensus.cc:3060] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:17.785758 21693 raft_consensus.cc:3055] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:17.786091 21693 raft_consensus.cc:740] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Running, Role: LEADER
I20260709 12:25:17.786741 21693 consensus_queue.cc:260] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:17.787699 21693 raft_consensus.cc:3060] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:17.790894 21898 raft_consensus.cc:2468] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a50d2d282f42b3ae9718061e4ea56e in term 3.
I20260709 12:25:17.792057 21587 leader_election.cc:304] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, ffb77abd008a4b5f90930139e5dca14a; no voters: 
I20260709 12:25:17.792714 21846 raft_consensus.cc:2804] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:17.793102 21846 raft_consensus.cc:697] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [term 3 LEADER]: Becoming Leader. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Running, Role: LEADER
I20260709 12:25:17.793275 21693 raft_consensus.cc:2468] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a50d2d282f42b3ae9718061e4ea56e in term 3.
I20260709 12:25:17.793820 21846 consensus_queue.cc:237] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:17.800781 21441 catalog_manager.cc:5697] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e reported cstate change: term changed from 2 to 3, leader changed from f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67) to f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66). New cstate: current_term: 3 leader_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:18.113917 21898 raft_consensus.cc:1275] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a [term 2 FOLLOWER]: Refusing update from remote peer f3a50d2d282f42b3ae9718061e4ea56e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:18.115741 21846 consensus_queue.cc:1048] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:18.126255 21693 raft_consensus.cc:1275] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Refusing update from remote peer f3a50d2d282f42b3ae9718061e4ea56e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:18.127883 21846 consensus_queue.cc:1048] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:18.229399 21898 raft_consensus.cc:1275] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Refusing update from remote peer f3a50d2d282f42b3ae9718061e4ea56e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:18.230715 21846 consensus_queue.cc:1048] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:18.241225 21693 raft_consensus.cc:1275] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 3 FOLLOWER]: Refusing update from remote peer f3a50d2d282f42b3ae9718061e4ea56e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:18.242808 21846 consensus_queue.cc:1048] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:18.284034 21491 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:18.679159  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:18.686779 21619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1c788ea1eb1437dba03fabd1d26fb4d"
dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
mode: GRACEFUL
new_leader_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
 from {username='slave'} at 127.0.0.1:50404
I20260709 12:25:18.687330 21619 raft_consensus.cc:606] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Received request to transfer leadership to TS f962f677972e4a4ab0f9eb083052a1ab
I20260709 12:25:18.689859 21619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de2b92c279e6439fb4f68aaa5b0351f3"
dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
mode: GRACEFUL
new_leader_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
 from {username='slave'} at 127.0.0.1:50404
I20260709 12:25:18.690318 21619 raft_consensus.cc:606] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 LEADER]: Received request to transfer leadership to TS f962f677972e4a4ab0f9eb083052a1ab
I20260709 12:25:18.691315  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:18.691813  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:18.692495  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:18.716355 21976 raft_consensus.cc:993] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e: : Instructing follower f962f677972e4a4ab0f9eb083052a1ab to start an election
I20260709 12:25:18.716881 21846 raft_consensus.cc:1081] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 LEADER]: Signalling peer f962f677972e4a4ab0f9eb083052a1ab to start an election
I20260709 12:25:18.718492 21693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de2b92c279e6439fb4f68aaa5b0351f3"
dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
 from {username='slave'} at 127.0.0.1:51998
I20260709 12:25:18.719030 21693 raft_consensus.cc:493] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:18.719296 21693 raft_consensus.cc:3060] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:18.725783 21693 raft_consensus.cc:515] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:18.727559 21693 leader_election.cc:290] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 2 election: Requested vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981)
I20260709 12:25:18.728344 21898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b92c279e6439fb4f68aaa5b0351f3" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ffb77abd008a4b5f90930139e5dca14a"
I20260709 12:25:18.728590 21619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b92c279e6439fb4f68aaa5b0351f3" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
I20260709 12:25:18.729040 21898 raft_consensus.cc:3060] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:18.729110 21619 raft_consensus.cc:3055] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:18.729480 21619 raft_consensus.cc:740] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Running, Role: LEADER
I20260709 12:25:18.730067 21619 consensus_queue.cc:260] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:18.730929 21619 raft_consensus.cc:3060] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:18.734519 21898 raft_consensus.cc:2468] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 2.
I20260709 12:25:18.735631 21619 raft_consensus.cc:2468] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 2.
I20260709 12:25:18.735713 21661 leader_election.cc:304] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f962f677972e4a4ab0f9eb083052a1ab, ffb77abd008a4b5f90930139e5dca14a; no voters: 
I20260709 12:25:18.736634 21824 raft_consensus.cc:2804] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:18.737639 21824 raft_consensus.cc:697] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab [term 2 LEADER]: Becoming Leader. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Running, Role: LEADER
I20260709 12:25:18.738441 21824 consensus_queue.cc:237] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:18.745754 21441 catalog_manager.cc:5697] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab reported cstate change: term changed from 1 to 2, leader changed from f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66) to f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67). New cstate: current_term: 2 leader_uuid: "f962f677972e4a4ab0f9eb083052a1ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:18.928958 21976 raft_consensus.cc:993] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e: : Instructing follower f962f677972e4a4ab0f9eb083052a1ab to start an election
I20260709 12:25:18.929385 21976 raft_consensus.cc:1081] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Signalling peer f962f677972e4a4ab0f9eb083052a1ab to start an election
I20260709 12:25:18.930902 21693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1c788ea1eb1437dba03fabd1d26fb4d"
dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
 from {username='slave'} at 127.0.0.1:51998
I20260709 12:25:18.931386 21693 raft_consensus.cc:493] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:18.931699 21693 raft_consensus.cc:3060] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:18.937085 21693 raft_consensus.cc:515] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:18.938802 21693 leader_election.cc:290] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 3 election: Requested vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981)
I20260709 12:25:18.939745 21619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c788ea1eb1437dba03fabd1d26fb4d" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
I20260709 12:25:18.939667 21898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c788ea1eb1437dba03fabd1d26fb4d" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ffb77abd008a4b5f90930139e5dca14a"
I20260709 12:25:18.940500 21619 raft_consensus.cc:3055] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:18.940574 21898 raft_consensus.cc:3060] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:18.940878 21619 raft_consensus.cc:740] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Running, Role: LEADER
I20260709 12:25:18.941702 21619 consensus_queue.cc:260] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:18.942868 21619 raft_consensus.cc:3060] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:18.948163 21898 raft_consensus.cc:2468] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 3.
I20260709 12:25:18.949524 21661 leader_election.cc:304] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f962f677972e4a4ab0f9eb083052a1ab, ffb77abd008a4b5f90930139e5dca14a; no voters: 
I20260709 12:25:18.949811 21619 raft_consensus.cc:2468] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 3.
I20260709 12:25:18.950409 21824 raft_consensus.cc:2804] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:18.950860 21824 raft_consensus.cc:697] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [term 3 LEADER]: Becoming Leader. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Running, Role: LEADER
I20260709 12:25:18.951646 21824 consensus_queue.cc:237] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:18.958524 21441 catalog_manager.cc:5697] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab reported cstate change: term changed from 2 to 3, leader changed from f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66) to f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67). New cstate: current_term: 3 leader_uuid: "f962f677972e4a4ab0f9eb083052a1ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.268993 21898 raft_consensus.cc:1275] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [term 2 FOLLOWER]: Refusing update from remote peer f962f677972e4a4ab0f9eb083052a1ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:19.270129 21978 consensus_queue.cc:1048] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:19.279875 21619 raft_consensus.cc:1275] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Refusing update from remote peer f962f677972e4a4ab0f9eb083052a1ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:19.281497 21987 consensus_queue.cc:1048] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:19.285032 21491 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:19.453006 21898 raft_consensus.cc:1275] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Refusing update from remote peer f962f677972e4a4ab0f9eb083052a1ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:19.454558 21987 consensus_queue.cc:1048] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:19.467821 21619 raft_consensus.cc:1275] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 3 FOLLOWER]: Refusing update from remote peer f962f677972e4a4ab0f9eb083052a1ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:19.469827 21987 consensus_queue.cc:1048] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:19.700047  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:19.710806 21693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f8690e3310b48c8b1423e5e0fce5d64"
dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
mode: GRACEFUL
new_leader_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
 from {username='slave'} at 127.0.0.1:59732
I20260709 12:25:19.711489 21693 raft_consensus.cc:606] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [term 1 LEADER]: Received request to transfer leadership to TS f3a50d2d282f42b3ae9718061e4ea56e
I20260709 12:25:19.714542 21693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9805ee3b0b9842169c095a6f9145a92f"
dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
mode: GRACEFUL
new_leader_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
 from {username='slave'} at 127.0.0.1:59732
I20260709 12:25:19.715090 21693 raft_consensus.cc:606] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 1 LEADER]: Received request to transfer leadership to TS f3a50d2d282f42b3ae9718061e4ea56e
I20260709 12:25:19.716343  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:19.716832  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:19.717535  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:20.077111 21987 raft_consensus.cc:993] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab: : Instructing follower f3a50d2d282f42b3ae9718061e4ea56e to start an election
I20260709 12:25:20.077656 21978 raft_consensus.cc:1081] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 1 LEADER]: Signalling peer f3a50d2d282f42b3ae9718061e4ea56e to start an election
I20260709 12:25:20.079465 21619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9805ee3b0b9842169c095a6f9145a92f"
dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
 from {username='slave'} at 127.0.0.1:38634
I20260709 12:25:20.080034 21619 raft_consensus.cc:493] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:20.080348 21619 raft_consensus.cc:3060] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:20.087939 21619 raft_consensus.cc:515] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:20.089983 21619 leader_election.cc:290] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 election: Requested vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:20.091130 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9805ee3b0b9842169c095a6f9145a92f" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
I20260709 12:25:20.091179 21898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9805ee3b0b9842169c095a6f9145a92f" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ffb77abd008a4b5f90930139e5dca14a"
I20260709 12:25:20.091967 21693 raft_consensus.cc:3055] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:20.092015 21898 raft_consensus.cc:3060] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:20.092291 21693 raft_consensus.cc:740] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Running, Role: LEADER
I20260709 12:25:20.093497 21693 consensus_queue.cc:260] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:20.094841 21693 raft_consensus.cc:3060] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:20.100147 21898 raft_consensus.cc:2468] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a50d2d282f42b3ae9718061e4ea56e in term 2.
I20260709 12:25:20.101842 21587 leader_election.cc:304] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, ffb77abd008a4b5f90930139e5dca14a; no voters: 
I20260709 12:25:20.102664 21976 raft_consensus.cc:2804] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:20.102988 21693 raft_consensus.cc:2468] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a50d2d282f42b3ae9718061e4ea56e in term 2.
I20260709 12:25:20.103881 21976 raft_consensus.cc:697] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Becoming Leader. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Running, Role: LEADER
I20260709 12:25:20.105170 21976 consensus_queue.cc:237] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:20.105891 21987 raft_consensus.cc:993] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab: : Instructing follower f3a50d2d282f42b3ae9718061e4ea56e to start an election
I20260709 12:25:20.106415 21978 raft_consensus.cc:1081] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [term 1 LEADER]: Signalling peer f3a50d2d282f42b3ae9718061e4ea56e to start an election
I20260709 12:25:20.108337 21619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f8690e3310b48c8b1423e5e0fce5d64"
dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
 from {username='slave'} at 127.0.0.1:38634
I20260709 12:25:20.109365 21619 raft_consensus.cc:493] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:20.109807 21619 raft_consensus.cc:3060] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:20.114526 21442 catalog_manager.cc:5697] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e reported cstate change: term changed from 1 to 2, leader changed from f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67) to f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66). New cstate: current_term: 2 leader_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:20.117527 21619 raft_consensus.cc:515] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:20.119944 21619 leader_election.cc:290] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 election: Requested vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67:36465)
I20260709 12:25:20.120321 21898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f8690e3310b48c8b1423e5e0fce5d64" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ffb77abd008a4b5f90930139e5dca14a"
I20260709 12:25:20.120631 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f8690e3310b48c8b1423e5e0fce5d64" candidate_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
I20260709 12:25:20.121030 21898 raft_consensus.cc:3060] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:20.121311 21693 raft_consensus.cc:3055] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:20.121753 21693 raft_consensus.cc:740] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Running, Role: LEADER
I20260709 12:25:20.122851 21693 consensus_queue.cc:260] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:20.124485 21693 raft_consensus.cc:3060] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:20.128091 21898 raft_consensus.cc:2468] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a50d2d282f42b3ae9718061e4ea56e in term 2.
I20260709 12:25:20.129406 21587 leader_election.cc:304] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3a50d2d282f42b3ae9718061e4ea56e, ffb77abd008a4b5f90930139e5dca14a; no voters: 
I20260709 12:25:20.130141 21976 raft_consensus.cc:2804] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:20.131090 21976 raft_consensus.cc:697] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Becoming Leader. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Running, Role: LEADER
I20260709 12:25:20.131983 21693 raft_consensus.cc:2468] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a50d2d282f42b3ae9718061e4ea56e in term 2.
I20260709 12:25:20.132477 21976 consensus_queue.cc:237] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:20.139981 21442 catalog_manager.cc:5697] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e reported cstate change: term changed from 1 to 2, leader changed from f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67) to f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66). New cstate: current_term: 2 leader_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:20.286325 21491 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:20.562511 21898 raft_consensus.cc:1275] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [term 2 FOLLOWER]: Refusing update from remote peer f3a50d2d282f42b3ae9718061e4ea56e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:20.564036 21994 consensus_queue.cc:1048] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:20.575696 21693 raft_consensus.cc:1275] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Refusing update from remote peer f3a50d2d282f42b3ae9718061e4ea56e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:20.577760 21994 consensus_queue.cc:1048] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:20.677023 21693 raft_consensus.cc:1275] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Refusing update from remote peer f3a50d2d282f42b3ae9718061e4ea56e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:20.678524 21994 consensus_queue.cc:1048] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:20.687697 21898 raft_consensus.cc:1275] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a [term 2 FOLLOWER]: Refusing update from remote peer f3a50d2d282f42b3ae9718061e4ea56e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:20.689105 22005 consensus_queue.cc:1048] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:20.723801  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:20.731998 21619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9805ee3b0b9842169c095a6f9145a92f"
dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
mode: GRACEFUL
new_leader_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
 from {username='slave'} at 127.0.0.1:50404
I20260709 12:25:20.732539 21619 raft_consensus.cc:606] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Received request to transfer leadership to TS f962f677972e4a4ab0f9eb083052a1ab
I20260709 12:25:20.735206 21619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de19482ce51d4ba5a2588085bd6f2d54"
dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
mode: GRACEFUL
new_leader_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
 from {username='slave'} at 127.0.0.1:50404
I20260709 12:25:20.735687 21619 raft_consensus.cc:606] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Received request to transfer leadership to TS f962f677972e4a4ab0f9eb083052a1ab
I20260709 12:25:20.736903  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:20.737537  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:20.738241  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:21.021585 21976 raft_consensus.cc:993] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e: : Instructing follower f962f677972e4a4ab0f9eb083052a1ab to start an election
I20260709 12:25:21.022065 22005 raft_consensus.cc:1081] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Signalling peer f962f677972e4a4ab0f9eb083052a1ab to start an election
I20260709 12:25:21.023715 21693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de19482ce51d4ba5a2588085bd6f2d54"
dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
 from {username='slave'} at 127.0.0.1:51998
I20260709 12:25:21.024260 21693 raft_consensus.cc:493] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:21.024536 21693 raft_consensus.cc:3060] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:21.029747 21693 raft_consensus.cc:515] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:21.031445 21693 leader_election.cc:290] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 3 election: Requested vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981)
I20260709 12:25:21.032301 21898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de19482ce51d4ba5a2588085bd6f2d54" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ffb77abd008a4b5f90930139e5dca14a"
I20260709 12:25:21.032723 21621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de19482ce51d4ba5a2588085bd6f2d54" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
I20260709 12:25:21.033008 21898 raft_consensus.cc:3060] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:21.033365 21621 raft_consensus.cc:3055] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:21.033730 21621 raft_consensus.cc:740] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Running, Role: LEADER
I20260709 12:25:21.034585 21621 consensus_queue.cc:260] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:21.035681 21621 raft_consensus.cc:3060] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:21.038465 21898 raft_consensus.cc:2468] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 3.
I20260709 12:25:21.039575 21661 leader_election.cc:304] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f962f677972e4a4ab0f9eb083052a1ab, ffb77abd008a4b5f90930139e5dca14a; no voters: 
I20260709 12:25:21.040571 22010 raft_consensus.cc:2804] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:21.041102 22010 raft_consensus.cc:697] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 3 LEADER]: Becoming Leader. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Running, Role: LEADER
I20260709 12:25:21.042161 22010 consensus_queue.cc:237] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:21.043376 21621 raft_consensus.cc:2468] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 3.
I20260709 12:25:21.050437 21442 catalog_manager.cc:5697] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab reported cstate change: term changed from 2 to 3, leader changed from f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66) to f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67). New cstate: current_term: 3 leader_uuid: "f962f677972e4a4ab0f9eb083052a1ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:21.191001 21976 raft_consensus.cc:993] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e: : Instructing follower f962f677972e4a4ab0f9eb083052a1ab to start an election
I20260709 12:25:21.191440 21976 raft_consensus.cc:1081] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Signalling peer f962f677972e4a4ab0f9eb083052a1ab to start an election
I20260709 12:25:21.192978 21693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9805ee3b0b9842169c095a6f9145a92f"
dest_uuid: "f962f677972e4a4ab0f9eb083052a1ab"
 from {username='slave'} at 127.0.0.1:51998
I20260709 12:25:21.193425 21693 raft_consensus.cc:493] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:21.193677 21693 raft_consensus.cc:3060] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:21.199002 21693 raft_consensus.cc:515] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:21.200649 21693 leader_election.cc:290] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 3 election: Requested vote from peers ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797), f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981)
I20260709 12:25:21.201422 21898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9805ee3b0b9842169c095a6f9145a92f" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ffb77abd008a4b5f90930139e5dca14a"
I20260709 12:25:21.201649 21621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9805ee3b0b9842169c095a6f9145a92f" candidate_uuid: "f962f677972e4a4ab0f9eb083052a1ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3a50d2d282f42b3ae9718061e4ea56e"
I20260709 12:25:21.201972 21898 raft_consensus.cc:3060] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:21.202313 21621 raft_consensus.cc:3055] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:21.202600 21621 raft_consensus.cc:740] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3a50d2d282f42b3ae9718061e4ea56e, State: Running, Role: LEADER
I20260709 12:25:21.203289 21621 consensus_queue.cc:260] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:21.204344 21621 raft_consensus.cc:3060] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:21.207214 21898 raft_consensus.cc:2468] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 3.
I20260709 12:25:21.208436 21661 leader_election.cc:304] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f962f677972e4a4ab0f9eb083052a1ab, ffb77abd008a4b5f90930139e5dca14a; no voters: 
I20260709 12:25:21.209205 21978 raft_consensus.cc:2804] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:21.209610 21978 raft_consensus.cc:697] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 3 LEADER]: Becoming Leader. State: Replica: f962f677972e4a4ab0f9eb083052a1ab, State: Running, Role: LEADER
I20260709 12:25:21.210187 21621 raft_consensus.cc:2468] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f962f677972e4a4ab0f9eb083052a1ab in term 3.
I20260709 12:25:21.210325 21978 consensus_queue.cc:237] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } }
I20260709 12:25:21.216660 21442 catalog_manager.cc:5697] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab reported cstate change: term changed from 2 to 3, leader changed from f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66) to f962f677972e4a4ab0f9eb083052a1ab (127.9.131.67). New cstate: current_term: 3 leader_uuid: "f962f677972e4a4ab0f9eb083052a1ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f962f677972e4a4ab0f9eb083052a1ab" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 36465 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:21.287571 21491 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:21.530735 21898 raft_consensus.cc:1275] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Refusing update from remote peer f962f677972e4a4ab0f9eb083052a1ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:21.531936 21978 consensus_queue.cc:1048] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:21.543576 21621 raft_consensus.cc:1275] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [term 3 FOLLOWER]: Refusing update from remote peer f962f677972e4a4ab0f9eb083052a1ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:21.545849 22010 consensus_queue.cc:1048] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:21.704710 21621 raft_consensus.cc:1275] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [term 3 FOLLOWER]: Refusing update from remote peer f962f677972e4a4ab0f9eb083052a1ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:21.706003 22010 consensus_queue.cc:1048] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a50d2d282f42b3ae9718061e4ea56e" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:21.715097 21898 raft_consensus.cc:1275] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Refusing update from remote peer f962f677972e4a4ab0f9eb083052a1ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:21.716806 21978 consensus_queue.cc:1048] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffb77abd008a4b5f90930139e5dca14a" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:21.744784  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:21.777274  9741 tablet_server.cc:179] TabletServer@127.9.131.65:43797 shutting down...
I20260709 12:25:21.797797  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:21.798632  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:21.799366  9741 raft_consensus.cc:2243] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.799942  9741 raft_consensus.cc:2272] T 36e09f17621b4023aad1c84e0d33340f P ffb77abd008a4b5f90930139e5dca14a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.802821  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:21.803766  9741 raft_consensus.cc:2243] T 982e043bb9104e98aaacc88810913fa9 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.804309  9741 raft_consensus.cc:2272] T 982e043bb9104e98aaacc88810913fa9 P ffb77abd008a4b5f90930139e5dca14a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.807673  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:21.808341  9741 raft_consensus.cc:2243] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.808851  9741 raft_consensus.cc:2272] T 9805ee3b0b9842169c095a6f9145a92f P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.811995  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:21.812639  9741 raft_consensus.cc:2243] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.813165  9741 raft_consensus.cc:2272] T de2b92c279e6439fb4f68aaa5b0351f3 P ffb77abd008a4b5f90930139e5dca14a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.815547  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:21.816176  9741 raft_consensus.cc:2243] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.816660  9741 raft_consensus.cc:2272] T a47d3188c0e34a9eb5c5305a2a7974a7 P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.819024  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:21.819563  9741 raft_consensus.cc:2243] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.820091  9741 raft_consensus.cc:2272] T 441470dd550541cf888bdd60da1f1db6 P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.822430  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:21.823016  9741 raft_consensus.cc:2243] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.823491  9741 raft_consensus.cc:2272] T ff34e8501cec4f95b61a5f71c1232420 P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.825754  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:21.826273  9741 raft_consensus.cc:2243] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.826702  9741 raft_consensus.cc:2272] T 0f8690e3310b48c8b1423e5e0fce5d64 P ffb77abd008a4b5f90930139e5dca14a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.828835  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:21.829365  9741 raft_consensus.cc:2243] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.829762  9741 raft_consensus.cc:2272] T a1c788ea1eb1437dba03fabd1d26fb4d P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.832096  9741 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:21.832589  9741 raft_consensus.cc:2243] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.833024  9741 raft_consensus.cc:2272] T de19482ce51d4ba5a2588085bd6f2d54 P ffb77abd008a4b5f90930139e5dca14a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.866360  9741 tablet_server.cc:196] TabletServer@127.9.131.65:43797 shutdown complete.
I20260709 12:25:21.893741  9741 tablet_server.cc:179] TabletServer@127.9.131.66:0 shutting down...
I20260709 12:25:21.916443  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:21.917106  9741 tablet_replica.cc:333] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e: stopping tablet replica
I20260709 12:25:21.918045  9741 raft_consensus.cc:2243] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:21.918913  9741 raft_consensus.cc:2272] T 0f8690e3310b48c8b1423e5e0fce5d64 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.921204  9741 tablet_replica.cc:333] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e: stopping tablet replica
I20260709 12:25:21.921788  9741 raft_consensus.cc:2243] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:21.922672  9741 raft_consensus.cc:2272] T ff34e8501cec4f95b61a5f71c1232420 P f3a50d2d282f42b3ae9718061e4ea56e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.925071  9741 tablet_replica.cc:333] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e: stopping tablet replica
I20260709 12:25:21.925686  9741 raft_consensus.cc:2243] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.926177  9741 raft_consensus.cc:2272] T de2b92c279e6439fb4f68aaa5b0351f3 P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.928532  9741 tablet_replica.cc:333] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e: stopping tablet replica
I20260709 12:25:21.929061  9741 raft_consensus.cc:2243] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:21.929953  9741 raft_consensus.cc:2272] T 36e09f17621b4023aad1c84e0d33340f P f3a50d2d282f42b3ae9718061e4ea56e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.932291  9741 tablet_replica.cc:333] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e: stopping tablet replica
I20260709 12:25:21.932928  9741 raft_consensus.cc:2243] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.933338  9741 raft_consensus.cc:2272] T 9805ee3b0b9842169c095a6f9145a92f P f3a50d2d282f42b3ae9718061e4ea56e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.936187  9741 tablet_replica.cc:333] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e: stopping tablet replica
I20260709 12:25:21.936800  9741 raft_consensus.cc:2243] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.937225  9741 raft_consensus.cc:2272] T de19482ce51d4ba5a2588085bd6f2d54 P f3a50d2d282f42b3ae9718061e4ea56e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.940369  9741 tablet_replica.cc:333] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e: stopping tablet replica
I20260709 12:25:21.940943  9741 raft_consensus.cc:2243] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.941392  9741 raft_consensus.cc:2272] T a1c788ea1eb1437dba03fabd1d26fb4d P f3a50d2d282f42b3ae9718061e4ea56e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.943468  9741 tablet_replica.cc:333] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e: stopping tablet replica
I20260709 12:25:21.944069  9741 raft_consensus.cc:2243] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:21.944955  9741 raft_consensus.cc:2272] T 982e043bb9104e98aaacc88810913fa9 P f3a50d2d282f42b3ae9718061e4ea56e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.947340  9741 tablet_replica.cc:333] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e: stopping tablet replica
I20260709 12:25:21.947826  9741 raft_consensus.cc:2243] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.948340  9741 raft_consensus.cc:2272] T 441470dd550541cf888bdd60da1f1db6 P f3a50d2d282f42b3ae9718061e4ea56e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.950809  9741 tablet_replica.cc:333] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e: stopping tablet replica
I20260709 12:25:21.951272  9741 raft_consensus.cc:2243] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.951800  9741 raft_consensus.cc:2272] T a47d3188c0e34a9eb5c5305a2a7974a7 P f3a50d2d282f42b3ae9718061e4ea56e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.982980  9741 tablet_server.cc:196] TabletServer@127.9.131.66:0 shutdown complete.
W20260709 12:25:22.008049 21659 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.131.66:38981: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260709 12:25:22.013309 21659 consensus_peers.cc:597] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab -> Peer f3a50d2d282f42b3ae9718061e4ea56e (127.9.131.66:38981): Couldn't send request to peer f3a50d2d282f42b3ae9718061e4ea56e. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:38981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:22.015096  9741 tablet_server.cc:179] TabletServer@127.9.131.67:0 shutting down...
W20260709 12:25:22.026001 21661 consensus_peers.cc:597] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:22.042301  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:22.043318  9741 tablet_replica.cc:333] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab: stopping tablet replica
I20260709 12:25:22.044373  9741 raft_consensus.cc:2243] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:22.045492  9741 raft_consensus.cc:2272] T de2b92c279e6439fb4f68aaa5b0351f3 P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:22.045637 21661 consensus_peers.cc:597] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab -> Peer ffb77abd008a4b5f90930139e5dca14a (127.9.131.65:43797): Couldn't send request to peer ffb77abd008a4b5f90930139e5dca14a. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:22.048002  9741 tablet_replica.cc:333] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab: stopping tablet replica
I20260709 12:25:22.048830  9741 raft_consensus.cc:2243] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:22.049777  9741 raft_consensus.cc:2272] T 9805ee3b0b9842169c095a6f9145a92f P f962f677972e4a4ab0f9eb083052a1ab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.052656  9741 tablet_replica.cc:333] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab: stopping tablet replica
I20260709 12:25:22.053248  9741 raft_consensus.cc:2243] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:22.054153  9741 raft_consensus.cc:2272] T 441470dd550541cf888bdd60da1f1db6 P f962f677972e4a4ab0f9eb083052a1ab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.056430  9741 tablet_replica.cc:333] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab: stopping tablet replica
I20260709 12:25:22.057045  9741 raft_consensus.cc:2243] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:22.057950  9741 raft_consensus.cc:2272] T a47d3188c0e34a9eb5c5305a2a7974a7 P f962f677972e4a4ab0f9eb083052a1ab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.060253  9741 tablet_replica.cc:333] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab: stopping tablet replica
I20260709 12:25:22.060770  9741 raft_consensus.cc:2243] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.061223  9741 raft_consensus.cc:2272] T ff34e8501cec4f95b61a5f71c1232420 P f962f677972e4a4ab0f9eb083052a1ab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.063349  9741 tablet_replica.cc:333] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab: stopping tablet replica
I20260709 12:25:22.064008  9741 raft_consensus.cc:2243] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.064419  9741 raft_consensus.cc:2272] T 0f8690e3310b48c8b1423e5e0fce5d64 P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.066525  9741 tablet_replica.cc:333] T 982e043bb9104e98aaacc88810913fa9 P f962f677972e4a4ab0f9eb083052a1ab: stopping tablet replica
I20260709 12:25:22.067026  9741 raft_consensus.cc:2243] T 982e043bb9104e98aaacc88810913fa9 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.067492  9741 raft_consensus.cc:2272] T 982e043bb9104e98aaacc88810913fa9 P f962f677972e4a4ab0f9eb083052a1ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.069837  9741 tablet_replica.cc:333] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab: stopping tablet replica
I20260709 12:25:22.070328  9741 raft_consensus.cc:2243] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.070783  9741 raft_consensus.cc:2272] T 36e09f17621b4023aad1c84e0d33340f P f962f677972e4a4ab0f9eb083052a1ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.072999  9741 tablet_replica.cc:333] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab: stopping tablet replica
I20260709 12:25:22.073498  9741 raft_consensus.cc:2243] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:22.074277  9741 raft_consensus.cc:2272] T a1c788ea1eb1437dba03fabd1d26fb4d P f962f677972e4a4ab0f9eb083052a1ab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.076458  9741 tablet_replica.cc:333] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab: stopping tablet replica
I20260709 12:25:22.076944  9741 raft_consensus.cc:2243] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:22.077765  9741 raft_consensus.cc:2272] T de19482ce51d4ba5a2588085bd6f2d54 P f962f677972e4a4ab0f9eb083052a1ab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.110087  9741 tablet_server.cc:196] TabletServer@127.9.131.67:0 shutdown complete.
I20260709 12:25:22.137017  9741 master.cc:562] Master@127.9.131.126:33573 shutting down...
I20260709 12:25:22.161731  9741 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:22.162254  9741 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.162549  9741 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7c62880afbaa46fc853dae972bce023e: stopping tablet replica
I20260709 12:25:22.184268  9741 master.cc:584] Master@127.9.131.126:33573 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13116 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:25:22.229924  9741 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.131.126:41635
I20260709 12:25:22.231060  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:22.236691 22028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:22.237004 22029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:22.238987 22031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:22.240530  9741 server_base.cc:1061] running on GCE node
I20260709 12:25:22.241636  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:22.241852  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:22.241976  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599922241963 us; error 0 us; skew 500 ppm
I20260709 12:25:22.242470  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:22.245528  9741 webserver.cc:533] Webserver started at http://127.9.131.126:33861/ using document root <none> and password file <none>
I20260709 12:25:22.246174  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:22.246445  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:22.246798  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:22.248347  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599527842218-9741-0/minicluster-data/master-0-root/instance:
uuid: "4345938e1c3349ac878cff4ad0b2163a"
format_stamp: "Formatted at 2026-07-09 12:25:22 on dist-test-slave-r7s7"
I20260709 12:25:22.253021  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:25:22.256769 22036 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.257751  9741 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:25:22.258075  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599527842218-9741-0/minicluster-data/master-0-root
uuid: "4345938e1c3349ac878cff4ad0b2163a"
format_stamp: "Formatted at 2026-07-09 12:25:22 on dist-test-slave-r7s7"
I20260709 12:25:22.258380  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599527842218-9741-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599527842218-9741-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599527842218-9741-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:22.272751  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:22.274000  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:22.312654  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.126:41635
I20260709 12:25:22.312779 22087 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.126:41635 every 8 connection(s)
I20260709 12:25:22.316603 22088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.329212 22088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a: Bootstrap starting.
I20260709 12:25:22.334271 22088 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.338738 22088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a: No bootstrap required, opened a new log
I20260709 12:25:22.341048 22088 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4345938e1c3349ac878cff4ad0b2163a" member_type: VOTER }
I20260709 12:25:22.341471 22088 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.341703 22088 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4345938e1c3349ac878cff4ad0b2163a, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.342322 22088 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4345938e1c3349ac878cff4ad0b2163a" member_type: VOTER }
I20260709 12:25:22.342787 22088 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:22.342998 22088 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:22.343252 22088 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.348591 22088 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4345938e1c3349ac878cff4ad0b2163a" member_type: VOTER }
I20260709 12:25:22.349118 22088 leader_election.cc:304] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4345938e1c3349ac878cff4ad0b2163a; no voters: 
I20260709 12:25:22.350256 22088 leader_election.cc:290] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:22.350672 22091 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:22.352049 22091 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a [term 1 LEADER]: Becoming Leader. State: Replica: 4345938e1c3349ac878cff4ad0b2163a, State: Running, Role: LEADER
I20260709 12:25:22.352715 22091 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4345938e1c3349ac878cff4ad0b2163a" member_type: VOTER }
I20260709 12:25:22.353176 22088 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:22.357576 22092 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4345938e1c3349ac878cff4ad0b2163a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4345938e1c3349ac878cff4ad0b2163a" member_type: VOTER } }
I20260709 12:25:22.358349 22092 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:22.358143 22093 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4345938e1c3349ac878cff4ad0b2163a. Latest consensus state: current_term: 1 leader_uuid: "4345938e1c3349ac878cff4ad0b2163a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4345938e1c3349ac878cff4ad0b2163a" member_type: VOTER } }
I20260709 12:25:22.359138 22093 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:22.361920 22098 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:22.366796 22098 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:22.370004  9741 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:22.375633 22098 catalog_manager.cc:1383] Generated new cluster ID: 05ac1e8b655f4f25afbc73615fef20bc
I20260709 12:25:22.375977 22098 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:22.391397 22098 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:22.392784 22098 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:22.411319 22098 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a: Generated new TSK 0
I20260709 12:25:22.412003 22098 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:22.437381  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:22.443938 22109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:22.444967 22110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:22.447428 22112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:22.447497  9741 server_base.cc:1061] running on GCE node
I20260709 12:25:22.448803  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:22.449000  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:22.449123  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599922449111 us; error 0 us; skew 500 ppm
I20260709 12:25:22.449630  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:22.451977  9741 webserver.cc:533] Webserver started at http://127.9.131.65:37061/ using document root <none> and password file <none>
I20260709 12:25:22.452436  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:22.452593  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:22.452796  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:22.453873  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599527842218-9741-0/minicluster-data/ts-0-root/instance:
uuid: "416191237616451eb0ab53e7c02767f0"
format_stamp: "Formatted at 2026-07-09 12:25:22 on dist-test-slave-r7s7"
I20260709 12:25:22.458949  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:25:22.462651 22117 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.463547  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:25:22.463838  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599527842218-9741-0/minicluster-data/ts-0-root
uuid: "416191237616451eb0ab53e7c02767f0"
format_stamp: "Formatted at 2026-07-09 12:25:22 on dist-test-slave-r7s7"
I20260709 12:25:22.464154  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599527842218-9741-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599527842218-9741-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599527842218-9741-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:22.481719  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:22.482933  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:22.484434  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:22.486799  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:22.486990  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.487255  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:22.487418  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.528699  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.65:45685
I20260709 12:25:22.528833 22179 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.65:45685 every 8 connection(s)
I20260709 12:25:22.533947  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:22.542280 22184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:22.543694 22185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:22.544723 22187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:22.547103  9741 server_base.cc:1061] running on GCE node
I20260709 12:25:22.547304 22180 heartbeater.cc:344] Connected to a master server at 127.9.131.126:41635
I20260709 12:25:22.547799 22180 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:22.548367  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:22.548641  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:22.548611 22180 heartbeater.cc:507] Master 127.9.131.126:41635 requested a full tablet report, sending...
I20260709 12:25:22.549036  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599922549014 us; error 0 us; skew 500 ppm
I20260709 12:25:22.549693  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:22.551309 22053 ts_manager.cc:194] Registered new tserver with Master: 416191237616451eb0ab53e7c02767f0 (127.9.131.65:45685)
I20260709 12:25:22.552547  9741 webserver.cc:533] Webserver started at http://127.9.131.66:41959/ using document root <none> and password file <none>
I20260709 12:25:22.553304  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:22.553542  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:22.553844  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:22.553948 22053 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36386
I20260709 12:25:22.555433  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599527842218-9741-0/minicluster-data/ts-1-root/instance:
uuid: "478213c7a1eb4b3d9dbc5218200f009b"
format_stamp: "Formatted at 2026-07-09 12:25:22 on dist-test-slave-r7s7"
I20260709 12:25:22.560673  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:25:22.564152 22192 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.564992  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:25:22.565294  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599527842218-9741-0/minicluster-data/ts-1-root
uuid: "478213c7a1eb4b3d9dbc5218200f009b"
format_stamp: "Formatted at 2026-07-09 12:25:22 on dist-test-slave-r7s7"
I20260709 12:25:22.565562  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599527842218-9741-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599527842218-9741-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599527842218-9741-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:22.579931  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:22.581152  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:22.582636  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:22.584980  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:22.585171  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.585415  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:22.585559  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.624527  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.66:39325
I20260709 12:25:22.624678 22254 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.66:39325 every 8 connection(s)
I20260709 12:25:22.629521  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:22.637156 22258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:22.638010 22259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:22.640167  9741 server_base.cc:1061] running on GCE node
I20260709 12:25:22.642082 22255 heartbeater.cc:344] Connected to a master server at 127.9.131.126:41635
W20260709 12:25:22.642182 22261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:22.642563 22255 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:22.643400  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:25:22.643558 22255 heartbeater.cc:507] Master 127.9.131.126:41635 requested a full tablet report, sending...
W20260709 12:25:22.643754  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:22.644207  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599922644184 us; error 0 us; skew 500 ppm
I20260709 12:25:22.644984  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:22.646130 22053 ts_manager.cc:194] Registered new tserver with Master: 478213c7a1eb4b3d9dbc5218200f009b (127.9.131.66:39325)
I20260709 12:25:22.647617 22053 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36402
I20260709 12:25:22.650767  9741 webserver.cc:533] Webserver started at http://127.9.131.67:35265/ using document root <none> and password file <none>
I20260709 12:25:22.651516  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:22.651748  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:22.652076  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:22.653772  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599527842218-9741-0/minicluster-data/ts-2-root/instance:
uuid: "0a0dd2d45ff544adb7e345e7d87d25f0"
format_stamp: "Formatted at 2026-07-09 12:25:22 on dist-test-slave-r7s7"
I20260709 12:25:22.658622  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:25:22.662205 22266 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.663049  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:25:22.663357  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599527842218-9741-0/minicluster-data/ts-2-root
uuid: "0a0dd2d45ff544adb7e345e7d87d25f0"
format_stamp: "Formatted at 2026-07-09 12:25:22 on dist-test-slave-r7s7"
I20260709 12:25:22.663640  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599527842218-9741-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599527842218-9741-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599527842218-9741-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:22.677892  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:22.679337  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:22.680923  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:22.683177  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:22.683387  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.683631  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:22.683785  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.724498  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.67:38485
I20260709 12:25:22.724618 22328 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.67:38485 every 8 connection(s)
I20260709 12:25:22.740465 22329 heartbeater.cc:344] Connected to a master server at 127.9.131.126:41635
I20260709 12:25:22.740913 22329 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:22.741655 22329 heartbeater.cc:507] Master 127.9.131.126:41635 requested a full tablet report, sending...
I20260709 12:25:22.744256 22053 ts_manager.cc:194] Registered new tserver with Master: 0a0dd2d45ff544adb7e345e7d87d25f0 (127.9.131.67:38485)
I20260709 12:25:22.744617  9741 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016953109s
I20260709 12:25:22.745797 22053 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36410
I20260709 12:25:22.772712 22053 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36412:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:22.775241 22053 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:22.830097 22219 tablet_service.cc:1511] Processing CreateTablet for tablet 18790645cb6b4dd897342c424d36bfcc (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=455870683c7142ebb47ec36c4a04e7fb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:22.831707 22294 tablet_service.cc:1511] Processing CreateTablet for tablet 6bd329151d9d4f228c286dc0cd6df8f2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=455870683c7142ebb47ec36c4a04e7fb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:22.832140 22293 tablet_service.cc:1511] Processing CreateTablet for tablet 18790645cb6b4dd897342c424d36bfcc (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=455870683c7142ebb47ec36c4a04e7fb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:22.833220 22294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bd329151d9d4f228c286dc0cd6df8f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.832901 22220 tablet_service.cc:1511] Processing CreateTablet for tablet 6bd329151d9d4f228c286dc0cd6df8f2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=455870683c7142ebb47ec36c4a04e7fb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:22.833981 22293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18790645cb6b4dd897342c424d36bfcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.831750 22219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18790645cb6b4dd897342c424d36bfcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.835114 22220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bd329151d9d4f228c286dc0cd6df8f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.835522 22145 tablet_service.cc:1511] Processing CreateTablet for tablet 6bd329151d9d4f228c286dc0cd6df8f2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=455870683c7142ebb47ec36c4a04e7fb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:22.837133 22145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bd329151d9d4f228c286dc0cd6df8f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.845285 22144 tablet_service.cc:1511] Processing CreateTablet for tablet 18790645cb6b4dd897342c424d36bfcc (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=455870683c7142ebb47ec36c4a04e7fb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:22.846814 22144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18790645cb6b4dd897342c424d36bfcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.877455 22344 tablet_bootstrap.cc:492] T 6bd329151d9d4f228c286dc0cd6df8f2 P 478213c7a1eb4b3d9dbc5218200f009b: Bootstrap starting.
I20260709 12:25:22.878547 22345 tablet_bootstrap.cc:492] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0: Bootstrap starting.
I20260709 12:25:22.881256 22346 tablet_bootstrap.cc:492] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0: Bootstrap starting.
I20260709 12:25:22.885941 22345 tablet_bootstrap.cc:654] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.886786 22344 tablet_bootstrap.cc:654] T 6bd329151d9d4f228c286dc0cd6df8f2 P 478213c7a1eb4b3d9dbc5218200f009b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.887188 22346 tablet_bootstrap.cc:654] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.893710 22345 tablet_bootstrap.cc:492] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0: No bootstrap required, opened a new log
I20260709 12:25:22.893909 22346 tablet_bootstrap.cc:492] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0: No bootstrap required, opened a new log
I20260709 12:25:22.894079 22344 tablet_bootstrap.cc:492] T 6bd329151d9d4f228c286dc0cd6df8f2 P 478213c7a1eb4b3d9dbc5218200f009b: No bootstrap required, opened a new log
I20260709 12:25:22.894259 22345 ts_tablet_manager.cc:1403] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 12:25:22.894436 22346 ts_tablet_manager.cc:1403] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:25:22.894610 22344 ts_tablet_manager.cc:1403] T 6bd329151d9d4f228c286dc0cd6df8f2 P 478213c7a1eb4b3d9dbc5218200f009b: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.002s
I20260709 12:25:22.897517 22344 raft_consensus.cc:359] T 6bd329151d9d4f228c286dc0cd6df8f2 P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } } peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } }
I20260709 12:25:22.898102 22344 raft_consensus.cc:385] T 6bd329151d9d4f228c286dc0cd6df8f2 P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.897868 22346 raft_consensus.cc:359] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } } peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } }
I20260709 12:25:22.898432 22344 raft_consensus.cc:740] T 6bd329151d9d4f228c286dc0cd6df8f2 P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 478213c7a1eb4b3d9dbc5218200f009b, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.898146 22345 raft_consensus.cc:359] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:22.898821 22346 raft_consensus.cc:385] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.898990 22345 raft_consensus.cc:385] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.899197 22346 raft_consensus.cc:740] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 416191237616451eb0ab53e7c02767f0, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.899331 22345 raft_consensus.cc:740] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0dd2d45ff544adb7e345e7d87d25f0, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.899335 22344 consensus_queue.cc:260] T 6bd329151d9d4f228c286dc0cd6df8f2 P 478213c7a1eb4b3d9dbc5218200f009b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } } peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } }
I20260709 12:25:22.900272 22346 consensus_queue.cc:260] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } } peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } }
I20260709 12:25:22.900358 22345 consensus_queue.cc:260] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:22.902204 22255 heartbeater.cc:499] Master 127.9.131.126:41635 was elected leader, sending a full tablet report...
I20260709 12:25:22.902462 22344 ts_tablet_manager.cc:1434] T 6bd329151d9d4f228c286dc0cd6df8f2 P 478213c7a1eb4b3d9dbc5218200f009b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:22.903515 22344 tablet_bootstrap.cc:492] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b: Bootstrap starting.
I20260709 12:25:22.909678 22344 tablet_bootstrap.cc:654] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.913936 22346 ts_tablet_manager.cc:1434] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.007s
I20260709 12:25:22.915849 22329 heartbeater.cc:499] Master 127.9.131.126:41635 was elected leader, sending a full tablet report...
I20260709 12:25:22.916390 22345 ts_tablet_manager.cc:1434] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0: Time spent starting tablet: real 0.022s	user 0.013s	sys 0.008s
I20260709 12:25:22.917536 22345 tablet_bootstrap.cc:492] T 6bd329151d9d4f228c286dc0cd6df8f2 P 0a0dd2d45ff544adb7e345e7d87d25f0: Bootstrap starting.
I20260709 12:25:22.923312 22180 heartbeater.cc:499] Master 127.9.131.126:41635 was elected leader, sending a full tablet report...
I20260709 12:25:22.924443 22345 tablet_bootstrap.cc:654] T 6bd329151d9d4f228c286dc0cd6df8f2 P 0a0dd2d45ff544adb7e345e7d87d25f0: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.936266 22345 tablet_bootstrap.cc:492] T 6bd329151d9d4f228c286dc0cd6df8f2 P 0a0dd2d45ff544adb7e345e7d87d25f0: No bootstrap required, opened a new log
I20260709 12:25:22.936851 22345 ts_tablet_manager.cc:1403] T 6bd329151d9d4f228c286dc0cd6df8f2 P 0a0dd2d45ff544adb7e345e7d87d25f0: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.012s
I20260709 12:25:22.937685 22346 tablet_bootstrap.cc:492] T 18790645cb6b4dd897342c424d36bfcc P 416191237616451eb0ab53e7c02767f0: Bootstrap starting.
I20260709 12:25:22.940063 22345 raft_consensus.cc:359] T 6bd329151d9d4f228c286dc0cd6df8f2 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } } peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } }
I20260709 12:25:22.940929 22345 raft_consensus.cc:385] T 6bd329151d9d4f228c286dc0cd6df8f2 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.941344 22345 raft_consensus.cc:740] T 6bd329151d9d4f228c286dc0cd6df8f2 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0dd2d45ff544adb7e345e7d87d25f0, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.942322 22345 consensus_queue.cc:260] T 6bd329151d9d4f228c286dc0cd6df8f2 P 0a0dd2d45ff544adb7e345e7d87d25f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } } peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } }
I20260709 12:25:22.943135 22344 tablet_bootstrap.cc:492] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b: No bootstrap required, opened a new log
I20260709 12:25:22.943676 22344 ts_tablet_manager.cc:1403] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.018s
I20260709 12:25:22.944594 22345 ts_tablet_manager.cc:1434] T 6bd329151d9d4f228c286dc0cd6df8f2 P 0a0dd2d45ff544adb7e345e7d87d25f0: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:22.946154 22346 tablet_bootstrap.cc:654] T 18790645cb6b4dd897342c424d36bfcc P 416191237616451eb0ab53e7c02767f0: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.947220 22344 raft_consensus.cc:359] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:22.948064 22344 raft_consensus.cc:385] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.948371 22344 raft_consensus.cc:740] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 478213c7a1eb4b3d9dbc5218200f009b, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.949177 22344 consensus_queue.cc:260] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:22.950915 22346 tablet_bootstrap.cc:492] T 18790645cb6b4dd897342c424d36bfcc P 416191237616451eb0ab53e7c02767f0: No bootstrap required, opened a new log
I20260709 12:25:22.951368 22346 ts_tablet_manager.cc:1403] T 18790645cb6b4dd897342c424d36bfcc P 416191237616451eb0ab53e7c02767f0: Time spent bootstrapping tablet: real 0.014s	user 0.001s	sys 0.009s
I20260709 12:25:22.951427 22344 ts_tablet_manager.cc:1434] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 12:25:22.954530 22346 raft_consensus.cc:359] T 18790645cb6b4dd897342c424d36bfcc P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:22.955376 22346 raft_consensus.cc:385] T 18790645cb6b4dd897342c424d36bfcc P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.955691 22346 raft_consensus.cc:740] T 18790645cb6b4dd897342c424d36bfcc P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 416191237616451eb0ab53e7c02767f0, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.956595 22346 consensus_queue.cc:260] T 18790645cb6b4dd897342c424d36bfcc P 416191237616451eb0ab53e7c02767f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:22.960132 22346 ts_tablet_manager.cc:1434] T 18790645cb6b4dd897342c424d36bfcc P 416191237616451eb0ab53e7c02767f0: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.006s
I20260709 12:25:22.962893 22350 raft_consensus.cc:493] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.963511 22350 raft_consensus.cc:515] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:22.966127 22350 leader_election.cc:290] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 416191237616451eb0ab53e7c02767f0 (127.9.131.65:45685), 0a0dd2d45ff544adb7e345e7d87d25f0 (127.9.131.67:38485)
I20260709 12:25:22.976306 22155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18790645cb6b4dd897342c424d36bfcc" candidate_uuid: "478213c7a1eb4b3d9dbc5218200f009b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "416191237616451eb0ab53e7c02767f0" is_pre_election: true
I20260709 12:25:22.976996 22155 raft_consensus.cc:2468] T 18790645cb6b4dd897342c424d36bfcc P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 478213c7a1eb4b3d9dbc5218200f009b in term 0.
I20260709 12:25:22.978109 22195 leader_election.cc:304] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 416191237616451eb0ab53e7c02767f0, 478213c7a1eb4b3d9dbc5218200f009b; no voters: 
I20260709 12:25:22.978968 22350 raft_consensus.cc:2804] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:22.979351 22350 raft_consensus.cc:493] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:22.979635 22350 raft_consensus.cc:3060] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.980320 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18790645cb6b4dd897342c424d36bfcc" candidate_uuid: "478213c7a1eb4b3d9dbc5218200f009b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" is_pre_election: true
I20260709 12:25:22.980916 22304 raft_consensus.cc:2468] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 478213c7a1eb4b3d9dbc5218200f009b in term 0.
I20260709 12:25:22.985555 22350 raft_consensus.cc:515] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:22.987447 22350 leader_election.cc:290] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [CANDIDATE]: Term 1 election: Requested vote from peers 416191237616451eb0ab53e7c02767f0 (127.9.131.65:45685), 0a0dd2d45ff544adb7e345e7d87d25f0 (127.9.131.67:38485)
I20260709 12:25:22.988329 22155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18790645cb6b4dd897342c424d36bfcc" candidate_uuid: "478213c7a1eb4b3d9dbc5218200f009b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "416191237616451eb0ab53e7c02767f0"
I20260709 12:25:22.988564 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18790645cb6b4dd897342c424d36bfcc" candidate_uuid: "478213c7a1eb4b3d9dbc5218200f009b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0"
I20260709 12:25:22.988873 22155 raft_consensus.cc:3060] T 18790645cb6b4dd897342c424d36bfcc P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.989132 22304 raft_consensus.cc:3060] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.994954 22155 raft_consensus.cc:2468] T 18790645cb6b4dd897342c424d36bfcc P 416191237616451eb0ab53e7c02767f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 478213c7a1eb4b3d9dbc5218200f009b in term 1.
I20260709 12:25:22.995179 22304 raft_consensus.cc:2468] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 478213c7a1eb4b3d9dbc5218200f009b in term 1.
I20260709 12:25:22.996198 22195 leader_election.cc:304] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 416191237616451eb0ab53e7c02767f0, 478213c7a1eb4b3d9dbc5218200f009b; no voters: 
I20260709 12:25:22.996973 22350 raft_consensus.cc:2804] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:22.998273 22350 raft_consensus.cc:697] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [term 1 LEADER]: Becoming Leader. State: Replica: 478213c7a1eb4b3d9dbc5218200f009b, State: Running, Role: LEADER
I20260709 12:25:22.999230 22350 consensus_queue.cc:237] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:23.008092 22052 catalog_manager.cc:5697] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b reported cstate change: term changed from 0 to 1, leader changed from <none> to 478213c7a1eb4b3d9dbc5218200f009b (127.9.131.66). New cstate: current_term: 1 leader_uuid: "478213c7a1eb4b3d9dbc5218200f009b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:23.062244 22351 raft_consensus.cc:493] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.062783 22351 raft_consensus.cc:515] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } } peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } }
I20260709 12:25:23.065104 22351 leader_election.cc:290] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0dd2d45ff544adb7e345e7d87d25f0 (127.9.131.67:38485), 478213c7a1eb4b3d9dbc5218200f009b (127.9.131.66:39325)
I20260709 12:25:23.077148 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd329151d9d4f228c286dc0cd6df8f2" candidate_uuid: "416191237616451eb0ab53e7c02767f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" is_pre_election: true
I20260709 12:25:23.077243 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd329151d9d4f228c286dc0cd6df8f2" candidate_uuid: "416191237616451eb0ab53e7c02767f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "478213c7a1eb4b3d9dbc5218200f009b" is_pre_election: true
I20260709 12:25:23.078195 22230 raft_consensus.cc:2468] T 6bd329151d9d4f228c286dc0cd6df8f2 P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 416191237616451eb0ab53e7c02767f0 in term 0.
I20260709 12:25:23.078197 22304 raft_consensus.cc:2468] T 6bd329151d9d4f228c286dc0cd6df8f2 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 416191237616451eb0ab53e7c02767f0 in term 0.
I20260709 12:25:23.079705 22119 leader_election.cc:304] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 416191237616451eb0ab53e7c02767f0, 478213c7a1eb4b3d9dbc5218200f009b; no voters: 
I20260709 12:25:23.080621 22351 raft_consensus.cc:2804] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:23.080978 22351 raft_consensus.cc:493] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.081274 22351 raft_consensus.cc:3060] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.088290 22351 raft_consensus.cc:515] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } } peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } }
I20260709 12:25:23.090080 22351 leader_election.cc:290] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0 [CANDIDATE]: Term 1 election: Requested vote from peers 0a0dd2d45ff544adb7e345e7d87d25f0 (127.9.131.67:38485), 478213c7a1eb4b3d9dbc5218200f009b (127.9.131.66:39325)
I20260709 12:25:23.091044 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd329151d9d4f228c286dc0cd6df8f2" candidate_uuid: "416191237616451eb0ab53e7c02767f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0"
I20260709 12:25:23.091095 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd329151d9d4f228c286dc0cd6df8f2" candidate_uuid: "416191237616451eb0ab53e7c02767f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "478213c7a1eb4b3d9dbc5218200f009b"
I20260709 12:25:23.091676 22304 raft_consensus.cc:3060] T 6bd329151d9d4f228c286dc0cd6df8f2 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.091749 22230 raft_consensus.cc:3060] T 6bd329151d9d4f228c286dc0cd6df8f2 P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.097779 22304 raft_consensus.cc:2468] T 6bd329151d9d4f228c286dc0cd6df8f2 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 416191237616451eb0ab53e7c02767f0 in term 1.
I20260709 12:25:23.097965 22230 raft_consensus.cc:2468] T 6bd329151d9d4f228c286dc0cd6df8f2 P 478213c7a1eb4b3d9dbc5218200f009b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 416191237616451eb0ab53e7c02767f0 in term 1.
I20260709 12:25:23.099141 22120 leader_election.cc:304] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0dd2d45ff544adb7e345e7d87d25f0, 416191237616451eb0ab53e7c02767f0; no voters: 
I20260709 12:25:23.100013 22351 raft_consensus.cc:2804] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:23.101265 22351 raft_consensus.cc:697] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0 [term 1 LEADER]: Becoming Leader. State: Replica: 416191237616451eb0ab53e7c02767f0, State: Running, Role: LEADER
I20260709 12:25:23.102047 22351 consensus_queue.cc:237] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } } peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } }
I20260709 12:25:23.109807 22052 catalog_manager.cc:5697] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 416191237616451eb0ab53e7c02767f0 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "416191237616451eb0ab53e7c02767f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:23.168028 22052 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36424:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:23.170024 22052 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:23.195688 22145 tablet_service.cc:1511] Processing CreateTablet for tablet 6dde4b0b23c045d38ff1cc26160d81f0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=2fbf270e302541669278daec2737c699]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:23.196657 22219 tablet_service.cc:1511] Processing CreateTablet for tablet 6dde4b0b23c045d38ff1cc26160d81f0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=2fbf270e302541669278daec2737c699]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:23.197089 22145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dde4b0b23c045d38ff1cc26160d81f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.198033 22219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dde4b0b23c045d38ff1cc26160d81f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.198159 22293 tablet_service.cc:1511] Processing CreateTablet for tablet 6dde4b0b23c045d38ff1cc26160d81f0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=2fbf270e302541669278daec2737c699]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:23.199524 22293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dde4b0b23c045d38ff1cc26160d81f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.202744 22144 tablet_service.cc:1511] Processing CreateTablet for tablet 03b0b37892044c8aa38115835bd1e240 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=2fbf270e302541669278daec2737c699]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:23.204207 22144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03b0b37892044c8aa38115835bd1e240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.202744 22220 tablet_service.cc:1511] Processing CreateTablet for tablet 03b0b37892044c8aa38115835bd1e240 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=2fbf270e302541669278daec2737c699]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:23.206616 22220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03b0b37892044c8aa38115835bd1e240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.213457 22294 tablet_service.cc:1511] Processing CreateTablet for tablet 03b0b37892044c8aa38115835bd1e240 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=2fbf270e302541669278daec2737c699]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:23.214864 22294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03b0b37892044c8aa38115835bd1e240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.215544 22344 tablet_bootstrap.cc:492] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b: Bootstrap starting.
I20260709 12:25:23.222621 22344 tablet_bootstrap.cc:654] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.227625 22346 tablet_bootstrap.cc:492] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0: Bootstrap starting.
I20260709 12:25:23.235452 22346 tablet_bootstrap.cc:654] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.241945 22345 tablet_bootstrap.cc:492] T 6dde4b0b23c045d38ff1cc26160d81f0 P 0a0dd2d45ff544adb7e345e7d87d25f0: Bootstrap starting.
I20260709 12:25:23.245911 22344 tablet_bootstrap.cc:492] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b: No bootstrap required, opened a new log
I20260709 12:25:23.247073 22344 ts_tablet_manager.cc:1403] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.007s
I20260709 12:25:23.250906 22344 raft_consensus.cc:359] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:23.251915 22344 raft_consensus.cc:385] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:23.252310 22344 raft_consensus.cc:740] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 478213c7a1eb4b3d9dbc5218200f009b, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.252521 22345 tablet_bootstrap.cc:654] T 6dde4b0b23c045d38ff1cc26160d81f0 P 0a0dd2d45ff544adb7e345e7d87d25f0: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.253440 22344 consensus_queue.cc:260] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:23.255909 22344 ts_tablet_manager.cc:1434] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 12:25:23.256835 22346 tablet_bootstrap.cc:492] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0: No bootstrap required, opened a new log
I20260709 12:25:23.257090 22344 tablet_bootstrap.cc:492] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b: Bootstrap starting.
I20260709 12:25:23.257467 22346 ts_tablet_manager.cc:1403] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.008s
I20260709 12:25:23.259116 22345 tablet_bootstrap.cc:492] T 6dde4b0b23c045d38ff1cc26160d81f0 P 0a0dd2d45ff544adb7e345e7d87d25f0: No bootstrap required, opened a new log
I20260709 12:25:23.259795 22345 ts_tablet_manager.cc:1403] T 6dde4b0b23c045d38ff1cc26160d81f0 P 0a0dd2d45ff544adb7e345e7d87d25f0: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.007s
I20260709 12:25:23.260974 22346 raft_consensus.cc:359] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:23.261854 22346 raft_consensus.cc:385] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:23.262166 22346 raft_consensus.cc:740] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 416191237616451eb0ab53e7c02767f0, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.262970 22346 consensus_queue.cc:260] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:23.264798 22344 tablet_bootstrap.cc:654] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.265534 22346 ts_tablet_manager.cc:1434] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:23.266889 22346 tablet_bootstrap.cc:492] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0: Bootstrap starting.
I20260709 12:25:23.267369 22345 raft_consensus.cc:359] T 6dde4b0b23c045d38ff1cc26160d81f0 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:23.268290 22345 raft_consensus.cc:385] T 6dde4b0b23c045d38ff1cc26160d81f0 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:23.268651 22345 raft_consensus.cc:740] T 6dde4b0b23c045d38ff1cc26160d81f0 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0dd2d45ff544adb7e345e7d87d25f0, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.269621 22345 consensus_queue.cc:260] T 6dde4b0b23c045d38ff1cc26160d81f0 P 0a0dd2d45ff544adb7e345e7d87d25f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:23.272166 22345 ts_tablet_manager.cc:1434] T 6dde4b0b23c045d38ff1cc26160d81f0 P 0a0dd2d45ff544adb7e345e7d87d25f0: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:25:23.273361 22345 tablet_bootstrap.cc:492] T 03b0b37892044c8aa38115835bd1e240 P 0a0dd2d45ff544adb7e345e7d87d25f0: Bootstrap starting.
I20260709 12:25:23.275028 22346 tablet_bootstrap.cc:654] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.288939 22345 tablet_bootstrap.cc:654] T 03b0b37892044c8aa38115835bd1e240 P 0a0dd2d45ff544adb7e345e7d87d25f0: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.294576 22344 tablet_bootstrap.cc:492] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b: No bootstrap required, opened a new log
I20260709 12:25:23.295040 22344 ts_tablet_manager.cc:1403] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.012s
I20260709 12:25:23.295111 22345 tablet_bootstrap.cc:492] T 03b0b37892044c8aa38115835bd1e240 P 0a0dd2d45ff544adb7e345e7d87d25f0: No bootstrap required, opened a new log
I20260709 12:25:23.295594 22346 tablet_bootstrap.cc:492] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0: No bootstrap required, opened a new log
I20260709 12:25:23.295718 22345 ts_tablet_manager.cc:1403] T 03b0b37892044c8aa38115835bd1e240 P 0a0dd2d45ff544adb7e345e7d87d25f0: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.003s
I20260709 12:25:23.296288 22346 ts_tablet_manager.cc:1403] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.007s
I20260709 12:25:23.297665 22344 raft_consensus.cc:359] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:23.298323 22344 raft_consensus.cc:385] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:23.298573 22344 raft_consensus.cc:740] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 478213c7a1eb4b3d9dbc5218200f009b, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.299268 22344 consensus_queue.cc:260] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:23.299165 22345 raft_consensus.cc:359] T 03b0b37892044c8aa38115835bd1e240 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:23.299394 22346 raft_consensus.cc:359] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:23.300421 22345 raft_consensus.cc:385] T 03b0b37892044c8aa38115835bd1e240 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:23.300774 22345 raft_consensus.cc:740] T 03b0b37892044c8aa38115835bd1e240 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0dd2d45ff544adb7e345e7d87d25f0, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.300518 22346 raft_consensus.cc:385] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:23.301311 22346 raft_consensus.cc:740] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 416191237616451eb0ab53e7c02767f0, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.302177 22344 ts_tablet_manager.cc:1434] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:23.302111 22345 consensus_queue.cc:260] T 03b0b37892044c8aa38115835bd1e240 P 0a0dd2d45ff544adb7e345e7d87d25f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:23.302110 22346 consensus_queue.cc:260] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:23.305119 22345 ts_tablet_manager.cc:1434] T 03b0b37892044c8aa38115835bd1e240 P 0a0dd2d45ff544adb7e345e7d87d25f0: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:25:23.305289 22346 ts_tablet_manager.cc:1434] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
W20260709 12:25:23.364988 22101 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:23.409062 22350 consensus_queue.cc:1048] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [LEADER]: Connected to new peer: Peer: permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:23.421319 22350 consensus_queue.cc:1048] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:23.463697 22351 raft_consensus.cc:493] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.464305 22351 raft_consensus.cc:515] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:23.466220 22351 leader_election.cc:290] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 478213c7a1eb4b3d9dbc5218200f009b (127.9.131.66:39325), 0a0dd2d45ff544adb7e345e7d87d25f0 (127.9.131.67:38485)
I20260709 12:25:23.466966 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dde4b0b23c045d38ff1cc26160d81f0" candidate_uuid: "416191237616451eb0ab53e7c02767f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "478213c7a1eb4b3d9dbc5218200f009b" is_pre_election: true
I20260709 12:25:23.467159 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dde4b0b23c045d38ff1cc26160d81f0" candidate_uuid: "416191237616451eb0ab53e7c02767f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" is_pre_election: true
I20260709 12:25:23.467649 22230 raft_consensus.cc:2468] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 416191237616451eb0ab53e7c02767f0 in term 0.
I20260709 12:25:23.467836 22304 raft_consensus.cc:2468] T 6dde4b0b23c045d38ff1cc26160d81f0 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 416191237616451eb0ab53e7c02767f0 in term 0.
I20260709 12:25:23.468693 22119 leader_election.cc:304] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 416191237616451eb0ab53e7c02767f0, 478213c7a1eb4b3d9dbc5218200f009b; no voters: 
I20260709 12:25:23.469343 22351 raft_consensus.cc:2804] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:23.469683 22351 raft_consensus.cc:493] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.469901 22351 raft_consensus.cc:3060] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.475150 22351 raft_consensus.cc:515] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:23.476945 22351 leader_election.cc:290] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [CANDIDATE]: Term 1 election: Requested vote from peers 478213c7a1eb4b3d9dbc5218200f009b (127.9.131.66:39325), 0a0dd2d45ff544adb7e345e7d87d25f0 (127.9.131.67:38485)
I20260709 12:25:23.477684 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dde4b0b23c045d38ff1cc26160d81f0" candidate_uuid: "416191237616451eb0ab53e7c02767f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "478213c7a1eb4b3d9dbc5218200f009b"
I20260709 12:25:23.477911 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dde4b0b23c045d38ff1cc26160d81f0" candidate_uuid: "416191237616451eb0ab53e7c02767f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0"
I20260709 12:25:23.478232 22230 raft_consensus.cc:3060] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.478550 22304 raft_consensus.cc:3060] T 6dde4b0b23c045d38ff1cc26160d81f0 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.483716 22230 raft_consensus.cc:2468] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 416191237616451eb0ab53e7c02767f0 in term 1.
I20260709 12:25:23.484688 22304 raft_consensus.cc:2468] T 6dde4b0b23c045d38ff1cc26160d81f0 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 416191237616451eb0ab53e7c02767f0 in term 1.
I20260709 12:25:23.485082 22119 leader_election.cc:304] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 416191237616451eb0ab53e7c02767f0, 478213c7a1eb4b3d9dbc5218200f009b; no voters: 
I20260709 12:25:23.485890 22351 raft_consensus.cc:2804] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:23.486269 22351 raft_consensus.cc:697] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [term 1 LEADER]: Becoming Leader. State: Replica: 416191237616451eb0ab53e7c02767f0, State: Running, Role: LEADER
I20260709 12:25:23.486950 22351 consensus_queue.cc:237] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:23.494179 22052 catalog_manager.cc:5697] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 416191237616451eb0ab53e7c02767f0 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "416191237616451eb0ab53e7c02767f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:23.527632 22350 raft_consensus.cc:493] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.528258 22350 raft_consensus.cc:515] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:23.529990 22350 leader_election.cc:290] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 416191237616451eb0ab53e7c02767f0 (127.9.131.65:45685), 0a0dd2d45ff544adb7e345e7d87d25f0 (127.9.131.67:38485)
I20260709 12:25:23.530877 22155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03b0b37892044c8aa38115835bd1e240" candidate_uuid: "478213c7a1eb4b3d9dbc5218200f009b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "416191237616451eb0ab53e7c02767f0" is_pre_election: true
I20260709 12:25:23.531160 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03b0b37892044c8aa38115835bd1e240" candidate_uuid: "478213c7a1eb4b3d9dbc5218200f009b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" is_pre_election: true
I20260709 12:25:23.531662 22155 raft_consensus.cc:2468] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 478213c7a1eb4b3d9dbc5218200f009b in term 0.
I20260709 12:25:23.531791 22304 raft_consensus.cc:2468] T 03b0b37892044c8aa38115835bd1e240 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 478213c7a1eb4b3d9dbc5218200f009b in term 0.
I20260709 12:25:23.532867 22195 leader_election.cc:304] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0dd2d45ff544adb7e345e7d87d25f0, 478213c7a1eb4b3d9dbc5218200f009b; no voters: 
I20260709 12:25:23.533525 22350 raft_consensus.cc:2804] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:23.533860 22350 raft_consensus.cc:493] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.534106 22350 raft_consensus.cc:3060] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.540159 22350 raft_consensus.cc:515] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:23.541780 22350 leader_election.cc:290] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [CANDIDATE]: Term 1 election: Requested vote from peers 416191237616451eb0ab53e7c02767f0 (127.9.131.65:45685), 0a0dd2d45ff544adb7e345e7d87d25f0 (127.9.131.67:38485)
I20260709 12:25:23.542649 22155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03b0b37892044c8aa38115835bd1e240" candidate_uuid: "478213c7a1eb4b3d9dbc5218200f009b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "416191237616451eb0ab53e7c02767f0"
I20260709 12:25:23.543001 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03b0b37892044c8aa38115835bd1e240" candidate_uuid: "478213c7a1eb4b3d9dbc5218200f009b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0"
I20260709 12:25:23.543385 22155 raft_consensus.cc:3060] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.543601 22304 raft_consensus.cc:3060] T 03b0b37892044c8aa38115835bd1e240 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.550930 22155 raft_consensus.cc:2468] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 478213c7a1eb4b3d9dbc5218200f009b in term 1.
I20260709 12:25:23.550930 22304 raft_consensus.cc:2468] T 03b0b37892044c8aa38115835bd1e240 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 478213c7a1eb4b3d9dbc5218200f009b in term 1.
I20260709 12:25:23.552264 22195 leader_election.cc:304] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 416191237616451eb0ab53e7c02767f0, 478213c7a1eb4b3d9dbc5218200f009b; no voters: 
I20260709 12:25:23.553100 22350 raft_consensus.cc:2804] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:23.553504 22350 raft_consensus.cc:697] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [term 1 LEADER]: Becoming Leader. State: Replica: 478213c7a1eb4b3d9dbc5218200f009b, State: Running, Role: LEADER
I20260709 12:25:23.554258 22350 consensus_queue.cc:237] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:23.561667 22052 catalog_manager.cc:5697] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b reported cstate change: term changed from 0 to 1, leader changed from <none> to 478213c7a1eb4b3d9dbc5218200f009b (127.9.131.66). New cstate: current_term: 1 leader_uuid: "478213c7a1eb4b3d9dbc5218200f009b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:23.636629 22230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18790645cb6b4dd897342c424d36bfcc"
dest_uuid: "478213c7a1eb4b3d9dbc5218200f009b"
mode: GRACEFUL
new_leader_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0"
 from {username='slave'} at 127.0.0.1:43224
I20260709 12:25:23.637169 22230 raft_consensus.cc:606] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [term 1 LEADER]: Received request to transfer leadership to TS 0a0dd2d45ff544adb7e345e7d87d25f0
I20260709 12:25:23.640297 22351 consensus_queue.cc:1048] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:23.647236 22230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03b0b37892044c8aa38115835bd1e240"
dest_uuid: "478213c7a1eb4b3d9dbc5218200f009b"
mode: GRACEFUL
new_leader_uuid: "416191237616451eb0ab53e7c02767f0"
 from {username='slave'} at 127.0.0.1:43224
I20260709 12:25:23.647832 22230 raft_consensus.cc:606] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [term 1 LEADER]: Received request to transfer leadership to TS 416191237616451eb0ab53e7c02767f0
I20260709 12:25:23.652613 22361 consensus_queue.cc:1048] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:23.864578 22357 raft_consensus.cc:993] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b: : Instructing follower 0a0dd2d45ff544adb7e345e7d87d25f0 to start an election
I20260709 12:25:23.865188 22357 raft_consensus.cc:1081] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [term 1 LEADER]: Signalling peer 0a0dd2d45ff544adb7e345e7d87d25f0 to start an election
I20260709 12:25:23.867046 22304 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18790645cb6b4dd897342c424d36bfcc"
dest_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0"
 from {username='slave'} at 127.0.0.1:53652
I20260709 12:25:23.867713 22304 raft_consensus.cc:493] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:23.868125 22304 raft_consensus.cc:3060] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.874491 22304 raft_consensus.cc:515] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:23.876478 22304 leader_election.cc:290] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0 [CANDIDATE]: Term 2 election: Requested vote from peers 416191237616451eb0ab53e7c02767f0 (127.9.131.65:45685), 478213c7a1eb4b3d9dbc5218200f009b (127.9.131.66:39325)
I20260709 12:25:23.884666 22361 consensus_queue.cc:1048] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:23.893301 22230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18790645cb6b4dd897342c424d36bfcc" candidate_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "478213c7a1eb4b3d9dbc5218200f009b"
I20260709 12:25:23.893953 22230 raft_consensus.cc:3055] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:23.894229 22230 raft_consensus.cc:740] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 478213c7a1eb4b3d9dbc5218200f009b, State: Running, Role: LEADER
I20260709 12:25:23.894942 22230 consensus_queue.cc:260] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:23.896119 22230 raft_consensus.cc:3060] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.896517 22155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18790645cb6b4dd897342c424d36bfcc" candidate_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "416191237616451eb0ab53e7c02767f0"
I20260709 12:25:23.897118 22155 raft_consensus.cc:3060] T 18790645cb6b4dd897342c424d36bfcc P 416191237616451eb0ab53e7c02767f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.903318 22361 consensus_queue.cc:1048] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:23.905043 22155 raft_consensus.cc:2468] T 18790645cb6b4dd897342c424d36bfcc P 416191237616451eb0ab53e7c02767f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a0dd2d45ff544adb7e345e7d87d25f0 in term 2.
I20260709 12:25:23.905072 22230 raft_consensus.cc:2468] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a0dd2d45ff544adb7e345e7d87d25f0 in term 2.
I20260709 12:25:23.908478 22268 leader_election.cc:304] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0dd2d45ff544adb7e345e7d87d25f0, 478213c7a1eb4b3d9dbc5218200f009b; no voters: 
I20260709 12:25:23.909543 22352 raft_consensus.cc:2804] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:23.924816 22352 raft_consensus.cc:697] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 2 LEADER]: Becoming Leader. State: Replica: 0a0dd2d45ff544adb7e345e7d87d25f0, State: Running, Role: LEADER
I20260709 12:25:23.925789 22352 consensus_queue.cc:237] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:23.932524 22052 catalog_manager.cc:5697] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0 reported cstate change: term changed from 1 to 2, leader changed from 478213c7a1eb4b3d9dbc5218200f009b (127.9.131.66) to 0a0dd2d45ff544adb7e345e7d87d25f0 (127.9.131.67). New cstate: current_term: 2 leader_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:24.123238 22357 consensus_queue.cc:1048] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [LEADER]: Connected to new peer: Peer: permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:24.130314 22350 raft_consensus.cc:993] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b: : Instructing follower 416191237616451eb0ab53e7c02767f0 to start an election
I20260709 12:25:24.130927 22350 raft_consensus.cc:1081] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [term 1 LEADER]: Signalling peer 416191237616451eb0ab53e7c02767f0 to start an election
I20260709 12:25:24.132931 22154 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03b0b37892044c8aa38115835bd1e240"
dest_uuid: "416191237616451eb0ab53e7c02767f0"
 from {username='slave'} at 127.0.0.1:46806
I20260709 12:25:24.134660 22154 raft_consensus.cc:493] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:24.135102 22154 raft_consensus.cc:3060] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.136809 22357 consensus_queue.cc:1048] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:24.144510 22154 raft_consensus.cc:515] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:24.150324 22229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03b0b37892044c8aa38115835bd1e240" candidate_uuid: "416191237616451eb0ab53e7c02767f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "478213c7a1eb4b3d9dbc5218200f009b"
I20260709 12:25:24.150604 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03b0b37892044c8aa38115835bd1e240" candidate_uuid: "416191237616451eb0ab53e7c02767f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0"
I20260709 12:25:24.151023 22229 raft_consensus.cc:3055] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:24.151274 22304 raft_consensus.cc:3060] T 03b0b37892044c8aa38115835bd1e240 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.151422 22229 raft_consensus.cc:740] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 478213c7a1eb4b3d9dbc5218200f009b, State: Running, Role: LEADER
I20260709 12:25:24.152431 22229 consensus_queue.cc:260] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:24.153311 22229 raft_consensus.cc:3060] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.157631 22304 raft_consensus.cc:2468] T 03b0b37892044c8aa38115835bd1e240 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 416191237616451eb0ab53e7c02767f0 in term 2.
I20260709 12:25:24.158350 22154 leader_election.cc:290] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0 [CANDIDATE]: Term 2 election: Requested vote from peers 478213c7a1eb4b3d9dbc5218200f009b (127.9.131.66:39325), 0a0dd2d45ff544adb7e345e7d87d25f0 (127.9.131.67:38485)
I20260709 12:25:24.159694 22120 leader_election.cc:304] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0dd2d45ff544adb7e345e7d87d25f0, 416191237616451eb0ab53e7c02767f0; no voters: 
I20260709 12:25:24.160171 22229 raft_consensus.cc:2468] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 416191237616451eb0ab53e7c02767f0 in term 2.
I20260709 12:25:24.160527 22361 raft_consensus.cc:2804] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:24.161046 22361 raft_consensus.cc:697] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0 [term 2 LEADER]: Becoming Leader. State: Replica: 416191237616451eb0ab53e7c02767f0, State: Running, Role: LEADER
I20260709 12:25:24.161827 22361 consensus_queue.cc:237] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:24.169047 22051 catalog_manager.cc:5697] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0 reported cstate change: term changed from 1 to 2, leader changed from 478213c7a1eb4b3d9dbc5218200f009b (127.9.131.66) to 416191237616451eb0ab53e7c02767f0 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "416191237616451eb0ab53e7c02767f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:24.366356 22229 raft_consensus.cc:1275] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [term 2 FOLLOWER]: Refusing update from remote peer 0a0dd2d45ff544adb7e345e7d87d25f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:24.368110 22352 consensus_queue.cc:1048] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:24.378257 22154 raft_consensus.cc:1275] T 18790645cb6b4dd897342c424d36bfcc P 416191237616451eb0ab53e7c02767f0 [term 2 FOLLOWER]: Refusing update from remote peer 0a0dd2d45ff544adb7e345e7d87d25f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:24.380256 22393 consensus_queue.cc:1048] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:24.398516  9741 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:25:24.400405  9741 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:25:24.400830  9741 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:25:24.413487 22154 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6dde4b0b23c045d38ff1cc26160d81f0"
dest_uuid: "416191237616451eb0ab53e7c02767f0"
mode: GRACEFUL
new_leader_uuid: "478213c7a1eb4b3d9dbc5218200f009b"
 from {username='slave'} at 127.0.0.1:42798
I20260709 12:25:24.414053 22154 raft_consensus.cc:606] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [term 1 LEADER]: Received request to transfer leadership to TS 478213c7a1eb4b3d9dbc5218200f009b
I20260709 12:25:24.415271  9741 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:25:24.590270 22229 raft_consensus.cc:1275] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [term 2 FOLLOWER]: Refusing update from remote peer 416191237616451eb0ab53e7c02767f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:24.591614 22361 consensus_queue.cc:1048] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:24.599604 22304 raft_consensus.cc:1275] T 03b0b37892044c8aa38115835bd1e240 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 2 FOLLOWER]: Refusing update from remote peer 416191237616451eb0ab53e7c02767f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:24.601257 22361 consensus_queue.cc:1048] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:24.910156 22351 raft_consensus.cc:993] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0: : Instructing follower 478213c7a1eb4b3d9dbc5218200f009b to start an election
I20260709 12:25:24.910569 22361 raft_consensus.cc:1081] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [term 1 LEADER]: Signalling peer 478213c7a1eb4b3d9dbc5218200f009b to start an election
I20260709 12:25:24.912314 22229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6dde4b0b23c045d38ff1cc26160d81f0"
dest_uuid: "478213c7a1eb4b3d9dbc5218200f009b"
 from {username='slave'} at 127.0.0.1:43210
I20260709 12:25:24.912889 22229 raft_consensus.cc:493] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:24.913189 22229 raft_consensus.cc:3060] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.918570 22229 raft_consensus.cc:515] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:24.920313 22229 leader_election.cc:290] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b [CANDIDATE]: Term 2 election: Requested vote from peers 416191237616451eb0ab53e7c02767f0 (127.9.131.65:45685), 0a0dd2d45ff544adb7e345e7d87d25f0 (127.9.131.67:38485)
I20260709 12:25:24.921155 22154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dde4b0b23c045d38ff1cc26160d81f0" candidate_uuid: "478213c7a1eb4b3d9dbc5218200f009b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "416191237616451eb0ab53e7c02767f0"
I20260709 12:25:24.921555 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dde4b0b23c045d38ff1cc26160d81f0" candidate_uuid: "478213c7a1eb4b3d9dbc5218200f009b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0"
I20260709 12:25:24.921829 22154 raft_consensus.cc:3055] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:24.922152 22154 raft_consensus.cc:740] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 416191237616451eb0ab53e7c02767f0, State: Running, Role: LEADER
I20260709 12:25:24.922169 22304 raft_consensus.cc:3060] T 6dde4b0b23c045d38ff1cc26160d81f0 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.922928 22154 consensus_queue.cc:260] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:24.924013 22154 raft_consensus.cc:3060] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.928278 22304 raft_consensus.cc:2468] T 6dde4b0b23c045d38ff1cc26160d81f0 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 478213c7a1eb4b3d9dbc5218200f009b in term 2.
I20260709 12:25:24.929225 22154 raft_consensus.cc:2468] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 478213c7a1eb4b3d9dbc5218200f009b in term 2.
I20260709 12:25:24.929558 22195 leader_election.cc:304] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0dd2d45ff544adb7e345e7d87d25f0, 478213c7a1eb4b3d9dbc5218200f009b; no voters: 
I20260709 12:25:24.930536 22357 raft_consensus.cc:2804] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:24.931461 22357 raft_consensus.cc:697] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b [term 2 LEADER]: Becoming Leader. State: Replica: 478213c7a1eb4b3d9dbc5218200f009b, State: Running, Role: LEADER
I20260709 12:25:24.932462 22357 consensus_queue.cc:237] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } }
I20260709 12:25:24.939198 22052 catalog_manager.cc:5697] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b reported cstate change: term changed from 1 to 2, leader changed from 416191237616451eb0ab53e7c02767f0 (127.9.131.65) to 478213c7a1eb4b3d9dbc5218200f009b (127.9.131.66). New cstate: current_term: 2 leader_uuid: "478213c7a1eb4b3d9dbc5218200f009b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416191237616451eb0ab53e7c02767f0" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 45685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "478213c7a1eb4b3d9dbc5218200f009b" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a0dd2d45ff544adb7e345e7d87d25f0" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 38485 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:25.036870  9741 tablet_server.cc:179] TabletServer@127.9.131.65:0 shutting down...
I20260709 12:25:25.057981  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:25.058686  9741 tablet_replica.cc:333] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0: stopping tablet replica
I20260709 12:25:25.059253  9741 raft_consensus.cc:2243] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:25.060196  9741 raft_consensus.cc:2272] T 03b0b37892044c8aa38115835bd1e240 P 416191237616451eb0ab53e7c02767f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.062726  9741 tablet_replica.cc:333] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0: stopping tablet replica
I20260709 12:25:25.063301  9741 raft_consensus.cc:2243] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.063697  9741 raft_consensus.cc:2272] T 6dde4b0b23c045d38ff1cc26160d81f0 P 416191237616451eb0ab53e7c02767f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.065819  9741 tablet_replica.cc:333] T 18790645cb6b4dd897342c424d36bfcc P 416191237616451eb0ab53e7c02767f0: stopping tablet replica
I20260709 12:25:25.066533  9741 raft_consensus.cc:2243] T 18790645cb6b4dd897342c424d36bfcc P 416191237616451eb0ab53e7c02767f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.066943  9741 raft_consensus.cc:2272] T 18790645cb6b4dd897342c424d36bfcc P 416191237616451eb0ab53e7c02767f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.069536  9741 tablet_replica.cc:333] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0: stopping tablet replica
I20260709 12:25:25.070075  9741 raft_consensus.cc:2243] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:25.070878  9741 raft_consensus.cc:2272] T 6bd329151d9d4f228c286dc0cd6df8f2 P 416191237616451eb0ab53e7c02767f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.083943  9741 tablet_server.cc:196] TabletServer@127.9.131.65:0 shutdown complete.
I20260709 12:25:25.097110  9741 tablet_server.cc:179] TabletServer@127.9.131.66:0 shutting down...
I20260709 12:25:25.119206  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:25.119928  9741 tablet_replica.cc:333] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b: stopping tablet replica
I20260709 12:25:25.120505  9741 raft_consensus.cc:2243] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.121232  9741 raft_consensus.cc:2272] T 03b0b37892044c8aa38115835bd1e240 P 478213c7a1eb4b3d9dbc5218200f009b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.123839  9741 tablet_replica.cc:333] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b: stopping tablet replica
I20260709 12:25:25.124452  9741 raft_consensus.cc:2243] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:25.125074  9741 pending_rounds.cc:70] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b: Trying to abort 1 pending ops.
I20260709 12:25:25.125244  9741 pending_rounds.cc:77] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305625292530606080 op_type: NO_OP noop_request { }
I20260709 12:25:25.125507  9741 raft_consensus.cc:2889] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:25.125741  9741 raft_consensus.cc:2272] T 6dde4b0b23c045d38ff1cc26160d81f0 P 478213c7a1eb4b3d9dbc5218200f009b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.128075  9741 tablet_replica.cc:333] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b: stopping tablet replica
I20260709 12:25:25.128592  9741 raft_consensus.cc:2243] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.129035  9741 raft_consensus.cc:2272] T 18790645cb6b4dd897342c424d36bfcc P 478213c7a1eb4b3d9dbc5218200f009b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.131191  9741 tablet_replica.cc:333] T 6bd329151d9d4f228c286dc0cd6df8f2 P 478213c7a1eb4b3d9dbc5218200f009b: stopping tablet replica
I20260709 12:25:25.131666  9741 raft_consensus.cc:2243] T 6bd329151d9d4f228c286dc0cd6df8f2 P 478213c7a1eb4b3d9dbc5218200f009b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.132097  9741 raft_consensus.cc:2272] T 6bd329151d9d4f228c286dc0cd6df8f2 P 478213c7a1eb4b3d9dbc5218200f009b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.154906  9741 tablet_server.cc:196] TabletServer@127.9.131.66:0 shutdown complete.
I20260709 12:25:25.170534  9741 tablet_server.cc:179] TabletServer@127.9.131.67:0 shutting down...
I20260709 12:25:25.191716  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:25.192775  9741 tablet_replica.cc:333] T 03b0b37892044c8aa38115835bd1e240 P 0a0dd2d45ff544adb7e345e7d87d25f0: stopping tablet replica
I20260709 12:25:25.193388  9741 raft_consensus.cc:2243] T 03b0b37892044c8aa38115835bd1e240 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.193843  9741 raft_consensus.cc:2272] T 03b0b37892044c8aa38115835bd1e240 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.196615  9741 tablet_replica.cc:333] T 6dde4b0b23c045d38ff1cc26160d81f0 P 0a0dd2d45ff544adb7e345e7d87d25f0: stopping tablet replica
I20260709 12:25:25.197154  9741 raft_consensus.cc:2243] T 6dde4b0b23c045d38ff1cc26160d81f0 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.197548  9741 raft_consensus.cc:2272] T 6dde4b0b23c045d38ff1cc26160d81f0 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.200280  9741 tablet_replica.cc:333] T 6bd329151d9d4f228c286dc0cd6df8f2 P 0a0dd2d45ff544adb7e345e7d87d25f0: stopping tablet replica
I20260709 12:25:25.200812  9741 raft_consensus.cc:2243] T 6bd329151d9d4f228c286dc0cd6df8f2 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.201257  9741 raft_consensus.cc:2272] T 6bd329151d9d4f228c286dc0cd6df8f2 P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.203182  9741 tablet_replica.cc:333] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0: stopping tablet replica
I20260709 12:25:25.203619  9741 raft_consensus.cc:2243] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:25.204450  9741 raft_consensus.cc:2272] T 18790645cb6b4dd897342c424d36bfcc P 0a0dd2d45ff544adb7e345e7d87d25f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.216984  9741 tablet_server.cc:196] TabletServer@127.9.131.67:0 shutdown complete.
I20260709 12:25:25.230768  9741 master.cc:562] Master@127.9.131.126:41635 shutting down...
I20260709 12:25:25.245638  9741 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:25.246305  9741 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.246654  9741 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4345938e1c3349ac878cff4ad0b2163a: stopping tablet replica
I20260709 12:25:25.265357  9741 master.cc:584] Master@127.9.131.126:41635 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (3063 ms)
[----------] 6 tests from LeaderRebalancerTest (397277 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:25:25.292459  9741 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.131.126:33059
I20260709 12:25:25.293569  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:25.298472 22404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:25.298472 22403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:25.306212 22406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:25.306313  9741 server_base.cc:1061] running on GCE node
I20260709 12:25:25.307307  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:25.307487  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:25.307665  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599925307645 us; error 0 us; skew 500 ppm
I20260709 12:25:25.308409  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:25.310802  9741 webserver.cc:533] Webserver started at http://127.9.131.126:44657/ using document root <none> and password file <none>
I20260709 12:25:25.311272  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:25.311445  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:25.311740  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:25.312860  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599527842218-9741-0/minicluster-data/master-0-root/instance:
uuid: "c982cc0a652949d6aab048e920d851a3"
format_stamp: "Formatted at 2026-07-09 12:25:25 on dist-test-slave-r7s7"
I20260709 12:25:25.317341  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:25:25.321224 22411 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:25.321995  9741 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:25:25.322297  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599527842218-9741-0/minicluster-data/master-0-root
uuid: "c982cc0a652949d6aab048e920d851a3"
format_stamp: "Formatted at 2026-07-09 12:25:25 on dist-test-slave-r7s7"
I20260709 12:25:25.322575  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599527842218-9741-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599527842218-9741-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599527842218-9741-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:25.332995  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:25.334010  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:25.368727  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.126:33059
I20260709 12:25:25.368830 22462 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.126:33059 every 8 connection(s)
I20260709 12:25:25.372509 22463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.383679 22463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3: Bootstrap starting.
I20260709 12:25:25.388659 22463 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.392933 22463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3: No bootstrap required, opened a new log
I20260709 12:25:25.395057 22463 raft_consensus.cc:359] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c982cc0a652949d6aab048e920d851a3" member_type: VOTER }
I20260709 12:25:25.395455 22463 raft_consensus.cc:385] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.395677 22463 raft_consensus.cc:740] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c982cc0a652949d6aab048e920d851a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.396318 22463 consensus_queue.cc:260] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c982cc0a652949d6aab048e920d851a3" member_type: VOTER }
I20260709 12:25:25.396756 22463 raft_consensus.cc:399] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:25.396962 22463 raft_consensus.cc:493] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:25.397217 22463 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.402110 22463 raft_consensus.cc:515] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c982cc0a652949d6aab048e920d851a3" member_type: VOTER }
I20260709 12:25:25.402640 22463 leader_election.cc:304] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c982cc0a652949d6aab048e920d851a3; no voters: 
I20260709 12:25:25.403764 22463 leader_election.cc:290] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:25.404158 22466 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.405551 22466 raft_consensus.cc:697] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3 [term 1 LEADER]: Becoming Leader. State: Replica: c982cc0a652949d6aab048e920d851a3, State: Running, Role: LEADER
I20260709 12:25:25.406224 22466 consensus_queue.cc:237] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c982cc0a652949d6aab048e920d851a3" member_type: VOTER }
I20260709 12:25:25.406534 22463 sys_catalog.cc:565] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:25.409068 22468 sys_catalog.cc:455] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c982cc0a652949d6aab048e920d851a3. Latest consensus state: current_term: 1 leader_uuid: "c982cc0a652949d6aab048e920d851a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c982cc0a652949d6aab048e920d851a3" member_type: VOTER } }
I20260709 12:25:25.408999 22467 sys_catalog.cc:455] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c982cc0a652949d6aab048e920d851a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c982cc0a652949d6aab048e920d851a3" member_type: VOTER } }
I20260709 12:25:25.409785 22468 sys_catalog.cc:458] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:25.409811 22467 sys_catalog.cc:458] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:25.414386 22471 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:25.419148 22471 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:25.421351  9741 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:25.428573 22471 catalog_manager.cc:1383] Generated new cluster ID: 12bb6c77e19443989afe129169725173
I20260709 12:25:25.428895 22471 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:25.460094 22471 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:25.461427 22471 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:25.476029 22471 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3: Generated new TSK 0
I20260709 12:25:25.476680 22471 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:25.488004  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:25.493822 22484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:25.494818 22485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:25.496261 22487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:25.497541  9741 server_base.cc:1061] running on GCE node
I20260709 12:25:25.498443  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:25.498636  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:25.498766  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599925498755 us; error 0 us; skew 500 ppm
I20260709 12:25:25.499260  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:25.501578  9741 webserver.cc:533] Webserver started at http://127.9.131.65:37055/ using document root <none> and password file <none>
I20260709 12:25:25.502027  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:25.502180  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:25.502404  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:25.503453  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599527842218-9741-0/minicluster-data/ts-0-root/instance:
uuid: "455ef2040975481fa5a87ee178499f4b"
format_stamp: "Formatted at 2026-07-09 12:25:25 on dist-test-slave-r7s7"
I20260709 12:25:25.508049  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:25:25.512010 22492 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:25.512830  9741 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:25:25.513140  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599527842218-9741-0/minicluster-data/ts-0-root
uuid: "455ef2040975481fa5a87ee178499f4b"
format_stamp: "Formatted at 2026-07-09 12:25:25 on dist-test-slave-r7s7"
I20260709 12:25:25.513409  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599527842218-9741-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599527842218-9741-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599527842218-9741-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:25.539808  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:25.541018  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:25.542464  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:25.544864  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:25.545083  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:25.545311  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:25.545473  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:25.590855  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.65:39625
I20260709 12:25:25.590996 22554 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.65:39625 every 8 connection(s)
I20260709 12:25:25.595844  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:25.602638 22559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:25.604625 22560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:25.607133 22562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:25.607722  9741 server_base.cc:1061] running on GCE node
I20260709 12:25:25.609182  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:25.609457  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:25.609671  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599925609651 us; error 0 us; skew 500 ppm
I20260709 12:25:25.609946 22555 heartbeater.cc:344] Connected to a master server at 127.9.131.126:33059
I20260709 12:25:25.610244  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:25.610366 22555 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:25.611377 22555 heartbeater.cc:507] Master 127.9.131.126:33059 requested a full tablet report, sending...
I20260709 12:25:25.613178  9741 webserver.cc:533] Webserver started at http://127.9.131.66:38009/ using document root <none> and password file <none>
I20260709 12:25:25.613920  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:25.613971 22428 ts_manager.cc:194] Registered new tserver with Master: 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625)
I20260709 12:25:25.614240  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:25.614645  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:25.616171  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599527842218-9741-0/minicluster-data/ts-1-root/instance:
uuid: "53423d4abfe4475f909f37f76c3b64cd"
format_stamp: "Formatted at 2026-07-09 12:25:25 on dist-test-slave-r7s7"
I20260709 12:25:25.616568 22428 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34984
I20260709 12:25:25.621353  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:25:25.625211 22567 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:25.626027  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:25:25.626318  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599527842218-9741-0/minicluster-data/ts-1-root
uuid: "53423d4abfe4475f909f37f76c3b64cd"
format_stamp: "Formatted at 2026-07-09 12:25:25 on dist-test-slave-r7s7"
I20260709 12:25:25.626566  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599527842218-9741-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599527842218-9741-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599527842218-9741-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:25.646544  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:25.647596  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:25.649140  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:25.651894  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:25.652125  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:25.652318  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:25.652452  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:25.691442  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.66:35073
I20260709 12:25:25.691562 22629 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.66:35073 every 8 connection(s)
I20260709 12:25:25.696297  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:25.703202 22633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:25.704334 22634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:25.708833 22630 heartbeater.cc:344] Connected to a master server at 127.9.131.126:33059
I20260709 12:25:25.709309 22630 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:25.710103 22630 heartbeater.cc:507] Master 127.9.131.126:33059 requested a full tablet report, sending...
I20260709 12:25:25.711594  9741 server_base.cc:1061] running on GCE node
I20260709 12:25:25.712517 22428 ts_manager.cc:194] Registered new tserver with Master: 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073)
W20260709 12:25:25.713406 22636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:25.714237 22428 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35000
I20260709 12:25:25.714697  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:25.715010  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:25.715221  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599925715202 us; error 0 us; skew 500 ppm
I20260709 12:25:25.715967  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:25.718642  9741 webserver.cc:533] Webserver started at http://127.9.131.67:36383/ using document root <none> and password file <none>
I20260709 12:25:25.719118  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:25.719296  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:25.719560  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:25.720702  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599527842218-9741-0/minicluster-data/ts-2-root/instance:
uuid: "14aa1a831920414a9002c10e716019ca"
format_stamp: "Formatted at 2026-07-09 12:25:25 on dist-test-slave-r7s7"
I20260709 12:25:25.725481  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:25:25.729389 22641 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:25.730208  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:25:25.730531  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599527842218-9741-0/minicluster-data/ts-2-root
uuid: "14aa1a831920414a9002c10e716019ca"
format_stamp: "Formatted at 2026-07-09 12:25:25 on dist-test-slave-r7s7"
I20260709 12:25:25.730845  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599527842218-9741-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599527842218-9741-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599527842218-9741-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:25.741935  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:25.743060  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:25.744524  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:25.746845  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:25.747059  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:25.747283  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:25.747437  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:25.785822  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.67:45073
I20260709 12:25:25.785956 22703 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.67:45073 every 8 connection(s)
I20260709 12:25:25.799607 22704 heartbeater.cc:344] Connected to a master server at 127.9.131.126:33059
I20260709 12:25:25.800098 22704 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:25.800819 22704 heartbeater.cc:507] Master 127.9.131.126:33059 requested a full tablet report, sending...
I20260709 12:25:25.802686 22428 ts_manager.cc:194] Registered new tserver with Master: 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:25.802852  9741 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013534158s
I20260709 12:25:25.804122 22428 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35014
I20260709 12:25:25.828557 22428 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35016:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:25.831097 22428 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:25.911798 22595 tablet_service.cc:1511] Processing CreateTablet for tablet b6a5a612a23b46318cd2f55db7e11764 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:25.913259 22595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a5a612a23b46318cd2f55db7e11764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.913460 22591 tablet_service.cc:1511] Processing CreateTablet for tablet 50a4f3e40a324906b514df458c11bb83 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:25.915145 22591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a4f3e40a324906b514df458c11bb83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.915239 22594 tablet_service.cc:1511] Processing CreateTablet for tablet 12c9fec992dd480c8c81149e589ce6ae (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:25.916534 22590 tablet_service.cc:1511] Processing CreateTablet for tablet 9a249da7da1c4e20a041b9d8798174c1 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:25.917212 22666 tablet_service.cc:1511] Processing CreateTablet for tablet 295498b76d5d4aadbc7d123c6a2043d4 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:25.918995 22669 tablet_service.cc:1511] Processing CreateTablet for tablet b6a5a612a23b46318cd2f55db7e11764 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:25.920194 22514 tablet_service.cc:1511] Processing CreateTablet for tablet bcbfae6456e64f039ef8a0b5765320d0 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:25.917577 22593 tablet_service.cc:1511] Processing CreateTablet for tablet 56382e75ff42435f8cd367e1cd7e04d6 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:25.917414 22520 tablet_service.cc:1511] Processing CreateTablet for tablet b6a5a612a23b46318cd2f55db7e11764 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:25.920452 22667 tablet_service.cc:1511] Processing CreateTablet for tablet 56382e75ff42435f8cd367e1cd7e04d6 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:25.920835 22518 tablet_service.cc:1511] Processing CreateTablet for tablet 56382e75ff42435f8cd367e1cd7e04d6 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:25.922528 22518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56382e75ff42435f8cd367e1cd7e04d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.922950 22517 tablet_service.cc:1511] Processing CreateTablet for tablet 295498b76d5d4aadbc7d123c6a2043d4 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:25.924304 22517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295498b76d5d4aadbc7d123c6a2043d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.915295 22668 tablet_service.cc:1511] Processing CreateTablet for tablet 12c9fec992dd480c8c81149e589ce6ae (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:25.919217 22592 tablet_service.cc:1511] Processing CreateTablet for tablet 295498b76d5d4aadbc7d123c6a2043d4 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:25.928618 22514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcbfae6456e64f039ef8a0b5765320d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.929144 22516 tablet_service.cc:1511] Processing CreateTablet for tablet 50a4f3e40a324906b514df458c11bb83 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:25.930526 22516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a4f3e40a324906b514df458c11bb83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.932328 22593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56382e75ff42435f8cd367e1cd7e04d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.933162 22515 tablet_service.cc:1511] Processing CreateTablet for tablet 9a249da7da1c4e20a041b9d8798174c1 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:25.919016 22666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295498b76d5d4aadbc7d123c6a2043d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.935602 22669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a5a612a23b46318cd2f55db7e11764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.919302 22519 tablet_service.cc:1511] Processing CreateTablet for tablet 12c9fec992dd480c8c81149e589ce6ae (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:25.936903 22668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12c9fec992dd480c8c81149e589ce6ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.933107 22592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295498b76d5d4aadbc7d123c6a2043d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.935700 22515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a249da7da1c4e20a041b9d8798174c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.939451 22590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a249da7da1c4e20a041b9d8798174c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.940284 22520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a5a612a23b46318cd2f55db7e11764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.941597 22519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12c9fec992dd480c8c81149e589ce6ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.942283 22667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56382e75ff42435f8cd367e1cd7e04d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.945381 22594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12c9fec992dd480c8c81149e589ce6ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.965822 22665 tablet_service.cc:1511] Processing CreateTablet for tablet 50a4f3e40a324906b514df458c11bb83 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:25.967644 22665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a4f3e40a324906b514df458c11bb83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.969744 22664 tablet_service.cc:1511] Processing CreateTablet for tablet 9a249da7da1c4e20a041b9d8798174c1 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:25.976981 22664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a249da7da1c4e20a041b9d8798174c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.979236 22589 tablet_service.cc:1511] Processing CreateTablet for tablet bcbfae6456e64f039ef8a0b5765320d0 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:25.980773 22589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcbfae6456e64f039ef8a0b5765320d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.992120 22663 tablet_service.cc:1511] Processing CreateTablet for tablet bcbfae6456e64f039ef8a0b5765320d0 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:25.993615 22663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcbfae6456e64f039ef8a0b5765320d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.014647 22513 tablet_service.cc:1511] Processing CreateTablet for tablet 1e620af1328f41a38c36a9d0f7bca559 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:26.020375 22513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e620af1328f41a38c36a9d0f7bca559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.041145 22588 tablet_service.cc:1511] Processing CreateTablet for tablet 1e620af1328f41a38c36a9d0f7bca559 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:26.046898 22588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e620af1328f41a38c36a9d0f7bca559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.048061 22719 tablet_bootstrap.cc:492] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd: Bootstrap starting.
I20260709 12:25:26.071156 22720 tablet_bootstrap.cc:492] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b: Bootstrap starting.
I20260709 12:25:26.073585 22721 tablet_bootstrap.cc:492] T bcbfae6456e64f039ef8a0b5765320d0 P 14aa1a831920414a9002c10e716019ca: Bootstrap starting.
I20260709 12:25:26.078557 22663 tablet_service.cc:1511] Processing CreateTablet for tablet 1e620af1328f41a38c36a9d0f7bca559 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:26.080134 22663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e620af1328f41a38c36a9d0f7bca559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.081020 22721 tablet_bootstrap.cc:654] T bcbfae6456e64f039ef8a0b5765320d0 P 14aa1a831920414a9002c10e716019ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.090939 22515 tablet_service.cc:1511] Processing CreateTablet for tablet ed2ed22d8525491cab6979ad9ddfc821 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:26.096350 22662 tablet_service.cc:1511] Processing CreateTablet for tablet ed2ed22d8525491cab6979ad9ddfc821 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:26.097316 22515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed2ed22d8525491cab6979ad9ddfc821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.097870 22662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed2ed22d8525491cab6979ad9ddfc821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.100988 22720 tablet_bootstrap.cc:654] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.121481 22719 tablet_bootstrap.cc:654] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.128926 22592 tablet_service.cc:1511] Processing CreateTablet for tablet ed2ed22d8525491cab6979ad9ddfc821 (DEFAULT_TABLE table=test-workload [id=ad5c94b655654b5a8efa00f89fd7753e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:26.130357 22592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed2ed22d8525491cab6979ad9ddfc821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.161362 22721 tablet_bootstrap.cc:492] T bcbfae6456e64f039ef8a0b5765320d0 P 14aa1a831920414a9002c10e716019ca: No bootstrap required, opened a new log
I20260709 12:25:26.161967 22721 ts_tablet_manager.cc:1403] T bcbfae6456e64f039ef8a0b5765320d0 P 14aa1a831920414a9002c10e716019ca: Time spent bootstrapping tablet: real 0.089s	user 0.020s	sys 0.039s
I20260709 12:25:26.163364 22720 tablet_bootstrap.cc:492] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b: No bootstrap required, opened a new log
I20260709 12:25:26.164438 22719 tablet_bootstrap.cc:492] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd: No bootstrap required, opened a new log
I20260709 12:25:26.165601 22719 ts_tablet_manager.cc:1403] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd: Time spent bootstrapping tablet: real 0.118s	user 0.011s	sys 0.003s
I20260709 12:25:26.165093 22721 raft_consensus.cc:359] T bcbfae6456e64f039ef8a0b5765320d0 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.166129 22721 raft_consensus.cc:385] T bcbfae6456e64f039ef8a0b5765320d0 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.166445 22721 raft_consensus.cc:740] T bcbfae6456e64f039ef8a0b5765320d0 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.167200 22721 consensus_queue.cc:260] T bcbfae6456e64f039ef8a0b5765320d0 P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.165046 22720 ts_tablet_manager.cc:1403] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b: Time spent bootstrapping tablet: real 0.094s	user 0.021s	sys 0.005s
I20260709 12:25:26.168550 22719 raft_consensus.cc:359] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.169359 22719 raft_consensus.cc:385] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.169661 22719 raft_consensus.cc:740] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.170455 22719 consensus_queue.cc:260] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.170922 22720 raft_consensus.cc:359] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.171566 22720 raft_consensus.cc:385] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.171833 22720 raft_consensus.cc:740] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.172441 22704 heartbeater.cc:499] Master 127.9.131.126:33059 was elected leader, sending a full tablet report...
I20260709 12:25:26.172627 22720 consensus_queue.cc:260] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.173583 22721 ts_tablet_manager.cc:1434] T bcbfae6456e64f039ef8a0b5765320d0 P 14aa1a831920414a9002c10e716019ca: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:25:26.174835 22721 tablet_bootstrap.cc:492] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca: Bootstrap starting.
I20260709 12:25:26.180176 22719 ts_tablet_manager.cc:1434] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 12:25:26.181427 22719 tablet_bootstrap.cc:492] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd: Bootstrap starting.
I20260709 12:25:26.182165 22721 tablet_bootstrap.cc:654] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.184221 22630 heartbeater.cc:499] Master 127.9.131.126:33059 was elected leader, sending a full tablet report...
I20260709 12:25:26.187729 22719 tablet_bootstrap.cc:654] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.196679 22721 tablet_bootstrap.cc:492] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca: No bootstrap required, opened a new log
I20260709 12:25:26.197290 22719 tablet_bootstrap.cc:492] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd: No bootstrap required, opened a new log
I20260709 12:25:26.197384 22721 ts_tablet_manager.cc:1403] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.003s
I20260709 12:25:26.198071 22719 ts_tablet_manager.cc:1403] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd: Time spent bootstrapping tablet: real 0.017s	user 0.002s	sys 0.012s
I20260709 12:25:26.201308 22719 raft_consensus.cc:359] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.202090 22719 raft_consensus.cc:385] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.201713 22721 raft_consensus.cc:359] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } } peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } }
I20260709 12:25:26.202479 22719 raft_consensus.cc:740] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.202951 22721 raft_consensus.cc:385] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.203550 22721 raft_consensus.cc:740] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.203437 22719 consensus_queue.cc:260] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.204880 22721 consensus_queue.cc:260] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } } peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } }
I20260709 12:25:26.206141 22719 ts_tablet_manager.cc:1434] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:25:26.207321 22719 tablet_bootstrap.cc:492] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd: Bootstrap starting.
I20260709 12:25:26.207849 22721 ts_tablet_manager.cc:1434] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:25:26.209205 22721 tablet_bootstrap.cc:492] T 9a249da7da1c4e20a041b9d8798174c1 P 14aa1a831920414a9002c10e716019ca: Bootstrap starting.
I20260709 12:25:26.213405 22719 tablet_bootstrap.cc:654] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.217519 22721 tablet_bootstrap.cc:654] T 9a249da7da1c4e20a041b9d8798174c1 P 14aa1a831920414a9002c10e716019ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.229655 22721 tablet_bootstrap.cc:492] T 9a249da7da1c4e20a041b9d8798174c1 P 14aa1a831920414a9002c10e716019ca: No bootstrap required, opened a new log
I20260709 12:25:26.230233 22721 ts_tablet_manager.cc:1403] T 9a249da7da1c4e20a041b9d8798174c1 P 14aa1a831920414a9002c10e716019ca: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 12:25:26.233112 22721 raft_consensus.cc:359] T 9a249da7da1c4e20a041b9d8798174c1 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.233851 22721 raft_consensus.cc:385] T 9a249da7da1c4e20a041b9d8798174c1 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.234184 22721 raft_consensus.cc:740] T 9a249da7da1c4e20a041b9d8798174c1 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.234730 22555 heartbeater.cc:499] Master 127.9.131.126:33059 was elected leader, sending a full tablet report...
I20260709 12:25:26.234957 22721 consensus_queue.cc:260] T 9a249da7da1c4e20a041b9d8798174c1 P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.235412 22720 ts_tablet_manager.cc:1434] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b: Time spent starting tablet: real 0.067s	user 0.015s	sys 0.051s
I20260709 12:25:26.236903 22720 tablet_bootstrap.cc:492] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b: Bootstrap starting.
I20260709 12:25:26.237685 22721 ts_tablet_manager.cc:1434] T 9a249da7da1c4e20a041b9d8798174c1 P 14aa1a831920414a9002c10e716019ca: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:26.238770 22721 tablet_bootstrap.cc:492] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca: Bootstrap starting.
I20260709 12:25:26.241267 22725 raft_consensus.cc:493] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.241904 22725 raft_consensus.cc:515] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } } peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } }
I20260709 12:25:26.243419 22720 tablet_bootstrap.cc:654] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.244956 22721 tablet_bootstrap.cc:654] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.260371 22725 leader_election.cc:290] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625)
I20260709 12:25:26.264937 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a5a612a23b46318cd2f55db7e11764" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b" is_pre_election: true
W20260709 12:25:26.267158 22645 leader_election.cc:343] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.286151 22721 tablet_bootstrap.cc:492] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca: No bootstrap required, opened a new log
I20260709 12:25:26.286809 22721 ts_tablet_manager.cc:1403] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca: Time spent bootstrapping tablet: real 0.048s	user 0.023s	sys 0.023s
I20260709 12:25:26.286188 22719 tablet_bootstrap.cc:492] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd: No bootstrap required, opened a new log
I20260709 12:25:26.289824 22721 raft_consensus.cc:359] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.290035 22719 ts_tablet_manager.cc:1403] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.021s
I20260709 12:25:26.290592 22721 raft_consensus.cc:385] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.290194 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a5a612a23b46318cd2f55db7e11764" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd" is_pre_election: true
I20260709 12:25:26.292462 22721 raft_consensus.cc:740] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.293406 22721 consensus_queue.cc:260] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
W20260709 12:25:26.294013 22642 leader_election.cc:343] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.294634 22642 leader_election.cc:304] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14aa1a831920414a9002c10e716019ca; no voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd
I20260709 12:25:26.296154 22721 ts_tablet_manager.cc:1434] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 12:25:26.296789 22725 raft_consensus.cc:2749] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:26.297461 22721 tablet_bootstrap.cc:492] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca: Bootstrap starting.
I20260709 12:25:26.298332 22719 raft_consensus.cc:359] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.299141 22720 tablet_bootstrap.cc:492] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b: No bootstrap required, opened a new log
I20260709 12:25:26.299116 22719 raft_consensus.cc:385] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.299911 22719 raft_consensus.cc:740] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.300130 22720 ts_tablet_manager.cc:1403] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b: Time spent bootstrapping tablet: real 0.064s	user 0.031s	sys 0.030s
I20260709 12:25:26.300719 22719 consensus_queue.cc:260] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.302968 22719 ts_tablet_manager.cc:1434] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:25:26.303462 22720 raft_consensus.cc:359] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.304039 22719 tablet_bootstrap.cc:492] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd: Bootstrap starting.
I20260709 12:25:26.304416 22720 raft_consensus.cc:385] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.304847 22720 raft_consensus.cc:740] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.305678 22720 consensus_queue.cc:260] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.308459 22721 tablet_bootstrap.cc:654] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.310370 22720 ts_tablet_manager.cc:1434] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:25:26.310734 22719 tablet_bootstrap.cc:654] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.311749 22720 tablet_bootstrap.cc:492] T 1e620af1328f41a38c36a9d0f7bca559 P 455ef2040975481fa5a87ee178499f4b: Bootstrap starting.
I20260709 12:25:26.319594 22720 tablet_bootstrap.cc:654] T 1e620af1328f41a38c36a9d0f7bca559 P 455ef2040975481fa5a87ee178499f4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.331764 22720 tablet_bootstrap.cc:492] T 1e620af1328f41a38c36a9d0f7bca559 P 455ef2040975481fa5a87ee178499f4b: No bootstrap required, opened a new log
I20260709 12:25:26.332311 22720 ts_tablet_manager.cc:1403] T 1e620af1328f41a38c36a9d0f7bca559 P 455ef2040975481fa5a87ee178499f4b: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.009s
I20260709 12:25:26.333086 22719 tablet_bootstrap.cc:492] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd: No bootstrap required, opened a new log
I20260709 12:25:26.333662 22719 ts_tablet_manager.cc:1403] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.017s
I20260709 12:25:26.333681 22721 tablet_bootstrap.cc:492] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca: No bootstrap required, opened a new log
I20260709 12:25:26.334338 22721 ts_tablet_manager.cc:1403] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.019s
I20260709 12:25:26.334827 22720 raft_consensus.cc:359] T 1e620af1328f41a38c36a9d0f7bca559 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.335630 22720 raft_consensus.cc:385] T 1e620af1328f41a38c36a9d0f7bca559 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.335939 22720 raft_consensus.cc:740] T 1e620af1328f41a38c36a9d0f7bca559 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.336107 22719 raft_consensus.cc:359] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.336791 22719 raft_consensus.cc:385] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.337160 22719 raft_consensus.cc:740] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.336730 22720 consensus_queue.cc:260] T 1e620af1328f41a38c36a9d0f7bca559 P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.337342 22721 raft_consensus.cc:359] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.337896 22725 raft_consensus.cc:493] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.338135 22721 raft_consensus.cc:385] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.338068 22719 consensus_queue.cc:260] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.338685 22721 raft_consensus.cc:740] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.338428 22725 raft_consensus.cc:515] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.339534 22721 consensus_queue.cc:260] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.340731 22725 leader_election.cc:290] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073)
I20260709 12:25:26.342270 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c9fec992dd480c8c81149e589ce6ae" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b" is_pre_election: true
W20260709 12:25:26.344094 22645 leader_election.cc:343] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.345667 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c9fec992dd480c8c81149e589ce6ae" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd" is_pre_election: true
I20260709 12:25:26.346143 22720 ts_tablet_manager.cc:1434] T 1e620af1328f41a38c36a9d0f7bca559 P 455ef2040975481fa5a87ee178499f4b: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.004s
I20260709 12:25:26.346374 22721 ts_tablet_manager.cc:1434] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.005s
W20260709 12:25:26.347222 22642 leader_election.cc:343] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.347326 22720 tablet_bootstrap.cc:492] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b: Bootstrap starting.
I20260709 12:25:26.347365 22721 tablet_bootstrap.cc:492] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca: Bootstrap starting.
I20260709 12:25:26.350785 22719 ts_tablet_manager.cc:1434] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.001s
I20260709 12:25:26.352089 22719 tablet_bootstrap.cc:492] T 295498b76d5d4aadbc7d123c6a2043d4 P 53423d4abfe4475f909f37f76c3b64cd: Bootstrap starting.
I20260709 12:25:26.354525 22720 tablet_bootstrap.cc:654] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.354543 22642 leader_election.cc:304] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14aa1a831920414a9002c10e716019ca; no voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd
I20260709 12:25:26.356186 22738 raft_consensus.cc:2749] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:26.354525 22721 tablet_bootstrap.cc:654] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.358668 22719 tablet_bootstrap.cc:654] T 295498b76d5d4aadbc7d123c6a2043d4 P 53423d4abfe4475f909f37f76c3b64cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.366868 22720 tablet_bootstrap.cc:492] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b: No bootstrap required, opened a new log
I20260709 12:25:26.367481 22720 ts_tablet_manager.cc:1403] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 12:25:26.389506 22720 raft_consensus.cc:359] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.390156 22720 raft_consensus.cc:385] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.390391 22720 raft_consensus.cc:740] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.391070 22720 consensus_queue.cc:260] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.391129 22727 raft_consensus.cc:493] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.391811 22727 raft_consensus.cc:515] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.394661 22721 tablet_bootstrap.cc:492] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca: No bootstrap required, opened a new log
I20260709 12:25:26.395356 22721 ts_tablet_manager.cc:1403] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca: Time spent bootstrapping tablet: real 0.048s	user 0.025s	sys 0.016s
I20260709 12:25:26.396507 22727 leader_election.cc:290] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:26.398443 22719 tablet_bootstrap.cc:492] T 295498b76d5d4aadbc7d123c6a2043d4 P 53423d4abfe4475f909f37f76c3b64cd: No bootstrap required, opened a new log
I20260709 12:25:26.399143 22719 ts_tablet_manager.cc:1403] T 295498b76d5d4aadbc7d123c6a2043d4 P 53423d4abfe4475f909f37f76c3b64cd: Time spent bootstrapping tablet: real 0.047s	user 0.020s	sys 0.024s
I20260709 12:25:26.399570 22721 raft_consensus.cc:359] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.400588 22721 raft_consensus.cc:385] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.400978 22721 raft_consensus.cc:740] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.402117 22721 consensus_queue.cc:260] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.402678 22719 raft_consensus.cc:359] T 295498b76d5d4aadbc7d123c6a2043d4 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.403645 22719 raft_consensus.cc:385] T 295498b76d5d4aadbc7d123c6a2043d4 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.404085 22719 raft_consensus.cc:740] T 295498b76d5d4aadbc7d123c6a2043d4 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.404942 22719 consensus_queue.cc:260] T 295498b76d5d4aadbc7d123c6a2043d4 P 53423d4abfe4475f909f37f76c3b64cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.407611 22719 ts_tablet_manager.cc:1434] T 295498b76d5d4aadbc7d123c6a2043d4 P 53423d4abfe4475f909f37f76c3b64cd: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 12:25:26.408685 22719 tablet_bootstrap.cc:492] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd: Bootstrap starting.
I20260709 12:25:26.409897 22720 ts_tablet_manager.cc:1434] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.002s
I20260709 12:25:26.414103 22721 ts_tablet_manager.cc:1434] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
W20260709 12:25:26.416815 22476 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:26.417640 22720 tablet_bootstrap.cc:492] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b: Bootstrap starting.
I20260709 12:25:26.417870 22719 tablet_bootstrap.cc:654] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.419708 22721 tablet_bootstrap.cc:492] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca: Bootstrap starting.
I20260709 12:25:26.427385 22721 tablet_bootstrap.cc:654] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.429004 22719 tablet_bootstrap.cc:492] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd: No bootstrap required, opened a new log
I20260709 12:25:26.429560 22719 ts_tablet_manager.cc:1403] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 12:25:26.432149 22719 raft_consensus.cc:359] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.432843 22719 raft_consensus.cc:385] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.433064 22719 raft_consensus.cc:740] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.433684 22719 consensus_queue.cc:260] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.435832 22719 ts_tablet_manager.cc:1434] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:25:26.436872 22719 tablet_bootstrap.cc:492] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd: Bootstrap starting.
I20260709 12:25:26.441385 22720 tablet_bootstrap.cc:654] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.443306 22719 tablet_bootstrap.cc:654] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.455955 22679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a249da7da1c4e20a041b9d8798174c1" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca" is_pre_election: true
I20260709 12:25:26.456226 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a249da7da1c4e20a041b9d8798174c1" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd" is_pre_election: true
I20260709 12:25:26.456771 22679 raft_consensus.cc:2468] T 9a249da7da1c4e20a041b9d8798174c1 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 0.
I20260709 12:25:26.456820 22605 raft_consensus.cc:2468] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 0.
I20260709 12:25:26.458364 22493 leader_election.cc:304] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:26.459580 22727 raft_consensus.cc:2804] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.460000 22727 raft_consensus.cc:493] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.460129 22721 tablet_bootstrap.cc:492] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca: No bootstrap required, opened a new log
I20260709 12:25:26.460361 22727 raft_consensus.cc:3060] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.460731 22721 ts_tablet_manager.cc:1403] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.016s
I20260709 12:25:26.464118 22721 raft_consensus.cc:359] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.464825 22721 raft_consensus.cc:385] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.465113 22721 raft_consensus.cc:740] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.465984 22721 consensus_queue.cc:260] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.469566 22727 raft_consensus.cc:515] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.472582 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a249da7da1c4e20a041b9d8798174c1" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:26.473201 22605 raft_consensus.cc:3060] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.475468 22721 ts_tablet_manager.cc:1434] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:25:26.478736 22726 raft_consensus.cc:493] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.479358 22726 raft_consensus.cc:515] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.481616 22605 raft_consensus.cc:2468] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 1.
I20260709 12:25:26.483139 22493 leader_election.cc:304] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:26.490157 22679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a249da7da1c4e20a041b9d8798174c1" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:26.490847 22679 raft_consensus.cc:3060] T 9a249da7da1c4e20a041b9d8798174c1 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.500509 22727 leader_election.cc:290] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 election: Requested vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:26.501449 22727 raft_consensus.cc:2804] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:26.501929 22727 raft_consensus.cc:697] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Becoming Leader. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Running, Role: LEADER
I20260709 12:25:26.500509 22726 leader_election.cc:290] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:26.502575 22726 raft_consensus.cc:493] T 295498b76d5d4aadbc7d123c6a2043d4 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.499643 22679 raft_consensus.cc:2468] T 9a249da7da1c4e20a041b9d8798174c1 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 1.
I20260709 12:25:26.503060 22726 raft_consensus.cc:515] T 295498b76d5d4aadbc7d123c6a2043d4 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.505333 22726 leader_election.cc:290] T 295498b76d5d4aadbc7d123c6a2043d4 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:26.505879 22727 consensus_queue.cc:237] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.513451 22721 tablet_bootstrap.cc:492] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca: Bootstrap starting.
I20260709 12:25:26.517038 22749 raft_consensus.cc:493] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.517977 22749 raft_consensus.cc:515] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.521924 22749 leader_election.cc:290] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:26.523303 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbfae6456e64f039ef8a0b5765320d0" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd" is_pre_election: true
I20260709 12:25:26.524160 22605 raft_consensus.cc:2468] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 0.
I20260709 12:25:26.524323 22721 tablet_bootstrap.cc:654] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.525421 22493 leader_election.cc:304] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:26.526274 22749 raft_consensus.cc:2804] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.526758 22749 raft_consensus.cc:493] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.526674 22679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbfae6456e64f039ef8a0b5765320d0" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca" is_pre_election: true
I20260709 12:25:26.527432 22749 raft_consensus.cc:3060] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.527683 22679 raft_consensus.cc:2468] T bcbfae6456e64f039ef8a0b5765320d0 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 0.
I20260709 12:25:26.537988 22719 tablet_bootstrap.cc:492] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd: No bootstrap required, opened a new log
I20260709 12:25:26.538635 22719 ts_tablet_manager.cc:1403] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd: Time spent bootstrapping tablet: real 0.102s	user 0.044s	sys 0.054s
I20260709 12:25:26.540159 22720 tablet_bootstrap.cc:492] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b: No bootstrap required, opened a new log
I20260709 12:25:26.541925 22719 raft_consensus.cc:359] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } } peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } }
I20260709 12:25:26.542968 22719 raft_consensus.cc:385] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.542685 22749 raft_consensus.cc:515] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.543308 22719 raft_consensus.cc:740] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.544139 22719 consensus_queue.cc:260] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } } peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } }
I20260709 12:25:26.546450 22719 ts_tablet_manager.cc:1434] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:26.547526 22719 tablet_bootstrap.cc:492] T ed2ed22d8525491cab6979ad9ddfc821 P 53423d4abfe4475f909f37f76c3b64cd: Bootstrap starting.
I20260709 12:25:26.549095 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a4f3e40a324906b514df458c11bb83" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b" is_pre_election: true
I20260709 12:25:26.549880 22530 raft_consensus.cc:2468] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 0.
I20260709 12:25:26.549081 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbfae6456e64f039ef8a0b5765320d0" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:26.551328 22605 raft_consensus.cc:3060] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.551703 22571 leader_election.cc:304] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:26.551821 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295498b76d5d4aadbc7d123c6a2043d4" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b" is_pre_election: true
I20260709 12:25:26.553057 22751 raft_consensus.cc:2804] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.553435 22751 raft_consensus.cc:493] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.553785 22751 raft_consensus.cc:3060] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.552170 22720 ts_tablet_manager.cc:1403] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b: Time spent bootstrapping tablet: real 0.135s	user 0.033s	sys 0.042s
W20260709 12:25:26.553929 22571 leader_election.cc:343] T 295498b76d5d4aadbc7d123c6a2043d4 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.554512 22719 tablet_bootstrap.cc:654] T ed2ed22d8525491cab6979ad9ddfc821 P 53423d4abfe4475f909f37f76c3b64cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.557202 22720 raft_consensus.cc:359] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.558035 22720 raft_consensus.cc:385] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.558331 22720 raft_consensus.cc:740] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.559095 22720 consensus_queue.cc:260] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.561080 22426 catalog_manager.cc:5697] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b reported cstate change: term changed from 0 to 1, leader changed from <none> to 455ef2040975481fa5a87ee178499f4b (127.9.131.65). New cstate: current_term: 1 leader_uuid: "455ef2040975481fa5a87ee178499f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.569232 22605 raft_consensus.cc:2468] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 1.
I20260709 12:25:26.568890 22751 raft_consensus.cc:515] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.571887 22679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbfae6456e64f039ef8a0b5765320d0" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:26.573374 22679 raft_consensus.cc:3060] T bcbfae6456e64f039ef8a0b5765320d0 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.574702 22751 leader_election.cc:290] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 election: Requested vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:26.576321 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a4f3e40a324906b514df458c11bb83" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b"
I20260709 12:25:26.572515 22749 leader_election.cc:290] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 election: Requested vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:26.577047 22529 raft_consensus.cc:3060] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.583173 22679 raft_consensus.cc:2468] T bcbfae6456e64f039ef8a0b5765320d0 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 1.
I20260709 12:25:26.584846 22493 leader_election.cc:304] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:26.585951 22529 raft_consensus.cc:2468] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 1.
I20260709 12:25:26.586318 22749 raft_consensus.cc:2804] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:26.587064 22749 raft_consensus.cc:697] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Becoming Leader. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Running, Role: LEADER
I20260709 12:25:26.587492 22571 leader_election.cc:304] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:26.588558 22751 raft_consensus.cc:2804] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:26.588076 22749 consensus_queue.cc:237] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.589143 22751 raft_consensus.cc:697] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Becoming Leader. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Running, Role: LEADER
I20260709 12:25:26.590018 22751 consensus_queue.cc:237] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.597627 22719 tablet_bootstrap.cc:492] T ed2ed22d8525491cab6979ad9ddfc821 P 53423d4abfe4475f909f37f76c3b64cd: No bootstrap required, opened a new log
I20260709 12:25:26.598313 22719 ts_tablet_manager.cc:1403] T ed2ed22d8525491cab6979ad9ddfc821 P 53423d4abfe4475f909f37f76c3b64cd: Time spent bootstrapping tablet: real 0.051s	user 0.020s	sys 0.028s
I20260709 12:25:26.598443 22720 ts_tablet_manager.cc:1434] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.010s
I20260709 12:25:26.599581 22720 tablet_bootstrap.cc:492] T ed2ed22d8525491cab6979ad9ddfc821 P 455ef2040975481fa5a87ee178499f4b: Bootstrap starting.
I20260709 12:25:26.601424 22719 raft_consensus.cc:359] T ed2ed22d8525491cab6979ad9ddfc821 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.602218 22719 raft_consensus.cc:385] T ed2ed22d8525491cab6979ad9ddfc821 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.602566 22719 raft_consensus.cc:740] T ed2ed22d8525491cab6979ad9ddfc821 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.602854 22738 raft_consensus.cc:493] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.603410 22719 consensus_queue.cc:260] T ed2ed22d8525491cab6979ad9ddfc821 P 53423d4abfe4475f909f37f76c3b64cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.605300 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a4f3e40a324906b514df458c11bb83" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:26.606125 22677 raft_consensus.cc:3060] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.607615 22720 tablet_bootstrap.cc:654] T ed2ed22d8525491cab6979ad9ddfc821 P 455ef2040975481fa5a87ee178499f4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.608423 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295498b76d5d4aadbc7d123c6a2043d4" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca" is_pre_election: true
I20260709 12:25:26.609844 22679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a4f3e40a324906b514df458c11bb83" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca" is_pre_election: true
I20260709 12:25:26.610301 22721 tablet_bootstrap.cc:492] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca: No bootstrap required, opened a new log
I20260709 12:25:26.603440 22738 raft_consensus.cc:515] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
W20260709 12:25:26.612422 22570 leader_election.cc:343] T 295498b76d5d4aadbc7d123c6a2043d4 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.613003 22570 leader_election.cc:304] T 295498b76d5d4aadbc7d123c6a2043d4 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53423d4abfe4475f909f37f76c3b64cd; no voters: 14aa1a831920414a9002c10e716019ca, 455ef2040975481fa5a87ee178499f4b
I20260709 12:25:26.613267 22721 ts_tablet_manager.cc:1403] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca: Time spent bootstrapping tablet: real 0.100s	user 0.021s	sys 0.022s
I20260709 12:25:26.613492 22738 leader_election.cc:290] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073)
I20260709 12:25:26.614269 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e620af1328f41a38c36a9d0f7bca559" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b" is_pre_election: true
I20260709 12:25:26.615051 22529 raft_consensus.cc:2468] T 1e620af1328f41a38c36a9d0f7bca559 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 0.
I20260709 12:25:26.616384 22645 leader_election.cc:304] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 455ef2040975481fa5a87ee178499f4b; no voters: 
I20260709 12:25:26.616504 22721 raft_consensus.cc:359] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.617334 22738 raft_consensus.cc:2804] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.617782 22738 raft_consensus.cc:493] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.618140 22738 raft_consensus.cc:3060] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.620870 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e620af1328f41a38c36a9d0f7bca559" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd" is_pre_election: true
I20260709 12:25:26.621784 22605 raft_consensus.cc:2468] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 0.
I20260709 12:25:26.623286 22751 raft_consensus.cc:2749] T 295498b76d5d4aadbc7d123c6a2043d4 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:26.627148 22738 raft_consensus.cc:515] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.617343 22721 raft_consensus.cc:385] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.628751 22721 raft_consensus.cc:740] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.629698 22721 consensus_queue.cc:260] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.606119 22719 ts_tablet_manager.cc:1434] T ed2ed22d8525491cab6979ad9ddfc821 P 53423d4abfe4475f909f37f76c3b64cd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:26.631762 22719 tablet_bootstrap.cc:492] T 56382e75ff42435f8cd367e1cd7e04d6 P 53423d4abfe4475f909f37f76c3b64cd: Bootstrap starting.
I20260709 12:25:26.633469 22677 raft_consensus.cc:2468] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 1.
I20260709 12:25:26.638842 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e620af1328f41a38c36a9d0f7bca559" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b"
I20260709 12:25:26.639605 22529 raft_consensus.cc:3060] T 1e620af1328f41a38c36a9d0f7bca559 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.648535 22529 raft_consensus.cc:2468] T 1e620af1328f41a38c36a9d0f7bca559 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 1.
I20260709 12:25:26.644945 22719 tablet_bootstrap.cc:654] T 56382e75ff42435f8cd367e1cd7e04d6 P 53423d4abfe4475f909f37f76c3b64cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.655433 22425 catalog_manager.cc:5697] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66). New cstate: current_term: 1 leader_uuid: "53423d4abfe4475f909f37f76c3b64cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.656607 22645 leader_election.cc:304] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 455ef2040975481fa5a87ee178499f4b; no voters: 
I20260709 12:25:26.657828 22725 raft_consensus.cc:2804] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:26.665758 22427 catalog_manager.cc:5697] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b reported cstate change: term changed from 0 to 1, leader changed from <none> to 455ef2040975481fa5a87ee178499f4b (127.9.131.65). New cstate: current_term: 1 leader_uuid: "455ef2040975481fa5a87ee178499f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.669080 22721 ts_tablet_manager.cc:1434] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.001s
I20260709 12:25:26.673059 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e620af1328f41a38c36a9d0f7bca559" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:26.673873 22605 raft_consensus.cc:3060] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.687213 22605 raft_consensus.cc:2468] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 1.
I20260709 12:25:26.688808 22725 raft_consensus.cc:697] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Becoming Leader. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Running, Role: LEADER
I20260709 12:25:26.690024 22725 consensus_queue.cc:237] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.693470 22738 leader_election.cc:290] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 election: Requested vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073)
I20260709 12:25:26.694599 22721 tablet_bootstrap.cc:492] T 295498b76d5d4aadbc7d123c6a2043d4 P 14aa1a831920414a9002c10e716019ca: Bootstrap starting.
I20260709 12:25:26.699080 22719 tablet_bootstrap.cc:492] T 56382e75ff42435f8cd367e1cd7e04d6 P 53423d4abfe4475f909f37f76c3b64cd: No bootstrap required, opened a new log
I20260709 12:25:26.703717 22719 ts_tablet_manager.cc:1403] T 56382e75ff42435f8cd367e1cd7e04d6 P 53423d4abfe4475f909f37f76c3b64cd: Time spent bootstrapping tablet: real 0.072s	user 0.034s	sys 0.019s
I20260709 12:25:26.706910 22720 tablet_bootstrap.cc:492] T ed2ed22d8525491cab6979ad9ddfc821 P 455ef2040975481fa5a87ee178499f4b: No bootstrap required, opened a new log
I20260709 12:25:26.707325 22721 tablet_bootstrap.cc:654] T 295498b76d5d4aadbc7d123c6a2043d4 P 14aa1a831920414a9002c10e716019ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.707562 22720 ts_tablet_manager.cc:1403] T ed2ed22d8525491cab6979ad9ddfc821 P 455ef2040975481fa5a87ee178499f4b: Time spent bootstrapping tablet: real 0.108s	user 0.049s	sys 0.045s
I20260709 12:25:26.707672 22719 raft_consensus.cc:359] T 56382e75ff42435f8cd367e1cd7e04d6 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.708755 22719 raft_consensus.cc:385] T 56382e75ff42435f8cd367e1cd7e04d6 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.709074 22719 raft_consensus.cc:740] T 56382e75ff42435f8cd367e1cd7e04d6 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.709959 22719 consensus_queue.cc:260] T 56382e75ff42435f8cd367e1cd7e04d6 P 53423d4abfe4475f909f37f76c3b64cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.710973 22720 raft_consensus.cc:359] T ed2ed22d8525491cab6979ad9ddfc821 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.711783 22720 raft_consensus.cc:385] T ed2ed22d8525491cab6979ad9ddfc821 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.712105 22720 raft_consensus.cc:740] T ed2ed22d8525491cab6979ad9ddfc821 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.712803 22719 ts_tablet_manager.cc:1434] T 56382e75ff42435f8cd367e1cd7e04d6 P 53423d4abfe4475f909f37f76c3b64cd: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:25:26.713023 22720 consensus_queue.cc:260] T ed2ed22d8525491cab6979ad9ddfc821 P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.713567 22425 catalog_manager.cc:5697] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 14aa1a831920414a9002c10e716019ca (127.9.131.67). New cstate: current_term: 1 leader_uuid: "14aa1a831920414a9002c10e716019ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:26.718107 22720 ts_tablet_manager.cc:1434] T ed2ed22d8525491cab6979ad9ddfc821 P 455ef2040975481fa5a87ee178499f4b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:25:26.719391 22720 tablet_bootstrap.cc:492] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b: Bootstrap starting.
I20260709 12:25:26.726157 22721 tablet_bootstrap.cc:492] T 295498b76d5d4aadbc7d123c6a2043d4 P 14aa1a831920414a9002c10e716019ca: No bootstrap required, opened a new log
I20260709 12:25:26.726643 22720 tablet_bootstrap.cc:654] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.726779 22721 ts_tablet_manager.cc:1403] T 295498b76d5d4aadbc7d123c6a2043d4 P 14aa1a831920414a9002c10e716019ca: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.007s
I20260709 12:25:26.729539 22721 raft_consensus.cc:359] T 295498b76d5d4aadbc7d123c6a2043d4 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.730175 22721 raft_consensus.cc:385] T 295498b76d5d4aadbc7d123c6a2043d4 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.730460 22721 raft_consensus.cc:740] T 295498b76d5d4aadbc7d123c6a2043d4 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.731122 22721 consensus_queue.cc:260] T 295498b76d5d4aadbc7d123c6a2043d4 P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.732513 22720 tablet_bootstrap.cc:492] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b: No bootstrap required, opened a new log
I20260709 12:25:26.733183 22720 ts_tablet_manager.cc:1403] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 12:25:26.733312 22721 ts_tablet_manager.cc:1434] T 295498b76d5d4aadbc7d123c6a2043d4 P 14aa1a831920414a9002c10e716019ca: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:25:26.736402 22720 raft_consensus.cc:359] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.736974 22720 raft_consensus.cc:385] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.737196 22720 raft_consensus.cc:740] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.737866 22720 consensus_queue.cc:260] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.739816 22720 ts_tablet_manager.cc:1434] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 12:25:26.740916 22720 tablet_bootstrap.cc:492] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b: Bootstrap starting.
I20260709 12:25:26.747169 22720 tablet_bootstrap.cc:654] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.751771 22720 tablet_bootstrap.cc:492] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b: No bootstrap required, opened a new log
I20260709 12:25:26.752231 22720 ts_tablet_manager.cc:1403] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.004s
I20260709 12:25:26.754138 22720 raft_consensus.cc:359] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.754657 22720 raft_consensus.cc:385] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.754853 22720 raft_consensus.cc:740] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.755357 22720 consensus_queue.cc:260] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.756798 22720 ts_tablet_manager.cc:1434] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:25:26.757725 22720 tablet_bootstrap.cc:492] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b: Bootstrap starting.
I20260709 12:25:26.763362 22720 tablet_bootstrap.cc:654] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.768041 22720 tablet_bootstrap.cc:492] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b: No bootstrap required, opened a new log
I20260709 12:25:26.768524 22720 ts_tablet_manager.cc:1403] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:25:26.770602 22720 raft_consensus.cc:359] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } } peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } }
I20260709 12:25:26.771104 22720 raft_consensus.cc:385] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.771298 22720 raft_consensus.cc:740] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.771835 22720 consensus_queue.cc:260] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } } peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } }
I20260709 12:25:26.773555 22720 ts_tablet_manager.cc:1434] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 12:25:26.778872 22751 raft_consensus.cc:493] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.779510 22751 raft_consensus.cc:515] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } } peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } }
I20260709 12:25:26.781479 22751 leader_election.cc:290] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073), 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625)
I20260709 12:25:26.782281 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a5a612a23b46318cd2f55db7e11764" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca" is_pre_election: true
I20260709 12:25:26.782929 22677 raft_consensus.cc:2468] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 0.
I20260709 12:25:26.782622 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a5a612a23b46318cd2f55db7e11764" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b" is_pre_election: true
I20260709 12:25:26.783558 22529 raft_consensus.cc:2468] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 0.
I20260709 12:25:26.784256 22570 leader_election.cc:304] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:26.785466 22751 raft_consensus.cc:2804] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.785777 22751 raft_consensus.cc:493] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.786037 22751 raft_consensus.cc:3060] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.791746 22749 raft_consensus.cc:493] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.792361 22749 raft_consensus.cc:515] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.792567 22751 raft_consensus.cc:515] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } } peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } }
I20260709 12:25:26.794263 22749 leader_election.cc:290] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:26.795231 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a5a612a23b46318cd2f55db7e11764" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:26.795184 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295498b76d5d4aadbc7d123c6a2043d4" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd" is_pre_election: true
I20260709 12:25:26.795764 22679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295498b76d5d4aadbc7d123c6a2043d4" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca" is_pre_election: true
I20260709 12:25:26.796008 22677 raft_consensus.cc:3060] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.796098 22605 raft_consensus.cc:2468] T 295498b76d5d4aadbc7d123c6a2043d4 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 0.
I20260709 12:25:26.796520 22679 raft_consensus.cc:2468] T 295498b76d5d4aadbc7d123c6a2043d4 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 0.
I20260709 12:25:26.797557 22493 leader_election.cc:304] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:26.798445 22749 raft_consensus.cc:2804] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.798820 22749 raft_consensus.cc:493] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.799142 22749 raft_consensus.cc:3060] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.799417 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a5a612a23b46318cd2f55db7e11764" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b"
I20260709 12:25:26.799981 22529 raft_consensus.cc:3060] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.803973 22751 leader_election.cc:290] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 election: Requested vote from peers 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073), 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625)
I20260709 12:25:26.804452 22677 raft_consensus.cc:2468] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 1.
I20260709 12:25:26.805223 22529 raft_consensus.cc:2468] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 1.
I20260709 12:25:26.805794 22570 leader_election.cc:304] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:26.806646 22751 raft_consensus.cc:2804] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:26.806473 22749 raft_consensus.cc:515] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.807209 22751 raft_consensus.cc:697] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Becoming Leader. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Running, Role: LEADER
I20260709 12:25:26.808110 22751 consensus_queue.cc:237] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } } peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } }
I20260709 12:25:26.808646 22749 leader_election.cc:290] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 election: Requested vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:26.809561 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295498b76d5d4aadbc7d123c6a2043d4" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:26.809953 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295498b76d5d4aadbc7d123c6a2043d4" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:26.810202 22605 raft_consensus.cc:3060] T 295498b76d5d4aadbc7d123c6a2043d4 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.810560 22677 raft_consensus.cc:3060] T 295498b76d5d4aadbc7d123c6a2043d4 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.817989 22677 raft_consensus.cc:2468] T 295498b76d5d4aadbc7d123c6a2043d4 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 1.
I20260709 12:25:26.817993 22605 raft_consensus.cc:2468] T 295498b76d5d4aadbc7d123c6a2043d4 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 1.
I20260709 12:25:26.819342 22493 leader_election.cc:304] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:26.820113 22749 raft_consensus.cc:2804] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:26.820600 22749 raft_consensus.cc:697] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Becoming Leader. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Running, Role: LEADER
I20260709 12:25:26.820360 22425 catalog_manager.cc:5697] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66). New cstate: current_term: 1 leader_uuid: "53423d4abfe4475f909f37f76c3b64cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.821467 22749 consensus_queue.cc:237] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.831452 22725 raft_consensus.cc:493] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.832105 22725 raft_consensus.cc:515] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.831382 22425 catalog_manager.cc:5697] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b reported cstate change: term changed from 0 to 1, leader changed from <none> to 455ef2040975481fa5a87ee178499f4b (127.9.131.65). New cstate: current_term: 1 leader_uuid: "455ef2040975481fa5a87ee178499f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.833932 22725 leader_election.cc:290] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073)
I20260709 12:25:26.834884 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2ed22d8525491cab6979ad9ddfc821" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b" is_pre_election: true
I20260709 12:25:26.835372 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2ed22d8525491cab6979ad9ddfc821" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd" is_pre_election: true
I20260709 12:25:26.835573 22529 raft_consensus.cc:2468] T ed2ed22d8525491cab6979ad9ddfc821 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 0.
I20260709 12:25:26.835983 22605 raft_consensus.cc:2468] T ed2ed22d8525491cab6979ad9ddfc821 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 0.
I20260709 12:25:26.836782 22645 leader_election.cc:304] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 455ef2040975481fa5a87ee178499f4b; no voters: 
I20260709 12:25:26.837778 22725 raft_consensus.cc:2804] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.838071 22725 raft_consensus.cc:493] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.838322 22725 raft_consensus.cc:3060] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.844890 22725 raft_consensus.cc:515] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.846715 22725 leader_election.cc:290] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 election: Requested vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073)
I20260709 12:25:26.847476 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2ed22d8525491cab6979ad9ddfc821" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b"
I20260709 12:25:26.847812 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2ed22d8525491cab6979ad9ddfc821" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:26.848188 22529 raft_consensus.cc:3060] T ed2ed22d8525491cab6979ad9ddfc821 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.848435 22605 raft_consensus.cc:3060] T ed2ed22d8525491cab6979ad9ddfc821 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.855702 22605 raft_consensus.cc:2468] T ed2ed22d8525491cab6979ad9ddfc821 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 1.
I20260709 12:25:26.855702 22529 raft_consensus.cc:2468] T ed2ed22d8525491cab6979ad9ddfc821 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 1.
I20260709 12:25:26.857090 22645 leader_election.cc:304] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 455ef2040975481fa5a87ee178499f4b; no voters: 
I20260709 12:25:26.857769 22725 raft_consensus.cc:2804] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:26.858217 22725 raft_consensus.cc:697] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Becoming Leader. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Running, Role: LEADER
I20260709 12:25:26.858978 22725 consensus_queue.cc:237] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.865965 22425 catalog_manager.cc:5697] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 14aa1a831920414a9002c10e716019ca (127.9.131.67). New cstate: current_term: 1 leader_uuid: "14aa1a831920414a9002c10e716019ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:26.877003 22725 raft_consensus.cc:493] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.877468 22725 raft_consensus.cc:515] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.879179 22725 leader_election.cc:290] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073)
I20260709 12:25:26.879930 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56382e75ff42435f8cd367e1cd7e04d6" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b" is_pre_election: true
I20260709 12:25:26.880215 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56382e75ff42435f8cd367e1cd7e04d6" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd" is_pre_election: true
I20260709 12:25:26.880545 22529 raft_consensus.cc:2468] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 0.
I20260709 12:25:26.880849 22605 raft_consensus.cc:2468] T 56382e75ff42435f8cd367e1cd7e04d6 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 0.
I20260709 12:25:26.881536 22645 leader_election.cc:304] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 455ef2040975481fa5a87ee178499f4b; no voters: 
I20260709 12:25:26.882339 22725 raft_consensus.cc:2804] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.882642 22725 raft_consensus.cc:493] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.882889 22725 raft_consensus.cc:3060] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.888131 22725 raft_consensus.cc:515] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.889737 22725 leader_election.cc:290] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 election: Requested vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073)
I20260709 12:25:26.890727 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56382e75ff42435f8cd367e1cd7e04d6" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b"
I20260709 12:25:26.890810 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56382e75ff42435f8cd367e1cd7e04d6" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:26.891396 22529 raft_consensus.cc:3060] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.891505 22605 raft_consensus.cc:3060] T 56382e75ff42435f8cd367e1cd7e04d6 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.897296 22605 raft_consensus.cc:2468] T 56382e75ff42435f8cd367e1cd7e04d6 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 1.
I20260709 12:25:26.897392 22529 raft_consensus.cc:2468] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 1.
I20260709 12:25:26.898445 22642 leader_election.cc:304] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:26.899154 22725 raft_consensus.cc:2804] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:26.899582 22725 raft_consensus.cc:697] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Becoming Leader. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Running, Role: LEADER
I20260709 12:25:26.900363 22725 consensus_queue.cc:237] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.907302 22425 catalog_manager.cc:5697] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 14aa1a831920414a9002c10e716019ca (127.9.131.67). New cstate: current_term: 1 leader_uuid: "14aa1a831920414a9002c10e716019ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:26.919246 22751 raft_consensus.cc:493] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.919765 22751 raft_consensus.cc:515] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.921581 22751 leader_election.cc:290] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:26.922328 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c9fec992dd480c8c81149e589ce6ae" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b" is_pre_election: true
I20260709 12:25:26.922588 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c9fec992dd480c8c81149e589ce6ae" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca" is_pre_election: true
I20260709 12:25:26.922978 22529 raft_consensus.cc:2468] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 0.
I20260709 12:25:26.923182 22677 raft_consensus.cc:2468] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 0.
I20260709 12:25:26.923988 22571 leader_election.cc:304] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:26.924753 22751 raft_consensus.cc:2804] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.925027 22751 raft_consensus.cc:493] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.925290 22751 raft_consensus.cc:3060] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.930667 22751 raft_consensus.cc:515] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.932392 22751 leader_election.cc:290] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 election: Requested vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:26.933207 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c9fec992dd480c8c81149e589ce6ae" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b"
I20260709 12:25:26.933523 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c9fec992dd480c8c81149e589ce6ae" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:26.933900 22529 raft_consensus.cc:3060] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.934078 22677 raft_consensus.cc:3060] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.941344 22677 raft_consensus.cc:2468] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 1.
I20260709 12:25:26.941344 22529 raft_consensus.cc:2468] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 1.
I20260709 12:25:26.942704 22571 leader_election.cc:304] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:26.943397 22751 raft_consensus.cc:2804] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:26.943840 22751 raft_consensus.cc:697] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Becoming Leader. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Running, Role: LEADER
I20260709 12:25:26.944533 22751 consensus_queue.cc:237] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:26.951325 22425 catalog_manager.cc:5697] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66). New cstate: current_term: 1 leader_uuid: "53423d4abfe4475f909f37f76c3b64cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.955274 22749 consensus_queue.cc:1048] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:26.968001 22755 consensus_queue.cc:1048] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:26.997432 22751 consensus_queue.cc:1048] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.009670 22780 consensus_queue.cc:1048] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:27.020951 22727 consensus_queue.cc:1048] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.033174 22727 consensus_queue.cc:1048] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.064553 22605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6a5a612a23b46318cd2f55db7e11764"
dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
mode: GRACEFUL
new_leader_uuid: "455ef2040975481fa5a87ee178499f4b"
 from {username='slave'} at 127.0.0.1:53028
I20260709 12:25:27.065137 22605 raft_consensus.cc:606] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Received request to transfer leadership to TS 455ef2040975481fa5a87ee178499f4b
I20260709 12:25:27.070755 22605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12c9fec992dd480c8c81149e589ce6ae"
dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
mode: GRACEFUL
new_leader_uuid: "455ef2040975481fa5a87ee178499f4b"
 from {username='slave'} at 127.0.0.1:53028
I20260709 12:25:27.071278 22605 raft_consensus.cc:606] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Received request to transfer leadership to TS 455ef2040975481fa5a87ee178499f4b
I20260709 12:25:27.084111 22677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56382e75ff42435f8cd367e1cd7e04d6"
dest_uuid: "14aa1a831920414a9002c10e716019ca"
mode: GRACEFUL
new_leader_uuid: "455ef2040975481fa5a87ee178499f4b"
 from {username='slave'} at 127.0.0.1:50110
I20260709 12:25:27.084635 22677 raft_consensus.cc:606] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Received request to transfer leadership to TS 455ef2040975481fa5a87ee178499f4b
I20260709 12:25:27.104542 22529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a249da7da1c4e20a041b9d8798174c1"
dest_uuid: "455ef2040975481fa5a87ee178499f4b"
mode: GRACEFUL
new_leader_uuid: "53423d4abfe4475f909f37f76c3b64cd"
 from {username='slave'} at 127.0.0.1:39200
I20260709 12:25:27.105068 22529 raft_consensus.cc:606] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Received request to transfer leadership to TS 53423d4abfe4475f909f37f76c3b64cd
I20260709 12:25:27.110639 22529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcbfae6456e64f039ef8a0b5765320d0"
dest_uuid: "455ef2040975481fa5a87ee178499f4b"
mode: GRACEFUL
new_leader_uuid: "53423d4abfe4475f909f37f76c3b64cd"
 from {username='slave'} at 127.0.0.1:39200
I20260709 12:25:27.111147 22529 raft_consensus.cc:606] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Received request to transfer leadership to TS 53423d4abfe4475f909f37f76c3b64cd
I20260709 12:25:27.116732 22677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e620af1328f41a38c36a9d0f7bca559"
dest_uuid: "14aa1a831920414a9002c10e716019ca"
mode: GRACEFUL
new_leader_uuid: "53423d4abfe4475f909f37f76c3b64cd"
 from {username='slave'} at 127.0.0.1:50110
I20260709 12:25:27.117228 22677 raft_consensus.cc:606] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Received request to transfer leadership to TS 53423d4abfe4475f909f37f76c3b64cd
I20260709 12:25:27.165318 22725 consensus_queue.cc:1048] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.175944 22738 consensus_queue.cc:1048] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.183655 22738 raft_consensus.cc:993] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca: : Instructing follower 53423d4abfe4475f909f37f76c3b64cd to start an election
I20260709 12:25:27.184264 22763 raft_consensus.cc:1081] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Signalling peer 53423d4abfe4475f909f37f76c3b64cd to start an election
I20260709 12:25:27.185981 22605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e620af1328f41a38c36a9d0f7bca559"
dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
 from {username='slave'} at 127.0.0.1:53010
I20260709 12:25:27.186604 22605 raft_consensus.cc:493] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:27.186976 22605 raft_consensus.cc:3060] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.192739 22605 raft_consensus.cc:515] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:27.195374 22605 leader_election.cc:290] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 2 election: Requested vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:27.195658 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e620af1328f41a38c36a9d0f7bca559" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "455ef2040975481fa5a87ee178499f4b"
I20260709 12:25:27.196007 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e620af1328f41a38c36a9d0f7bca559" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:27.196566 22529 raft_consensus.cc:3060] T 1e620af1328f41a38c36a9d0f7bca559 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.196677 22677 raft_consensus.cc:3055] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:27.197137 22677 raft_consensus.cc:740] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Running, Role: LEADER
I20260709 12:25:27.198019 22677 consensus_queue.cc:260] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:27.199090 22677 raft_consensus.cc:3060] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.203126 22529 raft_consensus.cc:2468] T 1e620af1328f41a38c36a9d0f7bca559 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 2.
I20260709 12:25:27.204319 22571 leader_election.cc:304] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:27.204711 22677 raft_consensus.cc:2468] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 2.
I20260709 12:25:27.205191 22780 raft_consensus.cc:2804] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:27.205708 22780 raft_consensus.cc:697] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd [term 2 LEADER]: Becoming Leader. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Running, Role: LEADER
I20260709 12:25:27.206525 22780 consensus_queue.cc:237] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:27.214001 22427 catalog_manager.cc:5697] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd reported cstate change: term changed from 1 to 2, leader changed from 14aa1a831920414a9002c10e716019ca (127.9.131.67) to 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66). New cstate: current_term: 2 leader_uuid: "53423d4abfe4475f909f37f76c3b64cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.252684 22727 consensus_queue.cc:1048] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.263939 22727 consensus_queue.cc:1048] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.316807 22780 consensus_queue.cc:1048] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.319348 22763 consensus_queue.cc:1048] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.321864 22763 consensus_queue.cc:1048] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.329291 22738 raft_consensus.cc:993] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca: : Instructing follower 455ef2040975481fa5a87ee178499f4b to start an election
I20260709 12:25:27.329792 22738 raft_consensus.cc:1081] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Signalling peer 455ef2040975481fa5a87ee178499f4b to start an election
I20260709 12:25:27.332319 22530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56382e75ff42435f8cd367e1cd7e04d6"
dest_uuid: "455ef2040975481fa5a87ee178499f4b"
 from {username='slave'} at 127.0.0.1:39168
I20260709 12:25:27.332978 22530 raft_consensus.cc:493] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:27.333371 22530 raft_consensus.cc:3060] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.344626 22738 consensus_queue.cc:1048] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:27.345000 22726 consensus_queue.cc:1048] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.346976 22530 raft_consensus.cc:515] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:27.348349 22528 raft_consensus.cc:1240] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Rejecting Update request from peer 14aa1a831920414a9002c10e716019ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:27.349299 22530 leader_election.cc:290] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 2 election: Requested vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:27.350767 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56382e75ff42435f8cd367e1cd7e04d6" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:27.351473 22677 raft_consensus.cc:3055] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:27.351821 22677 raft_consensus.cc:740] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Running, Role: LEADER
I20260709 12:25:27.352766 22677 consensus_queue.cc:260] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:27.353828 22677 raft_consensus.cc:3060] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.355742 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56382e75ff42435f8cd367e1cd7e04d6" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:27.356477 22604 raft_consensus.cc:3060] T 56382e75ff42435f8cd367e1cd7e04d6 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.367986 22726 raft_consensus.cc:993] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd: : Instructing follower 455ef2040975481fa5a87ee178499f4b to start an election
I20260709 12:25:27.368638 22726 raft_consensus.cc:1081] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Signalling peer 455ef2040975481fa5a87ee178499f4b to start an election
I20260709 12:25:27.370618 22527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6a5a612a23b46318cd2f55db7e11764"
dest_uuid: "455ef2040975481fa5a87ee178499f4b"
 from {username='slave'} at 127.0.0.1:39184
I20260709 12:25:27.371188 22527 raft_consensus.cc:493] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:27.372025 22527 raft_consensus.cc:3060] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.376235 22677 raft_consensus.cc:2468] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 2.
I20260709 12:25:27.377743 22604 raft_consensus.cc:2468] T 56382e75ff42435f8cd367e1cd7e04d6 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 2.
I20260709 12:25:27.378553 22605 raft_consensus.cc:1240] T 56382e75ff42435f8cd367e1cd7e04d6 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Rejecting Update request from peer 14aa1a831920414a9002c10e716019ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:27.380142 22527 raft_consensus.cc:515] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } } peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } }
I20260709 12:25:27.378656 22495 leader_election.cc:304] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 455ef2040975481fa5a87ee178499f4b; no voters: 
I20260709 12:25:27.382721 22755 raft_consensus.cc:2804] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:27.383230 22755 raft_consensus.cc:697] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b [term 2 LEADER]: Becoming Leader. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Running, Role: LEADER
I20260709 12:25:27.384104 22755 consensus_queue.cc:237] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:27.386245 22527 leader_election.cc:290] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 2 election: Requested vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:27.387501 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a5a612a23b46318cd2f55db7e11764" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:27.388269 22604 raft_consensus.cc:3055] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:27.388638 22604 raft_consensus.cc:740] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Running, Role: LEADER
I20260709 12:25:27.388718 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a5a612a23b46318cd2f55db7e11764" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:27.389333 22677 raft_consensus.cc:3060] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.389510 22604 consensus_queue.cc:260] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } } peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } }
I20260709 12:25:27.390924 22604 raft_consensus.cc:3060] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.396036 22677 raft_consensus.cc:2468] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 2.
I20260709 12:25:27.396663 22604 raft_consensus.cc:2468] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 2.
I20260709 12:25:27.397125 22495 leader_election.cc:304] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 455ef2040975481fa5a87ee178499f4b; no voters: 
I20260709 12:25:27.397913 22755 raft_consensus.cc:2804] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:27.398383 22755 raft_consensus.cc:697] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b [term 2 LEADER]: Becoming Leader. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Running, Role: LEADER
I20260709 12:25:27.398411 22425 catalog_manager.cc:5697] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b reported cstate change: term changed from 1 to 2, leader changed from 14aa1a831920414a9002c10e716019ca (127.9.131.67) to 455ef2040975481fa5a87ee178499f4b (127.9.131.65). New cstate: current_term: 2 leader_uuid: "455ef2040975481fa5a87ee178499f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.399289 22755 consensus_queue.cc:237] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } } peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } }
I20260709 12:25:27.411772 22425 catalog_manager.cc:5697] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b reported cstate change: term changed from 1 to 2, leader changed from 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66) to 455ef2040975481fa5a87ee178499f4b (127.9.131.65). New cstate: current_term: 2 leader_uuid: "455ef2040975481fa5a87ee178499f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.493677 22727 raft_consensus.cc:993] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b: : Instructing follower 53423d4abfe4475f909f37f76c3b64cd to start an election
I20260709 12:25:27.494127 22755 raft_consensus.cc:1081] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Signalling peer 53423d4abfe4475f909f37f76c3b64cd to start an election
I20260709 12:25:27.495674 22604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bcbfae6456e64f039ef8a0b5765320d0"
dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
 from {username='slave'} at 127.0.0.1:53026
I20260709 12:25:27.496264 22604 raft_consensus.cc:493] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:27.496564 22604 raft_consensus.cc:3060] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.501662 22604 raft_consensus.cc:515] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:27.503278 22604 leader_election.cc:290] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 2 election: Requested vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:27.504264 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbfae6456e64f039ef8a0b5765320d0" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "455ef2040975481fa5a87ee178499f4b"
I20260709 12:25:27.504474 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbfae6456e64f039ef8a0b5765320d0" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:27.504889 22527 raft_consensus.cc:3055] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:27.505067 22677 raft_consensus.cc:3060] T bcbfae6456e64f039ef8a0b5765320d0 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.505178 22527 raft_consensus.cc:740] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Running, Role: LEADER
I20260709 12:25:27.506119 22527 consensus_queue.cc:260] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:27.507270 22527 raft_consensus.cc:3060] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.510931 22677 raft_consensus.cc:2468] T bcbfae6456e64f039ef8a0b5765320d0 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 2.
I20260709 12:25:27.512236 22570 leader_election.cc:304] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:27.512558 22527 raft_consensus.cc:2468] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 2.
I20260709 12:25:27.512957 22751 raft_consensus.cc:2804] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:27.513486 22751 raft_consensus.cc:697] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd [term 2 LEADER]: Becoming Leader. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Running, Role: LEADER
I20260709 12:25:27.514374 22751 consensus_queue.cc:237] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:27.521005 22425 catalog_manager.cc:5697] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd reported cstate change: term changed from 1 to 2, leader changed from 455ef2040975481fa5a87ee178499f4b (127.9.131.65) to 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66). New cstate: current_term: 2 leader_uuid: "53423d4abfe4475f909f37f76c3b64cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.543444 22780 consensus_queue.cc:1048] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.549562 22780 consensus_queue.cc:1048] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.554405 22727 raft_consensus.cc:993] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b: : Instructing follower 53423d4abfe4475f909f37f76c3b64cd to start an election
I20260709 12:25:27.554898 22749 raft_consensus.cc:1081] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Signalling peer 53423d4abfe4475f909f37f76c3b64cd to start an election
I20260709 12:25:27.561012 22604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a249da7da1c4e20a041b9d8798174c1"
dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
 from {username='slave'} at 127.0.0.1:53026
I20260709 12:25:27.561626 22604 raft_consensus.cc:493] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:27.562059 22604 raft_consensus.cc:3060] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.564807 22780 raft_consensus.cc:993] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd: : Instructing follower 455ef2040975481fa5a87ee178499f4b to start an election
I20260709 12:25:27.565418 22780 raft_consensus.cc:1081] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Signalling peer 455ef2040975481fa5a87ee178499f4b to start an election
I20260709 12:25:27.568989 22526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12c9fec992dd480c8c81149e589ce6ae"
dest_uuid: "455ef2040975481fa5a87ee178499f4b"
 from {username='slave'} at 127.0.0.1:39184
I20260709 12:25:27.570333 22526 raft_consensus.cc:493] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:27.570760 22526 raft_consensus.cc:3060] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.573730 22604 raft_consensus.cc:515] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:27.576116 22604 leader_election.cc:290] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 2 election: Requested vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:27.576809 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a249da7da1c4e20a041b9d8798174c1" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "455ef2040975481fa5a87ee178499f4b"
I20260709 12:25:27.577040 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a249da7da1c4e20a041b9d8798174c1" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:27.577543 22527 raft_consensus.cc:3055] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:27.577591 22677 raft_consensus.cc:3060] T 9a249da7da1c4e20a041b9d8798174c1 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.577989 22527 raft_consensus.cc:740] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Running, Role: LEADER
I20260709 12:25:27.578707 22526 raft_consensus.cc:515] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:27.578888 22527 consensus_queue.cc:260] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:27.580328 22527 raft_consensus.cc:3060] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.581771 22526 leader_election.cc:290] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 2 election: Requested vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:27.582863 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c9fec992dd480c8c81149e589ce6ae" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:27.583110 22679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c9fec992dd480c8c81149e589ce6ae" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:27.583714 22679 raft_consensus.cc:3060] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.583803 22604 raft_consensus.cc:3055] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:27.584244 22604 raft_consensus.cc:740] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Running, Role: LEADER
I20260709 12:25:27.585165 22604 consensus_queue.cc:260] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:27.585574 22677 raft_consensus.cc:2468] T 9a249da7da1c4e20a041b9d8798174c1 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 2.
I20260709 12:25:27.586522 22604 raft_consensus.cc:3060] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.588671 22570 leader_election.cc:304] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:27.589620 22751 raft_consensus.cc:2804] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:27.590108 22751 raft_consensus.cc:697] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd [term 2 LEADER]: Becoming Leader. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Running, Role: LEADER
I20260709 12:25:27.591075 22751 consensus_queue.cc:237] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:27.592432 22527 raft_consensus.cc:2468] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 2.
I20260709 12:25:27.594302 22604 raft_consensus.cc:2468] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 2.
I20260709 12:25:27.595739 22493 leader_election.cc:304] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:27.595842 22679 raft_consensus.cc:2468] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 2.
I20260709 12:25:27.596638 22749 raft_consensus.cc:2804] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:27.597119 22749 raft_consensus.cc:697] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [term 2 LEADER]: Becoming Leader. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Running, Role: LEADER
I20260709 12:25:27.598071 22749 consensus_queue.cc:237] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:27.600543 22427 catalog_manager.cc:5697] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd reported cstate change: term changed from 1 to 2, leader changed from 455ef2040975481fa5a87ee178499f4b (127.9.131.65) to 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66). New cstate: current_term: 2 leader_uuid: "53423d4abfe4475f909f37f76c3b64cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.605726 22428 catalog_manager.cc:5697] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b reported cstate change: term changed from 1 to 2, leader changed from 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66) to 455ef2040975481fa5a87ee178499f4b (127.9.131.65). New cstate: current_term: 2 leader_uuid: "455ef2040975481fa5a87ee178499f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.702369 22527 raft_consensus.cc:1275] T 1e620af1328f41a38c36a9d0f7bca559 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Refusing update from remote peer 53423d4abfe4475f909f37f76c3b64cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:27.703665 22751 consensus_queue.cc:1048] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:27.711586 22679 raft_consensus.cc:1275] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Refusing update from remote peer 53423d4abfe4475f909f37f76c3b64cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:27.714123 22751 consensus_queue.cc:1048] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:27.823587 22604 raft_consensus.cc:1275] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Refusing update from remote peer 455ef2040975481fa5a87ee178499f4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:27.824960 22749 consensus_queue.cc:1048] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:27.834394 22679 raft_consensus.cc:1275] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Refusing update from remote peer 455ef2040975481fa5a87ee178499f4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:27.835920 22727 consensus_queue.cc:1048] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:27.848613 22604 raft_consensus.cc:1275] T 56382e75ff42435f8cd367e1cd7e04d6 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Refusing update from remote peer 455ef2040975481fa5a87ee178499f4b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:27.849925 22727 consensus_queue.cc:1048] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.864473 22679 raft_consensus.cc:1275] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Refusing update from remote peer 455ef2040975481fa5a87ee178499f4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:27.866039 22801 consensus_queue.cc:1048] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:27.993685 22679 raft_consensus.cc:1275] T bcbfae6456e64f039ef8a0b5765320d0 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Refusing update from remote peer 53423d4abfe4475f909f37f76c3b64cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:27.994982 22751 consensus_queue.cc:1048] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:27.999650 22677 raft_consensus.cc:1275] T 9a249da7da1c4e20a041b9d8798174c1 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Refusing update from remote peer 53423d4abfe4475f909f37f76c3b64cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.001960 22780 consensus_queue.cc:1048] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.002803 22527 raft_consensus.cc:1275] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Refusing update from remote peer 53423d4abfe4475f909f37f76c3b64cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.004639 22751 consensus_queue.cc:1048] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:28.020192 22527 raft_consensus.cc:1275] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Refusing update from remote peer 53423d4abfe4475f909f37f76c3b64cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.021651 22780 consensus_queue.cc:1048] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.073244 22605 raft_consensus.cc:1275] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Refusing update from remote peer 455ef2040975481fa5a87ee178499f4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.074566 22801 consensus_queue.cc:1048] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.083289 22677 raft_consensus.cc:1275] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Refusing update from remote peer 455ef2040975481fa5a87ee178499f4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.085528 22801 consensus_queue.cc:1048] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:29.710659 22571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:39625, user_credentials={real_user=slave}} blocked reactor thread for 246136us
W20260709 12:25:30.303939 22626 debug-util.cc:398] Leaking SignalData structure 0x7b080039cb80 after lost signal to thread 9744
W20260709 12:25:30.305605 22626 debug-util.cc:398] Leaking SignalData structure 0x7b08001e1440 after lost signal to thread 22462
W20260709 12:25:30.307562 22626 debug-util.cc:398] Leaking SignalData structure 0x7b08003be400 after lost signal to thread 22554
W20260709 12:25:30.308913 22626 debug-util.cc:398] Leaking SignalData structure 0x7b0800318c40 after lost signal to thread 22629
W20260709 12:25:30.309907 22626 debug-util.cc:398] Leaking SignalData structure 0x7b080025b720 after lost signal to thread 22703
I20260709 12:25:30.368767 22427 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35024:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:30.372030 22427 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:30.431054 22520 tablet_service.cc:1511] Processing CreateTablet for tablet ba6fecddbd094b4cae5a0778e1a1812e (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:30.433138 22520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba6fecddbd094b4cae5a0778e1a1812e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.436684 22592 tablet_service.cc:1511] Processing CreateTablet for tablet ae7288f6b45b460c943beb337f96dcef (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:30.437942 22593 tablet_service.cc:1511] Processing CreateTablet for tablet ba6fecddbd094b4cae5a0778e1a1812e (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:30.438591 22592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae7288f6b45b460c943beb337f96dcef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.440981 22666 tablet_service.cc:1511] Processing CreateTablet for tablet ba6fecddbd094b4cae5a0778e1a1812e (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:30.441566 22513 tablet_service.cc:1511] Processing CreateTablet for tablet ae7288f6b45b460c943beb337f96dcef (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:30.442626 22666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba6fecddbd094b4cae5a0778e1a1812e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.443022 22513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae7288f6b45b460c943beb337f96dcef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.445399 22662 tablet_service.cc:1511] Processing CreateTablet for tablet ae7288f6b45b460c943beb337f96dcef (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:30.446900 22662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae7288f6b45b460c943beb337f96dcef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.447201 22519 tablet_service.cc:1511] Processing CreateTablet for tablet 6ec5cea7cca64e8db6704a150b5952b9 (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:30.449297 22519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ec5cea7cca64e8db6704a150b5952b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.449669 22595 tablet_service.cc:1511] Processing CreateTablet for tablet 6ec5cea7cca64e8db6704a150b5952b9 (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:30.451210 22595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ec5cea7cca64e8db6704a150b5952b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.452261 22593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba6fecddbd094b4cae5a0778e1a1812e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.478046 22667 tablet_service.cc:1511] Processing CreateTablet for tablet 6ec5cea7cca64e8db6704a150b5952b9 (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:30.479635 22667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ec5cea7cca64e8db6704a150b5952b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.479539 22518 tablet_service.cc:1511] Processing CreateTablet for tablet b5faed52a86c4a82a727ee14f9cb07ba (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:30.481283 22518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5faed52a86c4a82a727ee14f9cb07ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.492308 22594 tablet_service.cc:1511] Processing CreateTablet for tablet b5faed52a86c4a82a727ee14f9cb07ba (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:30.493849 22594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5faed52a86c4a82a727ee14f9cb07ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.513616 22665 tablet_service.cc:1511] Processing CreateTablet for tablet b5faed52a86c4a82a727ee14f9cb07ba (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:30.515129 22665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5faed52a86c4a82a727ee14f9cb07ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.519830 22517 tablet_service.cc:1511] Processing CreateTablet for tablet c0ad4859df0b4464b7049efd51e3103b (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:30.521366 22517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0ad4859df0b4464b7049efd51e3103b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.538228 22822 tablet_bootstrap.cc:492] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca: Bootstrap starting.
I20260709 12:25:30.542063 22821 tablet_bootstrap.cc:492] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b: Bootstrap starting.
I20260709 12:25:30.550971 22595 tablet_service.cc:1511] Processing CreateTablet for tablet c0ad4859df0b4464b7049efd51e3103b (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:30.552544 22595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0ad4859df0b4464b7049efd51e3103b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.566399 22822 tablet_bootstrap.cc:654] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.569205 22593 tablet_service.cc:1511] Processing CreateTablet for tablet 997b0886b64a44678821c2ba820196bf (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:30.570752 22821 tablet_bootstrap.cc:654] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.573203 22520 tablet_service.cc:1511] Processing CreateTablet for tablet 997b0886b64a44678821c2ba820196bf (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:30.573843 22593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 997b0886b64a44678821c2ba820196bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.574543 22520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 997b0886b64a44678821c2ba820196bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.571434 22667 tablet_service.cc:1511] Processing CreateTablet for tablet c0ad4859df0b4464b7049efd51e3103b (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:30.579142 22667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0ad4859df0b4464b7049efd51e3103b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.582543 22519 tablet_service.cc:1511] Processing CreateTablet for tablet 566b8f12f7b14c3da9614e5e86b2c7a5 (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:30.583978 22519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566b8f12f7b14c3da9614e5e86b2c7a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.584146 22595 tablet_service.cc:1511] Processing CreateTablet for tablet 566b8f12f7b14c3da9614e5e86b2c7a5 (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:30.585553 22595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566b8f12f7b14c3da9614e5e86b2c7a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.589514 22668 tablet_service.cc:1511] Processing CreateTablet for tablet 566b8f12f7b14c3da9614e5e86b2c7a5 (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:30.589421 22665 tablet_service.cc:1511] Processing CreateTablet for tablet 997b0886b64a44678821c2ba820196bf (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:30.590958 22668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566b8f12f7b14c3da9614e5e86b2c7a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.591671 22594 tablet_service.cc:1511] Processing CreateTablet for tablet 577ed270d7c744b0b095890092b10643 (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:30.600018 22665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 997b0886b64a44678821c2ba820196bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.592927 22513 tablet_service.cc:1511] Processing CreateTablet for tablet 577ed270d7c744b0b095890092b10643 (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:30.602084 22594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 577ed270d7c744b0b095890092b10643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.607684 22513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 577ed270d7c744b0b095890092b10643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.602365 22823 tablet_bootstrap.cc:492] T ae7288f6b45b460c943beb337f96dcef P 53423d4abfe4475f909f37f76c3b64cd: Bootstrap starting.
I20260709 12:25:30.628288 22662 tablet_service.cc:1511] Processing CreateTablet for tablet 577ed270d7c744b0b095890092b10643 (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:30.629318 22518 tablet_service.cc:1511] Processing CreateTablet for tablet 9feefcd30077461493b44c5a22265514 (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:30.629750 22662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 577ed270d7c744b0b095890092b10643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.630673 22518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9feefcd30077461493b44c5a22265514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.633963 22595 tablet_service.cc:1511] Processing CreateTablet for tablet 9feefcd30077461493b44c5a22265514 (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:30.635406 22595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9feefcd30077461493b44c5a22265514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.638389 22822 tablet_bootstrap.cc:492] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca: No bootstrap required, opened a new log
I20260709 12:25:30.639000 22822 ts_tablet_manager.cc:1403] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.000s
I20260709 12:25:30.646677 22823 tablet_bootstrap.cc:654] T ae7288f6b45b460c943beb337f96dcef P 53423d4abfe4475f909f37f76c3b64cd: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:30.647929 22476 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:30.657845 22666 tablet_service.cc:1511] Processing CreateTablet for tablet 9feefcd30077461493b44c5a22265514 (DEFAULT_TABLE table=soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:30.662340 22666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9feefcd30077461493b44c5a22265514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.643306 22822 raft_consensus.cc:359] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.668233 22822 raft_consensus.cc:385] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.668605 22822 raft_consensus.cc:740] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.669428 22822 consensus_queue.cc:260] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.672854 22822 ts_tablet_manager.cc:1434] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.001s
I20260709 12:25:30.673928 22822 tablet_bootstrap.cc:492] T ba6fecddbd094b4cae5a0778e1a1812e P 14aa1a831920414a9002c10e716019ca: Bootstrap starting.
I20260709 12:25:30.693240 22823 tablet_bootstrap.cc:492] T ae7288f6b45b460c943beb337f96dcef P 53423d4abfe4475f909f37f76c3b64cd: No bootstrap required, opened a new log
I20260709 12:25:30.693873 22823 ts_tablet_manager.cc:1403] T ae7288f6b45b460c943beb337f96dcef P 53423d4abfe4475f909f37f76c3b64cd: Time spent bootstrapping tablet: real 0.092s	user 0.023s	sys 0.023s
I20260709 12:25:30.697935 22821 tablet_bootstrap.cc:492] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b: No bootstrap required, opened a new log
I20260709 12:25:30.698552 22821 ts_tablet_manager.cc:1403] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b: Time spent bootstrapping tablet: real 0.157s	user 0.016s	sys 0.004s
I20260709 12:25:30.702065 22821 raft_consensus.cc:359] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.702977 22821 raft_consensus.cc:385] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.703322 22821 raft_consensus.cc:740] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.703413 22823 raft_consensus.cc:359] T ae7288f6b45b460c943beb337f96dcef P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.704267 22823 raft_consensus.cc:385] T ae7288f6b45b460c943beb337f96dcef P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.704559 22823 raft_consensus.cc:740] T ae7288f6b45b460c943beb337f96dcef P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.706218 22821 consensus_queue.cc:260] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.708063 22823 consensus_queue.cc:260] T ae7288f6b45b460c943beb337f96dcef P 53423d4abfe4475f909f37f76c3b64cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.723431 22823 ts_tablet_manager.cc:1434] T ae7288f6b45b460c943beb337f96dcef P 53423d4abfe4475f909f37f76c3b64cd: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.003s
I20260709 12:25:30.728006 22823 tablet_bootstrap.cc:492] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd: Bootstrap starting.
I20260709 12:25:30.744504 22821 ts_tablet_manager.cc:1434] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b: Time spent starting tablet: real 0.046s	user 0.010s	sys 0.018s
I20260709 12:25:30.745775 22821 tablet_bootstrap.cc:492] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b: Bootstrap starting.
I20260709 12:25:30.747340 22823 tablet_bootstrap.cc:654] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.749289 22822 tablet_bootstrap.cc:654] T ba6fecddbd094b4cae5a0778e1a1812e P 14aa1a831920414a9002c10e716019ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.762257 22822 tablet_bootstrap.cc:492] T ba6fecddbd094b4cae5a0778e1a1812e P 14aa1a831920414a9002c10e716019ca: No bootstrap required, opened a new log
I20260709 12:25:30.762573 22823 tablet_bootstrap.cc:492] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd: No bootstrap required, opened a new log
I20260709 12:25:30.762936 22822 ts_tablet_manager.cc:1403] T ba6fecddbd094b4cae5a0778e1a1812e P 14aa1a831920414a9002c10e716019ca: Time spent bootstrapping tablet: real 0.089s	user 0.011s	sys 0.009s
I20260709 12:25:30.763211 22823 ts_tablet_manager.cc:1403] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd: Time spent bootstrapping tablet: real 0.036s	user 0.000s	sys 0.013s
I20260709 12:25:30.766454 22822 raft_consensus.cc:359] T ba6fecddbd094b4cae5a0778e1a1812e P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.766752 22823 raft_consensus.cc:359] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.767277 22822 raft_consensus.cc:385] T ba6fecddbd094b4cae5a0778e1a1812e P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.767604 22823 raft_consensus.cc:385] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.767760 22821 tablet_bootstrap.cc:654] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.767738 22822 raft_consensus.cc:740] T ba6fecddbd094b4cae5a0778e1a1812e P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.768069 22823 raft_consensus.cc:740] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.769048 22822 consensus_queue.cc:260] T ba6fecddbd094b4cae5a0778e1a1812e P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.769299 22823 consensus_queue.cc:260] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.771754 22822 ts_tablet_manager.cc:1434] T ba6fecddbd094b4cae5a0778e1a1812e P 14aa1a831920414a9002c10e716019ca: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 12:25:30.771939 22823 ts_tablet_manager.cc:1434] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:30.772970 22822 tablet_bootstrap.cc:492] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca: Bootstrap starting.
I20260709 12:25:30.780606 22822 tablet_bootstrap.cc:654] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.788786 22823 tablet_bootstrap.cc:492] T ba6fecddbd094b4cae5a0778e1a1812e P 53423d4abfe4475f909f37f76c3b64cd: Bootstrap starting.
I20260709 12:25:30.792659 22822 tablet_bootstrap.cc:492] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca: No bootstrap required, opened a new log
I20260709 12:25:30.793339 22822 ts_tablet_manager.cc:1403] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 12:25:30.796923 22822 raft_consensus.cc:359] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.797849 22822 raft_consensus.cc:385] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.798210 22822 raft_consensus.cc:740] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.799229 22822 consensus_queue.cc:260] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.801815 22822 ts_tablet_manager.cc:1434] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:25:30.803148 22822 tablet_bootstrap.cc:492] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca: Bootstrap starting.
I20260709 12:25:30.810953 22821 tablet_bootstrap.cc:492] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b: No bootstrap required, opened a new log
I20260709 12:25:30.811316 22822 tablet_bootstrap.cc:654] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.811661 22821 ts_tablet_manager.cc:1403] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.013s
I20260709 12:25:30.815106 22821 raft_consensus.cc:359] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.816172 22821 raft_consensus.cc:385] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.823669 22822 tablet_bootstrap.cc:492] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca: No bootstrap required, opened a new log
I20260709 12:25:30.824493 22822 ts_tablet_manager.cc:1403] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.010s
I20260709 12:25:30.827610 22823 tablet_bootstrap.cc:654] T ba6fecddbd094b4cae5a0778e1a1812e P 53423d4abfe4475f909f37f76c3b64cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.828200 22821 raft_consensus.cc:740] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.829164 22821 consensus_queue.cc:260] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.831353 22821 ts_tablet_manager.cc:1434] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.002s
I20260709 12:25:30.832530 22821 tablet_bootstrap.cc:492] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b: Bootstrap starting.
I20260709 12:25:30.827515 22822 raft_consensus.cc:359] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.836150 22822 raft_consensus.cc:385] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.836473 22822 raft_consensus.cc:740] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.837306 22822 consensus_queue.cc:260] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.839820 22822 ts_tablet_manager.cc:1434] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:25:30.844777 22821 tablet_bootstrap.cc:654] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.846740 22823 tablet_bootstrap.cc:492] T ba6fecddbd094b4cae5a0778e1a1812e P 53423d4abfe4475f909f37f76c3b64cd: No bootstrap required, opened a new log
I20260709 12:25:30.847399 22823 ts_tablet_manager.cc:1403] T ba6fecddbd094b4cae5a0778e1a1812e P 53423d4abfe4475f909f37f76c3b64cd: Time spent bootstrapping tablet: real 0.059s	user 0.020s	sys 0.005s
I20260709 12:25:30.850812 22823 raft_consensus.cc:359] T ba6fecddbd094b4cae5a0778e1a1812e P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.851717 22823 raft_consensus.cc:385] T ba6fecddbd094b4cae5a0778e1a1812e P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.852087 22823 raft_consensus.cc:740] T ba6fecddbd094b4cae5a0778e1a1812e P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.852141 22822 tablet_bootstrap.cc:492] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca: Bootstrap starting.
I20260709 12:25:30.859238 22822 tablet_bootstrap.cc:654] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.860208 22823 consensus_queue.cc:260] T ba6fecddbd094b4cae5a0778e1a1812e P 53423d4abfe4475f909f37f76c3b64cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.866230 22823 ts_tablet_manager.cc:1434] T ba6fecddbd094b4cae5a0778e1a1812e P 53423d4abfe4475f909f37f76c3b64cd: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.003s
I20260709 12:25:30.867365 22823 tablet_bootstrap.cc:492] T b5faed52a86c4a82a727ee14f9cb07ba P 53423d4abfe4475f909f37f76c3b64cd: Bootstrap starting.
I20260709 12:25:30.874560 22823 tablet_bootstrap.cc:654] T b5faed52a86c4a82a727ee14f9cb07ba P 53423d4abfe4475f909f37f76c3b64cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.882280 22822 tablet_bootstrap.cc:492] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca: No bootstrap required, opened a new log
I20260709 12:25:30.882936 22822 ts_tablet_manager.cc:1403] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca: Time spent bootstrapping tablet: real 0.042s	user 0.005s	sys 0.007s
I20260709 12:25:30.886408 22822 raft_consensus.cc:359] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.887238 22822 raft_consensus.cc:385] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.887542 22822 raft_consensus.cc:740] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.888414 22822 consensus_queue.cc:260] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.890985 22822 ts_tablet_manager.cc:1434] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:30.892354 22822 tablet_bootstrap.cc:492] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca: Bootstrap starting.
I20260709 12:25:30.902511 22821 tablet_bootstrap.cc:492] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b: No bootstrap required, opened a new log
I20260709 12:25:30.903201 22821 ts_tablet_manager.cc:1403] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b: Time spent bootstrapping tablet: real 0.071s	user 0.028s	sys 0.031s
I20260709 12:25:30.906368 22821 raft_consensus.cc:359] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.906937 22821 raft_consensus.cc:385] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.907162 22821 raft_consensus.cc:740] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.899663 22822 tablet_bootstrap.cc:654] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.907785 22821 consensus_queue.cc:260] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.910372 22821 ts_tablet_manager.cc:1434] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 12:25:30.910727 22823 tablet_bootstrap.cc:492] T b5faed52a86c4a82a727ee14f9cb07ba P 53423d4abfe4475f909f37f76c3b64cd: No bootstrap required, opened a new log
I20260709 12:25:30.911374 22823 ts_tablet_manager.cc:1403] T b5faed52a86c4a82a727ee14f9cb07ba P 53423d4abfe4475f909f37f76c3b64cd: Time spent bootstrapping tablet: real 0.044s	user 0.027s	sys 0.015s
I20260709 12:25:30.911474 22821 tablet_bootstrap.cc:492] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b: Bootstrap starting.
I20260709 12:25:30.912951 22809 raft_consensus.cc:493] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.913589 22809 raft_consensus.cc:515] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.917912 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7288f6b45b460c943beb337f96dcef" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd" is_pre_election: true
I20260709 12:25:30.918718 22605 raft_consensus.cc:2468] T ae7288f6b45b460c943beb337f96dcef P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 0.
I20260709 12:25:30.923369 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7288f6b45b460c943beb337f96dcef" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b" is_pre_election: true
I20260709 12:25:30.926550 22642 leader_election.cc:304] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:30.927732 22833 raft_consensus.cc:2804] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:30.928180 22833 raft_consensus.cc:493] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.928488 22833 raft_consensus.cc:3060] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:30.933391 22645 leader_election.cc:343] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.934461 22809 leader_election.cc:290] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073)
I20260709 12:25:30.942768 22833 raft_consensus.cc:515] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.945109 22827 raft_consensus.cc:493] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.945679 22827 raft_consensus.cc:515] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.946067 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7288f6b45b460c943beb337f96dcef" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b"
W20260709 12:25:30.947732 22645 leader_election.cc:343] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.948088 22827 leader_election.cc:290] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:30.949455 22821 tablet_bootstrap.cc:654] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.949658 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba6fecddbd094b4cae5a0778e1a1812e" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd" is_pre_election: true
I20260709 12:25:30.950435 22605 raft_consensus.cc:2468] T ba6fecddbd094b4cae5a0778e1a1812e P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 0.
I20260709 12:25:30.951485 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7288f6b45b460c943beb337f96dcef" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:30.951937 22493 leader_election.cc:304] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:30.952219 22603 raft_consensus.cc:3060] T ae7288f6b45b460c943beb337f96dcef P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:30.952836 22827 raft_consensus.cc:2804] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:30.953210 22827 raft_consensus.cc:493] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.953536 22827 raft_consensus.cc:3060] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:30.949731 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba6fecddbd094b4cae5a0778e1a1812e" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca" is_pre_election: true
I20260709 12:25:30.962189 22678 raft_consensus.cc:2468] T ba6fecddbd094b4cae5a0778e1a1812e P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 0.
I20260709 12:25:30.962484 22823 raft_consensus.cc:359] T b5faed52a86c4a82a727ee14f9cb07ba P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.964138 22823 raft_consensus.cc:385] T b5faed52a86c4a82a727ee14f9cb07ba P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.964411 22833 leader_election.cc:290] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 election: Requested vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073)
I20260709 12:25:30.961443 22603 raft_consensus.cc:2468] T ae7288f6b45b460c943beb337f96dcef P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 1.
I20260709 12:25:30.967042 22823 raft_consensus.cc:740] T b5faed52a86c4a82a727ee14f9cb07ba P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.967585 22821 tablet_bootstrap.cc:492] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b: No bootstrap required, opened a new log
I20260709 12:25:30.966471 22827 raft_consensus.cc:515] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.968217 22642 leader_election.cc:304] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 53423d4abfe4475f909f37f76c3b64cd; no voters: 455ef2040975481fa5a87ee178499f4b
I20260709 12:25:30.968057 22823 consensus_queue.cc:260] T b5faed52a86c4a82a727ee14f9cb07ba P 53423d4abfe4475f909f37f76c3b64cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.969663 22833 raft_consensus.cc:2804] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:30.971801 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba6fecddbd094b4cae5a0778e1a1812e" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:30.972482 22678 raft_consensus.cc:3060] T ba6fecddbd094b4cae5a0778e1a1812e P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:30.968212 22821 ts_tablet_manager.cc:1403] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b: Time spent bootstrapping tablet: real 0.057s	user 0.024s	sys 0.022s
I20260709 12:25:30.977473 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba6fecddbd094b4cae5a0778e1a1812e" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:30.978122 22603 raft_consensus.cc:3060] T ba6fecddbd094b4cae5a0778e1a1812e P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:30.978969 22821 raft_consensus.cc:359] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.979775 22821 raft_consensus.cc:385] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.980082 22821 raft_consensus.cc:740] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.983533 22823 ts_tablet_manager.cc:1434] T b5faed52a86c4a82a727ee14f9cb07ba P 53423d4abfe4475f909f37f76c3b64cd: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.000s
I20260709 12:25:30.984299 22809 raft_consensus.cc:493] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.984967 22809 raft_consensus.cc:515] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.986133 22821 consensus_queue.cc:260] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.987108 22833 raft_consensus.cc:697] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Becoming Leader. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Running, Role: LEADER
I20260709 12:25:30.988198 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5faed52a86c4a82a727ee14f9cb07ba" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b" is_pre_election: true
I20260709 12:25:30.988667 22822 tablet_bootstrap.cc:492] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca: No bootstrap required, opened a new log
I20260709 12:25:30.988374 22833 consensus_queue.cc:237] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:30.988936 22527 raft_consensus.cc:2468] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 0.
I20260709 12:25:30.989181 22822 ts_tablet_manager.cc:1403] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.004s
I20260709 12:25:30.990473 22645 leader_election.cc:304] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 455ef2040975481fa5a87ee178499f4b; no voters: 
I20260709 12:25:30.996253 22821 ts_tablet_manager.cc:1434] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:25:30.997490 22821 tablet_bootstrap.cc:492] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b: Bootstrap starting.
I20260709 12:25:31.005441 22809 leader_election.cc:290] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073)
I20260709 12:25:31.005724 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5faed52a86c4a82a727ee14f9cb07ba" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd" is_pre_election: true
I20260709 12:25:31.006165 22809 raft_consensus.cc:2804] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.006539 22809 raft_consensus.cc:493] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.006897 22809 raft_consensus.cc:3060] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.008006 22605 raft_consensus.cc:2468] T b5faed52a86c4a82a727ee14f9cb07ba P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 0.
I20260709 12:25:31.016302 22823 tablet_bootstrap.cc:492] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd: Bootstrap starting.
I20260709 12:25:31.015738 22427 catalog_manager.cc:5697] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 14aa1a831920414a9002c10e716019ca (127.9.131.67). New cstate: current_term: 1 leader_uuid: "14aa1a831920414a9002c10e716019ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:31.019711 22780 raft_consensus.cc:493] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.021224 22603 raft_consensus.cc:2468] T ba6fecddbd094b4cae5a0778e1a1812e P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 1.
I20260709 12:25:31.029520 22821 tablet_bootstrap.cc:654] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.023607 22780 raft_consensus.cc:515] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.032531 22493 leader_election.cc:304] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:31.033584 22828 raft_consensus.cc:2804] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.034217 22828 raft_consensus.cc:697] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Becoming Leader. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Running, Role: LEADER
I20260709 12:25:31.035068 22828 consensus_queue.cc:237] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.021344 22827 leader_election.cc:290] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 election: Requested vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:31.033456 22780 leader_election.cc:290] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:31.041541 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec5cea7cca64e8db6704a150b5952b9" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca" is_pre_election: true
I20260709 12:25:31.042449 22677 raft_consensus.cc:2468] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 0.
I20260709 12:25:31.021807 22678 raft_consensus.cc:2468] T ba6fecddbd094b4cae5a0778e1a1812e P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 1.
I20260709 12:25:31.044036 22570 leader_election.cc:304] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:31.045090 22780 raft_consensus.cc:2804] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.045516 22780 raft_consensus.cc:493] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.045841 22780 raft_consensus.cc:3060] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.046085 22821 tablet_bootstrap.cc:492] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b: No bootstrap required, opened a new log
I20260709 12:25:31.046710 22821 ts_tablet_manager.cc:1403] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.012s
I20260709 12:25:31.049939 22821 raft_consensus.cc:359] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.050843 22821 raft_consensus.cc:385] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.051189 22821 raft_consensus.cc:740] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.052192 22821 consensus_queue.cc:260] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.054605 22821 ts_tablet_manager.cc:1434] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.005s
I20260709 12:25:31.057152 22821 tablet_bootstrap.cc:492] T 997b0886b64a44678821c2ba820196bf P 455ef2040975481fa5a87ee178499f4b: Bootstrap starting.
I20260709 12:25:31.056510 22822 raft_consensus.cc:359] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.055397 22780 raft_consensus.cc:515] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.070559 22821 tablet_bootstrap.cc:654] T 997b0886b64a44678821c2ba820196bf P 455ef2040975481fa5a87ee178499f4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.071669 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec5cea7cca64e8db6704a150b5952b9" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b" is_pre_election: true
I20260709 12:25:31.067382 22822 raft_consensus.cc:385] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.076171 22822 raft_consensus.cc:740] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.076262 22527 raft_consensus.cc:2468] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 0.
I20260709 12:25:31.075572 22809 raft_consensus.cc:515] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.080410 22823 tablet_bootstrap.cc:654] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.082626 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec5cea7cca64e8db6704a150b5952b9" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:31.084097 22678 raft_consensus.cc:3060] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.086462 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5faed52a86c4a82a727ee14f9cb07ba" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:31.085834 22425 catalog_manager.cc:5697] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b reported cstate change: term changed from 0 to 1, leader changed from <none> to 455ef2040975481fa5a87ee178499f4b (127.9.131.65). New cstate: current_term: 1 leader_uuid: "455ef2040975481fa5a87ee178499f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.083173 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5faed52a86c4a82a727ee14f9cb07ba" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b"
I20260709 12:25:31.087122 22603 raft_consensus.cc:3060] T b5faed52a86c4a82a727ee14f9cb07ba P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.087375 22527 raft_consensus.cc:3060] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.083487 22780 leader_election.cc:290] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 election: Requested vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:31.092378 22822 consensus_queue.cc:260] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.096774 22678 raft_consensus.cc:2468] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 1.
I20260709 12:25:31.099663 22822 ts_tablet_manager.cc:1434] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca: Time spent starting tablet: real 0.110s	user 0.005s	sys 0.005s
I20260709 12:25:31.101159 22822 tablet_bootstrap.cc:492] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca: Bootstrap starting.
I20260709 12:25:31.102584 22570 leader_election.cc:304] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:31.103969 22780 raft_consensus.cc:2804] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.104453 22780 raft_consensus.cc:697] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Becoming Leader. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Running, Role: LEADER
I20260709 12:25:31.105247 22780 consensus_queue.cc:237] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.107901 22527 raft_consensus.cc:2468] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 1.
I20260709 12:25:31.111650 22603 raft_consensus.cc:2468] T b5faed52a86c4a82a727ee14f9cb07ba P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 1.
I20260709 12:25:31.119555 22645 leader_election.cc:304] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 455ef2040975481fa5a87ee178499f4b; no voters: 
I20260709 12:25:31.120575 22809 leader_election.cc:290] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 election: Requested vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073)
I20260709 12:25:31.120728 22841 raft_consensus.cc:2804] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.122829 22841 raft_consensus.cc:697] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Becoming Leader. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Running, Role: LEADER
I20260709 12:25:31.123752 22841 consensus_queue.cc:237] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.125281 22821 tablet_bootstrap.cc:492] T 997b0886b64a44678821c2ba820196bf P 455ef2040975481fa5a87ee178499f4b: No bootstrap required, opened a new log
I20260709 12:25:31.128424 22821 ts_tablet_manager.cc:1403] T 997b0886b64a44678821c2ba820196bf P 455ef2040975481fa5a87ee178499f4b: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.008s
I20260709 12:25:31.146560 22821 raft_consensus.cc:359] T 997b0886b64a44678821c2ba820196bf P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.147570 22821 raft_consensus.cc:385] T 997b0886b64a44678821c2ba820196bf P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.148388 22822 tablet_bootstrap.cc:654] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.149272 22425 catalog_manager.cc:5697] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66). New cstate: current_term: 1 leader_uuid: "53423d4abfe4475f909f37f76c3b64cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.140846 22809 raft_consensus.cc:493] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.164671 22823 tablet_bootstrap.cc:492] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd: No bootstrap required, opened a new log
I20260709 12:25:31.165325 22823 ts_tablet_manager.cc:1403] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd: Time spent bootstrapping tablet: real 0.149s	user 0.026s	sys 0.014s
I20260709 12:25:31.156035 22821 raft_consensus.cc:740] T 997b0886b64a44678821c2ba820196bf P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.169682 22821 consensus_queue.cc:260] T 997b0886b64a44678821c2ba820196bf P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.161796 22809 raft_consensus.cc:515] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.172302 22821 ts_tablet_manager.cc:1434] T 997b0886b64a44678821c2ba820196bf P 455ef2040975481fa5a87ee178499f4b: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.003s
I20260709 12:25:31.175444 22823 raft_consensus.cc:359] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.176328 22823 raft_consensus.cc:385] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.176621 22823 raft_consensus.cc:740] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.176720 22809 leader_election.cc:290] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073)
W20260709 12:25:31.156721 22571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:39625, user_credentials={real_user=slave}} blocked reactor thread for 81787.6us
I20260709 12:25:31.178778 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec5cea7cca64e8db6704a150b5952b9" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b"
I20260709 12:25:31.179425 22527 raft_consensus.cc:3060] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.177457 22823 consensus_queue.cc:260] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.184105 22821 tablet_bootstrap.cc:492] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 455ef2040975481fa5a87ee178499f4b: Bootstrap starting.
I20260709 12:25:31.187609 22527 raft_consensus.cc:2468] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 1.
I20260709 12:25:31.197939 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566b8f12f7b14c3da9614e5e86b2c7a5" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b" is_pre_election: true
I20260709 12:25:31.195490 22823 ts_tablet_manager.cc:1434] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 12:25:31.200296 22427 catalog_manager.cc:5697] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 14aa1a831920414a9002c10e716019ca (127.9.131.67). New cstate: current_term: 1 leader_uuid: "14aa1a831920414a9002c10e716019ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:31.201848 22823 tablet_bootstrap.cc:492] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd: Bootstrap starting.
W20260709 12:25:31.200835 22645 leader_election.cc:343] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.207381 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566b8f12f7b14c3da9614e5e86b2c7a5" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd" is_pre_election: true
W20260709 12:25:31.216640 22642 leader_election.cc:343] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.217140 22642 leader_election.cc:304] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14aa1a831920414a9002c10e716019ca; no voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd
I20260709 12:25:31.217980 22841 raft_consensus.cc:2749] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.218653 22822 tablet_bootstrap.cc:492] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca: No bootstrap required, opened a new log
I20260709 12:25:31.219113 22822 ts_tablet_manager.cc:1403] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca: Time spent bootstrapping tablet: real 0.118s	user 0.010s	sys 0.010s
I20260709 12:25:31.220271 22821 tablet_bootstrap.cc:654] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 455ef2040975481fa5a87ee178499f4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.222420 22822 raft_consensus.cc:359] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.223163 22822 raft_consensus.cc:385] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.223456 22822 raft_consensus.cc:740] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.219064 22823 tablet_bootstrap.cc:654] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.224225 22822 consensus_queue.cc:260] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.229032 22822 ts_tablet_manager.cc:1434] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:25:31.230126 22822 tablet_bootstrap.cc:492] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca: Bootstrap starting.
I20260709 12:25:31.232295 22841 raft_consensus.cc:493] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.232864 22841 raft_consensus.cc:515] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.235133 22841 leader_election.cc:290] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073)
I20260709 12:25:31.237722 22822 tablet_bootstrap.cc:654] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.238812 22821 tablet_bootstrap.cc:492] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 455ef2040975481fa5a87ee178499f4b: No bootstrap required, opened a new log
I20260709 12:25:31.239300 22828 raft_consensus.cc:493] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.240624 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997b0886b64a44678821c2ba820196bf" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd" is_pre_election: true
I20260709 12:25:31.240764 22828 raft_consensus.cc:515] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
W20260709 12:25:31.242255 22642 leader_election.cc:343] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.243049 22828 leader_election.cc:290] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:31.244025 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ad4859df0b4464b7049efd51e3103b" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd" is_pre_election: true
I20260709 12:25:31.244690 22605 raft_consensus.cc:2468] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 0.
I20260709 12:25:31.245112 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997b0886b64a44678821c2ba820196bf" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b" is_pre_election: true
I20260709 12:25:31.245707 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ad4859df0b4464b7049efd51e3103b" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca" is_pre_election: true
I20260709 12:25:31.246353 22678 raft_consensus.cc:2468] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 0.
I20260709 12:25:31.248118 22493 leader_election.cc:304] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:31.245754 22528 raft_consensus.cc:2468] T 997b0886b64a44678821c2ba820196bf P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 0.
I20260709 12:25:31.239431 22821 ts_tablet_manager.cc:1403] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 455ef2040975481fa5a87ee178499f4b: Time spent bootstrapping tablet: real 0.056s	user 0.019s	sys 0.003s
I20260709 12:25:31.253566 22828 raft_consensus.cc:2804] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.254755 22828 raft_consensus.cc:493] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.251246 22645 leader_election.cc:304] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 455ef2040975481fa5a87ee178499f4b; no voters: 53423d4abfe4475f909f37f76c3b64cd
I20260709 12:25:31.255556 22821 raft_consensus.cc:359] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.256099 22841 raft_consensus.cc:2804] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.256471 22821 raft_consensus.cc:385] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.256717 22841 raft_consensus.cc:493] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.256906 22821 raft_consensus.cc:740] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.254030 22823 tablet_bootstrap.cc:492] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd: No bootstrap required, opened a new log
I20260709 12:25:31.257216 22841 raft_consensus.cc:3060] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.257759 22821 consensus_queue.cc:260] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.260416 22821 ts_tablet_manager.cc:1434] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 455ef2040975481fa5a87ee178499f4b: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.005s
I20260709 12:25:31.261755 22821 tablet_bootstrap.cc:492] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b: Bootstrap starting.
I20260709 12:25:31.262131 22828 raft_consensus.cc:3060] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.268606 22821 tablet_bootstrap.cc:654] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.272190 22823 ts_tablet_manager.cc:1403] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.003s
I20260709 12:25:31.275592 22823 raft_consensus.cc:359] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.276556 22823 raft_consensus.cc:385] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.276907 22823 raft_consensus.cc:740] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.280388 22823 consensus_queue.cc:260] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.284579 22828 raft_consensus.cc:515] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.285815 22823 ts_tablet_manager.cc:1434] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:25:31.286969 22823 tablet_bootstrap.cc:492] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd: Bootstrap starting.
I20260709 12:25:31.288774 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ad4859df0b4464b7049efd51e3103b" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:31.289438 22605 raft_consensus.cc:3060] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.281092 22822 tablet_bootstrap.cc:492] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca: No bootstrap required, opened a new log
I20260709 12:25:31.292297 22822 ts_tablet_manager.cc:1403] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca: Time spent bootstrapping tablet: real 0.062s	user 0.024s	sys 0.003s
I20260709 12:25:31.294463 22821 tablet_bootstrap.cc:492] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b: No bootstrap required, opened a new log
I20260709 12:25:31.295003 22821 ts_tablet_manager.cc:1403] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.011s
I20260709 12:25:31.295064 22822 raft_consensus.cc:359] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.295783 22822 raft_consensus.cc:385] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.296072 22822 raft_consensus.cc:740] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.279141 22841 raft_consensus.cc:515] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.297894 22821 raft_consensus.cc:359] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.298362 22841 leader_election.cc:290] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 election: Requested vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073)
I20260709 12:25:31.298642 22821 raft_consensus.cc:385] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.299026 22821 raft_consensus.cc:740] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.299187 22822 consensus_queue.cc:260] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.299685 22821 consensus_queue.cc:260] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.302081 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997b0886b64a44678821c2ba820196bf" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:31.302385 22823 tablet_bootstrap.cc:654] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.299718 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997b0886b64a44678821c2ba820196bf" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b"
I20260709 12:25:31.303277 22528 raft_consensus.cc:3060] T 997b0886b64a44678821c2ba820196bf P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.306695 22822 ts_tablet_manager.cc:1434] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:25:31.307673 22822 tablet_bootstrap.cc:492] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca: Bootstrap starting.
I20260709 12:25:31.314394 22822 tablet_bootstrap.cc:654] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:31.315732 22642 leader_election.cc:343] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.325644 22822 tablet_bootstrap.cc:492] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca: No bootstrap required, opened a new log
I20260709 12:25:31.326116 22821 ts_tablet_manager.cc:1434] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:25:31.326202 22822 ts_tablet_manager.cc:1403] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 12:25:31.330643 22821 tablet_bootstrap.cc:492] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b: Bootstrap starting.
I20260709 12:25:31.331463 22822 raft_consensus.cc:359] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.332247 22822 raft_consensus.cc:385] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.332523 22822 raft_consensus.cc:740] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.333204 22822 consensus_queue.cc:260] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.338222 22821 tablet_bootstrap.cc:654] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.341202 22822 ts_tablet_manager.cc:1434] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:25:31.344693 22841 raft_consensus.cc:493] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.345466 22827 raft_consensus.cc:493] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.346376 22827 raft_consensus.cc:515] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.348572 22827 leader_election.cc:290] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:31.345489 22841 raft_consensus.cc:515] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.349586 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7288f6b45b460c943beb337f96dcef" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd" is_pre_election: true
I20260709 12:25:31.350385 22603 raft_consensus.cc:2393] T ae7288f6b45b460c943beb337f96dcef P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 455ef2040975481fa5a87ee178499f4b in current term 1: Already voted for candidate 14aa1a831920414a9002c10e716019ca in this term.
I20260709 12:25:31.351046 22841 leader_election.cc:290] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073)
I20260709 12:25:31.353677 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577ed270d7c744b0b095890092b10643" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd" is_pre_election: true
I20260709 12:25:31.356526 22828 leader_election.cc:290] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 election: Requested vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:31.357547 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577ed270d7c744b0b095890092b10643" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b" is_pre_election: true
I20260709 12:25:31.354012 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7288f6b45b460c943beb337f96dcef" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca" is_pre_election: true
I20260709 12:25:31.362946 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ad4859df0b4464b7049efd51e3103b" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:31.363564 22677 raft_consensus.cc:3060] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.364092 22821 tablet_bootstrap.cc:492] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b: No bootstrap required, opened a new log
I20260709 12:25:31.364718 22821 ts_tablet_manager.cc:1403] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.005s
W20260709 12:25:31.355700 22642 leader_election.cc:343] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.368350 22821 raft_consensus.cc:359] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.369282 22821 raft_consensus.cc:385] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.369541 22821 raft_consensus.cc:740] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.370293 22821 consensus_queue.cc:260] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
W20260709 12:25:31.371068 22645 leader_election.cc:343] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.372073 22645 leader_election.cc:304] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14aa1a831920414a9002c10e716019ca; no voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd
I20260709 12:25:31.372601 22821 ts_tablet_manager.cc:1434] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:31.374394 22495 leader_election.cc:304] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b; no voters: 14aa1a831920414a9002c10e716019ca, 53423d4abfe4475f909f37f76c3b64cd
I20260709 12:25:31.375794 22827 raft_consensus.cc:3060] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.389895 22528 raft_consensus.cc:2468] T 997b0886b64a44678821c2ba820196bf P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 1.
I20260709 12:25:31.390976 22809 consensus_queue.cc:1048] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:31.372849 22841 raft_consensus.cc:2749] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.393726 22645 leader_election.cc:304] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 455ef2040975481fa5a87ee178499f4b; no voters: 53423d4abfe4475f909f37f76c3b64cd
I20260709 12:25:31.394596 22841 raft_consensus.cc:2804] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.395133 22841 raft_consensus.cc:697] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Becoming Leader. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Running, Role: LEADER
I20260709 12:25:31.396144 22841 consensus_queue.cc:237] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.398604 22605 raft_consensus.cc:2468] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 1.
I20260709 12:25:31.401794 22493 leader_election.cc:304] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:31.402812 22828 raft_consensus.cc:2804] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.403302 22828 raft_consensus.cc:697] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Becoming Leader. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Running, Role: LEADER
I20260709 12:25:31.404136 22828 consensus_queue.cc:237] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.413709 22677 raft_consensus.cc:2468] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 1.
I20260709 12:25:31.416812 22808 consensus_queue.cc:1048] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:31.430135 22823 tablet_bootstrap.cc:492] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd: No bootstrap required, opened a new log
I20260709 12:25:31.430795 22823 ts_tablet_manager.cc:1403] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd: Time spent bootstrapping tablet: real 0.144s	user 0.044s	sys 0.053s
I20260709 12:25:31.422576 22426 catalog_manager.cc:5697] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 14aa1a831920414a9002c10e716019ca (127.9.131.67). New cstate: current_term: 1 leader_uuid: "14aa1a831920414a9002c10e716019ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:31.425642 22849 raft_consensus.cc:493] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.436252 22849 raft_consensus.cc:515] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.438601 22849 leader_election.cc:290] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:31.440296 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566b8f12f7b14c3da9614e5e86b2c7a5" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b" is_pre_election: true
I20260709 12:25:31.440562 22823 raft_consensus.cc:359] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.440762 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566b8f12f7b14c3da9614e5e86b2c7a5" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca" is_pre_election: true
I20260709 12:25:31.425748 22827 raft_consensus.cc:2749] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.441030 22528 raft_consensus.cc:2468] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 0.
I20260709 12:25:31.441535 22678 raft_consensus.cc:2468] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 0.
I20260709 12:25:31.442602 22571 leader_election.cc:304] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:31.444074 22849 raft_consensus.cc:2804] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.444773 22849 raft_consensus.cc:493] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.445173 22849 raft_consensus.cc:3060] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.445197 22823 raft_consensus.cc:385] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.446170 22823 raft_consensus.cc:740] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.455140 22849 raft_consensus.cc:515] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.459218 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566b8f12f7b14c3da9614e5e86b2c7a5" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b"
I20260709 12:25:31.459944 22528 raft_consensus.cc:3060] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.456655 22823 consensus_queue.cc:260] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.465451 22823 ts_tablet_manager.cc:1434] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 12:25:31.470395 22528 raft_consensus.cc:2468] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 1.
I20260709 12:25:31.472553 22571 leader_election.cc:304] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:31.473716 22853 raft_consensus.cc:2804] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.474236 22853 raft_consensus.cc:697] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Becoming Leader. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Running, Role: LEADER
I20260709 12:25:31.475096 22853 consensus_queue.cc:237] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.477434 22823 tablet_bootstrap.cc:492] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd: Bootstrap starting.
I20260709 12:25:31.479506 22780 raft_consensus.cc:493] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.480208 22780 raft_consensus.cc:515] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.482398 22780 leader_election.cc:290] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:31.483974 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577ed270d7c744b0b095890092b10643" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca" is_pre_election: true
I20260709 12:25:31.484558 22677 raft_consensus.cc:2468] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 0.
I20260709 12:25:31.485832 22570 leader_election.cc:304] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:31.487222 22808 raft_consensus.cc:493] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.487658 22849 leader_election.cc:290] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 election: Requested vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:31.488385 22849 raft_consensus.cc:2804] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.488731 22849 raft_consensus.cc:493] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.489042 22849 raft_consensus.cc:3060] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.490180 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566b8f12f7b14c3da9614e5e86b2c7a5" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:31.490823 22677 raft_consensus.cc:3060] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.496250 22827 raft_consensus.cc:493] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.487721 22808 raft_consensus.cc:515] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.497793 22827 raft_consensus.cc:515] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.499718 22808 leader_election.cc:290] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:31.498626 22677 raft_consensus.cc:2468] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 1.
I20260709 12:25:31.470609 22426 catalog_manager.cc:5697] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b reported cstate change: term changed from 0 to 1, leader changed from <none> to 455ef2040975481fa5a87ee178499f4b (127.9.131.65). New cstate: current_term: 1 leader_uuid: "455ef2040975481fa5a87ee178499f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.501336 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9feefcd30077461493b44c5a22265514" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd" is_pre_election: true
I20260709 12:25:31.501519 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577ed270d7c744b0b095890092b10643" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd" is_pre_election: true
I20260709 12:25:31.501320 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577ed270d7c744b0b095890092b10643" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca" is_pre_election: true
I20260709 12:25:31.501984 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9feefcd30077461493b44c5a22265514" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca" is_pre_election: true
W20260709 12:25:31.503017 22493 leader_election.cc:343] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.502858 22678 raft_consensus.cc:2468] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 0.
I20260709 12:25:31.497195 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577ed270d7c744b0b095890092b10643" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b" is_pre_election: true
I20260709 12:25:31.504316 22528 raft_consensus.cc:2468] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 0.
I20260709 12:25:31.504815 22495 leader_election.cc:304] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 455ef2040975481fa5a87ee178499f4b; no voters: 
I20260709 12:25:31.505878 22808 raft_consensus.cc:2804] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.506243 22808 raft_consensus.cc:493] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.506551 22808 raft_consensus.cc:3060] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.503566 22676 raft_consensus.cc:2468] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 0.
I20260709 12:25:31.512734 22495 leader_election.cc:304] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 455ef2040975481fa5a87ee178499f4b; no voters: 53423d4abfe4475f909f37f76c3b64cd
I20260709 12:25:31.499727 22827 leader_election.cc:290] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:31.519577 22844 consensus_queue.cc:1048] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:31.526190 22827 raft_consensus.cc:2804] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.533098 22827 raft_consensus.cc:493] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.533576 22827 raft_consensus.cc:3060] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.532914 22425 catalog_manager.cc:5697] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66). New cstate: current_term: 1 leader_uuid: "53423d4abfe4475f909f37f76c3b64cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.540822 22849 raft_consensus.cc:515] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.549052 22602 raft_consensus.cc:2393] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 455ef2040975481fa5a87ee178499f4b in current term 1: Already voted for candidate 53423d4abfe4475f909f37f76c3b64cd in this term.
I20260709 12:25:31.550006 22833 consensus_queue.cc:1048] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:31.563546 22833 consensus_queue.cc:1048] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:31.564895 22849 leader_election.cc:290] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 election: Requested vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:31.566804 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577ed270d7c744b0b095890092b10643" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b"
I20260709 12:25:31.567006 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577ed270d7c744b0b095890092b10643" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:31.569017 22677 raft_consensus.cc:3060] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.573186 22823 tablet_bootstrap.cc:654] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.572424 22875 consensus_queue.cc:1048] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:25:31.578934 22677 raft_consensus.cc:2468] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 1.
I20260709 12:25:31.588356 22570 leader_election.cc:304] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:31.589428 22780 raft_consensus.cc:2804] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.589952 22780 raft_consensus.cc:697] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Becoming Leader. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Running, Role: LEADER
I20260709 12:25:31.593436 22780 consensus_queue.cc:237] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.616959 22844 consensus_queue.cc:1048] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:31.618476 22827 raft_consensus.cc:515] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.620781 22827 leader_election.cc:290] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 election: Requested vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:31.627296 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9feefcd30077461493b44c5a22265514" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:31.627537 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9feefcd30077461493b44c5a22265514" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:31.628064 22676 raft_consensus.cc:3060] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:31.628909 22493 leader_election.cc:343] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.613178 22808 raft_consensus.cc:515] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.636529 22526 raft_consensus.cc:2393] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 53423d4abfe4475f909f37f76c3b64cd in current term 1: Already voted for candidate 455ef2040975481fa5a87ee178499f4b in this term.
I20260709 12:25:31.643143 22676 raft_consensus.cc:2468] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 1.
I20260709 12:25:31.644630 22495 leader_election.cc:304] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 455ef2040975481fa5a87ee178499f4b; no voters: 53423d4abfe4475f909f37f76c3b64cd
I20260709 12:25:31.645984 22827 raft_consensus.cc:2804] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.647295 22827 raft_consensus.cc:697] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Becoming Leader. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Running, Role: LEADER
I20260709 12:25:31.651690 22841 consensus_queue.cc:1048] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:31.654167 22808 leader_election.cc:290] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 election: Requested vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:31.655637 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577ed270d7c744b0b095890092b10643" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:31.659519 22677 raft_consensus.cc:2393] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 455ef2040975481fa5a87ee178499f4b in current term 1: Already voted for candidate 53423d4abfe4475f909f37f76c3b64cd in this term.
I20260709 12:25:31.651012 22426 catalog_manager.cc:5697] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66). New cstate: current_term: 1 leader_uuid: "53423d4abfe4475f909f37f76c3b64cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.649605 22827 consensus_queue.cc:237] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.658386 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577ed270d7c744b0b095890092b10643" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
W20260709 12:25:31.665433 22476 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:31.665504 22493 leader_election.cc:304] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b; no voters: 14aa1a831920414a9002c10e716019ca, 53423d4abfe4475f909f37f76c3b64cd
I20260709 12:25:31.666779 22808 raft_consensus.cc:2749] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.670279 22823 tablet_bootstrap.cc:492] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd: No bootstrap required, opened a new log
I20260709 12:25:31.670763 22823 ts_tablet_manager.cc:1403] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd: Time spent bootstrapping tablet: real 0.202s	user 0.013s	sys 0.007s
I20260709 12:25:31.673405 22823 raft_consensus.cc:359] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.676189 22823 raft_consensus.cc:385] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.676465 22823 raft_consensus.cc:740] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.677182 22823 consensus_queue.cc:260] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.679136 22823 ts_tablet_manager.cc:1434] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:25:31.680182 22823 tablet_bootstrap.cc:492] T 9feefcd30077461493b44c5a22265514 P 53423d4abfe4475f909f37f76c3b64cd: Bootstrap starting.
I20260709 12:25:31.685082 22823 tablet_bootstrap.cc:654] T 9feefcd30077461493b44c5a22265514 P 53423d4abfe4475f909f37f76c3b64cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.701936 22823 tablet_bootstrap.cc:492] T 9feefcd30077461493b44c5a22265514 P 53423d4abfe4475f909f37f76c3b64cd: No bootstrap required, opened a new log
I20260709 12:25:31.702473 22823 ts_tablet_manager.cc:1403] T 9feefcd30077461493b44c5a22265514 P 53423d4abfe4475f909f37f76c3b64cd: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260709 12:25:31.704824 22425 catalog_manager.cc:5697] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b reported cstate change: term changed from 0 to 1, leader changed from <none> to 455ef2040975481fa5a87ee178499f4b (127.9.131.65). New cstate: current_term: 1 leader_uuid: "455ef2040975481fa5a87ee178499f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.705278 22823 raft_consensus.cc:359] T 9feefcd30077461493b44c5a22265514 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.706228 22823 raft_consensus.cc:385] T 9feefcd30077461493b44c5a22265514 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.706522 22823 raft_consensus.cc:740] T 9feefcd30077461493b44c5a22265514 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.707340 22823 consensus_queue.cc:260] T 9feefcd30077461493b44c5a22265514 P 53423d4abfe4475f909f37f76c3b64cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.709458 22823 ts_tablet_manager.cc:1434] T 9feefcd30077461493b44c5a22265514 P 53423d4abfe4475f909f37f76c3b64cd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:31.775316 22780 raft_consensus.cc:493] T 9feefcd30077461493b44c5a22265514 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.775938 22780 raft_consensus.cc:515] T 9feefcd30077461493b44c5a22265514 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.778362 22780 leader_election.cc:290] T 9feefcd30077461493b44c5a22265514 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:31.779068 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9feefcd30077461493b44c5a22265514" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b" is_pre_election: true
I20260709 12:25:31.779565 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9feefcd30077461493b44c5a22265514" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca" is_pre_election: true
I20260709 12:25:31.780515 22678 raft_consensus.cc:2393] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53423d4abfe4475f909f37f76c3b64cd in current term 1: Already voted for candidate 455ef2040975481fa5a87ee178499f4b in this term.
I20260709 12:25:31.781558 22570 leader_election.cc:304] T 9feefcd30077461493b44c5a22265514 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53423d4abfe4475f909f37f76c3b64cd; no voters: 14aa1a831920414a9002c10e716019ca, 455ef2040975481fa5a87ee178499f4b
I20260709 12:25:31.782402 22780 raft_consensus.cc:3060] T 9feefcd30077461493b44c5a22265514 P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.787720 22780 raft_consensus.cc:2749] T 9feefcd30077461493b44c5a22265514 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.840312 22808 consensus_queue.cc:1048] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:31.854597 22866 consensus_queue.cc:1048] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:31.880079 22678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae7288f6b45b460c943beb337f96dcef"
dest_uuid: "14aa1a831920414a9002c10e716019ca"
mode: GRACEFUL
new_leader_uuid: "455ef2040975481fa5a87ee178499f4b"
 from {username='slave'} at 127.0.0.1:50110
I20260709 12:25:31.880816 22678 raft_consensus.cc:606] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Received request to transfer leadership to TS 455ef2040975481fa5a87ee178499f4b
I20260709 12:25:31.886199 22602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ec5cea7cca64e8db6704a150b5952b9"
dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
mode: GRACEFUL
new_leader_uuid: "455ef2040975481fa5a87ee178499f4b"
 from {username='slave'} at 127.0.0.1:53028
I20260709 12:25:31.886736 22602 raft_consensus.cc:606] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Received request to transfer leadership to TS 455ef2040975481fa5a87ee178499f4b
I20260709 12:25:31.891821 22678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5faed52a86c4a82a727ee14f9cb07ba"
dest_uuid: "14aa1a831920414a9002c10e716019ca"
mode: GRACEFUL
new_leader_uuid: "455ef2040975481fa5a87ee178499f4b"
 from {username='slave'} at 127.0.0.1:50110
I20260709 12:25:31.892386 22678 raft_consensus.cc:606] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Received request to transfer leadership to TS 455ef2040975481fa5a87ee178499f4b
I20260709 12:25:31.897969 22526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0ad4859df0b4464b7049efd51e3103b"
dest_uuid: "455ef2040975481fa5a87ee178499f4b"
mode: GRACEFUL
new_leader_uuid: "53423d4abfe4475f909f37f76c3b64cd"
 from {username='slave'} at 127.0.0.1:39200
I20260709 12:25:31.898639 22526 raft_consensus.cc:606] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Received request to transfer leadership to TS 53423d4abfe4475f909f37f76c3b64cd
I20260709 12:25:31.904317 22678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "997b0886b64a44678821c2ba820196bf"
dest_uuid: "14aa1a831920414a9002c10e716019ca"
mode: GRACEFUL
new_leader_uuid: "53423d4abfe4475f909f37f76c3b64cd"
 from {username='slave'} at 127.0.0.1:50110
I20260709 12:25:31.904824 22678 raft_consensus.cc:606] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Received request to transfer leadership to TS 53423d4abfe4475f909f37f76c3b64cd
I20260709 12:25:31.915887 22526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9feefcd30077461493b44c5a22265514"
dest_uuid: "455ef2040975481fa5a87ee178499f4b"
mode: GRACEFUL
new_leader_uuid: "14aa1a831920414a9002c10e716019ca"
 from {username='slave'} at 127.0.0.1:39200
I20260709 12:25:31.916553 22526 raft_consensus.cc:606] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Received request to transfer leadership to TS 14aa1a831920414a9002c10e716019ca
I20260709 12:25:31.952653 22602 raft_consensus.cc:3060] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.960673 22841 consensus_queue.cc:1048] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:31.968384 22873 consensus_queue.cc:1048] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:31.971252 22809 raft_consensus.cc:993] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca: : Instructing follower 53423d4abfe4475f909f37f76c3b64cd to start an election
I20260709 12:25:31.971848 22809 raft_consensus.cc:1081] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Signalling peer 53423d4abfe4475f909f37f76c3b64cd to start an election
I20260709 12:25:31.978009 22604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "997b0886b64a44678821c2ba820196bf"
dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
 from {username='slave'} at 127.0.0.1:53010
I20260709 12:25:31.978643 22604 raft_consensus.cc:493] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:31.979048 22604 raft_consensus.cc:3060] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:31.982815 22809 raft_consensus.cc:993] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca: : Instructing follower 455ef2040975481fa5a87ee178499f4b to start an election
I20260709 12:25:31.983340 22809 raft_consensus.cc:1081] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Signalling peer 455ef2040975481fa5a87ee178499f4b to start an election
I20260709 12:25:31.978880 22833 consensus_queue.cc:1048] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:31.985477 22526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae7288f6b45b460c943beb337f96dcef"
dest_uuid: "455ef2040975481fa5a87ee178499f4b"
 from {username='slave'} at 127.0.0.1:39168
I20260709 12:25:31.986088 22526 raft_consensus.cc:493] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:31.986423 22526 raft_consensus.cc:3060] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:31.995275 22526 raft_consensus.cc:515] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:31.997973 22526 leader_election.cc:290] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 2 election: Requested vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:31.999310 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7288f6b45b460c943beb337f96dcef" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:31.999644 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7288f6b45b460c943beb337f96dcef" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:32.000311 22677 raft_consensus.cc:3055] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:32.000685 22677 raft_consensus.cc:740] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Running, Role: LEADER
I20260709 12:25:32.000087 22602 raft_consensus.cc:3060] T ae7288f6b45b460c943beb337f96dcef P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.001453 22677 consensus_queue.cc:260] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:32.002511 22677 raft_consensus.cc:3060] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.009207 22602 raft_consensus.cc:2468] T ae7288f6b45b460c943beb337f96dcef P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 2.
I20260709 12:25:32.011596 22493 leader_election.cc:304] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:32.012447 22808 raft_consensus.cc:2804] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:32.012940 22808 raft_consensus.cc:697] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b [term 2 LEADER]: Becoming Leader. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Running, Role: LEADER
I20260709 12:25:32.013761 22808 consensus_queue.cc:237] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:32.014492 22780 consensus_queue.cc:1048] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:32.016901 22604 raft_consensus.cc:515] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:32.020574 22604 leader_election.cc:290] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 2 election: Requested vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:32.022534 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997b0886b64a44678821c2ba820196bf" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "455ef2040975481fa5a87ee178499f4b"
I20260709 12:25:32.023135 22528 raft_consensus.cc:3060] T 997b0886b64a44678821c2ba820196bf P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.023654 22677 raft_consensus.cc:2468] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 2.
I20260709 12:25:32.034050 22425 catalog_manager.cc:5697] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b reported cstate change: term changed from 1 to 2, leader changed from 14aa1a831920414a9002c10e716019ca (127.9.131.67) to 455ef2040975481fa5a87ee178499f4b (127.9.131.65). New cstate: current_term: 2 leader_uuid: "455ef2040975481fa5a87ee178499f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.036875 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997b0886b64a44678821c2ba820196bf" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:32.040375 22677 raft_consensus.cc:3055] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:32.040805 22677 raft_consensus.cc:740] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Running, Role: LEADER
I20260709 12:25:32.041669 22677 consensus_queue.cc:260] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:32.043164 22677 raft_consensus.cc:3060] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.048754 22528 raft_consensus.cc:2468] T 997b0886b64a44678821c2ba820196bf P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 2.
I20260709 12:25:32.050681 22677 raft_consensus.cc:2468] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 2.
I20260709 12:25:32.050748 22571 leader_election.cc:304] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:32.052054 22873 raft_consensus.cc:2804] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:32.052564 22873 raft_consensus.cc:697] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd [term 2 LEADER]: Becoming Leader. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Running, Role: LEADER
I20260709 12:25:32.053416 22873 consensus_queue.cc:237] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:32.069468 22425 catalog_manager.cc:5697] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd reported cstate change: term changed from 1 to 2, leader changed from 14aa1a831920414a9002c10e716019ca (127.9.131.67) to 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66). New cstate: current_term: 2 leader_uuid: "53423d4abfe4475f909f37f76c3b64cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.125283 22873 consensus_queue.cc:1048] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:32.134279 22873 consensus_queue.cc:1048] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:32.151149 22828 consensus_queue.cc:1048] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:32.184778 22808 consensus_queue.cc:1048] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:32.200525 22808 raft_consensus.cc:993] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b: : Instructing follower 14aa1a831920414a9002c10e716019ca to start an election
I20260709 12:25:32.201067 22808 raft_consensus.cc:1081] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Signalling peer 14aa1a831920414a9002c10e716019ca to start an election
I20260709 12:25:32.202906 22677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9feefcd30077461493b44c5a22265514"
dest_uuid: "14aa1a831920414a9002c10e716019ca"
 from {username='slave'} at 127.0.0.1:50090
I20260709 12:25:32.203480 22677 raft_consensus.cc:493] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:32.203809 22677 raft_consensus.cc:3060] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.210898 22677 raft_consensus.cc:515] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:32.211944 22833 raft_consensus.cc:993] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca: : Instructing follower 455ef2040975481fa5a87ee178499f4b to start an election
I20260709 12:25:32.212477 22833 raft_consensus.cc:1081] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Signalling peer 455ef2040975481fa5a87ee178499f4b to start an election
I20260709 12:25:32.213793 22677 leader_election.cc:290] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 2 election: Requested vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073)
I20260709 12:25:32.215102 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9feefcd30077461493b44c5a22265514" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "455ef2040975481fa5a87ee178499f4b"
I20260709 12:25:32.215497 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9feefcd30077461493b44c5a22265514" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:32.215636 22528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5faed52a86c4a82a727ee14f9cb07ba"
dest_uuid: "455ef2040975481fa5a87ee178499f4b"
 from {username='slave'} at 127.0.0.1:39168
I20260709 12:25:32.216296 22604 raft_consensus.cc:3060] T 9feefcd30077461493b44c5a22265514 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.216321 22528 raft_consensus.cc:493] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:32.216811 22526 raft_consensus.cc:3055] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:32.216899 22528 raft_consensus.cc:3060] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.217178 22526 raft_consensus.cc:740] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Running, Role: LEADER
I20260709 12:25:32.218060 22526 consensus_queue.cc:260] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:32.220973 22526 raft_consensus.cc:3060] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.226425 22604 raft_consensus.cc:2468] T 9feefcd30077461493b44c5a22265514 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 2.
I20260709 12:25:32.227959 22642 leader_election.cc:304] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:32.228850 22841 raft_consensus.cc:2804] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:32.229363 22841 raft_consensus.cc:697] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca [term 2 LEADER]: Becoming Leader. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Running, Role: LEADER
I20260709 12:25:32.230188 22841 consensus_queue.cc:237] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:32.234090 22849 raft_consensus.cc:993] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd: : Instructing follower 455ef2040975481fa5a87ee178499f4b to start an election
I20260709 12:25:32.234633 22849 raft_consensus.cc:1081] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Signalling peer 455ef2040975481fa5a87ee178499f4b to start an election
I20260709 12:25:32.236660 22527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ec5cea7cca64e8db6704a150b5952b9"
dest_uuid: "455ef2040975481fa5a87ee178499f4b"
 from {username='slave'} at 127.0.0.1:39184
I20260709 12:25:32.237628 22527 raft_consensus.cc:493] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:32.237706 22526 raft_consensus.cc:2468] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 2.
I20260709 12:25:32.238082 22527 raft_consensus.cc:3060] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.231178 22528 raft_consensus.cc:515] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:32.247089 22528 leader_election.cc:290] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 2 election: Requested vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:32.247882 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5faed52a86c4a82a727ee14f9cb07ba" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:32.248528 22604 raft_consensus.cc:3060] T b5faed52a86c4a82a727ee14f9cb07ba P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.249111 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5faed52a86c4a82a727ee14f9cb07ba" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:32.249783 22678 raft_consensus.cc:3055] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:32.250092 22678 raft_consensus.cc:740] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Running, Role: LEADER
I20260709 12:25:32.250944 22678 consensus_queue.cc:260] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:32.252170 22678 raft_consensus.cc:3060] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.253993 22527 raft_consensus.cc:515] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:32.245690 22426 catalog_manager.cc:5697] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca reported cstate change: term changed from 1 to 2, leader changed from 455ef2040975481fa5a87ee178499f4b (127.9.131.65) to 14aa1a831920414a9002c10e716019ca (127.9.131.67). New cstate: current_term: 2 leader_uuid: "14aa1a831920414a9002c10e716019ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:32.257718 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec5cea7cca64e8db6704a150b5952b9" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:32.258368 22602 raft_consensus.cc:3055] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:32.258715 22602 raft_consensus.cc:740] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Running, Role: LEADER
I20260709 12:25:32.259410 22527 leader_election.cc:290] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 2 election: Requested vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:32.258631 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec5cea7cca64e8db6704a150b5952b9" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:32.260217 22677 raft_consensus.cc:3060] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.261418 22678 raft_consensus.cc:2468] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 2.
I20260709 12:25:32.262827 22495 leader_election.cc:304] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 455ef2040975481fa5a87ee178499f4b; no voters: 
I20260709 12:25:32.263705 22808 raft_consensus.cc:2804] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:32.264292 22808 raft_consensus.cc:697] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b [term 2 LEADER]: Becoming Leader. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Running, Role: LEADER
I20260709 12:25:32.264559 22602 consensus_queue.cc:260] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:32.265110 22808 consensus_queue.cc:237] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:32.266033 22602 raft_consensus.cc:3060] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.268692 22604 raft_consensus.cc:2468] T b5faed52a86c4a82a727ee14f9cb07ba P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 2.
I20260709 12:25:32.271265 22677 raft_consensus.cc:2468] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 2.
I20260709 12:25:32.272771 22495 leader_election.cc:304] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 455ef2040975481fa5a87ee178499f4b; no voters: 
I20260709 12:25:32.273701 22808 raft_consensus.cc:2804] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:32.274219 22808 raft_consensus.cc:697] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [term 2 LEADER]: Becoming Leader. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Running, Role: LEADER
I20260709 12:25:32.275077 22808 consensus_queue.cc:237] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:32.279524 22602 raft_consensus.cc:2468] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 2.
I20260709 12:25:32.279181 22428 catalog_manager.cc:5697] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b reported cstate change: term changed from 1 to 2, leader changed from 14aa1a831920414a9002c10e716019ca (127.9.131.67) to 455ef2040975481fa5a87ee178499f4b (127.9.131.65). New cstate: current_term: 2 leader_uuid: "455ef2040975481fa5a87ee178499f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.291797 22428 catalog_manager.cc:5697] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b reported cstate change: term changed from 1 to 2, leader changed from 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66) to 455ef2040975481fa5a87ee178499f4b (127.9.131.65). New cstate: current_term: 2 leader_uuid: "455ef2040975481fa5a87ee178499f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.331725 22828 raft_consensus.cc:993] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b: : Instructing follower 53423d4abfe4475f909f37f76c3b64cd to start an election
I20260709 12:25:32.332211 22808 raft_consensus.cc:1081] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Signalling peer 53423d4abfe4475f909f37f76c3b64cd to start an election
I20260709 12:25:32.333585 22602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0ad4859df0b4464b7049efd51e3103b"
dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
 from {username='slave'} at 127.0.0.1:53026
I20260709 12:25:32.334061 22602 raft_consensus.cc:493] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:32.334395 22602 raft_consensus.cc:3060] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.340117 22602 raft_consensus.cc:515] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:32.342572 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ad4859df0b4464b7049efd51e3103b" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "455ef2040975481fa5a87ee178499f4b"
I20260709 12:25:32.342782 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ad4859df0b4464b7049efd51e3103b" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:32.343091 22527 raft_consensus.cc:3055] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:32.343393 22527 raft_consensus.cc:740] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Running, Role: LEADER
I20260709 12:25:32.343446 22677 raft_consensus.cc:3060] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.344141 22527 consensus_queue.cc:260] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:32.345041 22527 raft_consensus.cc:3060] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.347950 22602 leader_election.cc:290] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 2 election: Requested vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:32.351239 22677 raft_consensus.cc:2468] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 2.
I20260709 12:25:32.351814 22527 raft_consensus.cc:2468] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 2.
I20260709 12:25:32.352646 22570 leader_election.cc:304] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:32.353543 22780 raft_consensus.cc:2804] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:32.354032 22780 raft_consensus.cc:697] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd [term 2 LEADER]: Becoming Leader. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Running, Role: LEADER
I20260709 12:25:32.354858 22780 consensus_queue.cc:237] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:32.363543 22428 catalog_manager.cc:5697] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd reported cstate change: term changed from 1 to 2, leader changed from 455ef2040975481fa5a87ee178499f4b (127.9.131.65) to 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66). New cstate: current_term: 2 leader_uuid: "53423d4abfe4475f909f37f76c3b64cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.439073 22677 raft_consensus.cc:1275] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Refusing update from remote peer 455ef2040975481fa5a87ee178499f4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:32.440476 22808 consensus_queue.cc:1048] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:32.450688 22602 raft_consensus.cc:1275] T ae7288f6b45b460c943beb337f96dcef P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Refusing update from remote peer 455ef2040975481fa5a87ee178499f4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:32.452091 22828 consensus_queue.cc:1048] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:32.455582 22677 raft_consensus.cc:1275] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Refusing update from remote peer 53423d4abfe4475f909f37f76c3b64cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:32.457201 22849 consensus_queue.cc:1048] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:32.470242 22527 raft_consensus.cc:1275] T 997b0886b64a44678821c2ba820196bf P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Refusing update from remote peer 53423d4abfe4475f909f37f76c3b64cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:32.471783 22849 consensus_queue.cc:1048] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:32.687727 22602 raft_consensus.cc:1275] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Refusing update from remote peer 455ef2040975481fa5a87ee178499f4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:32.689262 22897 consensus_queue.cc:1048] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:32.698587 22677 raft_consensus.cc:1275] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Refusing update from remote peer 455ef2040975481fa5a87ee178499f4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:32.700510 22828 consensus_queue.cc:1048] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:32.720888 22602 raft_consensus.cc:1275] T 9feefcd30077461493b44c5a22265514 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Refusing update from remote peer 14aa1a831920414a9002c10e716019ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:32.722291 22841 consensus_queue.cc:1048] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:32.730448 22527 raft_consensus.cc:1275] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Refusing update from remote peer 14aa1a831920414a9002c10e716019ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:32.733312 22841 consensus_queue.cc:1048] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:32.796011 22602 raft_consensus.cc:1275] T b5faed52a86c4a82a727ee14f9cb07ba P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Refusing update from remote peer 455ef2040975481fa5a87ee178499f4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:32.797452 22828 consensus_queue.cc:1048] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:32.807009 22677 raft_consensus.cc:1275] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Refusing update from remote peer 455ef2040975481fa5a87ee178499f4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:32.809514 22897 consensus_queue.cc:1048] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:32.846324 22527 raft_consensus.cc:1275] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Refusing update from remote peer 53423d4abfe4475f909f37f76c3b64cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:32.847627 22873 consensus_queue.cc:1048] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:32.858660 22678 raft_consensus.cc:1275] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Refusing update from remote peer 53423d4abfe4475f909f37f76c3b64cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:32.862967 22780 consensus_queue.cc:1048] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:34.920306 22425 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35024:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:25:34.941309 22425 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35024:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:25:35.022272  9741 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:35.064874 22950 tablet.cc:1724] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.069989 22948 tablet.cc:1724] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.120819 22949 tablet.cc:1724] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:35.132517 22705 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:6ec5cea7cca64e8db6704a150b5952b9)
W20260709 12:25:35.145011 22705 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:6ec5cea7cca64e8db6704a150b5952b9)
W20260709 12:25:35.146304 22705 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:6ec5cea7cca64e8db6704a150b5952b9)
I20260709 12:25:35.161688 22935 tablet.cc:1724] T 997b0886b64a44678821c2ba820196bf P 455ef2040975481fa5a87ee178499f4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:35.226815 22956 log.cc:927] Time spent T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:25:35.169986 22954 tablet.cc:1724] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:35.240288 22955 log.cc:927] Time spent T ae7288f6b45b460c943beb337f96dcef P 53423d4abfe4475f909f37f76c3b64cd: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 12:25:35.305903 22962 log.cc:927] Time spent T 9feefcd30077461493b44c5a22265514 P 53423d4abfe4475f909f37f76c3b64cd: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:25:35.345429 22935 tablet.cc:1724] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:35.327950 22571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.65:39625, user_credentials={real_user=slave}} blocked reactor thread for 57996.7us
I20260709 12:25:35.352815 22974 tablet.cc:1724] T ae7288f6b45b460c943beb337f96dcef P 53423d4abfe4475f909f37f76c3b64cd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.357445 22968 tablet.cc:1724] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:35.358880 22959 log.cc:927] Time spent T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 12:25:35.364223 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:45073, user_credentials={real_user=slave}} blocked reactor thread for 49254us
I20260709 12:25:35.277822 22961 tablet.cc:1724] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.305367 22950 tablet.cc:1724] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 455ef2040975481fa5a87ee178499f4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.295408 22960 tablet.cc:1724] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.376003 22948 tablet.cc:1724] T ba6fecddbd094b4cae5a0778e1a1812e P 53423d4abfe4475f909f37f76c3b64cd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.375582 22971 tablet.cc:1724] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.390549 22973 tablet.cc:1724] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.409938 22949 tablet.cc:1724] T ba6fecddbd094b4cae5a0778e1a1812e P 14aa1a831920414a9002c10e716019ca: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.396073 22972 tablet.cc:1724] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.425921 22960 tablet.cc:1724] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.417564 22935 tablet.cc:1724] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.420930 22961 tablet.cc:1724] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.430312 22968 tablet.cc:1724] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:35.440306 22493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:35073, user_credentials={real_user=slave}} blocked reactor thread for 66266.5us
I20260709 12:25:35.442834 22971 tablet.cc:1724] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.463572 22949 tablet.cc:1724] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.458209 22968 tablet.cc:1724] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.468338 22605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "566b8f12f7b14c3da9614e5e86b2c7a5"
dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
mode: GRACEFUL
new_leader_uuid: "14aa1a831920414a9002c10e716019ca"
 from {username='slave'} at 127.0.0.1:34918
I20260709 12:25:35.472641 22954 tablet.cc:1724] T b5faed52a86c4a82a727ee14f9cb07ba P 53423d4abfe4475f909f37f76c3b64cd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.472746 22605 raft_consensus.cc:606] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Received request to transfer leadership to TS 14aa1a831920414a9002c10e716019ca
I20260709 12:25:35.493148 22976 raft_consensus.cc:993] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd: : Instructing follower 14aa1a831920414a9002c10e716019ca to start an election
I20260709 12:25:35.493858 22947 raft_consensus.cc:1081] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Signalling peer 14aa1a831920414a9002c10e716019ca to start an election
I20260709 12:25:35.495838 22972 tablet.cc:1724] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.488148 22948 tablet.cc:1724] T 9feefcd30077461493b44c5a22265514 P 53423d4abfe4475f909f37f76c3b64cd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.501253 22675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "566b8f12f7b14c3da9614e5e86b2c7a5"
dest_uuid: "14aa1a831920414a9002c10e716019ca"
 from {username='slave'} at 127.0.0.1:50100
I20260709 12:25:35.501961 22675 raft_consensus.cc:493] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:35.502318 22675 raft_consensus.cc:3060] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:35.508234 22949 tablet.cc:1724] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.510929 22675 raft_consensus.cc:515] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:35.513370 22675 leader_election.cc:290] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 2 election: Requested vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073)
I20260709 12:25:35.515232 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566b8f12f7b14c3da9614e5e86b2c7a5" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:35.516289 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566b8f12f7b14c3da9614e5e86b2c7a5" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "455ef2040975481fa5a87ee178499f4b"
I20260709 12:25:35.516747 22605 raft_consensus.cc:3055] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:35.517082 22529 raft_consensus.cc:3060] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:35.520046 22605 raft_consensus.cc:740] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Running, Role: LEADER
I20260709 12:25:35.523468 22605 consensus_queue.cc:260] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:35.524798 22605 raft_consensus.cc:3060] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:35.526917 22529 raft_consensus.cc:2468] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 2.
I20260709 12:25:35.531348 22645 leader_election.cc:304] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 455ef2040975481fa5a87ee178499f4b; no voters: 
I20260709 12:25:35.532424 22906 raft_consensus.cc:2804] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:35.532936 22906 raft_consensus.cc:697] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [term 2 LEADER]: Becoming Leader. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Running, Role: LEADER
I20260709 12:25:35.533056 22605 raft_consensus.cc:2468] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 2.
I20260709 12:25:35.534420 22906 consensus_queue.cc:237] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:35.539186 22529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ec5cea7cca64e8db6704a150b5952b9"
dest_uuid: "455ef2040975481fa5a87ee178499f4b"
mode: GRACEFUL
new_leader_uuid: "14aa1a831920414a9002c10e716019ca"
 from {username='slave'} at 127.0.0.1:39004
I20260709 12:25:35.539990 22529 raft_consensus.cc:606] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [term 2 LEADER]: Received request to transfer leadership to TS 14aa1a831920414a9002c10e716019ca
I20260709 12:25:35.541322 22977 raft_consensus.cc:993] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b: : Instructing follower 14aa1a831920414a9002c10e716019ca to start an election
I20260709 12:25:35.541759  9741 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:25:35.541800 22977 raft_consensus.cc:1081] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [term 2 LEADER]: Signalling peer 14aa1a831920414a9002c10e716019ca to start an election
I20260709 12:25:35.542392  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:35.543953 22675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ec5cea7cca64e8db6704a150b5952b9"
dest_uuid: "14aa1a831920414a9002c10e716019ca"
 from {username='slave'} at 127.0.0.1:50090
I20260709 12:25:35.544579 22675 raft_consensus.cc:493] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:35.544956 22675 raft_consensus.cc:3060] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:35.543759 22425 catalog_manager.cc:6242] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3: soft_deleted_table [id=5510aad0bd2b4ffb8436ea56488c869c] alter complete (version 1)
I20260709 12:25:35.553203 22675 raft_consensus.cc:515] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:35.555745 22529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12c9fec992dd480c8c81149e589ce6ae"
dest_uuid: "455ef2040975481fa5a87ee178499f4b"
mode: GRACEFUL
new_leader_uuid: "14aa1a831920414a9002c10e716019ca"
 from {username='slave'} at 127.0.0.1:39004
I20260709 12:25:35.557202 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec5cea7cca64e8db6704a150b5952b9" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:35.557639 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec5cea7cca64e8db6704a150b5952b9" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "455ef2040975481fa5a87ee178499f4b"
I20260709 12:25:35.557722 22428 catalog_manager.cc:5697] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca reported cstate change: term changed from 1 to 2, leader changed from 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66) to 14aa1a831920414a9002c10e716019ca (127.9.131.67). New cstate: current_term: 2 leader_uuid: "14aa1a831920414a9002c10e716019ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:35.558744 22529 raft_consensus.cc:606] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [term 2 LEADER]: Received request to transfer leadership to TS 14aa1a831920414a9002c10e716019ca
I20260709 12:25:35.558916 22528 raft_consensus.cc:3055] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:35.559413 22528 raft_consensus.cc:740] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Running, Role: LEADER
I20260709 12:25:35.560227 22528 consensus_queue.cc:260] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:35.561228 22528 raft_consensus.cc:3060] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:35.561470 22605 raft_consensus.cc:3060] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:35.555945 22675 leader_election.cc:290] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 3 election: Requested vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073)
I20260709 12:25:35.562276 22602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50a4f3e40a324906b514df458c11bb83"
dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
mode: GRACEFUL
new_leader_uuid: "14aa1a831920414a9002c10e716019ca"
 from {username='slave'} at 127.0.0.1:34918
I20260709 12:25:35.563011 22602 raft_consensus.cc:606] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Received request to transfer leadership to TS 14aa1a831920414a9002c10e716019ca
I20260709 12:25:35.568821 22528 raft_consensus.cc:2468] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 3.
I20260709 12:25:35.569077  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:35.570060  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:35.568907 22605 raft_consensus.cc:2468] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 3.
I20260709 12:25:35.570231 22645 leader_election.cc:304] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 455ef2040975481fa5a87ee178499f4b; no voters: 
I20260709 12:25:35.571272 22906 raft_consensus.cc:2804] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:35.571768 22906 raft_consensus.cc:697] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca [term 3 LEADER]: Becoming Leader. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Running, Role: LEADER
I20260709 12:25:35.572659 22906 consensus_queue.cc:237] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:35.579548 22428 catalog_manager.cc:5697] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca reported cstate change: term changed from 2 to 3, leader changed from 455ef2040975481fa5a87ee178499f4b (127.9.131.65) to 14aa1a831920414a9002c10e716019ca (127.9.131.67). New cstate: current_term: 3 leader_uuid: "14aa1a831920414a9002c10e716019ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:35.887004 22947 raft_consensus.cc:993] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd: : Instructing follower 14aa1a831920414a9002c10e716019ca to start an election
I20260709 12:25:35.887776 22947 raft_consensus.cc:1081] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Signalling peer 14aa1a831920414a9002c10e716019ca to start an election
I20260709 12:25:35.889813 22675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50a4f3e40a324906b514df458c11bb83"
dest_uuid: "14aa1a831920414a9002c10e716019ca"
 from {username='slave'} at 127.0.0.1:50100
I20260709 12:25:35.890327 22675 raft_consensus.cc:493] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:35.890640 22675 raft_consensus.cc:3060] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:35.897121 22675 raft_consensus.cc:515] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:35.898173 22909 raft_consensus.cc:993] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b: : Instructing follower 14aa1a831920414a9002c10e716019ca to start an election
I20260709 12:25:35.898690 22977 raft_consensus.cc:1081] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [term 2 LEADER]: Signalling peer 14aa1a831920414a9002c10e716019ca to start an election
I20260709 12:25:35.899133 22675 leader_election.cc:290] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 2 election: Requested vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073)
I20260709 12:25:35.899765 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a4f3e40a324906b514df458c11bb83" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "455ef2040975481fa5a87ee178499f4b"
I20260709 12:25:35.900545 22529 raft_consensus.cc:3060] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:35.900460 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a4f3e40a324906b514df458c11bb83" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:35.901166 22675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12c9fec992dd480c8c81149e589ce6ae"
dest_uuid: "14aa1a831920414a9002c10e716019ca"
 from {username='slave'} at 127.0.0.1:50090
I20260709 12:25:35.901314 22605 raft_consensus.cc:3055] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:35.901906 22605 raft_consensus.cc:740] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Running, Role: LEADER
I20260709 12:25:35.901959 22675 raft_consensus.cc:493] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:35.902407 22675 raft_consensus.cc:3060] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:35.902798 22605 consensus_queue.cc:260] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:35.904208 22605 raft_consensus.cc:3060] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:35.910383 22675 raft_consensus.cc:515] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:35.911831 22605 raft_consensus.cc:2468] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 2.
I20260709 12:25:35.911798 22529 raft_consensus.cc:2468] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 2.
I20260709 12:25:35.913682 22642 leader_election.cc:304] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:35.914180 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c9fec992dd480c8c81149e589ce6ae" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "455ef2040975481fa5a87ee178499f4b"
I20260709 12:25:35.914080 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c9fec992dd480c8c81149e589ce6ae" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:35.915262 22906 raft_consensus.cc:2804] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:35.915488 22675 leader_election.cc:290] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 3 election: Requested vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073)
I20260709 12:25:35.915512 22602 raft_consensus.cc:3060] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:35.916093 22906 raft_consensus.cc:697] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [term 2 LEADER]: Becoming Leader. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Running, Role: LEADER
I20260709 12:25:35.915335 22529 raft_consensus.cc:3055] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:35.921857 22529 raft_consensus.cc:740] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 455ef2040975481fa5a87ee178499f4b, State: Running, Role: LEADER
I20260709 12:25:35.922770 22529 consensus_queue.cc:260] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:35.922053 22906 consensus_queue.cc:237] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:35.924153 22529 raft_consensus.cc:3060] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:35.929714 22602 raft_consensus.cc:2468] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 3.
I20260709 12:25:35.930998 22529 raft_consensus.cc:2468] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14aa1a831920414a9002c10e716019ca in term 3.
I20260709 12:25:35.930992 22642 leader_election.cc:304] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:35.932116 22906 raft_consensus.cc:2804] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:35.932626 22906 raft_consensus.cc:697] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [term 3 LEADER]: Becoming Leader. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Running, Role: LEADER
I20260709 12:25:35.933279 22906 consensus_queue.cc:237] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:35.938097 22428 catalog_manager.cc:5697] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca reported cstate change: term changed from 1 to 2, leader changed from 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66) to 14aa1a831920414a9002c10e716019ca (127.9.131.67). New cstate: current_term: 2 leader_uuid: "14aa1a831920414a9002c10e716019ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:35.953305 22428 catalog_manager.cc:5697] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca reported cstate change: term changed from 2 to 3, leader changed from 455ef2040975481fa5a87ee178499f4b (127.9.131.65) to 14aa1a831920414a9002c10e716019ca (127.9.131.67). New cstate: current_term: 3 leader_uuid: "14aa1a831920414a9002c10e716019ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:35.969622 22529 raft_consensus.cc:1275] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [term 3 FOLLOWER]: Refusing update from remote peer 14aa1a831920414a9002c10e716019ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:25:35.971134 22923 consensus_queue.cc:1048] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:35.980738 22602 raft_consensus.cc:1275] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [term 3 FOLLOWER]: Refusing update from remote peer 14aa1a831920414a9002c10e716019ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:25:35.982300 22906 consensus_queue.cc:1048] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:36.021246 22528 raft_consensus.cc:1275] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Refusing update from remote peer 14aa1a831920414a9002c10e716019ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:25:36.022461 22906 consensus_queue.cc:1048] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:36.032841 22602 raft_consensus.cc:1275] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Refusing update from remote peer 14aa1a831920414a9002c10e716019ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:25:36.034325 22906 consensus_queue.cc:1048] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:36.357156 22602 raft_consensus.cc:1275] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 3 FOLLOWER]: Refusing update from remote peer 14aa1a831920414a9002c10e716019ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:36.358335 22906 consensus_queue.cc:1048] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:36.367439 22528 raft_consensus.cc:1275] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [term 3 FOLLOWER]: Refusing update from remote peer 14aa1a831920414a9002c10e716019ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:36.369099 22906 consensus_queue.cc:1048] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:36.444679 22529 raft_consensus.cc:1275] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Refusing update from remote peer 14aa1a831920414a9002c10e716019ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:36.445943 22906 consensus_queue.cc:1048] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:36.460338 22602 raft_consensus.cc:1275] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Refusing update from remote peer 14aa1a831920414a9002c10e716019ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:36.462457 22987 consensus_queue.cc:1048] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:36.571936  9741 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:36.576967  9741 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:36.577399  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:36.582127  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:36.582535  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:37.583451  9741 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:37.589035  9741 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:37.589455  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:37.594969  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:37.595502  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:38.596518  9741 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:38.601678  9741 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:38.602089  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:38.606901  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:38.607324  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:39.608337  9741 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:39.614212  9741 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:39.614754  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:39.619760  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:39.620198  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:40.621402  9741 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:40.626739  9741 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:40.627184  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:40.631923  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:40.632344  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:41.633491  9741 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:41.638518  9741 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:41.638960  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:41.644369  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:41.644802  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:42.645818  9741 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:42.652637  9741 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:42.653187  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:42.658218  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:42.658571  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:43.659634  9741 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:43.664634  9741 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:43.665019  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:43.669873  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:43.670233  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:45.034016 23012 raft_consensus.cc:493] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53423d4abfe4475f909f37f76c3b64cd)
I20260709 12:25:45.034909 23012 raft_consensus.cc:515] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:45.039783 23012 leader_election.cc:290] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073)
I20260709 12:25:45.072367 23017 raft_consensus.cc:493] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 14aa1a831920414a9002c10e716019ca)
I20260709 12:25:45.073206 23017 raft_consensus.cc:515] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:45.080278 23017 leader_election.cc:290] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:45.096134 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ad4859df0b4464b7049efd51e3103b" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b" is_pre_election: true
I20260709 12:25:45.101234 23019 raft_consensus.cc:493] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 14aa1a831920414a9002c10e716019ca)
I20260709 12:25:45.102097 23019 raft_consensus.cc:515] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:45.105394 23019 leader_election.cc:290] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:45.106011 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a4f3e40a324906b514df458c11bb83" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd" is_pre_election: true
I20260709 12:25:45.106948 22605 raft_consensus.cc:2468] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 455ef2040975481fa5a87ee178499f4b in term 2.
I20260709 12:25:45.108454 22493 leader_election.cc:304] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd; no voters: 
I20260709 12:25:45.109314 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c9fec992dd480c8c81149e589ce6ae" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b" is_pre_election: true
I20260709 12:25:45.112955 23021 raft_consensus.cc:493] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 14aa1a831920414a9002c10e716019ca)
I20260709 12:25:45.117106 23021 raft_consensus.cc:515] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:45.114214 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c9fec992dd480c8c81149e589ce6ae" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca" is_pre_election: true
I20260709 12:25:45.109514 23019 raft_consensus.cc:2804] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:45.119649 23019 raft_consensus.cc:493] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 14aa1a831920414a9002c10e716019ca)
I20260709 12:25:45.120143 23019 raft_consensus.cc:3060] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:45.120815 23021 leader_election.cc:290] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:45.121315 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566b8f12f7b14c3da9614e5e86b2c7a5" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "455ef2040975481fa5a87ee178499f4b" is_pre_election: true
I20260709 12:25:45.125495 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a4f3e40a324906b514df458c11bb83" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca" is_pre_election: true
I20260709 12:25:45.130172 23019 raft_consensus.cc:515] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:45.131984 23019 leader_election.cc:290] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 3 election: Requested vote from peers 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:45.132475 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ad4859df0b4464b7049efd51e3103b" candidate_uuid: "14aa1a831920414a9002c10e716019ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd" is_pre_election: true
I20260709 12:25:45.133708 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566b8f12f7b14c3da9614e5e86b2c7a5" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca" is_pre_election: true
I20260709 12:25:45.133785 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a4f3e40a324906b514df458c11bb83" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "53423d4abfe4475f909f37f76c3b64cd"
I20260709 12:25:45.134847 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a4f3e40a324906b514df458c11bb83" candidate_uuid: "455ef2040975481fa5a87ee178499f4b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca"
I20260709 12:25:45.137625 22570 leader_election.cc:304] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53423d4abfe4475f909f37f76c3b64cd; no voters: 14aa1a831920414a9002c10e716019ca, 455ef2040975481fa5a87ee178499f4b
I20260709 12:25:45.137646 22495 leader_election.cc:304] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 455ef2040975481fa5a87ee178499f4b; no voters: 14aa1a831920414a9002c10e716019ca, 53423d4abfe4475f909f37f76c3b64cd
I20260709 12:25:45.138659 23022 raft_consensus.cc:2749] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:45.138891 23019 raft_consensus.cc:2749] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:25:45.139719 22570 leader_election.cc:304] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53423d4abfe4475f909f37f76c3b64cd; no voters: 14aa1a831920414a9002c10e716019ca, 455ef2040975481fa5a87ee178499f4b
I20260709 12:25:45.140504 23022 raft_consensus.cc:2749] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:45.141681 22642 leader_election.cc:304] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14aa1a831920414a9002c10e716019ca; no voters: 455ef2040975481fa5a87ee178499f4b, 53423d4abfe4475f909f37f76c3b64cd
I20260709 12:25:45.142405 23009 raft_consensus.cc:2749] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:45.442039 22528 raft_consensus.cc:1240] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [term 3 FOLLOWER]: Rejecting Update request from peer 14aa1a831920414a9002c10e716019ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:45.443549 23011 consensus_queue.cc:1059] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:45.444581 23009 raft_consensus.cc:3055] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:45.444885 23009 raft_consensus.cc:740] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 14aa1a831920414a9002c10e716019ca, State: Running, Role: LEADER
I20260709 12:25:45.445693 23009 consensus_queue.cc:260] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:45.446900 23009 raft_consensus.cc:3060] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:25:45.726943 22700 debug-util.cc:398] Leaking SignalData structure 0x7b08001305e0 after lost signal to thread 9744
W20260709 12:25:45.728101 22700 debug-util.cc:398] Leaking SignalData structure 0x7b0800225100 after lost signal to thread 22462
W20260709 12:25:45.729207 22700 debug-util.cc:398] Leaking SignalData structure 0x7b08000e09e0 after lost signal to thread 22554
W20260709 12:25:45.730242 22700 debug-util.cc:398] Leaking SignalData structure 0x7b080025a3e0 after lost signal to thread 22629
W20260709 12:25:45.731212 22700 debug-util.cc:398] Leaking SignalData structure 0x7b080017eaa0 after lost signal to thread 22703
I20260709 12:25:45.777364  9741 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:45.785157  9741 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:45.785732  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:45.792824  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:45.793380  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:46.868228  9741 tablet_server.cc:179] TabletServer@127.9.131.65:0 shutting down...
I20260709 12:25:46.903975 23025 raft_consensus.cc:493] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 14aa1a831920414a9002c10e716019ca)
I20260709 12:25:46.904572 23025 raft_consensus.cc:515] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:46.906572 23025 leader_election.cc:290] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
W20260709 12:25:46.907744 22571 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
I20260709 12:25:46.908420 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a4f3e40a324906b514df458c11bb83" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca" is_pre_election: true
I20260709 12:25:46.909065 22678 raft_consensus.cc:2468] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 3.
W20260709 12:25:46.911636 22571 leader_election.cc:336] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:46.913731 22570 leader_election.cc:304] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 53423d4abfe4475f909f37f76c3b64cd; no voters: 455ef2040975481fa5a87ee178499f4b
I20260709 12:25:46.915611 23021 raft_consensus.cc:2804] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:46.916054 23021 raft_consensus.cc:493] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 14aa1a831920414a9002c10e716019ca)
I20260709 12:25:46.916227  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:46.916431 23021 raft_consensus.cc:3060] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:46.917654  9741 tablet_replica.cc:333] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b: stopping tablet replica
I20260709 12:25:46.918973  9741 raft_consensus.cc:2243] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.919793  9741 raft_consensus.cc:2272] T 577ed270d7c744b0b095890092b10643 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.925211  9741 tablet_replica.cc:333] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b: stopping tablet replica
I20260709 12:25:46.926316  9741 raft_consensus.cc:2243] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.926237 23021 raft_consensus.cc:515] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:46.927361  9741 raft_consensus.cc:2272] T c0ad4859df0b4464b7049efd51e3103b P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.930224 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a4f3e40a324906b514df458c11bb83" candidate_uuid: "53423d4abfe4475f909f37f76c3b64cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14aa1a831920414a9002c10e716019ca"
W20260709 12:25:46.931423 22571 leader_election.cc:336] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:46.932583  9741 tablet_replica.cc:333] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b: stopping tablet replica
I20260709 12:25:46.933941  9741 raft_consensus.cc:2243] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.935475  9741 raft_consensus.cc:2272] T ae7288f6b45b460c943beb337f96dcef P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.937656 22678 raft_consensus.cc:2468] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53423d4abfe4475f909f37f76c3b64cd in term 3.
I20260709 12:25:46.938202 23021 leader_election.cc:290] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 3 election: Requested vote from peers 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625), 14aa1a831920414a9002c10e716019ca (127.9.131.67:45073)
I20260709 12:25:46.939029 22570 leader_election.cc:304] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14aa1a831920414a9002c10e716019ca, 53423d4abfe4475f909f37f76c3b64cd; no voters: 455ef2040975481fa5a87ee178499f4b
I20260709 12:25:46.939301  9741 tablet_replica.cc:333] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b: stopping tablet replica
I20260709 12:25:46.939816 23021 raft_consensus.cc:2804] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:46.940339  9741 raft_consensus.cc:2243] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.940665 23021 raft_consensus.cc:697] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 3 LEADER]: Becoming Leader. State: Replica: 53423d4abfe4475f909f37f76c3b64cd, State: Running, Role: LEADER
I20260709 12:25:46.941215  9741 raft_consensus.cc:2272] T 6ec5cea7cca64e8db6704a150b5952b9 P 455ef2040975481fa5a87ee178499f4b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.941946 23021 consensus_queue.cc:237] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } }
I20260709 12:25:46.951375  9741 tablet_replica.cc:333] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b: stopping tablet replica
I20260709 12:25:46.952471  9741 raft_consensus.cc:2243] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.953934  9741 raft_consensus.cc:2272] T b5faed52a86c4a82a727ee14f9cb07ba P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.958220  9741 tablet_replica.cc:333] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b: stopping tablet replica
I20260709 12:25:46.957866 22425 catalog_manager.cc:5697] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd reported cstate change: term changed from 2 to 3, leader changed from 14aa1a831920414a9002c10e716019ca (127.9.131.67) to 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66). New cstate: current_term: 3 leader_uuid: "53423d4abfe4475f909f37f76c3b64cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455ef2040975481fa5a87ee178499f4b" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53423d4abfe4475f909f37f76c3b64cd" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 35073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14aa1a831920414a9002c10e716019ca" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 45073 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:46.959309  9741 raft_consensus.cc:2243] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.960820  9741 raft_consensus.cc:2272] T b6a5a612a23b46318cd2f55db7e11764 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.966100  9741 tablet_replica.cc:333] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b: stopping tablet replica
I20260709 12:25:46.967032  9741 raft_consensus.cc:2243] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.967664  9741 raft_consensus.cc:2272] T 12c9fec992dd480c8c81149e589ce6ae P 455ef2040975481fa5a87ee178499f4b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.971071  9741 tablet_replica.cc:333] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b: stopping tablet replica
I20260709 12:25:46.972126  9741 raft_consensus.cc:2243] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.973479  9741 raft_consensus.cc:2272] T 56382e75ff42435f8cd367e1cd7e04d6 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.977453  9741 tablet_replica.cc:333] T ed2ed22d8525491cab6979ad9ddfc821 P 455ef2040975481fa5a87ee178499f4b: stopping tablet replica
I20260709 12:25:46.978477  9741 raft_consensus.cc:2243] T ed2ed22d8525491cab6979ad9ddfc821 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.979255  9741 raft_consensus.cc:2272] T ed2ed22d8525491cab6979ad9ddfc821 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.983227  9741 tablet_replica.cc:333] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b: stopping tablet replica
I20260709 12:25:46.984223  9741 raft_consensus.cc:2243] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.985699  9741 raft_consensus.cc:2272] T 295498b76d5d4aadbc7d123c6a2043d4 P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.989715  9741 tablet_replica.cc:333] T 997b0886b64a44678821c2ba820196bf P 455ef2040975481fa5a87ee178499f4b: stopping tablet replica
W20260709 12:25:46.990514 22571 consensus_peers.cc:597] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd -> Peer 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625): Couldn't send request to peer 455ef2040975481fa5a87ee178499f4b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:46.990602  9741 raft_consensus.cc:2243] T 997b0886b64a44678821c2ba820196bf P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.991628  9741 raft_consensus.cc:2272] T 997b0886b64a44678821c2ba820196bf P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.994597  9741 tablet_replica.cc:333] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b: stopping tablet replica
I20260709 12:25:46.995298  9741 raft_consensus.cc:2243] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.995908  9741 raft_consensus.cc:2272] T 50a4f3e40a324906b514df458c11bb83 P 455ef2040975481fa5a87ee178499f4b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.998807  9741 tablet_replica.cc:333] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 455ef2040975481fa5a87ee178499f4b: stopping tablet replica
I20260709 12:25:46.999415  9741 raft_consensus.cc:2243] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.000155  9741 raft_consensus.cc:2272] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.004419  9741 tablet_replica.cc:333] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b: stopping tablet replica
I20260709 12:25:47.005187  9741 raft_consensus.cc:2243] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:47.006383  9741 raft_consensus.cc:2272] T ba6fecddbd094b4cae5a0778e1a1812e P 455ef2040975481fa5a87ee178499f4b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:47.006392 22645 consensus_peers.cc:597] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca -> Peer 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625): Couldn't send request to peer 455ef2040975481fa5a87ee178499f4b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:47.009683  9741 tablet_replica.cc:333] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b: stopping tablet replica
I20260709 12:25:47.010316  9741 raft_consensus.cc:2243] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.011008  9741 raft_consensus.cc:2272] T bcbfae6456e64f039ef8a0b5765320d0 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.013949  9741 tablet_replica.cc:333] T 1e620af1328f41a38c36a9d0f7bca559 P 455ef2040975481fa5a87ee178499f4b: stopping tablet replica
I20260709 12:25:47.014552  9741 raft_consensus.cc:2243] T 1e620af1328f41a38c36a9d0f7bca559 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.015237  9741 raft_consensus.cc:2272] T 1e620af1328f41a38c36a9d0f7bca559 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.018201  9741 tablet_replica.cc:333] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b: stopping tablet replica
I20260709 12:25:47.018805  9741 raft_consensus.cc:2243] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.019449  9741 raft_consensus.cc:2272] T 9feefcd30077461493b44c5a22265514 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.022750  9741 tablet_replica.cc:333] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b: stopping tablet replica
I20260709 12:25:47.023531  9741 raft_consensus.cc:2243] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.024158  9741 raft_consensus.cc:2272] T 9a249da7da1c4e20a041b9d8798174c1 P 455ef2040975481fa5a87ee178499f4b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:47.032163 22571 consensus_peers.cc:597] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd -> Peer 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625): Couldn't send request to peer 455ef2040975481fa5a87ee178499f4b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:47.050154 22645 consensus_peers.cc:597] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca -> Peer 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625): Couldn't send request to peer 455ef2040975481fa5a87ee178499f4b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:47.056102 22571 consensus_peers.cc:597] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd -> Peer 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625): Couldn't send request to peer 455ef2040975481fa5a87ee178499f4b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:47.080648  9741 tablet_server.cc:196] TabletServer@127.9.131.65:0 shutdown complete.
W20260709 12:25:47.109150 22571 consensus_peers.cc:597] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd -> Peer 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625): Couldn't send request to peer 455ef2040975481fa5a87ee178499f4b. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:39625: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:47.139403  9741 tablet_server.cc:179] TabletServer@127.9.131.66:0 shutting down...
W20260709 12:25:47.157845 22645 consensus_peers.cc:597] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca -> Peer 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625): Couldn't send request to peer 455ef2040975481fa5a87ee178499f4b. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:39625: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:47.178918 22645 consensus_peers.cc:597] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca -> Peer 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625): Couldn't send request to peer 455ef2040975481fa5a87ee178499f4b. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:39625: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:47.195463  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:47.196560  9741 tablet_replica.cc:333] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd: stopping tablet replica
I20260709 12:25:47.197659  9741 raft_consensus.cc:2243] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:47.198908  9741 raft_consensus.cc:2272] T 577ed270d7c744b0b095890092b10643 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.202615  9741 tablet_replica.cc:333] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd: stopping tablet replica
I20260709 12:25:47.203691  9741 raft_consensus.cc:2243] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:47.205164  9741 raft_consensus.cc:2272] T c0ad4859df0b4464b7049efd51e3103b P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.208737  9741 tablet_replica.cc:333] T b5faed52a86c4a82a727ee14f9cb07ba P 53423d4abfe4475f909f37f76c3b64cd: stopping tablet replica
I20260709 12:25:47.209628  9741 raft_consensus.cc:2243] T b5faed52a86c4a82a727ee14f9cb07ba P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.210371  9741 raft_consensus.cc:2272] T b5faed52a86c4a82a727ee14f9cb07ba P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.214144  9741 tablet_replica.cc:333] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd: stopping tablet replica
I20260709 12:25:47.215077  9741 raft_consensus.cc:2243] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.215879  9741 raft_consensus.cc:2272] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:47.216569 22645 consensus_peers.cc:597] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca -> Peer 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625): Couldn't send request to peer 455ef2040975481fa5a87ee178499f4b. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:39625: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:47.219259  9741 tablet_replica.cc:333] T ba6fecddbd094b4cae5a0778e1a1812e P 53423d4abfe4475f909f37f76c3b64cd: stopping tablet replica
I20260709 12:25:47.220261  9741 raft_consensus.cc:2243] T ba6fecddbd094b4cae5a0778e1a1812e P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.220969  9741 raft_consensus.cc:2272] T ba6fecddbd094b4cae5a0778e1a1812e P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.224439  9741 tablet_replica.cc:333] T ae7288f6b45b460c943beb337f96dcef P 53423d4abfe4475f909f37f76c3b64cd: stopping tablet replica
I20260709 12:25:47.225345  9741 raft_consensus.cc:2243] T ae7288f6b45b460c943beb337f96dcef P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.226055  9741 raft_consensus.cc:2272] T ae7288f6b45b460c943beb337f96dcef P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.229465  9741 tablet_replica.cc:333] T ed2ed22d8525491cab6979ad9ddfc821 P 53423d4abfe4475f909f37f76c3b64cd: stopping tablet replica
I20260709 12:25:47.230391  9741 raft_consensus.cc:2243] T ed2ed22d8525491cab6979ad9ddfc821 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.231045  9741 raft_consensus.cc:2272] T ed2ed22d8525491cab6979ad9ddfc821 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.234763  9741 tablet_replica.cc:333] T 56382e75ff42435f8cd367e1cd7e04d6 P 53423d4abfe4475f909f37f76c3b64cd: stopping tablet replica
I20260709 12:25:47.235663  9741 raft_consensus.cc:2243] T 56382e75ff42435f8cd367e1cd7e04d6 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.236383  9741 raft_consensus.cc:2272] T 56382e75ff42435f8cd367e1cd7e04d6 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.239832  9741 tablet_replica.cc:333] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd: stopping tablet replica
I20260709 12:25:47.240703  9741 raft_consensus.cc:2243] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.241380  9741 raft_consensus.cc:2272] T 6ec5cea7cca64e8db6704a150b5952b9 P 53423d4abfe4475f909f37f76c3b64cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.244982  9741 tablet_replica.cc:333] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd: stopping tablet replica
I20260709 12:25:47.245884  9741 raft_consensus.cc:2243] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.246644  9741 raft_consensus.cc:2272] T b6a5a612a23b46318cd2f55db7e11764 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.250159  9741 tablet_replica.cc:333] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd: stopping tablet replica
I20260709 12:25:47.251026  9741 raft_consensus.cc:2243] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.251736  9741 raft_consensus.cc:2272] T 12c9fec992dd480c8c81149e589ce6ae P 53423d4abfe4475f909f37f76c3b64cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.255012  9741 tablet_replica.cc:333] T 295498b76d5d4aadbc7d123c6a2043d4 P 53423d4abfe4475f909f37f76c3b64cd: stopping tablet replica
I20260709 12:25:47.256027  9741 raft_consensus.cc:2243] T 295498b76d5d4aadbc7d123c6a2043d4 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.256835  9741 raft_consensus.cc:2272] T 295498b76d5d4aadbc7d123c6a2043d4 P 53423d4abfe4475f909f37f76c3b64cd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:47.258797 22571 consensus_peers.cc:597] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd -> Peer 455ef2040975481fa5a87ee178499f4b (127.9.131.65:39625): Couldn't send request to peer 455ef2040975481fa5a87ee178499f4b. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:39625: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:47.260267  9741 tablet_replica.cc:333] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd: stopping tablet replica
I20260709 12:25:47.261166  9741 raft_consensus.cc:2243] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:47.262434  9741 raft_consensus.cc:2272] T 1e620af1328f41a38c36a9d0f7bca559 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.265893  9741 tablet_replica.cc:333] T 9feefcd30077461493b44c5a22265514 P 53423d4abfe4475f909f37f76c3b64cd: stopping tablet replica
I20260709 12:25:47.266741  9741 raft_consensus.cc:2243] T 9feefcd30077461493b44c5a22265514 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.267496  9741 raft_consensus.cc:2272] T 9feefcd30077461493b44c5a22265514 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.270841  9741 tablet_replica.cc:333] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd: stopping tablet replica
I20260709 12:25:47.271839  9741 raft_consensus.cc:2243] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:47.273072  9741 raft_consensus.cc:2272] T 9a249da7da1c4e20a041b9d8798174c1 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.276197  9741 tablet_replica.cc:333] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd: stopping tablet replica
I20260709 12:25:47.276949  9741 raft_consensus.cc:2243] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:47.278074  9741 raft_consensus.cc:2272] T bcbfae6456e64f039ef8a0b5765320d0 P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.281250  9741 tablet_replica.cc:333] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd: stopping tablet replica
I20260709 12:25:47.281950  9741 raft_consensus.cc:2243] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:47.283150  9741 raft_consensus.cc:2272] T 997b0886b64a44678821c2ba820196bf P 53423d4abfe4475f909f37f76c3b64cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.286741  9741 tablet_replica.cc:333] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd: stopping tablet replica
I20260709 12:25:47.287500  9741 raft_consensus.cc:2243] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:47.288380  9741 pending_rounds.cc:70] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd: Trying to abort 1 pending ops.
I20260709 12:25:47.288659  9741 pending_rounds.cc:77] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305625382690111488 op_type: NO_OP noop_request { }
I20260709 12:25:47.289111  9741 raft_consensus.cc:2889] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:47.289487  9741 raft_consensus.cc:2272] T 50a4f3e40a324906b514df458c11bb83 P 53423d4abfe4475f909f37f76c3b64cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.366462  9741 tablet_server.cc:196] TabletServer@127.9.131.66:0 shutdown complete.
W20260709 12:25:47.371557 22642 consensus_peers.cc:597] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca -> Peer 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073): Couldn't send request to peer 53423d4abfe4475f909f37f76c3b64cd. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:35073: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:47.394831 22642 consensus_peers.cc:597] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca -> Peer 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073): Couldn't send request to peer 53423d4abfe4475f909f37f76c3b64cd. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:35073: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:47.427567  9741 tablet_server.cc:179] TabletServer@127.9.131.67:0 shutting down...
W20260709 12:25:47.447173 22642 consensus_peers.cc:597] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca -> Peer 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073): Couldn't send request to peer 53423d4abfe4475f909f37f76c3b64cd. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:35073: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:47.463764  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:47.464771  9741 tablet_replica.cc:333] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca: stopping tablet replica
I20260709 12:25:47.465803  9741 raft_consensus.cc:2243] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.466629  9741 raft_consensus.cc:2272] T 577ed270d7c744b0b095890092b10643 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:47.467325 22642 consensus_peers.cc:597] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca -> Peer 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073): Couldn't send request to peer 53423d4abfe4475f909f37f76c3b64cd. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:35073: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:47.469534  9741 tablet_replica.cc:333] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca: stopping tablet replica
I20260709 12:25:47.470322  9741 raft_consensus.cc:2243] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.470996  9741 raft_consensus.cc:2272] T c0ad4859df0b4464b7049efd51e3103b P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.474802  9741 tablet_replica.cc:333] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca: stopping tablet replica
I20260709 12:25:47.475936  9741 raft_consensus.cc:2243] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.476893  9741 raft_consensus.cc:2272] T ae7288f6b45b460c943beb337f96dcef P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:47.478365 22642 consensus_peers.cc:597] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca -> Peer 53423d4abfe4475f909f37f76c3b64cd (127.9.131.66:35073): Couldn't send request to peer 53423d4abfe4475f909f37f76c3b64cd. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:35073: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:47.480573  9741 tablet_replica.cc:333] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca: stopping tablet replica
I20260709 12:25:47.482558  9741 raft_consensus.cc:2243] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.483299  9741 raft_consensus.cc:2272] T b5faed52a86c4a82a727ee14f9cb07ba P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.486572  9741 tablet_replica.cc:333] T 295498b76d5d4aadbc7d123c6a2043d4 P 14aa1a831920414a9002c10e716019ca: stopping tablet replica
I20260709 12:25:47.487452  9741 raft_consensus.cc:2243] T 295498b76d5d4aadbc7d123c6a2043d4 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.488138  9741 raft_consensus.cc:2272] T 295498b76d5d4aadbc7d123c6a2043d4 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.491616  9741 tablet_replica.cc:333] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca: stopping tablet replica
I20260709 12:25:47.492560  9741 raft_consensus.cc:2243] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:47.493691  9741 raft_consensus.cc:2272] T ed2ed22d8525491cab6979ad9ddfc821 P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.496083  9741 tablet_replica.cc:333] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca: stopping tablet replica
I20260709 12:25:47.496781  9741 raft_consensus.cc:2243] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.497354  9741 raft_consensus.cc:2272] T 56382e75ff42435f8cd367e1cd7e04d6 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.499898  9741 tablet_replica.cc:333] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca: stopping tablet replica
I20260709 12:25:47.500663  9741 raft_consensus.cc:2243] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.501230  9741 raft_consensus.cc:2272] T 997b0886b64a44678821c2ba820196bf P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.503829  9741 tablet_replica.cc:333] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca: stopping tablet replica
I20260709 12:25:47.504532  9741 raft_consensus.cc:2243] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.505013  9741 raft_consensus.cc:2272] T 50a4f3e40a324906b514df458c11bb83 P 14aa1a831920414a9002c10e716019ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.507277  9741 tablet_replica.cc:333] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca: stopping tablet replica
I20260709 12:25:47.507931  9741 raft_consensus.cc:2243] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:47.508816  9741 raft_consensus.cc:2272] T 6ec5cea7cca64e8db6704a150b5952b9 P 14aa1a831920414a9002c10e716019ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.511319  9741 tablet_replica.cc:333] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca: stopping tablet replica
I20260709 12:25:47.511934  9741 raft_consensus.cc:2243] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.512492  9741 raft_consensus.cc:2272] T b6a5a612a23b46318cd2f55db7e11764 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.514911  9741 tablet_replica.cc:333] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca: stopping tablet replica
I20260709 12:25:47.515496  9741 raft_consensus.cc:2243] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:47.516412  9741 raft_consensus.cc:2272] T 12c9fec992dd480c8c81149e589ce6ae P 14aa1a831920414a9002c10e716019ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.518920  9741 tablet_replica.cc:333] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca: stopping tablet replica
I20260709 12:25:47.519472  9741 raft_consensus.cc:2243] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.520061  9741 raft_consensus.cc:2272] T 1e620af1328f41a38c36a9d0f7bca559 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.522347  9741 tablet_replica.cc:333] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca: stopping tablet replica
I20260709 12:25:47.522912  9741 raft_consensus.cc:2243] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:47.523787  9741 raft_consensus.cc:2272] T 9feefcd30077461493b44c5a22265514 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.526331  9741 tablet_replica.cc:333] T 9a249da7da1c4e20a041b9d8798174c1 P 14aa1a831920414a9002c10e716019ca: stopping tablet replica
I20260709 12:25:47.526887  9741 raft_consensus.cc:2243] T 9a249da7da1c4e20a041b9d8798174c1 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.527422  9741 raft_consensus.cc:2272] T 9a249da7da1c4e20a041b9d8798174c1 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.530067  9741 tablet_replica.cc:333] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca: stopping tablet replica
I20260709 12:25:47.530684  9741 raft_consensus.cc:2243] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:47.531632  9741 raft_consensus.cc:2272] T 566b8f12f7b14c3da9614e5e86b2c7a5 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.534076  9741 tablet_replica.cc:333] T ba6fecddbd094b4cae5a0778e1a1812e P 14aa1a831920414a9002c10e716019ca: stopping tablet replica
I20260709 12:25:47.534570  9741 raft_consensus.cc:2243] T ba6fecddbd094b4cae5a0778e1a1812e P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.535135  9741 raft_consensus.cc:2272] T ba6fecddbd094b4cae5a0778e1a1812e P 14aa1a831920414a9002c10e716019ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.537464  9741 tablet_replica.cc:333] T bcbfae6456e64f039ef8a0b5765320d0 P 14aa1a831920414a9002c10e716019ca: stopping tablet replica
I20260709 12:25:47.537953  9741 raft_consensus.cc:2243] T bcbfae6456e64f039ef8a0b5765320d0 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.538448  9741 raft_consensus.cc:2272] T bcbfae6456e64f039ef8a0b5765320d0 P 14aa1a831920414a9002c10e716019ca [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:48.580360  9741 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 22700)
I20260709 12:25:48.770979  9741 tablet_server.cc:196] TabletServer@127.9.131.67:0 shutdown complete.
I20260709 12:25:48.805896  9741 master.cc:562] Master@127.9.131.126:33059 shutting down...
I20260709 12:25:48.828485  9741 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:48.829077  9741 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:48.829397  9741 tablet_replica.cc:333] T 00000000000000000000000000000000 P c982cc0a652949d6aab048e920d851a3: stopping tablet replica
I20260709 12:25:48.849795  9741 master.cc:584] Master@127.9.131.126:33059 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (23608 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:25:48.900748  9741 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.131.126:36999
I20260709 12:25:48.901906  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:48.907635 23035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:48.907652 23036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:48.908557 23038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:48.908941  9741 server_base.cc:1061] running on GCE node
I20260709 12:25:48.909979  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:48.910184  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:48.910347  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599948910328 us; error 0 us; skew 500 ppm
I20260709 12:25:48.910853  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:48.913484  9741 webserver.cc:533] Webserver started at http://127.9.131.126:35835/ using document root <none> and password file <none>
I20260709 12:25:48.913956  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:48.914151  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:48.914418  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:48.915628  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599527842218-9741-0/minicluster-data/master-0-root/instance:
uuid: "734775a1bdcb4ca7ba926ea30fa9ee17"
format_stamp: "Formatted at 2026-07-09 12:25:48 on dist-test-slave-r7s7"
I20260709 12:25:48.920961  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:25:48.924876 23043 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:48.925658  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.004s
I20260709 12:25:48.925976  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599527842218-9741-0/minicluster-data/master-0-root
uuid: "734775a1bdcb4ca7ba926ea30fa9ee17"
format_stamp: "Formatted at 2026-07-09 12:25:48 on dist-test-slave-r7s7"
I20260709 12:25:48.926249  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599527842218-9741-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599527842218-9741-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599527842218-9741-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:48.942732  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:48.944022  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:48.983306  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.126:36999
I20260709 12:25:48.983467 23094 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.126:36999 every 8 connection(s)
I20260709 12:25:48.987219 23095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:48.999959 23095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17: Bootstrap starting.
I20260709 12:25:49.005251 23095 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.009624 23095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17: No bootstrap required, opened a new log
I20260709 12:25:49.011930 23095 raft_consensus.cc:359] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "734775a1bdcb4ca7ba926ea30fa9ee17" member_type: VOTER }
I20260709 12:25:49.012311 23095 raft_consensus.cc:385] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.012501 23095 raft_consensus.cc:740] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 734775a1bdcb4ca7ba926ea30fa9ee17, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.013067 23095 consensus_queue.cc:260] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "734775a1bdcb4ca7ba926ea30fa9ee17" member_type: VOTER }
I20260709 12:25:49.013530 23095 raft_consensus.cc:399] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:49.013726 23095 raft_consensus.cc:493] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:49.013936 23095 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.018965 23095 raft_consensus.cc:515] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "734775a1bdcb4ca7ba926ea30fa9ee17" member_type: VOTER }
I20260709 12:25:49.019460 23095 leader_election.cc:304] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 734775a1bdcb4ca7ba926ea30fa9ee17; no voters: 
I20260709 12:25:49.020537 23095 leader_election.cc:290] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:49.020938 23098 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:49.022236 23098 raft_consensus.cc:697] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17 [term 1 LEADER]: Becoming Leader. State: Replica: 734775a1bdcb4ca7ba926ea30fa9ee17, State: Running, Role: LEADER
I20260709 12:25:49.022927 23098 consensus_queue.cc:237] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "734775a1bdcb4ca7ba926ea30fa9ee17" member_type: VOTER }
I20260709 12:25:49.023389 23095 sys_catalog.cc:565] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:49.027134 23099 sys_catalog.cc:455] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "734775a1bdcb4ca7ba926ea30fa9ee17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "734775a1bdcb4ca7ba926ea30fa9ee17" member_type: VOTER } }
I20260709 12:25:49.027631 23100 sys_catalog.cc:455] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 734775a1bdcb4ca7ba926ea30fa9ee17. Latest consensus state: current_term: 1 leader_uuid: "734775a1bdcb4ca7ba926ea30fa9ee17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "734775a1bdcb4ca7ba926ea30fa9ee17" member_type: VOTER } }
I20260709 12:25:49.027971 23099 sys_catalog.cc:458] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:49.028332 23100 sys_catalog.cc:458] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:49.032855 23105 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:49.038458 23105 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:49.040576  9741 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:49.047887 23105 catalog_manager.cc:1383] Generated new cluster ID: 4cec664feee04a88b35b06fc125c1069
I20260709 12:25:49.048215 23105 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:49.080502 23105 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:49.081861 23105 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:49.097517 23105 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17: Generated new TSK 0
I20260709 12:25:49.098145 23105 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:49.106961  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:49.113063 23116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:49.113838 23117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:49.115191 23119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:49.115929  9741 server_base.cc:1061] running on GCE node
I20260709 12:25:49.116858  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:49.117041  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:49.117159  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599949117149 us; error 0 us; skew 500 ppm
I20260709 12:25:49.117635  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:49.119966  9741 webserver.cc:533] Webserver started at http://127.9.131.65:38979/ using document root <none> and password file <none>
I20260709 12:25:49.120393  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:49.120539  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:49.120743  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:49.121778  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599527842218-9741-0/minicluster-data/ts-0-root/instance:
uuid: "d08efaa729434ed4a7a396b571f4c597"
format_stamp: "Formatted at 2026-07-09 12:25:49 on dist-test-slave-r7s7"
I20260709 12:25:49.126300  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:25:49.129983 23124 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:49.130812  9741 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:25:49.131099  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599527842218-9741-0/minicluster-data/ts-0-root
uuid: "d08efaa729434ed4a7a396b571f4c597"
format_stamp: "Formatted at 2026-07-09 12:25:49 on dist-test-slave-r7s7"
I20260709 12:25:49.131392  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599527842218-9741-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599527842218-9741-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599527842218-9741-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:49.144538  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:49.145738  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:49.147226  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:49.149746  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:49.150007  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:49.150242  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:49.150416  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:49.192994  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.65:43095
I20260709 12:25:49.193102 23186 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.65:43095 every 8 connection(s)
I20260709 12:25:49.199060  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:49.205866 23191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:49.206986 23192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:49.210563 23194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:49.210614  9741 server_base.cc:1061] running on GCE node
I20260709 12:25:49.212033  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:49.212242  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:49.212393  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599949212378 us; error 0 us; skew 500 ppm
I20260709 12:25:49.212888  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:49.215250  9741 webserver.cc:533] Webserver started at http://127.9.131.66:34997/ using document root <none> and password file <none>
I20260709 12:25:49.215764  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:49.215994  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:49.216256  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:49.217456  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599527842218-9741-0/minicluster-data/ts-1-root/instance:
uuid: "f89574c003f34931a776f1213874a675"
format_stamp: "Formatted at 2026-07-09 12:25:49 on dist-test-slave-r7s7"
I20260709 12:25:49.219491 23187 heartbeater.cc:344] Connected to a master server at 127.9.131.126:36999
I20260709 12:25:49.219965 23187 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:49.220698 23187 heartbeater.cc:507] Master 127.9.131.126:36999 requested a full tablet report, sending...
I20260709 12:25:49.222842  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:49.222863 23060 ts_manager.cc:194] Registered new tserver with Master: d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095)
I20260709 12:25:49.224931 23060 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60554
I20260709 12:25:49.226856 23199 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:49.227973  9741 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:25:49.228384  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599527842218-9741-0/minicluster-data/ts-1-root
uuid: "f89574c003f34931a776f1213874a675"
format_stamp: "Formatted at 2026-07-09 12:25:49 on dist-test-slave-r7s7"
I20260709 12:25:49.228703  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599527842218-9741-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599527842218-9741-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599527842218-9741-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:49.249254  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:49.250454  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:49.251952  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:49.254246  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:49.254441  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:49.254686  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:49.254828  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:49.294823  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.66:39573
I20260709 12:25:49.294953 23261 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.66:39573 every 8 connection(s)
I20260709 12:25:49.299793  9741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:49.306638 23265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:49.308439 23266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:49.311282 23268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:49.312037  9741 server_base.cc:1061] running on GCE node
I20260709 12:25:49.312184 23262 heartbeater.cc:344] Connected to a master server at 127.9.131.126:36999
I20260709 12:25:49.312700 23262 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:49.312986  9741 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:49.313244  9741 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:49.313410  9741 hybrid_clock.cc:648] HybridClock initialized: now 1783599949313395 us; error 0 us; skew 500 ppm
I20260709 12:25:49.313460 23262 heartbeater.cc:507] Master 127.9.131.126:36999 requested a full tablet report, sending...
I20260709 12:25:49.314016  9741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:49.315753 23060 ts_manager.cc:194] Registered new tserver with Master: f89574c003f34931a776f1213874a675 (127.9.131.66:39573)
I20260709 12:25:49.316874  9741 webserver.cc:533] Webserver started at http://127.9.131.67:36747/ using document root <none> and password file <none>
I20260709 12:25:49.317557  9741 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:49.317621 23060 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60558
I20260709 12:25:49.317807  9741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:49.318197  9741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:49.319553  9741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599527842218-9741-0/minicluster-data/ts-2-root/instance:
uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
format_stamp: "Formatted at 2026-07-09 12:25:49 on dist-test-slave-r7s7"
I20260709 12:25:49.324143  9741 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:25:49.327822 23273 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:49.328728  9741 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:25:49.329007  9741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599527842218-9741-0/minicluster-data/ts-2-root
uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
format_stamp: "Formatted at 2026-07-09 12:25:49 on dist-test-slave-r7s7"
I20260709 12:25:49.329262  9741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599527842218-9741-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599527842218-9741-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPZQtm1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599527842218-9741-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:49.354406  9741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:49.355618  9741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:49.357156  9741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:49.359421  9741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:49.359609  9741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:49.359880  9741 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:49.360033  9741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:25:49.401827  9741 rpc_server.cc:307] RPC server started. Bound to: 127.9.131.67:33057
I20260709 12:25:49.401933 23335 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.131.67:33057 every 8 connection(s)
I20260709 12:25:49.415587 23336 heartbeater.cc:344] Connected to a master server at 127.9.131.126:36999
I20260709 12:25:49.416108 23336 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:49.416848 23336 heartbeater.cc:507] Master 127.9.131.126:36999 requested a full tablet report, sending...
I20260709 12:25:49.419097 23060 ts_manager.cc:194] Registered new tserver with Master: 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:49.419740  9741 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014869347s
I20260709 12:25:49.420559 23060 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60574
I20260709 12:25:49.445829 23060 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60578:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:49.448633 23060 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:49.516443 23301 tablet_service.cc:1511] Processing CreateTablet for tablet f169737ec5ce479d8965c1a1aacbc999 (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:49.516611 23300 tablet_service.cc:1511] Processing CreateTablet for tablet ad581a43dcff4560afed00e7a0d3897f (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:49.518157 23301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f169737ec5ce479d8965c1a1aacbc999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.518805 23300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad581a43dcff4560afed00e7a0d3897f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.542256 23299 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc33df488b3440f9bb491ec0af24c37 (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:49.543787 23299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc33df488b3440f9bb491ec0af24c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.549062 23227 tablet_service.cc:1511] Processing CreateTablet for tablet f169737ec5ce479d8965c1a1aacbc999 (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:49.550561 23227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f169737ec5ce479d8965c1a1aacbc999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.553063 23226 tablet_service.cc:1511] Processing CreateTablet for tablet ad581a43dcff4560afed00e7a0d3897f (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:49.554519 23226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad581a43dcff4560afed00e7a0d3897f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.555212 23224 tablet_service.cc:1511] Processing CreateTablet for tablet 533a483e22a54a949dd7813032a5258b (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:49.556663 23224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 533a483e22a54a949dd7813032a5258b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.557029 23225 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc33df488b3440f9bb491ec0af24c37 (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:49.558374 23225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc33df488b3440f9bb491ec0af24c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.560959 23223 tablet_service.cc:1511] Processing CreateTablet for tablet fc408da3258243a69dec87746d508e0b (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:49.562449 23223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc408da3258243a69dec87746d508e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.566228 23298 tablet_service.cc:1511] Processing CreateTablet for tablet 533a483e22a54a949dd7813032a5258b (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:49.568166 23298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 533a483e22a54a949dd7813032a5258b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.580297 23152 tablet_service.cc:1511] Processing CreateTablet for tablet f169737ec5ce479d8965c1a1aacbc999 (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:49.581813 23152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f169737ec5ce479d8965c1a1aacbc999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.583269 23151 tablet_service.cc:1511] Processing CreateTablet for tablet ad581a43dcff4560afed00e7a0d3897f (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:49.585695 23150 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc33df488b3440f9bb491ec0af24c37 (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:49.587745 23222 tablet_service.cc:1511] Processing CreateTablet for tablet 87c1f73ef3a347d9b95becab3beaa1ee (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:49.588043 23149 tablet_service.cc:1511] Processing CreateTablet for tablet 533a483e22a54a949dd7813032a5258b (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:49.589439 23222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87c1f73ef3a347d9b95becab3beaa1ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.590296 23148 tablet_service.cc:1511] Processing CreateTablet for tablet fc408da3258243a69dec87746d508e0b (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:49.600291 23149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 533a483e22a54a949dd7813032a5258b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.603749 23148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc408da3258243a69dec87746d508e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.608353 23150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc33df488b3440f9bb491ec0af24c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.609642 23151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad581a43dcff4560afed00e7a0d3897f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.610348 23351 tablet_bootstrap.cc:492] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Bootstrap starting.
I20260709 12:25:49.612157 23301 tablet_service.cc:1511] Processing CreateTablet for tablet 87c1f73ef3a347d9b95becab3beaa1ee (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:49.613612 23301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87c1f73ef3a347d9b95becab3beaa1ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.613993 23227 tablet_service.cc:1511] Processing CreateTablet for tablet fe0d8886980a40428832e06881de2a28 (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:49.615302 23227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0d8886980a40428832e06881de2a28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.612690 23146 tablet_service.cc:1511] Processing CreateTablet for tablet fe0d8886980a40428832e06881de2a28 (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:49.617115 23146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0d8886980a40428832e06881de2a28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.593154 23352 tablet_bootstrap.cc:492] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675: Bootstrap starting.
I20260709 12:25:49.592818 23147 tablet_service.cc:1511] Processing CreateTablet for tablet 87c1f73ef3a347d9b95becab3beaa1ee (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:49.631433 23147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87c1f73ef3a347d9b95becab3beaa1ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.594270 23297 tablet_service.cc:1511] Processing CreateTablet for tablet fc408da3258243a69dec87746d508e0b (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:49.635504 23297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc408da3258243a69dec87746d508e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.635070 23145 tablet_service.cc:1511] Processing CreateTablet for tablet 5ffc3ac9d2274edb9db5701cafc9f598 (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:49.636710 23145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ffc3ac9d2274edb9db5701cafc9f598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.638214 23352 tablet_bootstrap.cc:654] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.635823 23300 tablet_service.cc:1511] Processing CreateTablet for tablet fe0d8886980a40428832e06881de2a28 (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:49.629257 23351 tablet_bootstrap.cc:654] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.640364 23300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0d8886980a40428832e06881de2a28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.642721 23226 tablet_service.cc:1511] Processing CreateTablet for tablet 5ffc3ac9d2274edb9db5701cafc9f598 (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:49.647543 23226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ffc3ac9d2274edb9db5701cafc9f598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.653335 23301 tablet_service.cc:1511] Processing CreateTablet for tablet 5ffc3ac9d2274edb9db5701cafc9f598 (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:49.654946 23301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ffc3ac9d2274edb9db5701cafc9f598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.656991 23223 tablet_service.cc:1511] Processing CreateTablet for tablet 68466758e88a4c1db2d233627c8bb383 (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:49.657687 23296 tablet_service.cc:1511] Processing CreateTablet for tablet 68466758e88a4c1db2d233627c8bb383 (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:49.658429 23223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68466758e88a4c1db2d233627c8bb383. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.658991 23296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68466758e88a4c1db2d233627c8bb383. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.654819 23144 tablet_service.cc:1511] Processing CreateTablet for tablet 68466758e88a4c1db2d233627c8bb383 (DEFAULT_TABLE table=test-workload [id=78cc67d635a6446ca0a7717baf8c2fb4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:49.665230 23144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68466758e88a4c1db2d233627c8bb383. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.681463 23351 tablet_bootstrap.cc:492] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee: No bootstrap required, opened a new log
I20260709 12:25:49.684684 23351 ts_tablet_manager.cc:1403] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent bootstrapping tablet: real 0.075s	user 0.005s	sys 0.008s
I20260709 12:25:49.701164 23352 tablet_bootstrap.cc:492] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675: No bootstrap required, opened a new log
I20260709 12:25:49.701889 23352 ts_tablet_manager.cc:1403] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675: Time spent bootstrapping tablet: real 0.109s	user 0.011s	sys 0.005s
I20260709 12:25:49.687783 23351 raft_consensus.cc:359] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:49.719242 23351 raft_consensus.cc:385] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.721131 23351 raft_consensus.cc:740] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.722198 23351 consensus_queue.cc:260] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:49.710702 23352 raft_consensus.cc:359] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } } peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } }
I20260709 12:25:49.731518 23352 raft_consensus.cc:385] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.733783 23352 raft_consensus.cc:740] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.734797 23352 consensus_queue.cc:260] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } } peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } }
I20260709 12:25:49.750250 23355 tablet_bootstrap.cc:492] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597: Bootstrap starting.
I20260709 12:25:49.756507 23336 heartbeater.cc:499] Master 127.9.131.126:36999 was elected leader, sending a full tablet report...
I20260709 12:25:49.759915 23351 ts_tablet_manager.cc:1434] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent starting tablet: real 0.075s	user 0.012s	sys 0.022s
I20260709 12:25:49.761138 23351 tablet_bootstrap.cc:492] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Bootstrap starting.
I20260709 12:25:49.765650 23262 heartbeater.cc:499] Master 127.9.131.126:36999 was elected leader, sending a full tablet report...
I20260709 12:25:49.767313 23351 tablet_bootstrap.cc:654] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.769222 23352 ts_tablet_manager.cc:1434] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.016s
I20260709 12:25:49.770381 23355 tablet_bootstrap.cc:654] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.770447 23352 tablet_bootstrap.cc:492] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675: Bootstrap starting.
I20260709 12:25:49.773710 23351 tablet_bootstrap.cc:492] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee: No bootstrap required, opened a new log
I20260709 12:25:49.774410 23351 ts_tablet_manager.cc:1403] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.005s
W20260709 12:25:49.796798 23047 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.9.131.67:33057, user_credentials={real_user=slave}} blocked reactor thread for 43489.7us
W20260709 12:25:49.811025 23263 tablet.cc:2406] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:25:49.816987 23358 raft_consensus.cc:493] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.814502 23351 raft_consensus.cc:359] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } } peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } }
I20260709 12:25:49.818598 23358 raft_consensus.cc:515] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } } peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } }
I20260709 12:25:49.819700 23351 raft_consensus.cc:385] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.820362 23351 raft_consensus.cc:740] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.822412 23351 consensus_queue.cc:260] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } } peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } }
I20260709 12:25:49.810978 23355 tablet_bootstrap.cc:492] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597: No bootstrap required, opened a new log
I20260709 12:25:49.827605 23351 ts_tablet_manager.cc:1434] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent starting tablet: real 0.053s	user 0.003s	sys 0.010s
I20260709 12:25:49.829489 23355 ts_tablet_manager.cc:1403] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597: Time spent bootstrapping tablet: real 0.080s	user 0.011s	sys 0.006s
I20260709 12:25:49.832989 23351 tablet_bootstrap.cc:492] T ad581a43dcff4560afed00e7a0d3897f P 1d6cace6e70d433b9c0eb3d0d514e3ee: Bootstrap starting.
I20260709 12:25:49.835006 23355 raft_consensus.cc:359] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:49.836707 23355 raft_consensus.cc:385] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.836587 23358 leader_election.cc:290] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057), d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095)
I20260709 12:25:49.837886 23355 raft_consensus.cc:740] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.839468 23355 consensus_queue.cc:260] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:49.842718 23357 raft_consensus.cc:493] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.843595 23357 raft_consensus.cc:515] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } } peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } }
I20260709 12:25:49.845451 23352 tablet_bootstrap.cc:654] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.847846 23351 tablet_bootstrap.cc:654] T ad581a43dcff4560afed00e7a0d3897f P 1d6cace6e70d433b9c0eb3d0d514e3ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.853020 23357 leader_election.cc:290] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), f89574c003f34931a776f1213874a675 (127.9.131.66:39573)
I20260709 12:25:49.876255 23355 ts_tablet_manager.cc:1434] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597: Time spent starting tablet: real 0.046s	user 0.018s	sys 0.005s
I20260709 12:25:49.877182 23311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f169737ec5ce479d8965c1a1aacbc999" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" is_pre_election: true
I20260709 12:25:49.878015 23187 heartbeater.cc:499] Master 127.9.131.126:36999 was elected leader, sending a full tablet report...
I20260709 12:25:49.878384 23311 raft_consensus.cc:2468] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 0.
I20260709 12:25:49.882040 23203 leader_election.cc:304] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:49.883199 23358 raft_consensus.cc:2804] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:49.883687 23358 raft_consensus.cc:493] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.884100 23358 raft_consensus.cc:3060] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.885095 23355 tablet_bootstrap.cc:492] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597: Bootstrap starting.
I20260709 12:25:49.885141 23352 tablet_bootstrap.cc:492] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675: No bootstrap required, opened a new log
I20260709 12:25:49.891287 23352 ts_tablet_manager.cc:1403] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675: Time spent bootstrapping tablet: real 0.121s	user 0.015s	sys 0.010s
I20260709 12:25:49.895331 23352 raft_consensus.cc:359] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:49.896857 23358 raft_consensus.cc:515] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } } peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } }
I20260709 12:25:49.899924 23358 leader_election.cc:290] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 election: Requested vote from peers 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057), d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095)
I20260709 12:25:49.900287 23311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f169737ec5ce479d8965c1a1aacbc999" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:49.900985 23311 raft_consensus.cc:3060] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.908818 23355 tablet_bootstrap.cc:654] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.909237 23237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f169737ec5ce479d8965c1a1aacbc999" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675" is_pre_election: true
I20260709 12:25:49.910647 23237 raft_consensus.cc:2393] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in current term 1: Already voted for candidate f89574c003f34931a776f1213874a675 in this term.
I20260709 12:25:49.910806 23162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f169737ec5ce479d8965c1a1aacbc999" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597" is_pre_election: true
W20260709 12:25:49.912554 23276 leader_election.cc:343] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:49.913455 23275 leader_election.cc:304] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee; no voters: d08efaa729434ed4a7a396b571f4c597, f89574c003f34931a776f1213874a675
I20260709 12:25:49.920284 23351 tablet_bootstrap.cc:492] T ad581a43dcff4560afed00e7a0d3897f P 1d6cace6e70d433b9c0eb3d0d514e3ee: No bootstrap required, opened a new log
I20260709 12:25:49.921062 23351 ts_tablet_manager.cc:1403] T ad581a43dcff4560afed00e7a0d3897f P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent bootstrapping tablet: real 0.089s	user 0.019s	sys 0.012s
I20260709 12:25:49.921514 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f169737ec5ce479d8965c1a1aacbc999" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
W20260709 12:25:49.923424 23202 leader_election.cc:343] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:49.920997 23162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f169737ec5ce479d8965c1a1aacbc999" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597" is_pre_election: true
I20260709 12:25:49.925212 23351 raft_consensus.cc:359] T ad581a43dcff4560afed00e7a0d3897f P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:49.896358 23352 raft_consensus.cc:385] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:25:49.926005 23202 leader_election.cc:343] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:49.926218 23351 raft_consensus.cc:385] T ad581a43dcff4560afed00e7a0d3897f P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.931784 23355 tablet_bootstrap.cc:492] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597: No bootstrap required, opened a new log
I20260709 12:25:49.932087 23351 raft_consensus.cc:740] T ad581a43dcff4560afed00e7a0d3897f P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.932278 23311 raft_consensus.cc:2468] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 1.
I20260709 12:25:49.932504 23355 ts_tablet_manager.cc:1403] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.004s
I20260709 12:25:49.932276 23352 raft_consensus.cc:740] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.933135 23357 raft_consensus.cc:2749] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:49.933486 23351 consensus_queue.cc:260] T ad581a43dcff4560afed00e7a0d3897f P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:49.934540 23352 consensus_queue.cc:260] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:49.937398 23363 raft_consensus.cc:493] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.938143 23363 raft_consensus.cc:515] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:49.944398 23355 raft_consensus.cc:359] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:49.945272 23355 raft_consensus.cc:385] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.945577 23355 raft_consensus.cc:740] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.946553 23355 consensus_queue.cc:260] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:49.951223 23351 ts_tablet_manager.cc:1434] T ad581a43dcff4560afed00e7a0d3897f P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.016s
I20260709 12:25:49.952833 23351 tablet_bootstrap.cc:492] T 87c1f73ef3a347d9b95becab3beaa1ee P 1d6cace6e70d433b9c0eb3d0d514e3ee: Bootstrap starting.
I20260709 12:25:49.955057 23355 ts_tablet_manager.cc:1434] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.001s
I20260709 12:25:49.958200 23363 leader_election.cc:290] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f89574c003f34931a776f1213874a675 (127.9.131.66:39573), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:49.960453 23351 tablet_bootstrap.cc:654] T 87c1f73ef3a347d9b95becab3beaa1ee P 1d6cace6e70d433b9c0eb3d0d514e3ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.960541 23203 leader_election.cc:304] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675; no voters: d08efaa729434ed4a7a396b571f4c597
I20260709 12:25:49.962044 23358 raft_consensus.cc:2804] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:49.965070 23355 tablet_bootstrap.cc:492] T fe0d8886980a40428832e06881de2a28 P d08efaa729434ed4a7a396b571f4c597: Bootstrap starting.
I20260709 12:25:49.969465 23352 ts_tablet_manager.cc:1434] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675: Time spent starting tablet: real 0.078s	user 0.004s	sys 0.004s
I20260709 12:25:49.974233 23355 tablet_bootstrap.cc:654] T fe0d8886980a40428832e06881de2a28 P d08efaa729434ed4a7a396b571f4c597: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.980262 23358 raft_consensus.cc:697] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Becoming Leader. State: Replica: f89574c003f34931a776f1213874a675, State: Running, Role: LEADER
I20260709 12:25:49.981937 23352 tablet_bootstrap.cc:492] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675: Bootstrap starting.
I20260709 12:25:49.982117 23358 consensus_queue.cc:237] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } } peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } }
I20260709 12:25:49.987321 23355 tablet_bootstrap.cc:492] T fe0d8886980a40428832e06881de2a28 P d08efaa729434ed4a7a396b571f4c597: No bootstrap required, opened a new log
I20260709 12:25:49.988014 23355 ts_tablet_manager.cc:1403] T fe0d8886980a40428832e06881de2a28 P d08efaa729434ed4a7a396b571f4c597: Time spent bootstrapping tablet: real 0.023s	user 0.021s	sys 0.000s
I20260709 12:25:49.992998 23355 raft_consensus.cc:359] T fe0d8886980a40428832e06881de2a28 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:49.994442 23355 raft_consensus.cc:385] T fe0d8886980a40428832e06881de2a28 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.994771 23355 raft_consensus.cc:740] T fe0d8886980a40428832e06881de2a28 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.995795 23355 consensus_queue.cc:260] T fe0d8886980a40428832e06881de2a28 P d08efaa729434ed4a7a396b571f4c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.000660 23355 ts_tablet_manager.cc:1434] T fe0d8886980a40428832e06881de2a28 P d08efaa729434ed4a7a396b571f4c597: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:25:50.002502 23355 tablet_bootstrap.cc:492] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597: Bootstrap starting.
I20260709 12:25:50.004570 23351 tablet_bootstrap.cc:492] T 87c1f73ef3a347d9b95becab3beaa1ee P 1d6cace6e70d433b9c0eb3d0d514e3ee: No bootstrap required, opened a new log
I20260709 12:25:50.005230 23351 ts_tablet_manager.cc:1403] T 87c1f73ef3a347d9b95becab3beaa1ee P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent bootstrapping tablet: real 0.053s	user 0.022s	sys 0.028s
I20260709 12:25:50.008664 23351 raft_consensus.cc:359] T 87c1f73ef3a347d9b95becab3beaa1ee P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.009516 23351 raft_consensus.cc:385] T 87c1f73ef3a347d9b95becab3beaa1ee P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.009598 23237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87c1f73ef3a347d9b95becab3beaa1ee" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675" is_pre_election: true
I20260709 12:25:50.009876 23351 raft_consensus.cc:740] T 87c1f73ef3a347d9b95becab3beaa1ee P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.010953 23351 consensus_queue.cc:260] T 87c1f73ef3a347d9b95becab3beaa1ee P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
W20260709 12:25:50.011549 23126 leader_election.cc:343] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f89574c003f34931a776f1213874a675 (127.9.131.66:39573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:50.013161 23355 tablet_bootstrap.cc:654] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.014709 23311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87c1f73ef3a347d9b95becab3beaa1ee" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" is_pre_election: true
I20260709 12:25:50.015441 23311 raft_consensus.cc:2468] T 87c1f73ef3a347d9b95becab3beaa1ee P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 0.
I20260709 12:25:50.016876 23351 ts_tablet_manager.cc:1434] T 87c1f73ef3a347d9b95becab3beaa1ee P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:25:50.017107 23128 leader_election.cc:304] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, d08efaa729434ed4a7a396b571f4c597; no voters: f89574c003f34931a776f1213874a675
I20260709 12:25:50.018230 23372 raft_consensus.cc:2804] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:50.018698 23372 raft_consensus.cc:493] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.019114 23372 raft_consensus.cc:3060] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.020380 23352 tablet_bootstrap.cc:654] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.018455 23351 tablet_bootstrap.cc:492] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee: Bootstrap starting.
I20260709 12:25:50.027096 23059 catalog_manager.cc:5697] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 reported cstate change: term changed from 0 to 1, leader changed from <none> to f89574c003f34931a776f1213874a675 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "f89574c003f34931a776f1213874a675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.031694 23351 tablet_bootstrap.cc:654] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.033738 23352 tablet_bootstrap.cc:492] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675: No bootstrap required, opened a new log
I20260709 12:25:50.034456 23352 ts_tablet_manager.cc:1403] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.008s
W20260709 12:25:50.036180 23108 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:50.038493 23352 raft_consensus.cc:359] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.039474 23352 raft_consensus.cc:385] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.039798 23352 raft_consensus.cc:740] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.040840 23352 consensus_queue.cc:260] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.047139 23372 raft_consensus.cc:515] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.048317 23352 ts_tablet_manager.cc:1434] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 12:25:50.051724 23352 tablet_bootstrap.cc:492] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675: Bootstrap starting.
I20260709 12:25:50.051930 23363 raft_consensus.cc:493] T fe0d8886980a40428832e06881de2a28 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.052687 23363 raft_consensus.cc:515] T fe0d8886980a40428832e06881de2a28 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.053169 23372 leader_election.cc:290] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 election: Requested vote from peers f89574c003f34931a776f1213874a675 (127.9.131.66:39573), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:50.053946 23237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87c1f73ef3a347d9b95becab3beaa1ee" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675"
I20260709 12:25:50.054695 23351 tablet_bootstrap.cc:492] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee: No bootstrap required, opened a new log
I20260709 12:25:50.054673 23237 raft_consensus.cc:3060] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.055348 23351 ts_tablet_manager.cc:1403] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.011s
I20260709 12:25:50.054615 23311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87c1f73ef3a347d9b95becab3beaa1ee" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:50.058753 23351 raft_consensus.cc:359] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.059630 23311 raft_consensus.cc:3060] T 87c1f73ef3a347d9b95becab3beaa1ee P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.061497 23363 leader_election.cc:290] T fe0d8886980a40428832e06881de2a28 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f89574c003f34931a776f1213874a675 (127.9.131.66:39573), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:50.059489 23351 raft_consensus.cc:385] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.062391 23351 raft_consensus.cc:740] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.062602 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0d8886980a40428832e06881de2a28" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675" is_pre_election: true
I20260709 12:25:50.063323 23351 consensus_queue.cc:260] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
W20260709 12:25:50.064652 23126 leader_election.cc:343] T fe0d8886980a40428832e06881de2a28 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f89574c003f34931a776f1213874a675 (127.9.131.66:39573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:50.065454 23355 tablet_bootstrap.cc:492] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597: No bootstrap required, opened a new log
I20260709 12:25:50.065280 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0d8886980a40428832e06881de2a28" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" is_pre_election: true
I20260709 12:25:50.065982 23355 ts_tablet_manager.cc:1403] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.008s
I20260709 12:25:50.066085 23351 ts_tablet_manager.cc:1434] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
W20260709 12:25:50.066967 23128 leader_election.cc:343] T fe0d8886980a40428832e06881de2a28 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:50.067580 23351 tablet_bootstrap.cc:492] T fe0d8886980a40428832e06881de2a28 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Bootstrap starting.
I20260709 12:25:50.067504 23128 leader_election.cc:304] T fe0d8886980a40428832e06881de2a28 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d08efaa729434ed4a7a396b571f4c597; no voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675
I20260709 12:25:50.069415 23355 raft_consensus.cc:359] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.070267 23355 raft_consensus.cc:385] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.070578 23355 raft_consensus.cc:740] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.071432 23355 consensus_queue.cc:260] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.072328 23369 raft_consensus.cc:493] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.072921 23369 raft_consensus.cc:515] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.074033 23372 raft_consensus.cc:2749] T fe0d8886980a40428832e06881de2a28 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:50.076037 23351 tablet_bootstrap.cc:654] T fe0d8886980a40428832e06881de2a28 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.077085 23352 tablet_bootstrap.cc:654] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.076898 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533a483e22a54a949dd7813032a5258b" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675" is_pre_election: true
W20260709 12:25:50.078578 23275 leader_election.cc:343] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f89574c003f34931a776f1213874a675 (127.9.131.66:39573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:50.080538 23162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533a483e22a54a949dd7813032a5258b" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597" is_pre_election: true
I20260709 12:25:50.081399 23162 raft_consensus.cc:2468] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 0.
I20260709 12:25:50.081732 23355 ts_tablet_manager.cc:1434] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 12:25:50.083606 23355 tablet_bootstrap.cc:492] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597: Bootstrap starting.
I20260709 12:25:50.087764 23358 raft_consensus.cc:493] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.092523 23237 raft_consensus.cc:2468] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 1.
I20260709 12:25:50.094350 23126 leader_election.cc:304] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d08efaa729434ed4a7a396b571f4c597, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:50.095595 23363 raft_consensus.cc:2804] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:50.096154 23363 raft_consensus.cc:697] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [term 1 LEADER]: Becoming Leader. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Running, Role: LEADER
I20260709 12:25:50.097123 23363 consensus_queue.cc:237] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.100309 23276 leader_election.cc:304] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, d08efaa729434ed4a7a396b571f4c597; no voters: f89574c003f34931a776f1213874a675
I20260709 12:25:50.101533 23357 raft_consensus.cc:2804] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:50.101982 23357 raft_consensus.cc:493] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.102499 23357 raft_consensus.cc:3060] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.092619 23358 raft_consensus.cc:515] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.106587 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad581a43dcff4560afed00e7a0d3897f" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" is_pre_election: true
I20260709 12:25:50.107291 23310 raft_consensus.cc:2468] T ad581a43dcff4560afed00e7a0d3897f P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 0.
I20260709 12:25:50.108186 23358 leader_election.cc:290] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:50.109988 23203 leader_election.cc:304] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:50.101869 23369 leader_election.cc:290] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), f89574c003f34931a776f1213874a675 (127.9.131.66:39573)
I20260709 12:25:50.113119 23162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad581a43dcff4560afed00e7a0d3897f" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597" is_pre_election: true
I20260709 12:25:50.113894 23162 raft_consensus.cc:2468] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 0.
I20260709 12:25:50.110525 23311 raft_consensus.cc:2468] T 87c1f73ef3a347d9b95becab3beaa1ee P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 1.
I20260709 12:25:50.119071 23352 tablet_bootstrap.cc:492] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675: No bootstrap required, opened a new log
I20260709 12:25:50.125116 23352 ts_tablet_manager.cc:1403] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675: Time spent bootstrapping tablet: real 0.074s	user 0.037s	sys 0.017s
I20260709 12:25:50.122526 23357 raft_consensus.cc:515] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.126657 23351 tablet_bootstrap.cc:492] T fe0d8886980a40428832e06881de2a28 P 1d6cace6e70d433b9c0eb3d0d514e3ee: No bootstrap required, opened a new log
I20260709 12:25:50.127271 23351 ts_tablet_manager.cc:1403] T fe0d8886980a40428832e06881de2a28 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent bootstrapping tablet: real 0.060s	user 0.022s	sys 0.015s
I20260709 12:25:50.116995 23358 raft_consensus.cc:2804] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:50.128257 23358 raft_consensus.cc:493] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.128587 23352 raft_consensus.cc:359] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.129444 23352 raft_consensus.cc:385] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.129772 23352 raft_consensus.cc:740] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.130895 23352 consensus_queue.cc:260] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.132031 23373 raft_consensus.cc:493] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.132521 23373 raft_consensus.cc:515] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.133234 23355 tablet_bootstrap.cc:654] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.135509 23351 raft_consensus.cc:359] T fe0d8886980a40428832e06881de2a28 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.128677 23358 raft_consensus.cc:3060] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.137943 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533a483e22a54a949dd7813032a5258b" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597" is_pre_election: true
I20260709 12:25:50.138664 23161 raft_consensus.cc:2468] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 0.
I20260709 12:25:50.136754 23373 leader_election.cc:290] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:50.140170 23202 leader_election.cc:304] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d08efaa729434ed4a7a396b571f4c597, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:50.141453 23162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533a483e22a54a949dd7813032a5258b" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:25:50.142123 23162 raft_consensus.cc:3060] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.136368 23351 raft_consensus.cc:385] T fe0d8886980a40428832e06881de2a28 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.146488 23351 raft_consensus.cc:740] T fe0d8886980a40428832e06881de2a28 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.147459 23387 raft_consensus.cc:2804] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:50.147750 23351 consensus_queue.cc:260] T fe0d8886980a40428832e06881de2a28 P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.154982 23387 raft_consensus.cc:493] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.155304 23237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533a483e22a54a949dd7813032a5258b" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675"
I20260709 12:25:50.154465 23352 ts_tablet_manager.cc:1434] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.008s
I20260709 12:25:50.154695 23369 raft_consensus.cc:493] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.156513 23369 raft_consensus.cc:515] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.157891 23352 tablet_bootstrap.cc:492] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675: Bootstrap starting.
I20260709 12:25:50.158933 23369 leader_election.cc:290] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), f89574c003f34931a776f1213874a675 (127.9.131.66:39573)
I20260709 12:25:50.161209 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc33df488b3440f9bb491ec0af24c37" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675" is_pre_election: true
W20260709 12:25:50.162956 23275 leader_election.cc:343] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f89574c003f34931a776f1213874a675 (127.9.131.66:39573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:50.166724 23352 tablet_bootstrap.cc:654] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.155474 23387 raft_consensus.cc:3060] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.167970 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc33df488b3440f9bb491ec0af24c37" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597" is_pre_election: true
W20260709 12:25:50.169708 23276 leader_election.cc:343] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:50.170173 23276 leader_election.cc:304] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee; no voters: d08efaa729434ed4a7a396b571f4c597, f89574c003f34931a776f1213874a675
I20260709 12:25:50.172048 23369 raft_consensus.cc:2749] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:50.152349 23311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533a483e22a54a949dd7813032a5258b" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" is_pre_election: true
I20260709 12:25:50.173514 23311 raft_consensus.cc:2393] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f89574c003f34931a776f1213874a675 in current term 1: Already voted for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in this term.
I20260709 12:25:50.175678 23357 leader_election.cc:290] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), f89574c003f34931a776f1213874a675 (127.9.131.66:39573)
I20260709 12:25:50.183835 23387 raft_consensus.cc:515] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.185601 23237 raft_consensus.cc:2393] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in current term 1: Already voted for candidate f89574c003f34931a776f1213874a675 in this term.
I20260709 12:25:50.173336 23162 raft_consensus.cc:2468] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 1.
I20260709 12:25:50.186131 23060 catalog_manager.cc:5697] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 reported cstate change: term changed from 0 to 1, leader changed from <none> to d08efaa729434ed4a7a396b571f4c597 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "d08efaa729434ed4a7a396b571f4c597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:50.186904 23355 tablet_bootstrap.cc:492] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597: No bootstrap required, opened a new log
I20260709 12:25:50.188959 23355 ts_tablet_manager.cc:1403] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597: Time spent bootstrapping tablet: real 0.106s	user 0.028s	sys 0.028s
I20260709 12:25:50.190188 23352 tablet_bootstrap.cc:492] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675: No bootstrap required, opened a new log
I20260709 12:25:50.190814 23352 ts_tablet_manager.cc:1403] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.002s
I20260709 12:25:50.183372 23358 raft_consensus.cc:515] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.194340 23352 raft_consensus.cc:359] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.194885 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad581a43dcff4560afed00e7a0d3897f" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:25:50.195281 23352 raft_consensus.cc:385] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.195627 23161 raft_consensus.cc:3060] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.195688 23352 raft_consensus.cc:740] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.196375 23276 leader_election.cc:304] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, d08efaa729434ed4a7a396b571f4c597; no voters: f89574c003f34931a776f1213874a675
I20260709 12:25:50.196671 23352 consensus_queue.cc:260] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.197621 23357 raft_consensus.cc:2804] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:50.198920 23357 raft_consensus.cc:697] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Becoming Leader. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Running, Role: LEADER
I20260709 12:25:50.199820 23357 consensus_queue.cc:237] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.201647 23352 ts_tablet_manager.cc:1434] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.003s
I20260709 12:25:50.203080 23352 tablet_bootstrap.cc:492] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675: Bootstrap starting.
I20260709 12:25:50.195102 23311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad581a43dcff4560afed00e7a0d3897f" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:50.204193 23311 raft_consensus.cc:3060] T ad581a43dcff4560afed00e7a0d3897f P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.210618 23352 tablet_bootstrap.cc:654] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.211988 23358 leader_election.cc:290] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:50.213171 23355 raft_consensus.cc:359] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.216410 23351 ts_tablet_manager.cc:1434] T fe0d8886980a40428832e06881de2a28 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent starting tablet: real 0.089s	user 0.025s	sys 0.013s
I20260709 12:25:50.217271 23311 raft_consensus.cc:2468] T ad581a43dcff4560afed00e7a0d3897f P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 1.
I20260709 12:25:50.218065 23351 tablet_bootstrap.cc:492] T 5ffc3ac9d2274edb9db5701cafc9f598 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Bootstrap starting.
I20260709 12:25:50.218676 23203 leader_election.cc:304] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:50.219655 23358 raft_consensus.cc:2804] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:50.220211 23358 raft_consensus.cc:697] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Becoming Leader. State: Replica: f89574c003f34931a776f1213874a675, State: Running, Role: LEADER
I20260709 12:25:50.221045 23358 consensus_queue.cc:237] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.221860 23162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533a483e22a54a949dd7813032a5258b" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:25:50.222095 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533a483e22a54a949dd7813032a5258b" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:50.223057 23162 raft_consensus.cc:2393] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f89574c003f34931a776f1213874a675 in current term 1: Already voted for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in this term.
I20260709 12:25:50.214076 23355 raft_consensus.cc:385] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.224064 23352 tablet_bootstrap.cc:492] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675: No bootstrap required, opened a new log
I20260709 12:25:50.224577 23202 leader_election.cc:304] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f89574c003f34931a776f1213874a675; no voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, d08efaa729434ed4a7a396b571f4c597
I20260709 12:25:50.225077 23352 ts_tablet_manager.cc:1403] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.015s
I20260709 12:25:50.225683 23373 raft_consensus.cc:2749] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:50.218943 23161 raft_consensus.cc:2468] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 1.
I20260709 12:25:50.224359 23355 raft_consensus.cc:740] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.224143 23387 leader_election.cc:290] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:50.228760 23352 raft_consensus.cc:359] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.229617 23352 raft_consensus.cc:385] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.229944 23352 raft_consensus.cc:740] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.228782 23355 consensus_queue.cc:260] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.230808 23060 catalog_manager.cc:5697] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.230858 23352 consensus_queue.cc:260] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.232713 23355 ts_tablet_manager.cc:1434] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.004s
I20260709 12:25:50.236743 23352 ts_tablet_manager.cc:1434] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:25:50.241636 23352 tablet_bootstrap.cc:492] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675: Bootstrap starting.
I20260709 12:25:50.244753 23059 catalog_manager.cc:5697] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 reported cstate change: term changed from 0 to 1, leader changed from <none> to f89574c003f34931a776f1213874a675 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "f89574c003f34931a776f1213874a675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:50.249166 23352 tablet_bootstrap.cc:654] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.236894 23355 tablet_bootstrap.cc:492] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597: Bootstrap starting.
I20260709 12:25:50.240191 23351 tablet_bootstrap.cc:654] T 5ffc3ac9d2274edb9db5701cafc9f598 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.257507 23351 tablet_bootstrap.cc:492] T 5ffc3ac9d2274edb9db5701cafc9f598 P 1d6cace6e70d433b9c0eb3d0d514e3ee: No bootstrap required, opened a new log
I20260709 12:25:50.258049 23351 ts_tablet_manager.cc:1403] T 5ffc3ac9d2274edb9db5701cafc9f598 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.004s
I20260709 12:25:50.259728 23355 tablet_bootstrap.cc:654] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.261299 23351 raft_consensus.cc:359] T 5ffc3ac9d2274edb9db5701cafc9f598 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.262111 23351 raft_consensus.cc:385] T 5ffc3ac9d2274edb9db5701cafc9f598 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.262411 23351 raft_consensus.cc:740] T 5ffc3ac9d2274edb9db5701cafc9f598 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.263310 23351 consensus_queue.cc:260] T 5ffc3ac9d2274edb9db5701cafc9f598 P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.265829 23351 ts_tablet_manager.cc:1434] T 5ffc3ac9d2274edb9db5701cafc9f598 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:50.266913 23351 tablet_bootstrap.cc:492] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee: Bootstrap starting.
I20260709 12:25:50.269454 23352 tablet_bootstrap.cc:492] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675: No bootstrap required, opened a new log
I20260709 12:25:50.270226 23352 ts_tablet_manager.cc:1403] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.004s
I20260709 12:25:50.273998 23351 tablet_bootstrap.cc:654] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.275199 23352 raft_consensus.cc:359] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.276242 23352 raft_consensus.cc:385] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.276597 23352 raft_consensus.cc:740] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.277630 23352 consensus_queue.cc:260] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.279657 23355 tablet_bootstrap.cc:492] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597: No bootstrap required, opened a new log
I20260709 12:25:50.280368 23352 ts_tablet_manager.cc:1434] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 12:25:50.280368 23355 ts_tablet_manager.cc:1403] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.011s
I20260709 12:25:50.282022 23352 tablet_bootstrap.cc:492] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675: Bootstrap starting.
I20260709 12:25:50.284129 23355 raft_consensus.cc:359] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.284929 23355 raft_consensus.cc:385] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.285231 23355 raft_consensus.cc:740] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.286701 23355 consensus_queue.cc:260] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.287979 23351 tablet_bootstrap.cc:492] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee: No bootstrap required, opened a new log
I20260709 12:25:50.288594 23351 ts_tablet_manager.cc:1403] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 12:25:50.290941 23352 tablet_bootstrap.cc:654] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.291502 23351 raft_consensus.cc:359] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.292640 23355 ts_tablet_manager.cc:1434] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:25:50.292655 23351 raft_consensus.cc:385] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.293262 23351 raft_consensus.cc:740] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.294343 23355 tablet_bootstrap.cc:492] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597: Bootstrap starting.
I20260709 12:25:50.294059 23351 consensus_queue.cc:260] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.298224 23351 ts_tablet_manager.cc:1434] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:25:50.299449 23351 tablet_bootstrap.cc:492] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Bootstrap starting.
I20260709 12:25:50.309674 23351 tablet_bootstrap.cc:654] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.312988 23355 tablet_bootstrap.cc:654] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.314046 23351 tablet_bootstrap.cc:492] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee: No bootstrap required, opened a new log
I20260709 12:25:50.314534 23351 ts_tablet_manager.cc:1403] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:25:50.316740 23351 raft_consensus.cc:359] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.317392 23351 raft_consensus.cc:385] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.317683 23351 raft_consensus.cc:740] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.318348 23351 consensus_queue.cc:260] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.320405 23351 ts_tablet_manager.cc:1434] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:25:50.320816 23355 tablet_bootstrap.cc:492] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597: No bootstrap required, opened a new log
I20260709 12:25:50.321492 23355 ts_tablet_manager.cc:1403] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.000s
I20260709 12:25:50.323535 23352 tablet_bootstrap.cc:492] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675: No bootstrap required, opened a new log
I20260709 12:25:50.324138 23352 ts_tablet_manager.cc:1403] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675: Time spent bootstrapping tablet: real 0.043s	user 0.022s	sys 0.015s
I20260709 12:25:50.325321 23355 raft_consensus.cc:359] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } } peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } }
I20260709 12:25:50.326197 23355 raft_consensus.cc:385] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.326511 23355 raft_consensus.cc:740] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.327273 23352 raft_consensus.cc:359] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.327358 23355 consensus_queue.cc:260] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } } peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } }
I20260709 12:25:50.328220 23352 raft_consensus.cc:385] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.328526 23352 raft_consensus.cc:740] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.329238 23352 consensus_queue.cc:260] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.331851 23352 ts_tablet_manager.cc:1434] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:50.333076 23352 tablet_bootstrap.cc:492] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675: Bootstrap starting.
I20260709 12:25:50.333164 23355 ts_tablet_manager.cc:1434] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:25:50.334615 23355 tablet_bootstrap.cc:492] T fc408da3258243a69dec87746d508e0b P d08efaa729434ed4a7a396b571f4c597: Bootstrap starting.
I20260709 12:25:50.340539 23352 tablet_bootstrap.cc:654] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.342008 23355 tablet_bootstrap.cc:654] T fc408da3258243a69dec87746d508e0b P d08efaa729434ed4a7a396b571f4c597: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.343443 23363 raft_consensus.cc:493] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.344152 23363 raft_consensus.cc:515] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.348098 23311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffc3ac9d2274edb9db5701cafc9f598" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" is_pre_election: true
I20260709 12:25:50.348508 23363 leader_election.cc:290] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f89574c003f34931a776f1213874a675 (127.9.131.66:39573), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:50.348662 23311 raft_consensus.cc:2468] T 5ffc3ac9d2274edb9db5701cafc9f598 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 0.
I20260709 12:25:50.348752 23237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffc3ac9d2274edb9db5701cafc9f598" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675" is_pre_election: true
I20260709 12:25:50.349637 23237 raft_consensus.cc:2468] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 0.
I20260709 12:25:50.350164 23128 leader_election.cc:304] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, d08efaa729434ed4a7a396b571f4c597; no voters: 
I20260709 12:25:50.351157 23363 raft_consensus.cc:2804] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:50.351630 23363 raft_consensus.cc:493] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.352073 23363 raft_consensus.cc:3060] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.354243 23355 tablet_bootstrap.cc:492] T fc408da3258243a69dec87746d508e0b P d08efaa729434ed4a7a396b571f4c597: No bootstrap required, opened a new log
I20260709 12:25:50.354382 23352 tablet_bootstrap.cc:492] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675: No bootstrap required, opened a new log
I20260709 12:25:50.354910 23355 ts_tablet_manager.cc:1403] T fc408da3258243a69dec87746d508e0b P d08efaa729434ed4a7a396b571f4c597: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.000s
I20260709 12:25:50.354971 23352 ts_tablet_manager.cc:1403] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.010s
I20260709 12:25:50.357982 23352 raft_consensus.cc:359] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.358170 23355 raft_consensus.cc:359] T fc408da3258243a69dec87746d508e0b P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.358747 23352 raft_consensus.cc:385] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.358916 23355 raft_consensus.cc:385] T fc408da3258243a69dec87746d508e0b P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.358721 23363 raft_consensus.cc:515] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.359431 23352 raft_consensus.cc:740] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.359519 23355 raft_consensus.cc:740] T fc408da3258243a69dec87746d508e0b P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.360378 23352 consensus_queue.cc:260] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.360385 23355 consensus_queue.cc:260] T fc408da3258243a69dec87746d508e0b P d08efaa729434ed4a7a396b571f4c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.361835 23363 leader_election.cc:290] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 election: Requested vote from peers f89574c003f34931a776f1213874a675 (127.9.131.66:39573), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:50.362166 23311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffc3ac9d2274edb9db5701cafc9f598" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:50.362684 23311 raft_consensus.cc:3060] T 5ffc3ac9d2274edb9db5701cafc9f598 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.362064 23237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffc3ac9d2274edb9db5701cafc9f598" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675"
I20260709 12:25:50.365199 23237 raft_consensus.cc:3060] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.367098 23357 raft_consensus.cc:493] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.367682 23357 raft_consensus.cc:515] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.370258 23357 leader_election.cc:290] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), f89574c003f34931a776f1213874a675 (127.9.131.66:39573)
I20260709 12:25:50.371495 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc408da3258243a69dec87746d508e0b" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675" is_pre_election: true
I20260709 12:25:50.371969 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc408da3258243a69dec87746d508e0b" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597" is_pre_election: true
I20260709 12:25:50.372318 23236 raft_consensus.cc:2468] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 0.
I20260709 12:25:50.373730 23275 leader_election.cc:304] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:50.373941 23237 raft_consensus.cc:2468] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 1.
I20260709 12:25:50.375659 23161 raft_consensus.cc:2468] T fc408da3258243a69dec87746d508e0b P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 0.
I20260709 12:25:50.365288 23352 ts_tablet_manager.cc:1434] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:25:50.375806 23126 leader_election.cc:304] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d08efaa729434ed4a7a396b571f4c597, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:50.375892 23311 raft_consensus.cc:2468] T 5ffc3ac9d2274edb9db5701cafc9f598 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 1.
I20260709 12:25:50.376230 23387 consensus_queue.cc:1048] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:50.375325 23357 raft_consensus.cc:2804] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:50.379058 23357 raft_consensus.cc:493] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.379432 23357 raft_consensus.cc:3060] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.376976 23363 raft_consensus.cc:2804] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:50.384213 23363 raft_consensus.cc:697] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [term 1 LEADER]: Becoming Leader. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Running, Role: LEADER
I20260709 12:25:50.385104 23363 consensus_queue.cc:237] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.387416 23357 raft_consensus.cc:515] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.391422 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc408da3258243a69dec87746d508e0b" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:25:50.392143 23161 raft_consensus.cc:3060] T fc408da3258243a69dec87746d508e0b P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.394706 23162 raft_consensus.cc:3060] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.376289 23355 ts_tablet_manager.cc:1434] T fc408da3258243a69dec87746d508e0b P d08efaa729434ed4a7a396b571f4c597: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.004s
I20260709 12:25:50.402173 23355 tablet_bootstrap.cc:492] T 68466758e88a4c1db2d233627c8bb383 P d08efaa729434ed4a7a396b571f4c597: Bootstrap starting.
I20260709 12:25:50.404170 23237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc408da3258243a69dec87746d508e0b" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675"
I20260709 12:25:50.405018 23237 raft_consensus.cc:3060] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.408320 23387 consensus_queue.cc:1048] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:50.414860 23357 leader_election.cc:290] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), f89574c003f34931a776f1213874a675 (127.9.131.66:39573)
I20260709 12:25:50.420010 23237 raft_consensus.cc:2468] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 1.
I20260709 12:25:50.422173 23275 leader_election.cc:304] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:50.423147 23357 raft_consensus.cc:2804] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:50.423581 23357 raft_consensus.cc:697] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Becoming Leader. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Running, Role: LEADER
I20260709 12:25:50.424472 23357 consensus_queue.cc:237] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.426972 23355 tablet_bootstrap.cc:654] T 68466758e88a4c1db2d233627c8bb383 P d08efaa729434ed4a7a396b571f4c597: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.416895 23161 raft_consensus.cc:2468] T fc408da3258243a69dec87746d508e0b P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 1.
I20260709 12:25:50.434554 23058 catalog_manager.cc:5697] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.440436 23355 tablet_bootstrap.cc:492] T 68466758e88a4c1db2d233627c8bb383 P d08efaa729434ed4a7a396b571f4c597: No bootstrap required, opened a new log
I20260709 12:25:50.441150 23355 ts_tablet_manager.cc:1403] T 68466758e88a4c1db2d233627c8bb383 P d08efaa729434ed4a7a396b571f4c597: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.002s
I20260709 12:25:50.440976 23060 catalog_manager.cc:5697] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 reported cstate change: term changed from 0 to 1, leader changed from <none> to d08efaa729434ed4a7a396b571f4c597 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "d08efaa729434ed4a7a396b571f4c597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:50.444567 23355 raft_consensus.cc:359] T 68466758e88a4c1db2d233627c8bb383 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.445437 23355 raft_consensus.cc:385] T 68466758e88a4c1db2d233627c8bb383 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.445731 23355 raft_consensus.cc:740] T 68466758e88a4c1db2d233627c8bb383 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.446578 23355 consensus_queue.cc:260] T 68466758e88a4c1db2d233627c8bb383 P d08efaa729434ed4a7a396b571f4c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.449285 23355 ts_tablet_manager.cc:1434] T 68466758e88a4c1db2d233627c8bb383 P d08efaa729434ed4a7a396b571f4c597: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:25:50.485807 23387 raft_consensus.cc:493] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.486510 23387 raft_consensus.cc:515] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.488476 23387 leader_election.cc:290] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:50.489387 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68466758e88a4c1db2d233627c8bb383" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597" is_pre_election: true
I20260709 12:25:50.489557 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68466758e88a4c1db2d233627c8bb383" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" is_pre_election: true
I20260709 12:25:50.489842 23387 raft_consensus.cc:493] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.490095 23160 raft_consensus.cc:2468] T 68466758e88a4c1db2d233627c8bb383 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 0.
I20260709 12:25:50.490319 23310 raft_consensus.cc:2468] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 0.
I20260709 12:25:50.490370 23387 raft_consensus.cc:515] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.491250 23202 leader_election.cc:304] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d08efaa729434ed4a7a396b571f4c597, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:50.492115 23358 raft_consensus.cc:2804] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:50.492523 23358 raft_consensus.cc:493] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.492832 23358 raft_consensus.cc:3060] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.493100 23387 leader_election.cc:290] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:50.493937 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc33df488b3440f9bb491ec0af24c37" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597" is_pre_election: true
I20260709 12:25:50.494235 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc33df488b3440f9bb491ec0af24c37" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" is_pre_election: true
I20260709 12:25:50.494674 23160 raft_consensus.cc:2468] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 0.
I20260709 12:25:50.494874 23310 raft_consensus.cc:2468] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 0.
I20260709 12:25:50.495802 23202 leader_election.cc:304] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d08efaa729434ed4a7a396b571f4c597, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:50.496650 23387 raft_consensus.cc:2804] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:50.497006 23387 raft_consensus.cc:493] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.497269 23387 raft_consensus.cc:3060] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.499470 23358 raft_consensus.cc:515] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.501878 23358 leader_election.cc:290] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:50.502425 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68466758e88a4c1db2d233627c8bb383" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:25:50.502452 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68466758e88a4c1db2d233627c8bb383" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:50.503407 23160 raft_consensus.cc:3060] T 68466758e88a4c1db2d233627c8bb383 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.503530 23310 raft_consensus.cc:3060] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.503427 23387 raft_consensus.cc:515] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.507035 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc33df488b3440f9bb491ec0af24c37" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:25:50.507436 23311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc33df488b3440f9bb491ec0af24c37" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:50.507761 23161 raft_consensus.cc:3060] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.508210 23311 raft_consensus.cc:3060] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.512122 23358 raft_consensus.cc:493] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.512790 23160 raft_consensus.cc:2468] T 68466758e88a4c1db2d233627c8bb383 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 1.
I20260709 12:25:50.512868 23310 raft_consensus.cc:2468] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 1.
I20260709 12:25:50.513991 23387 leader_election.cc:290] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:50.512871 23358 raft_consensus.cc:515] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.514300 23203 leader_election.cc:304] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:50.516209 23358 leader_election.cc:290] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:50.517964 23387 raft_consensus.cc:2804] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:50.518795 23311 raft_consensus.cc:2468] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 1.
I20260709 12:25:50.519526 23387 raft_consensus.cc:697] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Becoming Leader. State: Replica: f89574c003f34931a776f1213874a675, State: Running, Role: LEADER
I20260709 12:25:50.518929 23161 raft_consensus.cc:2468] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 1.
I20260709 12:25:50.520390 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0d8886980a40428832e06881de2a28" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" is_pre_election: true
I20260709 12:25:50.520594 23203 leader_election.cc:304] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:50.521020 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0d8886980a40428832e06881de2a28" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597" is_pre_election: true
I20260709 12:25:50.521147 23310 raft_consensus.cc:2468] T fe0d8886980a40428832e06881de2a28 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 0.
I20260709 12:25:50.521593 23373 raft_consensus.cc:2804] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:50.521672 23160 raft_consensus.cc:2468] T fe0d8886980a40428832e06881de2a28 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 0.
I20260709 12:25:50.522301 23373 raft_consensus.cc:697] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Becoming Leader. State: Replica: f89574c003f34931a776f1213874a675, State: Running, Role: LEADER
I20260709 12:25:50.520654 23387 consensus_queue.cc:237] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.523157 23202 leader_election.cc:304] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d08efaa729434ed4a7a396b571f4c597, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:50.523254 23373 consensus_queue.cc:237] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.524722 23358 raft_consensus.cc:2804] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:50.525262 23358 raft_consensus.cc:493] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.525614 23358 raft_consensus.cc:3060] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.532788 23060 catalog_manager.cc:5697] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 reported cstate change: term changed from 0 to 1, leader changed from <none> to f89574c003f34931a776f1213874a675 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "f89574c003f34931a776f1213874a675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:50.533418 23358 raft_consensus.cc:515] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.535766 23358 leader_election.cc:290] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:50.536202 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0d8886980a40428832e06881de2a28" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:25:50.536945 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0d8886980a40428832e06881de2a28" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:50.537199 23160 raft_consensus.cc:3060] T fe0d8886980a40428832e06881de2a28 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.537609 23310 raft_consensus.cc:3060] T fe0d8886980a40428832e06881de2a28 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.544974 23160 raft_consensus.cc:2468] T fe0d8886980a40428832e06881de2a28 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 1.
I20260709 12:25:50.544974 23310 raft_consensus.cc:2468] T fe0d8886980a40428832e06881de2a28 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 1.
I20260709 12:25:50.546466 23202 leader_election.cc:304] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d08efaa729434ed4a7a396b571f4c597, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:50.547257 23358 raft_consensus.cc:2804] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:50.547773 23358 raft_consensus.cc:697] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Becoming Leader. State: Replica: f89574c003f34931a776f1213874a675, State: Running, Role: LEADER
I20260709 12:25:50.547394 23060 catalog_manager.cc:5697] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 reported cstate change: term changed from 0 to 1, leader changed from <none> to f89574c003f34931a776f1213874a675 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "f89574c003f34931a776f1213874a675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:50.548473 23358 consensus_queue.cc:237] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.559928 23060 catalog_manager.cc:5697] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675 reported cstate change: term changed from 0 to 1, leader changed from <none> to f89574c003f34931a776f1213874a675 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "f89574c003f34931a776f1213874a675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:50.581429 23363 consensus_queue.cc:1048] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:50.592480 23363 consensus_queue.cc:1048] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:50.655210 23358 consensus_queue.cc:1048] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:50.668556 23417 consensus_queue.cc:1048] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:50.705205 23237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f169737ec5ce479d8965c1a1aacbc999"
dest_uuid: "f89574c003f34931a776f1213874a675"
mode: GRACEFUL
new_leader_uuid: "d08efaa729434ed4a7a396b571f4c597"
 from {username='slave'} at 127.0.0.1:48854
I20260709 12:25:50.705914 23237 raft_consensus.cc:606] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Received request to transfer leadership to TS d08efaa729434ed4a7a396b571f4c597
I20260709 12:25:50.711234 23237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad581a43dcff4560afed00e7a0d3897f"
dest_uuid: "f89574c003f34931a776f1213874a675"
mode: GRACEFUL
new_leader_uuid: "d08efaa729434ed4a7a396b571f4c597"
 from {username='slave'} at 127.0.0.1:48854
I20260709 12:25:50.711845 23237 raft_consensus.cc:606] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Received request to transfer leadership to TS d08efaa729434ed4a7a396b571f4c597
I20260709 12:25:50.717301 23237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fc33df488b3440f9bb491ec0af24c37"
dest_uuid: "f89574c003f34931a776f1213874a675"
mode: GRACEFUL
new_leader_uuid: "d08efaa729434ed4a7a396b571f4c597"
 from {username='slave'} at 127.0.0.1:48854
I20260709 12:25:50.717840 23237 raft_consensus.cc:606] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Received request to transfer leadership to TS d08efaa729434ed4a7a396b571f4c597
I20260709 12:25:50.731624 23310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "533a483e22a54a949dd7813032a5258b"
dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
mode: GRACEFUL
new_leader_uuid: "d08efaa729434ed4a7a396b571f4c597"
 from {username='slave'} at 127.0.0.1:56920
I20260709 12:25:50.732306 23310 raft_consensus.cc:606] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Received request to transfer leadership to TS d08efaa729434ed4a7a396b571f4c597
I20260709 12:25:50.734091 23357 consensus_queue.cc:1048] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:50.738139 23310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc408da3258243a69dec87746d508e0b"
dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
mode: GRACEFUL
new_leader_uuid: "f89574c003f34931a776f1213874a675"
 from {username='slave'} at 127.0.0.1:56920
I20260709 12:25:50.738761 23310 raft_consensus.cc:606] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Received request to transfer leadership to TS f89574c003f34931a776f1213874a675
I20260709 12:25:50.742085 23388 raft_consensus.cc:993] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee: : Instructing follower d08efaa729434ed4a7a396b571f4c597 to start an election
I20260709 12:25:50.743062 23357 raft_consensus.cc:1081] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Signalling peer d08efaa729434ed4a7a396b571f4c597 to start an election
I20260709 12:25:50.747532 23161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "533a483e22a54a949dd7813032a5258b"
dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
 from {username='slave'} at 127.0.0.1:39930
I20260709 12:25:50.748225 23161 raft_consensus.cc:493] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:50.748615 23161 raft_consensus.cc:3060] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:50.750094 23388 consensus_queue.cc:1048] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:50.759503 23161 raft_consensus.cc:515] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.765019 23160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87c1f73ef3a347d9b95becab3beaa1ee"
dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
mode: GRACEFUL
new_leader_uuid: "f89574c003f34931a776f1213874a675"
 from {username='slave'} at 127.0.0.1:39942
I20260709 12:25:50.765259 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533a483e22a54a949dd7813032a5258b" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:50.765722 23160 raft_consensus.cc:606] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [term 1 LEADER]: Received request to transfer leadership to TS f89574c003f34931a776f1213874a675
I20260709 12:25:50.765853 23237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "533a483e22a54a949dd7813032a5258b" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f89574c003f34931a776f1213874a675"
I20260709 12:25:50.765987 23310 raft_consensus.cc:3055] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:50.764616 23161 leader_election.cc:290] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 2 election: Requested vote from peers f89574c003f34931a776f1213874a675 (127.9.131.66:39573), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:50.767194 23310 raft_consensus.cc:740] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Running, Role: LEADER
I20260709 12:25:50.769224 23310 consensus_queue.cc:260] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.766723 23237 raft_consensus.cc:3060] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:50.770351 23310 raft_consensus.cc:3060] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:50.776891 23310 raft_consensus.cc:2468] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 2.
I20260709 12:25:50.776948 23161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ffc3ac9d2274edb9db5701cafc9f598"
dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
mode: GRACEFUL
new_leader_uuid: "f89574c003f34931a776f1213874a675"
 from {username='slave'} at 127.0.0.1:39942
I20260709 12:25:50.777822 23161 raft_consensus.cc:606] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [term 1 LEADER]: Received request to transfer leadership to TS f89574c003f34931a776f1213874a675
I20260709 12:25:50.778069 23128 leader_election.cc:304] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, d08efaa729434ed4a7a396b571f4c597; no voters: 
I20260709 12:25:50.778435 23237 raft_consensus.cc:2468] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 2.
I20260709 12:25:50.779143 23363 raft_consensus.cc:2804] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:50.779592 23363 raft_consensus.cc:697] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597 [term 2 LEADER]: Becoming Leader. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Running, Role: LEADER
I20260709 12:25:50.780508 23363 consensus_queue.cc:237] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.784505 23237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68466758e88a4c1db2d233627c8bb383"
dest_uuid: "f89574c003f34931a776f1213874a675"
mode: GRACEFUL
new_leader_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
 from {username='slave'} at 127.0.0.1:48854
I20260709 12:25:50.785178 23237 raft_consensus.cc:606] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Received request to transfer leadership to TS 1d6cace6e70d433b9c0eb3d0d514e3ee
I20260709 12:25:50.788556 23060 catalog_manager.cc:5697] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597 reported cstate change: term changed from 1 to 2, leader changed from 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67) to d08efaa729434ed4a7a396b571f4c597 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "d08efaa729434ed4a7a396b571f4c597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:50.831444 23387 raft_consensus.cc:993] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675: : Instructing follower d08efaa729434ed4a7a396b571f4c597 to start an election
I20260709 12:25:50.832108 23387 raft_consensus.cc:1081] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Signalling peer d08efaa729434ed4a7a396b571f4c597 to start an election
I20260709 12:25:50.833765 23161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f169737ec5ce479d8965c1a1aacbc999"
dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
 from {username='slave'} at 127.0.0.1:39924
I20260709 12:25:50.834340 23161 raft_consensus.cc:493] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:50.834638 23161 raft_consensus.cc:3060] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:50.840364 23161 raft_consensus.cc:515] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } } peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } }
I20260709 12:25:50.842054 23161 leader_election.cc:290] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 2 election: Requested vote from peers 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057), f89574c003f34931a776f1213874a675 (127.9.131.66:39573)
I20260709 12:25:50.842916 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f169737ec5ce479d8965c1a1aacbc999" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:50.843212 23237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f169737ec5ce479d8965c1a1aacbc999" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f89574c003f34931a776f1213874a675"
I20260709 12:25:50.843672 23310 raft_consensus.cc:3060] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:50.843930 23237 raft_consensus.cc:3055] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:50.844353 23237 raft_consensus.cc:740] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Running, Role: LEADER
I20260709 12:25:50.845212 23237 consensus_queue.cc:260] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } } peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } }
I20260709 12:25:50.846522 23237 raft_consensus.cc:3060] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:50.851562 23310 raft_consensus.cc:2468] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 2.
I20260709 12:25:50.852905 23128 leader_election.cc:304] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, d08efaa729434ed4a7a396b571f4c597; no voters: 
I20260709 12:25:50.853821 23363 raft_consensus.cc:2804] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:50.854004 23237 raft_consensus.cc:2468] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 2.
I20260709 12:25:50.854224 23363 raft_consensus.cc:697] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597 [term 2 LEADER]: Becoming Leader. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Running, Role: LEADER
I20260709 12:25:50.855149 23363 consensus_queue.cc:237] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } } peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } }
I20260709 12:25:50.861486 23060 catalog_manager.cc:5697] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597 reported cstate change: term changed from 1 to 2, leader changed from f89574c003f34931a776f1213874a675 (127.9.131.66) to d08efaa729434ed4a7a396b571f4c597 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "d08efaa729434ed4a7a396b571f4c597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:50.896996 23363 consensus_queue.cc:1048] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:50.910782 23387 consensus_queue.cc:1048] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:50.910782 23427 consensus_queue.cc:1048] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:50.923774 23372 raft_consensus.cc:993] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597: : Instructing follower f89574c003f34931a776f1213874a675 to start an election
I20260709 12:25:50.924364 23372 raft_consensus.cc:1081] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [term 1 LEADER]: Signalling peer f89574c003f34931a776f1213874a675 to start an election
I20260709 12:25:50.926538 23387 consensus_queue.cc:1048] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:50.927997 23237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ffc3ac9d2274edb9db5701cafc9f598"
dest_uuid: "f89574c003f34931a776f1213874a675"
 from {username='slave'} at 127.0.0.1:48844
I20260709 12:25:50.928653 23237 raft_consensus.cc:493] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:50.929033 23237 raft_consensus.cc:3060] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:50.936587 23237 raft_consensus.cc:515] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.938897 23237 leader_election.cc:290] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 2 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:50.939431 23387 raft_consensus.cc:993] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675: : Instructing follower d08efaa729434ed4a7a396b571f4c597 to start an election
I20260709 12:25:50.940062 23417 raft_consensus.cc:1081] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Signalling peer d08efaa729434ed4a7a396b571f4c597 to start an election
I20260709 12:25:50.940737 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffc3ac9d2274edb9db5701cafc9f598" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:25:50.941427 23161 raft_consensus.cc:3055] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:50.941622 23311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffc3ac9d2274edb9db5701cafc9f598" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:50.942317 23311 raft_consensus.cc:3060] T 5ffc3ac9d2274edb9db5701cafc9f598 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:50.941737 23161 raft_consensus.cc:740] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Running, Role: LEADER
I20260709 12:25:50.942771 23160 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fc33df488b3440f9bb491ec0af24c37"
dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
 from {username='slave'} at 127.0.0.1:39924
I20260709 12:25:50.943492 23160 raft_consensus.cc:493] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:50.944057 23160 raft_consensus.cc:3060] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:50.943523 23161 consensus_queue.cc:260] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.945093 23161 raft_consensus.cc:3060] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:50.950436 23311 raft_consensus.cc:2468] T 5ffc3ac9d2274edb9db5701cafc9f598 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 2.
I20260709 12:25:50.951834 23160 raft_consensus.cc:515] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.952801 23161 raft_consensus.cc:2468] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 2.
I20260709 12:25:50.953502 23203 leader_election.cc:304] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:50.954443 23387 raft_consensus.cc:2804] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:50.955072 23387 raft_consensus.cc:697] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675 [term 2 LEADER]: Becoming Leader. State: Replica: f89574c003f34931a776f1213874a675, State: Running, Role: LEADER
I20260709 12:25:50.955904 23387 consensus_queue.cc:237] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.956302 23357 consensus_queue.cc:1048] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:50.958462 23160 leader_election.cc:290] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 2 election: Requested vote from peers f89574c003f34931a776f1213874a675 (127.9.131.66:39573), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:50.958559 23237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc33df488b3440f9bb491ec0af24c37" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f89574c003f34931a776f1213874a675"
I20260709 12:25:50.959337 23237 raft_consensus.cc:3055] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:50.959667 23237 raft_consensus.cc:740] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Running, Role: LEADER
I20260709 12:25:50.960632 23237 consensus_queue.cc:260] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.962090 23237 raft_consensus.cc:3060] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:50.964460 23311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc33df488b3440f9bb491ec0af24c37" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:50.965289 23311 raft_consensus.cc:3060] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:50.967828 23060 catalog_manager.cc:5697] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675 reported cstate change: term changed from 1 to 2, leader changed from d08efaa729434ed4a7a396b571f4c597 (127.9.131.65) to f89574c003f34931a776f1213874a675 (127.9.131.66). New cstate: current_term: 2 leader_uuid: "f89574c003f34931a776f1213874a675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:50.972826 23417 consensus_queue.cc:1048] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:50.977766 23237 raft_consensus.cc:2468] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 2.
I20260709 12:25:50.978996 23126 leader_election.cc:304] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d08efaa729434ed4a7a396b571f4c597, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:50.980254 23363 raft_consensus.cc:2804] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:50.980756 23363 raft_consensus.cc:697] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [term 2 LEADER]: Becoming Leader. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Running, Role: LEADER
I20260709 12:25:50.981575 23363 consensus_queue.cc:237] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:50.984402 23311 raft_consensus.cc:2468] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 2.
I20260709 12:25:50.990372 23357 consensus_queue.cc:1048] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:50.992319 23417 raft_consensus.cc:993] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675: : Instructing follower 1d6cace6e70d433b9c0eb3d0d514e3ee to start an election
I20260709 12:25:50.992952 23358 raft_consensus.cc:1081] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Signalling peer 1d6cace6e70d433b9c0eb3d0d514e3ee to start an election
I20260709 12:25:50.995819 23311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68466758e88a4c1db2d233627c8bb383"
dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
 from {username='slave'} at 127.0.0.1:56900
I20260709 12:25:50.996573 23311 raft_consensus.cc:493] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:50.996999 23311 raft_consensus.cc:3060] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:50.999457 23358 consensus_queue.cc:1048] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:51.000937 23427 raft_consensus.cc:993] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597: : Instructing follower f89574c003f34931a776f1213874a675 to start an election
I20260709 12:25:51.001536 23427 raft_consensus.cc:1081] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [term 1 LEADER]: Signalling peer f89574c003f34931a776f1213874a675 to start an election
I20260709 12:25:51.003275 23236 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87c1f73ef3a347d9b95becab3beaa1ee"
dest_uuid: "f89574c003f34931a776f1213874a675"
 from {username='slave'} at 127.0.0.1:48844
I20260709 12:25:51.003904 23236 raft_consensus.cc:493] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:51.004300 23236 raft_consensus.cc:3060] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:50.997900 23058 catalog_manager.cc:5697] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 reported cstate change: term changed from 1 to 2, leader changed from f89574c003f34931a776f1213874a675 (127.9.131.66) to d08efaa729434ed4a7a396b571f4c597 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "d08efaa729434ed4a7a396b571f4c597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:51.005892 23311 raft_consensus.cc:515] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:51.007210 23310 raft_consensus.cc:1240] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Rejecting Update request from peer f89574c003f34931a776f1213874a675 for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:51.014065 23311 leader_election.cc:290] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 2 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), f89574c003f34931a776f1213874a675 (127.9.131.66:39573)
I20260709 12:25:51.015408 23235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68466758e88a4c1db2d233627c8bb383" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f89574c003f34931a776f1213874a675"
I20260709 12:25:51.015446 23358 consensus_queue.cc:1059] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:51.016933 23235 raft_consensus.cc:3055] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:51.017304 23235 raft_consensus.cc:740] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Running, Role: LEADER
I20260709 12:25:51.018644 23357 raft_consensus.cc:993] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee: : Instructing follower f89574c003f34931a776f1213874a675 to start an election
I20260709 12:25:51.018399 23235 consensus_queue.cc:260] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:51.019184 23357 raft_consensus.cc:1081] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Signalling peer f89574c003f34931a776f1213874a675 to start an election
I20260709 12:25:51.019678 23235 raft_consensus.cc:3060] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.019773 23236 raft_consensus.cc:515] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:51.021893 23234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc408da3258243a69dec87746d508e0b"
dest_uuid: "f89574c003f34931a776f1213874a675"
 from {username='slave'} at 127.0.0.1:48838
I20260709 12:25:51.022624 23234 raft_consensus.cc:493] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:51.022680 23236 leader_election.cc:290] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 2 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:51.023039 23234 raft_consensus.cc:3060] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.023422 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87c1f73ef3a347d9b95becab3beaa1ee" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:25:51.024156 23160 raft_consensus.cc:3055] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:51.024510 23160 raft_consensus.cc:740] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Running, Role: LEADER
I20260709 12:25:51.025542 23311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87c1f73ef3a347d9b95becab3beaa1ee" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:51.025439 23160 consensus_queue.cc:260] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:51.026255 23311 raft_consensus.cc:3060] T 87c1f73ef3a347d9b95becab3beaa1ee P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.027443 23160 raft_consensus.cc:3060] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.029143 23162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68466758e88a4c1db2d233627c8bb383" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:25:51.029814 23162 raft_consensus.cc:3060] T 68466758e88a4c1db2d233627c8bb383 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.031668 23235 raft_consensus.cc:2468] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 2.
W20260709 12:25:51.032424 23358 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:25:51.033289 23275 leader_election.cc:304] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:51.033502 23417 consensus_queue.cc:1048] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:51.034509 23423 raft_consensus.cc:2804] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:51.035025 23423 raft_consensus.cc:697] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 LEADER]: Becoming Leader. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Running, Role: LEADER
I20260709 12:25:51.035898 23423 consensus_queue.cc:237] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:51.037439 23311 raft_consensus.cc:2468] T 87c1f73ef3a347d9b95becab3beaa1ee P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 2.
I20260709 12:25:51.038878 23203 leader_election.cc:304] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:51.039815 23358 raft_consensus.cc:2804] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:51.040335 23358 raft_consensus.cc:697] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675 [term 2 LEADER]: Becoming Leader. State: Replica: f89574c003f34931a776f1213874a675, State: Running, Role: LEADER
I20260709 12:25:51.041224 23162 raft_consensus.cc:2468] T 68466758e88a4c1db2d233627c8bb383 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 2.
I20260709 12:25:51.041134 23358 consensus_queue.cc:237] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:51.044080 23234 raft_consensus.cc:515] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:51.046561 23234 leader_election.cc:290] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 2 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:51.047734 23311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc408da3258243a69dec87746d508e0b" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:51.048210 23160 raft_consensus.cc:2468] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 2.
I20260709 12:25:51.048463 23311 raft_consensus.cc:3055] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:51.048979 23311 raft_consensus.cc:740] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Running, Role: LEADER
I20260709 12:25:51.049947 23311 consensus_queue.cc:260] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:51.051425 23311 raft_consensus.cc:3060] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.054477 23060 catalog_manager.cc:5697] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee reported cstate change: term changed from 1 to 2, leader changed from f89574c003f34931a776f1213874a675 (127.9.131.66) to 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67). New cstate: current_term: 2 leader_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:51.064431 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc408da3258243a69dec87746d508e0b" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:25:51.064694 23358 consensus_queue.cc:1048] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:51.065282 23160 raft_consensus.cc:3060] T fc408da3258243a69dec87746d508e0b P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.071192 23059 catalog_manager.cc:5697] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675 reported cstate change: term changed from 1 to 2, leader changed from d08efaa729434ed4a7a396b571f4c597 (127.9.131.65) to f89574c003f34931a776f1213874a675 (127.9.131.66). New cstate: current_term: 2 leader_uuid: "f89574c003f34931a776f1213874a675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:51.074676 23417 raft_consensus.cc:993] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675: : Instructing follower d08efaa729434ed4a7a396b571f4c597 to start an election
I20260709 12:25:51.075358 23387 raft_consensus.cc:1081] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Signalling peer d08efaa729434ed4a7a396b571f4c597 to start an election
I20260709 12:25:51.077440 23161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad581a43dcff4560afed00e7a0d3897f"
dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
 from {username='slave'} at 127.0.0.1:39924
I20260709 12:25:51.078099 23161 raft_consensus.cc:493] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:51.078512 23161 raft_consensus.cc:3060] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.079231 23160 raft_consensus.cc:2468] T fc408da3258243a69dec87746d508e0b P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 2.
I20260709 12:25:51.081110 23311 raft_consensus.cc:2468] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 2.
I20260709 12:25:51.082548 23203 leader_election.cc:304] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:51.083499 23387 raft_consensus.cc:2804] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:51.084056 23387 raft_consensus.cc:697] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [term 2 LEADER]: Becoming Leader. State: Replica: f89574c003f34931a776f1213874a675, State: Running, Role: LEADER
I20260709 12:25:51.084896 23387 consensus_queue.cc:237] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:51.087657 23161 raft_consensus.cc:515] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:51.092449 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad581a43dcff4560afed00e7a0d3897f" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f89574c003f34931a776f1213874a675"
I20260709 12:25:51.093137 23234 raft_consensus.cc:3055] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:51.093475 23234 raft_consensus.cc:740] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Running, Role: LEADER
I20260709 12:25:51.094244 23234 consensus_queue.cc:260] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:51.095396 23234 raft_consensus.cc:3060] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.099123 23060 catalog_manager.cc:5697] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 reported cstate change: term changed from 1 to 2, leader changed from 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67) to f89574c003f34931a776f1213874a675 (127.9.131.66). New cstate: current_term: 2 leader_uuid: "f89574c003f34931a776f1213874a675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:51.102295 23234 raft_consensus.cc:2468] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 2.
I20260709 12:25:51.105469 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad581a43dcff4560afed00e7a0d3897f" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:51.106098 23310 raft_consensus.cc:3060] T ad581a43dcff4560afed00e7a0d3897f P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.106655 23126 leader_election.cc:304] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d08efaa729434ed4a7a396b571f4c597, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:51.107618 23363 raft_consensus.cc:2804] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:51.108124 23363 raft_consensus.cc:697] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597 [term 2 LEADER]: Becoming Leader. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Running, Role: LEADER
I20260709 12:25:51.108970 23363 consensus_queue.cc:237] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:51.115295 23310 raft_consensus.cc:2468] T ad581a43dcff4560afed00e7a0d3897f P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 2.
I20260709 12:25:51.116451 23161 leader_election.cc:290] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 2 election: Requested vote from peers f89574c003f34931a776f1213874a675 (127.9.131.66:39573), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:51.119473 23060 catalog_manager.cc:5697] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597 reported cstate change: term changed from 1 to 2, leader changed from f89574c003f34931a776f1213874a675 (127.9.131.66) to d08efaa729434ed4a7a396b571f4c597 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "d08efaa729434ed4a7a396b571f4c597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:51.176904 23234 raft_consensus.cc:1275] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Refusing update from remote peer d08efaa729434ed4a7a396b571f4c597: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.178416 23363 consensus_queue.cc:1048] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:51.186100 23310 raft_consensus.cc:1275] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Refusing update from remote peer d08efaa729434ed4a7a396b571f4c597: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.187686 23363 consensus_queue.cc:1048] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:51.269261 23310 raft_consensus.cc:1275] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Refusing update from remote peer d08efaa729434ed4a7a396b571f4c597: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.271166 23363 consensus_queue.cc:1048] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:51.282006 23234 raft_consensus.cc:1275] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Refusing update from remote peer d08efaa729434ed4a7a396b571f4c597: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.283648 23414 consensus_queue.cc:1048] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:51.357715 23310 raft_consensus.cc:1275] T 5ffc3ac9d2274edb9db5701cafc9f598 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Refusing update from remote peer f89574c003f34931a776f1213874a675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.359056 23387 consensus_queue.cc:1048] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:51.366901 23161 raft_consensus.cc:1275] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Refusing update from remote peer f89574c003f34931a776f1213874a675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.368687 23373 consensus_queue.cc:1048] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:51.428985 23234 raft_consensus.cc:1275] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Refusing update from remote peer d08efaa729434ed4a7a396b571f4c597: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.430361 23414 consensus_queue.cc:1048] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:51.439283 23310 raft_consensus.cc:1275] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Refusing update from remote peer d08efaa729434ed4a7a396b571f4c597: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.441077 23363 consensus_queue.cc:1048] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:51.496148 23161 raft_consensus.cc:1275] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Refusing update from remote peer f89574c003f34931a776f1213874a675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.497577 23373 consensus_queue.cc:1048] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:51.505345 23310 raft_consensus.cc:1275] T 87c1f73ef3a347d9b95becab3beaa1ee P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Refusing update from remote peer f89574c003f34931a776f1213874a675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.506978 23358 consensus_queue.cc:1048] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:51.511005 23311 raft_consensus.cc:1275] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Refusing update from remote peer f89574c003f34931a776f1213874a675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.512557 23358 consensus_queue.cc:1048] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:51.520515 23161 raft_consensus.cc:1275] T fc408da3258243a69dec87746d508e0b P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Refusing update from remote peer f89574c003f34931a776f1213874a675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.522675 23387 consensus_queue.cc:1048] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:51.580610 23234 raft_consensus.cc:1275] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Refusing update from remote peer 1d6cace6e70d433b9c0eb3d0d514e3ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.582109 23423 consensus_queue.cc:1048] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:51.594055 23161 raft_consensus.cc:1275] T 68466758e88a4c1db2d233627c8bb383 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Refusing update from remote peer 1d6cace6e70d433b9c0eb3d0d514e3ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.595345 23423 consensus_queue.cc:1048] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:51.605919 23310 raft_consensus.cc:1275] T ad581a43dcff4560afed00e7a0d3897f P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Refusing update from remote peer d08efaa729434ed4a7a396b571f4c597: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.607411 23363 consensus_queue.cc:1048] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:51.612453 23234 raft_consensus.cc:1275] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Refusing update from remote peer d08efaa729434ed4a7a396b571f4c597: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.614012 23372 consensus_queue.cc:1048] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:53.989684 23058 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52900:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:53.992190 23058 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:54.042820 23144 tablet_service.cc:1511] Processing CreateTablet for tablet f9ea03eeb5984676938e35a08ecffbba (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:54.044605 23144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9ea03eeb5984676938e35a08ecffbba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.044260 23223 tablet_service.cc:1511] Processing CreateTablet for tablet f9ea03eeb5984676938e35a08ecffbba (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:54.045307 23296 tablet_service.cc:1511] Processing CreateTablet for tablet f9ea03eeb5984676938e35a08ecffbba (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:54.045792 23223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9ea03eeb5984676938e35a08ecffbba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.046804 23296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9ea03eeb5984676938e35a08ecffbba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.049226 23148 tablet_service.cc:1511] Processing CreateTablet for tablet 22afdeda3e8a4f98be141363034871c8 (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:54.050634 23148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22afdeda3e8a4f98be141363034871c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.053603 23227 tablet_service.cc:1511] Processing CreateTablet for tablet 22afdeda3e8a4f98be141363034871c8 (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:54.055208 23227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22afdeda3e8a4f98be141363034871c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.056743 23297 tablet_service.cc:1511] Processing CreateTablet for tablet 22afdeda3e8a4f98be141363034871c8 (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:54.058311 23297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22afdeda3e8a4f98be141363034871c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.060328 23152 tablet_service.cc:1511] Processing CreateTablet for tablet c5069ba21386475b9f811e03482f3859 (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:54.061760 23152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5069ba21386475b9f811e03482f3859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.079095 23145 tablet_service.cc:1511] Processing CreateTablet for tablet ca25c8c3f8cd41439402cf6939bc7d9e (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:54.078961 23301 tablet_service.cc:1511] Processing CreateTablet for tablet c5069ba21386475b9f811e03482f3859 (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:54.080562 23145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca25c8c3f8cd41439402cf6939bc7d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.081225 23301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5069ba21386475b9f811e03482f3859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.081892 23226 tablet_service.cc:1511] Processing CreateTablet for tablet c5069ba21386475b9f811e03482f3859 (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:54.083256 23150 tablet_service.cc:1511] Processing CreateTablet for tablet 7ee16d300d1d47edb83146fd64599ac1 (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:54.084602 23150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ee16d300d1d47edb83146fd64599ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.087406 23224 tablet_service.cc:1511] Processing CreateTablet for tablet ca25c8c3f8cd41439402cf6939bc7d9e (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:54.090581 23149 tablet_service.cc:1511] Processing CreateTablet for tablet 26af7ad3266a463a97cd0546dd3ddc2c (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:54.091316 23225 tablet_service.cc:1511] Processing CreateTablet for tablet 7ee16d300d1d47edb83146fd64599ac1 (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:54.092042 23149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26af7ad3266a463a97cd0546dd3ddc2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.092430 23298 tablet_service.cc:1511] Processing CreateTablet for tablet 7ee16d300d1d47edb83146fd64599ac1 (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:54.093783 23298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ee16d300d1d47edb83146fd64599ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.091317 23300 tablet_service.cc:1511] Processing CreateTablet for tablet ca25c8c3f8cd41439402cf6939bc7d9e (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:54.095266 23147 tablet_service.cc:1511] Processing CreateTablet for tablet 5a8dd1f9f24249ff809ccce3a9a25811 (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:54.096784 23300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca25c8c3f8cd41439402cf6939bc7d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.096786 23147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a8dd1f9f24249ff809ccce3a9a25811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.083256 23226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5069ba21386475b9f811e03482f3859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.098928 23146 tablet_service.cc:1511] Processing CreateTablet for tablet dc1c17f0a66d425fb526791ee677b8f9 (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:54.100306 23146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc1c17f0a66d425fb526791ee677b8f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.101843 23299 tablet_service.cc:1511] Processing CreateTablet for tablet 26af7ad3266a463a97cd0546dd3ddc2c (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:54.104493 23295 tablet_service.cc:1511] Processing CreateTablet for tablet 5a8dd1f9f24249ff809ccce3a9a25811 (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
W20260709 12:25:54.107266 23108 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:54.100281 23225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ee16d300d1d47edb83146fd64599ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.109094 23151 tablet_service.cc:1511] Processing CreateTablet for tablet a419a938289f4c16abab61929f5d6914 (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:54.110448 23151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a419a938289f4c16abab61929f5d6914. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.111994 23299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26af7ad3266a463a97cd0546dd3ddc2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.112249 23224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca25c8c3f8cd41439402cf6939bc7d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.116240 23295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a8dd1f9f24249ff809ccce3a9a25811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.120682 23294 tablet_service.cc:1511] Processing CreateTablet for tablet dc1c17f0a66d425fb526791ee677b8f9 (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:54.120986 23293 tablet_service.cc:1511] Processing CreateTablet for tablet a419a938289f4c16abab61929f5d6914 (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:54.122221 23294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc1c17f0a66d425fb526791ee677b8f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.124208 23293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a419a938289f4c16abab61929f5d6914. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.174266 23222 tablet_service.cc:1511] Processing CreateTablet for tablet 26af7ad3266a463a97cd0546dd3ddc2c (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:54.174765 23220 tablet_service.cc:1511] Processing CreateTablet for tablet dc1c17f0a66d425fb526791ee677b8f9 (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:54.176878 23221 tablet_service.cc:1511] Processing CreateTablet for tablet 5a8dd1f9f24249ff809ccce3a9a25811 (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:54.177696 23219 tablet_service.cc:1511] Processing CreateTablet for tablet a419a938289f4c16abab61929f5d6914 (DEFAULT_TABLE table=soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:54.175756 23222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26af7ad3266a463a97cd0546dd3ddc2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.179054 23219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a419a938289f4c16abab61929f5d6914. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.179632 23221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a8dd1f9f24249ff809ccce3a9a25811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.184198 23220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc1c17f0a66d425fb526791ee677b8f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.280913 23456 tablet_bootstrap.cc:492] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Bootstrap starting.
I20260709 12:25:54.293421 23456 tablet_bootstrap.cc:654] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.295349 23458 tablet_bootstrap.cc:492] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675: Bootstrap starting.
I20260709 12:25:54.306061 23458 tablet_bootstrap.cc:654] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.306430 23456 tablet_bootstrap.cc:492] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee: No bootstrap required, opened a new log
I20260709 12:25:54.307062 23456 ts_tablet_manager.cc:1403] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.007s
I20260709 12:25:54.310837 23456 raft_consensus.cc:359] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.311828 23456 raft_consensus.cc:385] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.312186 23456 raft_consensus.cc:740] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.313194 23456 consensus_queue.cc:260] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.316011 23456 ts_tablet_manager.cc:1434] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.007s
I20260709 12:25:54.317114 23456 tablet_bootstrap.cc:492] T f9ea03eeb5984676938e35a08ecffbba P 1d6cace6e70d433b9c0eb3d0d514e3ee: Bootstrap starting.
W20260709 12:25:54.317186 23128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.67:33057, user_credentials={real_user=slave}} blocked reactor thread for 203061us
I20260709 12:25:54.324607 23456 tablet_bootstrap.cc:654] T f9ea03eeb5984676938e35a08ecffbba P 1d6cace6e70d433b9c0eb3d0d514e3ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.347378 23454 tablet_bootstrap.cc:492] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597: Bootstrap starting.
I20260709 12:25:54.400882 23456 tablet_bootstrap.cc:492] T f9ea03eeb5984676938e35a08ecffbba P 1d6cace6e70d433b9c0eb3d0d514e3ee: No bootstrap required, opened a new log
I20260709 12:25:54.401592 23458 tablet_bootstrap.cc:492] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675: No bootstrap required, opened a new log
I20260709 12:25:54.402230 23458 ts_tablet_manager.cc:1403] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675: Time spent bootstrapping tablet: real 0.112s	user 0.039s	sys 0.059s
I20260709 12:25:54.401584 23456 ts_tablet_manager.cc:1403] T f9ea03eeb5984676938e35a08ecffbba P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent bootstrapping tablet: real 0.085s	user 0.040s	sys 0.026s
I20260709 12:25:54.404616 23454 tablet_bootstrap.cc:654] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.405592 23458 raft_consensus.cc:359] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.405916 23456 raft_consensus.cc:359] T f9ea03eeb5984676938e35a08ecffbba P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.406459 23458 raft_consensus.cc:385] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.406867 23456 raft_consensus.cc:385] T f9ea03eeb5984676938e35a08ecffbba P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.406889 23458 raft_consensus.cc:740] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.407383 23456 raft_consensus.cc:740] T f9ea03eeb5984676938e35a08ecffbba P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.408311 23458 consensus_queue.cc:260] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.408720 23456 consensus_queue.cc:260] T f9ea03eeb5984676938e35a08ecffbba P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.411279 23458 ts_tablet_manager.cc:1434] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:25:54.412493 23458 tablet_bootstrap.cc:492] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675: Bootstrap starting.
I20260709 12:25:54.420580 23456 ts_tablet_manager.cc:1434] T f9ea03eeb5984676938e35a08ecffbba P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:25:54.422217 23456 tablet_bootstrap.cc:492] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Bootstrap starting.
I20260709 12:25:54.420586 23458 tablet_bootstrap.cc:654] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.432538 23456 tablet_bootstrap.cc:654] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.438896 23458 tablet_bootstrap.cc:492] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675: No bootstrap required, opened a new log
I20260709 12:25:54.439476 23458 ts_tablet_manager.cc:1403] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.005s
I20260709 12:25:54.443136 23458 raft_consensus.cc:359] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.444041 23458 raft_consensus.cc:385] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.444418 23458 raft_consensus.cc:740] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.445333 23458 consensus_queue.cc:260] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.447767 23458 ts_tablet_manager.cc:1434] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:25:54.449071 23458 tablet_bootstrap.cc:492] T ca25c8c3f8cd41439402cf6939bc7d9e P f89574c003f34931a776f1213874a675: Bootstrap starting.
I20260709 12:25:54.454002 23454 tablet_bootstrap.cc:492] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597: No bootstrap required, opened a new log
I20260709 12:25:54.454665 23454 ts_tablet_manager.cc:1403] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597: Time spent bootstrapping tablet: real 0.108s	user 0.015s	sys 0.008s
I20260709 12:25:54.456408 23458 tablet_bootstrap.cc:654] T ca25c8c3f8cd41439402cf6939bc7d9e P f89574c003f34931a776f1213874a675: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.459792 23456 tablet_bootstrap.cc:492] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee: No bootstrap required, opened a new log
I20260709 12:25:54.459430 23454 raft_consensus.cc:359] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.460439 23456 ts_tablet_manager.cc:1403] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.013s
I20260709 12:25:54.460454 23454 raft_consensus.cc:385] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.462637 23454 raft_consensus.cc:740] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.464164 23454 consensus_queue.cc:260] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.466791 23454 ts_tablet_manager.cc:1434] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 12:25:54.467968 23454 tablet_bootstrap.cc:492] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597: Bootstrap starting.
I20260709 12:25:54.475400 23456 raft_consensus.cc:359] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.476202 23456 raft_consensus.cc:385] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.476505 23456 raft_consensus.cc:740] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.477430 23456 consensus_queue.cc:260] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.483345 23456 ts_tablet_manager.cc:1434] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:25:54.484925 23456 tablet_bootstrap.cc:492] T c5069ba21386475b9f811e03482f3859 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Bootstrap starting.
I20260709 12:25:54.488209 23454 tablet_bootstrap.cc:654] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.503337 23456 tablet_bootstrap.cc:654] T c5069ba21386475b9f811e03482f3859 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.505846 23458 tablet_bootstrap.cc:492] T ca25c8c3f8cd41439402cf6939bc7d9e P f89574c003f34931a776f1213874a675: No bootstrap required, opened a new log
I20260709 12:25:54.506485 23458 ts_tablet_manager.cc:1403] T ca25c8c3f8cd41439402cf6939bc7d9e P f89574c003f34931a776f1213874a675: Time spent bootstrapping tablet: real 0.058s	user 0.020s	sys 0.031s
I20260709 12:25:54.511217 23458 raft_consensus.cc:359] T ca25c8c3f8cd41439402cf6939bc7d9e P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.512163 23458 raft_consensus.cc:385] T ca25c8c3f8cd41439402cf6939bc7d9e P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.512503 23458 raft_consensus.cc:740] T ca25c8c3f8cd41439402cf6939bc7d9e P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.513383 23458 consensus_queue.cc:260] T ca25c8c3f8cd41439402cf6939bc7d9e P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.516299 23458 ts_tablet_manager.cc:1434] T ca25c8c3f8cd41439402cf6939bc7d9e P f89574c003f34931a776f1213874a675: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 12:25:54.517521 23458 tablet_bootstrap.cc:492] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675: Bootstrap starting.
I20260709 12:25:54.519886 23454 tablet_bootstrap.cc:492] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597: No bootstrap required, opened a new log
I20260709 12:25:54.520756 23454 ts_tablet_manager.cc:1403] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.004s
I20260709 12:25:54.523897 23454 raft_consensus.cc:359] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.524629 23458 tablet_bootstrap.cc:654] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.525701 23454 raft_consensus.cc:385] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.526146 23454 raft_consensus.cc:740] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.525223 23456 tablet_bootstrap.cc:492] T c5069ba21386475b9f811e03482f3859 P 1d6cace6e70d433b9c0eb3d0d514e3ee: No bootstrap required, opened a new log
I20260709 12:25:54.527663 23456 ts_tablet_manager.cc:1403] T c5069ba21386475b9f811e03482f3859 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.006s
I20260709 12:25:54.530110 23427 raft_consensus.cc:493] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.527006 23454 consensus_queue.cc:260] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.530714 23427 raft_consensus.cc:515] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.532975 23427 leader_election.cc:290] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f89574c003f34931a776f1213874a675 (127.9.131.66:39573), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:54.533835 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea03eeb5984676938e35a08ecffbba" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675" is_pre_election: true
I20260709 12:25:54.534318 23311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea03eeb5984676938e35a08ecffbba" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" is_pre_election: true
I20260709 12:25:54.535025 23311 raft_consensus.cc:2468] T f9ea03eeb5984676938e35a08ecffbba P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 0.
W20260709 12:25:54.535602 23126 leader_election.cc:343] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f89574c003f34931a776f1213874a675 (127.9.131.66:39573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.535670 23454 ts_tablet_manager.cc:1434] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 12:25:54.537424 23454 tablet_bootstrap.cc:492] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597: Bootstrap starting.
I20260709 12:25:54.538779 23128 leader_election.cc:304] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, d08efaa729434ed4a7a396b571f4c597; no voters: f89574c003f34931a776f1213874a675
I20260709 12:25:54.540688 23427 raft_consensus.cc:2804] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:54.541083 23427 raft_consensus.cc:493] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.541427 23427 raft_consensus.cc:3060] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.542265 23456 raft_consensus.cc:359] T c5069ba21386475b9f811e03482f3859 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.543133 23456 raft_consensus.cc:385] T c5069ba21386475b9f811e03482f3859 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.543489 23456 raft_consensus.cc:740] T c5069ba21386475b9f811e03482f3859 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.544549 23456 consensus_queue.cc:260] T c5069ba21386475b9f811e03482f3859 P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.546075 23454 tablet_bootstrap.cc:654] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.546702 23458 tablet_bootstrap.cc:492] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675: No bootstrap required, opened a new log
I20260709 12:25:54.547343 23458 ts_tablet_manager.cc:1403] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.004s
I20260709 12:25:54.549762 23456 ts_tablet_manager.cc:1434] T c5069ba21386475b9f811e03482f3859 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:25:54.551010 23456 tablet_bootstrap.cc:492] T 22afdeda3e8a4f98be141363034871c8 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Bootstrap starting.
W20260709 12:25:54.552389 23332 debug-util.cc:398] Leaking SignalData structure 0x7b080036f360 after lost signal to thread 9744
W20260709 12:25:54.554761 23332 debug-util.cc:398] Leaking SignalData structure 0x7b08001f2540 after lost signal to thread 23186
I20260709 12:25:54.550729 23458 raft_consensus.cc:359] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.555212 23458 raft_consensus.cc:385] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.555580 23458 raft_consensus.cc:740] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.556559 23458 consensus_queue.cc:260] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.560103 23456 tablet_bootstrap.cc:654] T 22afdeda3e8a4f98be141363034871c8 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:54.564183 23332 debug-util.cc:398] Leaking SignalData structure 0x7b08003954a0 after lost signal to thread 23261
W20260709 12:25:54.565763 23332 debug-util.cc:398] Leaking SignalData structure 0x7b0800109100 after lost signal to thread 23335
I20260709 12:25:54.559474 23458 ts_tablet_manager.cc:1434] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:25:54.572086 23456 tablet_bootstrap.cc:492] T 22afdeda3e8a4f98be141363034871c8 P 1d6cace6e70d433b9c0eb3d0d514e3ee: No bootstrap required, opened a new log
I20260709 12:25:54.572762 23456 ts_tablet_manager.cc:1403] T 22afdeda3e8a4f98be141363034871c8 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.013s
I20260709 12:25:54.573242 23458 tablet_bootstrap.cc:492] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675: Bootstrap starting.
I20260709 12:25:54.581264 23456 raft_consensus.cc:359] T 22afdeda3e8a4f98be141363034871c8 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.582293 23456 raft_consensus.cc:385] T 22afdeda3e8a4f98be141363034871c8 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.582679 23456 raft_consensus.cc:740] T 22afdeda3e8a4f98be141363034871c8 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.583637 23456 consensus_queue.cc:260] T 22afdeda3e8a4f98be141363034871c8 P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.581753 23458 tablet_bootstrap.cc:654] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.589375 23456 ts_tablet_manager.cc:1434] T 22afdeda3e8a4f98be141363034871c8 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:25:54.590588 23456 tablet_bootstrap.cc:492] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Bootstrap starting.
I20260709 12:25:54.595417 23442 raft_consensus.cc:493] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.596130 23442 raft_consensus.cc:515] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.598508 23442 leader_election.cc:290] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:54.598628 23456 tablet_bootstrap.cc:654] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.599876 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee16d300d1d47edb83146fd64599ac1" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597" is_pre_election: true
W20260709 12:25:54.602308 23202 leader_election.cc:343] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.603266 23311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee16d300d1d47edb83146fd64599ac1" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" is_pre_election: true
W20260709 12:25:54.604974 23203 leader_election.cc:343] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.605451 23203 leader_election.cc:304] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f89574c003f34931a776f1213874a675; no voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, d08efaa729434ed4a7a396b571f4c597
I20260709 12:25:54.606645 23442 raft_consensus.cc:2749] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.620604 23458 tablet_bootstrap.cc:492] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675: No bootstrap required, opened a new log
I20260709 12:25:54.621153 23458 ts_tablet_manager.cc:1403] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.002s
I20260709 12:25:54.621701 23441 raft_consensus.cc:493] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.622283 23441 raft_consensus.cc:515] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.624171 23458 raft_consensus.cc:359] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.624979 23458 raft_consensus.cc:385] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.625253 23458 raft_consensus.cc:740] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.626020 23458 consensus_queue.cc:260] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.627544 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8dd1f9f24249ff809ccce3a9a25811" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675" is_pre_election: true
I20260709 12:25:54.628356 23234 raft_consensus.cc:2468] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 0.
I20260709 12:25:54.629724 23275 leader_election.cc:304] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:54.625756 23427 raft_consensus.cc:515] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.632113 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8dd1f9f24249ff809ccce3a9a25811" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597" is_pre_election: true
W20260709 12:25:54.634058 23276 leader_election.cc:343] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.635486 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea03eeb5984676938e35a08ecffbba" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:54.644129 23310 raft_consensus.cc:3060] T f9ea03eeb5984676938e35a08ecffbba P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.645407 23474 raft_consensus.cc:2804] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:54.645964 23474 raft_consensus.cc:493] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.646313 23474 raft_consensus.cc:3060] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.649080 23454 tablet_bootstrap.cc:492] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597: No bootstrap required, opened a new log
I20260709 12:25:54.649520 23456 tablet_bootstrap.cc:492] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee: No bootstrap required, opened a new log
I20260709 12:25:54.649817 23454 ts_tablet_manager.cc:1403] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597: Time spent bootstrapping tablet: real 0.113s	user 0.023s	sys 0.049s
I20260709 12:25:54.650071 23456 ts_tablet_manager.cc:1403] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent bootstrapping tablet: real 0.060s	user 0.007s	sys 0.013s
I20260709 12:25:54.653468 23456 raft_consensus.cc:359] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.636742 23458 ts_tablet_manager.cc:1434] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:25:54.638835 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea03eeb5984676938e35a08ecffbba" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675"
I20260709 12:25:54.640034 23441 leader_election.cc:290] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), f89574c003f34931a776f1213874a675 (127.9.131.66:39573)
I20260709 12:25:54.636457 23427 leader_election.cc:290] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 election: Requested vote from peers f89574c003f34931a776f1213874a675 (127.9.131.66:39573), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:54.655503 23454 raft_consensus.cc:359] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.656304 23454 raft_consensus.cc:385] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:25:54.656457 23126 leader_election.cc:343] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f89574c003f34931a776f1213874a675 (127.9.131.66:39573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.654168 23456 raft_consensus.cc:385] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.657261 23456 raft_consensus.cc:740] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.658231 23456 consensus_queue.cc:260] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.663015 23458 tablet_bootstrap.cc:492] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675: Bootstrap starting.
I20260709 12:25:54.663797 23454 raft_consensus.cc:740] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.666666 23454 consensus_queue.cc:260] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.668213 23456 ts_tablet_manager.cc:1434] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 12:25:54.669507 23310 raft_consensus.cc:2468] T f9ea03eeb5984676938e35a08ecffbba P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 1.
I20260709 12:25:54.671747 23474 raft_consensus.cc:515] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.672995 23454 ts_tablet_manager.cc:1434] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:25:54.676405 23128 leader_election.cc:304] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, d08efaa729434ed4a7a396b571f4c597; no voters: f89574c003f34931a776f1213874a675
I20260709 12:25:54.676924 23454 tablet_bootstrap.cc:492] T dc1c17f0a66d425fb526791ee677b8f9 P d08efaa729434ed4a7a396b571f4c597: Bootstrap starting.
I20260709 12:25:54.677609 23427 raft_consensus.cc:2804] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.678135 23427 raft_consensus.cc:697] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 [term 1 LEADER]: Becoming Leader. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Running, Role: LEADER
I20260709 12:25:54.678278 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8dd1f9f24249ff809ccce3a9a25811" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:25:54.679023 23427 consensus_queue.cc:237] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
W20260709 12:25:54.679818 23276 leader_election.cc:343] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.684425 23454 tablet_bootstrap.cc:654] T dc1c17f0a66d425fb526791ee677b8f9 P d08efaa729434ed4a7a396b571f4c597: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.675063 23458 tablet_bootstrap.cc:654] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.684630 23456 tablet_bootstrap.cc:492] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee: Bootstrap starting.
I20260709 12:25:54.687530 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8dd1f9f24249ff809ccce3a9a25811" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675"
I20260709 12:25:54.688295 23234 raft_consensus.cc:3060] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.697450 23234 raft_consensus.cc:2468] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 1.
I20260709 12:25:54.697961 23454 tablet_bootstrap.cc:492] T dc1c17f0a66d425fb526791ee677b8f9 P d08efaa729434ed4a7a396b571f4c597: No bootstrap required, opened a new log
I20260709 12:25:54.698207 23456 tablet_bootstrap.cc:654] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.698833 23454 ts_tablet_manager.cc:1403] T dc1c17f0a66d425fb526791ee677b8f9 P d08efaa729434ed4a7a396b571f4c597: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.001s
I20260709 12:25:54.696045 23474 leader_election.cc:290] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), f89574c003f34931a776f1213874a675 (127.9.131.66:39573)
I20260709 12:25:54.699007 23275 leader_election.cc:304] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675; no voters: d08efaa729434ed4a7a396b571f4c597
I20260709 12:25:54.703085 23474 raft_consensus.cc:2804] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.704635 23474 raft_consensus.cc:697] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Becoming Leader. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Running, Role: LEADER
I20260709 12:25:54.705669 23474 consensus_queue.cc:237] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.712869 23058 catalog_manager.cc:5697] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 reported cstate change: term changed from 0 to 1, leader changed from <none> to d08efaa729434ed4a7a396b571f4c597 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "d08efaa729434ed4a7a396b571f4c597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.711835 23454 raft_consensus.cc:359] T dc1c17f0a66d425fb526791ee677b8f9 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.715688 23454 raft_consensus.cc:385] T dc1c17f0a66d425fb526791ee677b8f9 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.716323 23454 raft_consensus.cc:740] T dc1c17f0a66d425fb526791ee677b8f9 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.717849 23458 tablet_bootstrap.cc:492] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675: No bootstrap required, opened a new log
I20260709 12:25:54.718443 23458 ts_tablet_manager.cc:1403] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.009s
I20260709 12:25:54.718546 23456 tablet_bootstrap.cc:492] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee: No bootstrap required, opened a new log
I20260709 12:25:54.719146 23456 ts_tablet_manager.cc:1403] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent bootstrapping tablet: real 0.035s	user 0.004s	sys 0.011s
I20260709 12:25:54.722879 23456 raft_consensus.cc:359] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.717168 23454 consensus_queue.cc:260] T dc1c17f0a66d425fb526791ee677b8f9 P d08efaa729434ed4a7a396b571f4c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.724016 23456 raft_consensus.cc:385] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.724443 23456 raft_consensus.cc:740] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.725476 23456 consensus_queue.cc:260] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.728833 23456 ts_tablet_manager.cc:1434] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 12:25:54.730284 23456 tablet_bootstrap.cc:492] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Bootstrap starting.
I20260709 12:25:54.726118 23454 ts_tablet_manager.cc:1434] T dc1c17f0a66d425fb526791ee677b8f9 P d08efaa729434ed4a7a396b571f4c597: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:25:54.731267 23458 raft_consensus.cc:359] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.732136 23458 raft_consensus.cc:385] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.732477 23458 raft_consensus.cc:740] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.733239 23458 consensus_queue.cc:260] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.732008 23454 tablet_bootstrap.cc:492] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597: Bootstrap starting.
I20260709 12:25:54.738313 23458 ts_tablet_manager.cc:1434] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:25:54.739535 23458 tablet_bootstrap.cc:492] T a419a938289f4c16abab61929f5d6914 P f89574c003f34931a776f1213874a675: Bootstrap starting.
I20260709 12:25:54.741993 23456 tablet_bootstrap.cc:654] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.742586 23442 raft_consensus.cc:493] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.743151 23442 raft_consensus.cc:515] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.744287 23454 tablet_bootstrap.cc:654] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.747364 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26af7ad3266a463a97cd0546dd3ddc2c" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" is_pre_election: true
I20260709 12:25:54.752671 23442 leader_election.cc:290] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:54.753865 23456 tablet_bootstrap.cc:492] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee: No bootstrap required, opened a new log
I20260709 12:25:54.754483 23456 ts_tablet_manager.cc:1403] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.000s
I20260709 12:25:54.755625 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26af7ad3266a463a97cd0546dd3ddc2c" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597" is_pre_election: true
W20260709 12:25:54.753415 23203 leader_election.cc:343] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:54.757788 23202 leader_election.cc:343] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.758386 23202 leader_election.cc:304] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f89574c003f34931a776f1213874a675; no voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, d08efaa729434ed4a7a396b571f4c597
I20260709 12:25:54.738818 23060 catalog_manager.cc:5697] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:54.762266 23474 raft_consensus.cc:493] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.763036 23442 raft_consensus.cc:2749] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.762852 23474 raft_consensus.cc:515] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.757743 23456 raft_consensus.cc:359] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.764710 23456 raft_consensus.cc:385] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.765003 23456 raft_consensus.cc:740] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.765899 23474 leader_election.cc:290] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), f89574c003f34931a776f1213874a675 (127.9.131.66:39573)
I20260709 12:25:54.765678 23456 consensus_queue.cc:260] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.751613 23458 tablet_bootstrap.cc:654] T a419a938289f4c16abab61929f5d6914 P f89574c003f34931a776f1213874a675: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.770077 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1c17f0a66d425fb526791ee677b8f9" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675" is_pre_election: true
I20260709 12:25:54.771477 23456 ts_tablet_manager.cc:1434] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
W20260709 12:25:54.772217 23275 leader_election.cc:343] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f89574c003f34931a776f1213874a675 (127.9.131.66:39573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.772585 23456 tablet_bootstrap.cc:492] T 26af7ad3266a463a97cd0546dd3ddc2c P 1d6cace6e70d433b9c0eb3d0d514e3ee: Bootstrap starting.
I20260709 12:25:54.773307 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1c17f0a66d425fb526791ee677b8f9" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597" is_pre_election: true
I20260709 12:25:54.774051 23161 raft_consensus.cc:2468] T dc1c17f0a66d425fb526791ee677b8f9 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 0.
I20260709 12:25:54.775435 23276 leader_election.cc:304] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, d08efaa729434ed4a7a396b571f4c597; no voters: f89574c003f34931a776f1213874a675
I20260709 12:25:54.776700 23474 raft_consensus.cc:2804] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:54.777127 23474 raft_consensus.cc:493] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.777536 23474 raft_consensus.cc:3060] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.778477 23457 raft_consensus.cc:493] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.779032 23457 raft_consensus.cc:515] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.781394 23457 leader_election.cc:290] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:54.784016 23456 tablet_bootstrap.cc:654] T 26af7ad3266a463a97cd0546dd3ddc2c P 1d6cace6e70d433b9c0eb3d0d514e3ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.784446 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5069ba21386475b9f811e03482f3859" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597" is_pre_election: true
I20260709 12:25:54.783922 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5069ba21386475b9f811e03482f3859" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" is_pre_election: true
W20260709 12:25:54.785902 23202 leader_election.cc:343] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.787333 23310 raft_consensus.cc:2468] T c5069ba21386475b9f811e03482f3859 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 0.
I20260709 12:25:54.788753 23203 leader_election.cc:304] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675; no voters: d08efaa729434ed4a7a396b571f4c597
I20260709 12:25:54.790560 23457 raft_consensus.cc:2804] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:54.790961 23457 raft_consensus.cc:493] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.791581 23457 raft_consensus.cc:3060] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.792094 23474 raft_consensus.cc:515] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.796010 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1c17f0a66d425fb526791ee677b8f9" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:25:54.796643 23161 raft_consensus.cc:3060] T dc1c17f0a66d425fb526791ee677b8f9 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.810153 23457 raft_consensus.cc:515] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.813868 23474 leader_election.cc:290] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), f89574c003f34931a776f1213874a675 (127.9.131.66:39573)
I20260709 12:25:54.814266 23454 tablet_bootstrap.cc:492] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597: No bootstrap required, opened a new log
I20260709 12:25:54.814778 23454 ts_tablet_manager.cc:1403] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597: Time spent bootstrapping tablet: real 0.083s	user 0.014s	sys 0.015s
I20260709 12:25:54.815716 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1c17f0a66d425fb526791ee677b8f9" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675"
W20260709 12:25:54.817416 23275 leader_election.cc:343] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f89574c003f34931a776f1213874a675 (127.9.131.66:39573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.823957 23162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5069ba21386475b9f811e03482f3859" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:25:54.824946 23442 raft_consensus.cc:493] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.823957 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5069ba21386475b9f811e03482f3859" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:54.825472 23442 raft_consensus.cc:515] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.826249 23310 raft_consensus.cc:3060] T c5069ba21386475b9f811e03482f3859 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:54.826719 23202 leader_election.cc:343] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.827651 23442 leader_election.cc:290] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:54.828792 23162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22afdeda3e8a4f98be141363034871c8" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597" is_pre_election: true
I20260709 12:25:54.829370 23311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22afdeda3e8a4f98be141363034871c8" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" is_pre_election: true
I20260709 12:25:54.830042 23311 raft_consensus.cc:2468] T 22afdeda3e8a4f98be141363034871c8 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 0.
I20260709 12:25:54.831333 23203 leader_election.cc:304] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675; no voters: 
W20260709 12:25:54.832446 23202 leader_election.cc:343] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.833344 23442 raft_consensus.cc:2804] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:54.833824 23310 raft_consensus.cc:2468] T c5069ba21386475b9f811e03482f3859 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 1.
I20260709 12:25:54.833770 23442 raft_consensus.cc:493] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.835395 23442 raft_consensus.cc:3060] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.835587 23203 leader_election.cc:304] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675; no voters: d08efaa729434ed4a7a396b571f4c597
I20260709 12:25:54.824070 23457 leader_election.cc:290] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:54.843178 23457 raft_consensus.cc:2804] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.844354 23457 raft_consensus.cc:697] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Becoming Leader. State: Replica: f89574c003f34931a776f1213874a675, State: Running, Role: LEADER
I20260709 12:25:54.845329 23457 consensus_queue.cc:237] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.844224 23161 raft_consensus.cc:2468] T dc1c17f0a66d425fb526791ee677b8f9 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 1.
I20260709 12:25:54.849589 23276 leader_election.cc:304] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, d08efaa729434ed4a7a396b571f4c597; no voters: f89574c003f34931a776f1213874a675
I20260709 12:25:54.850687 23474 raft_consensus.cc:2804] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.850878 23427 raft_consensus.cc:493] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.851895 23427 raft_consensus.cc:515] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.852813 23456 tablet_bootstrap.cc:492] T 26af7ad3266a463a97cd0546dd3ddc2c P 1d6cace6e70d433b9c0eb3d0d514e3ee: No bootstrap required, opened a new log
I20260709 12:25:54.853281 23456 ts_tablet_manager.cc:1403] T 26af7ad3266a463a97cd0546dd3ddc2c P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.017s
I20260709 12:25:54.849642 23454 raft_consensus.cc:359] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.853853 23474 raft_consensus.cc:697] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Becoming Leader. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Running, Role: LEADER
I20260709 12:25:54.854792 23454 raft_consensus.cc:385] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.855255 23454 raft_consensus.cc:740] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.855557 23474 consensus_queue.cc:237] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.856437 23427 leader_election.cc:290] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f89574c003f34931a776f1213874a675 (127.9.131.66:39573), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:54.856029 23454 consensus_queue.cc:260] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.856261 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a419a938289f4c16abab61929f5d6914" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675" is_pre_election: true
W20260709 12:25:54.858312 23126 leader_election.cc:343] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f89574c003f34931a776f1213874a675 (127.9.131.66:39573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.859741 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a419a938289f4c16abab61929f5d6914" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" is_pre_election: true
I20260709 12:25:54.860476 23310 raft_consensus.cc:2468] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 0.
I20260709 12:25:54.861786 23128 leader_election.cc:304] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, d08efaa729434ed4a7a396b571f4c597; no voters: f89574c003f34931a776f1213874a675
I20260709 12:25:54.862136 23442 raft_consensus.cc:515] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.863534 23427 raft_consensus.cc:2804] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:54.863934 23427 raft_consensus.cc:493] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.864027 23454 ts_tablet_manager.cc:1434] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.001s
I20260709 12:25:54.864346 23427 raft_consensus.cc:3060] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.865459 23454 tablet_bootstrap.cc:492] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597: Bootstrap starting.
I20260709 12:25:54.871341 23462 raft_consensus.cc:493] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.871316 23456 raft_consensus.cc:359] T 26af7ad3266a463a97cd0546dd3ddc2c P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.872284 23462 raft_consensus.cc:515] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.872956 23456 raft_consensus.cc:385] T 26af7ad3266a463a97cd0546dd3ddc2c P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.873310 23456 raft_consensus.cc:740] T 26af7ad3266a463a97cd0546dd3ddc2c P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.874226 23456 consensus_queue.cc:260] T 26af7ad3266a463a97cd0546dd3ddc2c P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.874608 23462 leader_election.cc:290] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f89574c003f34931a776f1213874a675 (127.9.131.66:39573), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:54.876574 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26af7ad3266a463a97cd0546dd3ddc2c" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675" is_pre_election: true
I20260709 12:25:54.877527 23234 raft_consensus.cc:2468] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 0.
I20260709 12:25:54.877918 23458 tablet_bootstrap.cc:492] T a419a938289f4c16abab61929f5d6914 P f89574c003f34931a776f1213874a675: No bootstrap required, opened a new log
I20260709 12:25:54.878500 23458 ts_tablet_manager.cc:1403] T a419a938289f4c16abab61929f5d6914 P f89574c003f34931a776f1213874a675: Time spent bootstrapping tablet: real 0.139s	user 0.019s	sys 0.027s
I20260709 12:25:54.878959 23126 leader_election.cc:304] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d08efaa729434ed4a7a396b571f4c597, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:54.879738 23456 ts_tablet_manager.cc:1434] T 26af7ad3266a463a97cd0546dd3ddc2c P 1d6cace6e70d433b9c0eb3d0d514e3ee: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.002s
I20260709 12:25:54.879994 23462 raft_consensus.cc:2804] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:54.884227 23462 raft_consensus.cc:493] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.884704 23462 raft_consensus.cc:3060] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.876526 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26af7ad3266a463a97cd0546dd3ddc2c" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" is_pre_election: true
I20260709 12:25:54.885557 23310 raft_consensus.cc:2468] T 26af7ad3266a463a97cd0546dd3ddc2c P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 0.
I20260709 12:25:54.883618 23454 tablet_bootstrap.cc:654] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.893949 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22afdeda3e8a4f98be141363034871c8" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:25:54.896281 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22afdeda3e8a4f98be141363034871c8" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:54.897022 23310 raft_consensus.cc:3060] T 22afdeda3e8a4f98be141363034871c8 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.890268 23427 raft_consensus.cc:515] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.891407 23442 leader_election.cc:290] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:54.905387 23310 raft_consensus.cc:2468] T 22afdeda3e8a4f98be141363034871c8 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 1.
W20260709 12:25:54.908406 23202 leader_election.cc:343] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.910342 23311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a419a938289f4c16abab61929f5d6914" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:54.911188 23311 raft_consensus.cc:3060] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.897022 23059 catalog_manager.cc:5697] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 reported cstate change: term changed from 0 to 1, leader changed from <none> to f89574c003f34931a776f1213874a675 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "f89574c003f34931a776f1213874a675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.917922 23203 leader_election.cc:304] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675; no voters: d08efaa729434ed4a7a396b571f4c597
I20260709 12:25:54.924261 23442 raft_consensus.cc:2804] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.924983 23442 raft_consensus.cc:697] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Becoming Leader. State: Replica: f89574c003f34931a776f1213874a675, State: Running, Role: LEADER
I20260709 12:25:54.925966 23442 consensus_queue.cc:237] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.926383 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a419a938289f4c16abab61929f5d6914" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675"
I20260709 12:25:54.919274 23462 raft_consensus.cc:515] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.931953 23462 leader_election.cc:290] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 election: Requested vote from peers f89574c003f34931a776f1213874a675 (127.9.131.66:39573), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:54.932386 23474 raft_consensus.cc:493] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.932556 23462 raft_consensus.cc:493] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.907130 23427 leader_election.cc:290] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 election: Requested vote from peers f89574c003f34931a776f1213874a675 (127.9.131.66:39573), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:54.936028 23462 raft_consensus.cc:515] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.935966 23474 raft_consensus.cc:515] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.937829 23060 catalog_manager.cc:5697] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:54.944311 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25c8c3f8cd41439402cf6939bc7d9e" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597" is_pre_election: true
I20260709 12:25:54.945075 23161 raft_consensus.cc:2468] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 0.
I20260709 12:25:54.946185 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26af7ad3266a463a97cd0546dd3ddc2c" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:54.946759 23276 leader_election.cc:304] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, d08efaa729434ed4a7a396b571f4c597; no voters: 
I20260709 12:25:54.947625 23441 raft_consensus.cc:2804] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:54.948010 23441 raft_consensus.cc:493] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.946795 23310 raft_consensus.cc:3060] T 26af7ad3266a463a97cd0546dd3ddc2c P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.948357 23441 raft_consensus.cc:3060] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.950134 23474 leader_election.cc:290] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), f89574c003f34931a776f1213874a675 (127.9.131.66:39573)
I20260709 12:25:54.951385 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25c8c3f8cd41439402cf6939bc7d9e" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675" is_pre_election: true
I20260709 12:25:54.952196 23234 raft_consensus.cc:2468] T ca25c8c3f8cd41439402cf6939bc7d9e P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 0.
I20260709 12:25:54.957590 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26af7ad3266a463a97cd0546dd3ddc2c" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675"
I20260709 12:25:54.960059 23311 raft_consensus.cc:2468] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 1.
I20260709 12:25:54.958281 23234 raft_consensus.cc:3060] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.965673 23310 raft_consensus.cc:2468] T 26af7ad3266a463a97cd0546dd3ddc2c P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 1.
I20260709 12:25:54.967943 23128 leader_election.cc:304] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, d08efaa729434ed4a7a396b571f4c597; no voters: 
I20260709 12:25:54.969028 23458 raft_consensus.cc:359] T a419a938289f4c16abab61929f5d6914 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.969877 23458 raft_consensus.cc:385] T a419a938289f4c16abab61929f5d6914 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.970129 23494 raft_consensus.cc:2804] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.971338 23494 raft_consensus.cc:697] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [term 1 LEADER]: Becoming Leader. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Running, Role: LEADER
I20260709 12:25:54.972931 23234 raft_consensus.cc:2468] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 1.
I20260709 12:25:54.971936 23128 leader_election.cc:304] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, d08efaa729434ed4a7a396b571f4c597; no voters: 
I20260709 12:25:54.975677 23493 raft_consensus.cc:2804] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.970201 23458 raft_consensus.cc:740] T a419a938289f4c16abab61929f5d6914 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.977412 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25c8c3f8cd41439402cf6939bc7d9e" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" is_pre_election: true
I20260709 12:25:54.977643 23493 raft_consensus.cc:697] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [term 1 LEADER]: Becoming Leader. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Running, Role: LEADER
I20260709 12:25:54.977845 23441 raft_consensus.cc:515] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.979076 23310 raft_consensus.cc:2393] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d08efaa729434ed4a7a396b571f4c597 in current term 1: Already voted for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in this term.
I20260709 12:25:54.978735 23493 consensus_queue.cc:237] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.980063 23441 leader_election.cc:290] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), f89574c003f34931a776f1213874a675 (127.9.131.66:39573)
I20260709 12:25:54.981177 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25c8c3f8cd41439402cf6939bc7d9e" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:25:54.981456 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25c8c3f8cd41439402cf6939bc7d9e" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675"
I20260709 12:25:54.981876 23161 raft_consensus.cc:3060] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.982317 23234 raft_consensus.cc:3060] T ca25c8c3f8cd41439402cf6939bc7d9e P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:54.986177 23126 leader_election.cc:343] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f89574c003f34931a776f1213874a675 (127.9.131.66:39573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.973852 23462 leader_election.cc:290] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f89574c003f34931a776f1213874a675 (127.9.131.66:39573), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:54.972087 23454 tablet_bootstrap.cc:492] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597: No bootstrap required, opened a new log
I20260709 12:25:54.988687 23454 ts_tablet_manager.cc:1403] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597: Time spent bootstrapping tablet: real 0.123s	user 0.022s	sys 0.014s
I20260709 12:25:54.990267 23161 raft_consensus.cc:2468] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 1.
I20260709 12:25:54.991441 23234 raft_consensus.cc:2468] T ca25c8c3f8cd41439402cf6939bc7d9e P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 1.
I20260709 12:25:54.991626 23276 leader_election.cc:304] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, d08efaa729434ed4a7a396b571f4c597; no voters: 
I20260709 12:25:54.976967 23458 consensus_queue.cc:260] T a419a938289f4c16abab61929f5d6914 P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.992723 23441 raft_consensus.cc:2804] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.993980 23441 raft_consensus.cc:697] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Becoming Leader. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Running, Role: LEADER
I20260709 12:25:54.994501 23454 raft_consensus.cc:359] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.995225 23454 raft_consensus.cc:385] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.994880 23441 consensus_queue.cc:237] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.995487 23454 raft_consensus.cc:740] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.997133 23457 raft_consensus.cc:493] T a419a938289f4c16abab61929f5d6914 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.998605 23457 raft_consensus.cc:515] T a419a938289f4c16abab61929f5d6914 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:54.973189 23494 consensus_queue.cc:237] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.001430 23457 leader_election.cc:290] T a419a938289f4c16abab61929f5d6914 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:54.996783 23454 consensus_queue.cc:260] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.003995 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a419a938289f4c16abab61929f5d6914" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" is_pre_election: true
I20260709 12:25:55.005093 23310 raft_consensus.cc:2393] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f89574c003f34931a776f1213874a675 in current term 1: Already voted for candidate d08efaa729434ed4a7a396b571f4c597 in this term.
I20260709 12:25:55.007278 23454 ts_tablet_manager.cc:1434] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:25:55.009034 23454 tablet_bootstrap.cc:492] T 5a8dd1f9f24249ff809ccce3a9a25811 P d08efaa729434ed4a7a396b571f4c597: Bootstrap starting.
I20260709 12:25:54.997759 23458 ts_tablet_manager.cc:1434] T a419a938289f4c16abab61929f5d6914 P f89574c003f34931a776f1213874a675: Time spent starting tablet: real 0.119s	user 0.008s	sys 0.003s
I20260709 12:25:55.016669 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25c8c3f8cd41439402cf6939bc7d9e" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675" is_pre_election: true
I20260709 12:25:55.017843 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a419a938289f4c16abab61929f5d6914" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597" is_pre_election: true
I20260709 12:25:55.019423 23234 raft_consensus.cc:2393] T ca25c8c3f8cd41439402cf6939bc7d9e P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d08efaa729434ed4a7a396b571f4c597 in current term 1: Already voted for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in this term.
I20260709 12:25:55.019666 23202 leader_election.cc:304] T a419a938289f4c16abab61929f5d6914 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f89574c003f34931a776f1213874a675; no voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, d08efaa729434ed4a7a396b571f4c597
I20260709 12:25:55.021130 23457 raft_consensus.cc:3060] T a419a938289f4c16abab61929f5d6914 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.021517 23126 leader_election.cc:304] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d08efaa729434ed4a7a396b571f4c597; no voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675
I20260709 12:25:55.023748 23058 catalog_manager.cc:5697] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:55.027432 23427 raft_consensus.cc:2749] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.035447 23427 raft_consensus.cc:493] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.036075 23427 raft_consensus.cc:515] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.038298 23427 leader_election.cc:290] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f89574c003f34931a776f1213874a675 (127.9.131.66:39573), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:55.031602 23457 raft_consensus.cc:2749] T a419a938289f4c16abab61929f5d6914 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.039908 23454 tablet_bootstrap.cc:654] T 5a8dd1f9f24249ff809ccce3a9a25811 P d08efaa729434ed4a7a396b571f4c597: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.041880 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22afdeda3e8a4f98be141363034871c8" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675" is_pre_election: true
I20260709 12:25:55.042212 23060 catalog_manager.cc:5697] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 reported cstate change: term changed from 0 to 1, leader changed from <none> to f89574c003f34931a776f1213874a675 (127.9.131.66). New cstate: current_term: 1 leader_uuid: "f89574c003f34931a776f1213874a675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.048175 23458 tablet_bootstrap.cc:492] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675: Bootstrap starting.
I20260709 12:25:55.042466 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22afdeda3e8a4f98be141363034871c8" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" is_pre_election: true
I20260709 12:25:55.049454 23310 raft_consensus.cc:2393] T 22afdeda3e8a4f98be141363034871c8 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d08efaa729434ed4a7a396b571f4c597 in current term 1: Already voted for candidate f89574c003f34931a776f1213874a675 in this term.
I20260709 12:25:55.055722 23128 leader_election.cc:304] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d08efaa729434ed4a7a396b571f4c597; no voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675
I20260709 12:25:55.057468 23494 raft_consensus.cc:3060] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.071729 23494 raft_consensus.cc:2749] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.062893 23059 catalog_manager.cc:5697] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 reported cstate change: term changed from 0 to 1, leader changed from <none> to d08efaa729434ed4a7a396b571f4c597 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "d08efaa729434ed4a7a396b571f4c597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.076640 23458 tablet_bootstrap.cc:654] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.078670 23454 tablet_bootstrap.cc:492] T 5a8dd1f9f24249ff809ccce3a9a25811 P d08efaa729434ed4a7a396b571f4c597: No bootstrap required, opened a new log
I20260709 12:25:55.079329 23454 ts_tablet_manager.cc:1403] T 5a8dd1f9f24249ff809ccce3a9a25811 P d08efaa729434ed4a7a396b571f4c597: Time spent bootstrapping tablet: real 0.071s	user 0.020s	sys 0.003s
I20260709 12:25:55.089711 23058 catalog_manager.cc:5697] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 reported cstate change: term changed from 0 to 1, leader changed from <none> to d08efaa729434ed4a7a396b571f4c597 (127.9.131.65). New cstate: current_term: 1 leader_uuid: "d08efaa729434ed4a7a396b571f4c597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.083225 23454 raft_consensus.cc:359] T 5a8dd1f9f24249ff809ccce3a9a25811 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.091514 23454 raft_consensus.cc:385] T 5a8dd1f9f24249ff809ccce3a9a25811 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.092011 23454 raft_consensus.cc:740] T 5a8dd1f9f24249ff809ccce3a9a25811 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.093010 23454 consensus_queue.cc:260] T 5a8dd1f9f24249ff809ccce3a9a25811 P d08efaa729434ed4a7a396b571f4c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.104041 23454 ts_tablet_manager.cc:1434] T 5a8dd1f9f24249ff809ccce3a9a25811 P d08efaa729434ed4a7a396b571f4c597: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:25:55.106544 23454 tablet_bootstrap.cc:492] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597: Bootstrap starting.
I20260709 12:25:55.107159 23458 tablet_bootstrap.cc:492] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675: No bootstrap required, opened a new log
I20260709 12:25:55.107753 23458 ts_tablet_manager.cc:1403] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675: Time spent bootstrapping tablet: real 0.075s	user 0.021s	sys 0.015s
I20260709 12:25:55.111017 23458 raft_consensus.cc:359] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.111814 23458 raft_consensus.cc:385] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.112124 23458 raft_consensus.cc:740] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.112938 23458 consensus_queue.cc:260] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
W20260709 12:25:55.113605 23108 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:55.120379 23458 ts_tablet_manager.cc:1434] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:25:55.121562 23458 tablet_bootstrap.cc:492] T f9ea03eeb5984676938e35a08ecffbba P f89574c003f34931a776f1213874a675: Bootstrap starting.
I20260709 12:25:55.127579 23458 tablet_bootstrap.cc:654] T f9ea03eeb5984676938e35a08ecffbba P f89574c003f34931a776f1213874a675: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.129532 23454 tablet_bootstrap.cc:654] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.142011 23454 tablet_bootstrap.cc:492] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597: No bootstrap required, opened a new log
I20260709 12:25:55.142539 23454 ts_tablet_manager.cc:1403] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.000s
I20260709 12:25:55.143209 23458 tablet_bootstrap.cc:492] T f9ea03eeb5984676938e35a08ecffbba P f89574c003f34931a776f1213874a675: No bootstrap required, opened a new log
I20260709 12:25:55.143904 23458 ts_tablet_manager.cc:1403] T f9ea03eeb5984676938e35a08ecffbba P f89574c003f34931a776f1213874a675: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 12:25:55.145695 23454 raft_consensus.cc:359] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.146579 23454 raft_consensus.cc:385] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.146853 23454 raft_consensus.cc:740] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.147212 23458 raft_consensus.cc:359] T f9ea03eeb5984676938e35a08ecffbba P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.148032 23458 raft_consensus.cc:385] T f9ea03eeb5984676938e35a08ecffbba P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.147766 23454 consensus_queue.cc:260] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.148466 23458 raft_consensus.cc:740] T f9ea03eeb5984676938e35a08ecffbba P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.149458 23458 consensus_queue.cc:260] T f9ea03eeb5984676938e35a08ecffbba P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.150817 23454 ts_tablet_manager.cc:1434] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:55.152297 23454 tablet_bootstrap.cc:492] T 7ee16d300d1d47edb83146fd64599ac1 P d08efaa729434ed4a7a396b571f4c597: Bootstrap starting.
I20260709 12:25:55.158561 23454 tablet_bootstrap.cc:654] T 7ee16d300d1d47edb83146fd64599ac1 P d08efaa729434ed4a7a396b571f4c597: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.162467 23458 ts_tablet_manager.cc:1434] T f9ea03eeb5984676938e35a08ecffbba P f89574c003f34931a776f1213874a675: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.004s
I20260709 12:25:55.171926 23454 tablet_bootstrap.cc:492] T 7ee16d300d1d47edb83146fd64599ac1 P d08efaa729434ed4a7a396b571f4c597: No bootstrap required, opened a new log
I20260709 12:25:55.172519 23454 ts_tablet_manager.cc:1403] T 7ee16d300d1d47edb83146fd64599ac1 P d08efaa729434ed4a7a396b571f4c597: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.002s
I20260709 12:25:55.175810 23454 raft_consensus.cc:359] T 7ee16d300d1d47edb83146fd64599ac1 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.176499 23454 raft_consensus.cc:385] T 7ee16d300d1d47edb83146fd64599ac1 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.176786 23454 raft_consensus.cc:740] T 7ee16d300d1d47edb83146fd64599ac1 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.177374 23454 consensus_queue.cc:260] T 7ee16d300d1d47edb83146fd64599ac1 P d08efaa729434ed4a7a396b571f4c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.178989 23454 ts_tablet_manager.cc:1434] T 7ee16d300d1d47edb83146fd64599ac1 P d08efaa729434ed4a7a396b571f4c597: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:25:55.180363 23441 raft_consensus.cc:493] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.180896 23441 raft_consensus.cc:515] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.183136 23441 leader_election.cc:290] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), f89574c003f34931a776f1213874a675 (127.9.131.66:39573)
I20260709 12:25:55.183959 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee16d300d1d47edb83146fd64599ac1" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597" is_pre_election: true
I20260709 12:25:55.184710 23161 raft_consensus.cc:2468] T 7ee16d300d1d47edb83146fd64599ac1 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 0.
I20260709 12:25:55.185046 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee16d300d1d47edb83146fd64599ac1" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675" is_pre_election: true
I20260709 12:25:55.186079 23234 raft_consensus.cc:2468] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 0.
I20260709 12:25:55.186306 23276 leader_election.cc:304] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, d08efaa729434ed4a7a396b571f4c597; no voters: 
I20260709 12:25:55.187871 23441 raft_consensus.cc:2804] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:55.188237 23441 raft_consensus.cc:493] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.188555 23441 raft_consensus.cc:3060] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.198802 23441 raft_consensus.cc:515] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.199560 23457 raft_consensus.cc:493] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.200166 23457 raft_consensus.cc:515] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.202380 23457 leader_election.cc:290] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:55.201680 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee16d300d1d47edb83146fd64599ac1" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:25:55.204494 23161 raft_consensus.cc:3060] T 7ee16d300d1d47edb83146fd64599ac1 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.210389 23162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1c17f0a66d425fb526791ee677b8f9" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d08efaa729434ed4a7a396b571f4c597" is_pre_election: true
I20260709 12:25:55.211534 23162 raft_consensus.cc:2393] T dc1c17f0a66d425fb526791ee677b8f9 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f89574c003f34931a776f1213874a675 in current term 1: Already voted for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in this term.
I20260709 12:25:55.204602 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1c17f0a66d425fb526791ee677b8f9" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" is_pre_election: true
I20260709 12:25:55.212477 23161 raft_consensus.cc:2468] T 7ee16d300d1d47edb83146fd64599ac1 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 1.
I20260709 12:25:55.213812 23276 leader_election.cc:304] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, d08efaa729434ed4a7a396b571f4c597; no voters: 
I20260709 12:25:55.213991 23202 leader_election.cc:304] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f89574c003f34931a776f1213874a675; no voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, d08efaa729434ed4a7a396b571f4c597
I20260709 12:25:55.214823 23474 raft_consensus.cc:2804] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:55.214864 23457 raft_consensus.cc:3060] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.216090 23474 raft_consensus.cc:697] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Becoming Leader. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Running, Role: LEADER
I20260709 12:25:55.217016 23474 consensus_queue.cc:237] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.218855 23441 leader_election.cc:290] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 1 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), f89574c003f34931a776f1213874a675 (127.9.131.66:39573)
I20260709 12:25:55.220474 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee16d300d1d47edb83146fd64599ac1" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675"
I20260709 12:25:55.221405 23234 raft_consensus.cc:3060] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.230816 23457 raft_consensus.cc:2749] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.235699 23234 raft_consensus.cc:2468] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 1.
I20260709 12:25:55.240249 23457 consensus_queue.cc:1048] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.240046 23059 catalog_manager.cc:5697] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67). New cstate: current_term: 1 leader_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:55.250713 23494 consensus_queue.cc:1048] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:55.251639 23441 consensus_queue.cc:1048] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.271638 23235 raft_consensus.cc:3060] T f9ea03eeb5984676938e35a08ecffbba P f89574c003f34931a776f1213874a675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.282709 23162 raft_consensus.cc:3060] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.293576 23160 raft_consensus.cc:3060] T 5a8dd1f9f24249ff809ccce3a9a25811 P d08efaa729434ed4a7a396b571f4c597 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.309021 23441 consensus_queue.cc:1048] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.320212 23493 consensus_queue.cc:1048] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.322356 23504 consensus_queue.cc:1048] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.326581 23494 raft_consensus.cc:493] T 5a8dd1f9f24249ff809ccce3a9a25811 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.327270 23494 raft_consensus.cc:515] T 5a8dd1f9f24249ff809ccce3a9a25811 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.330147 23494 leader_election.cc:290] T 5a8dd1f9f24249ff809ccce3a9a25811 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f89574c003f34931a776f1213874a675 (127.9.131.66:39573), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:55.336241 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8dd1f9f24249ff809ccce3a9a25811" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89574c003f34931a776f1213874a675" is_pre_election: true
I20260709 12:25:55.345089 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8dd1f9f24249ff809ccce3a9a25811" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" is_pre_election: true
I20260709 12:25:55.354547 23486 consensus_queue.cc:1048] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.382748 23128 leader_election.cc:304] T 5a8dd1f9f24249ff809ccce3a9a25811 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d08efaa729434ed4a7a396b571f4c597; no voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675
I20260709 12:25:55.383795 23462 raft_consensus.cc:2749] T 5a8dd1f9f24249ff809ccce3a9a25811 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:55.415838 23462 consensus_queue.cc:1048] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.425519 23462 consensus_queue.cc:1048] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.442442 23237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22afdeda3e8a4f98be141363034871c8"
dest_uuid: "f89574c003f34931a776f1213874a675"
mode: GRACEFUL
new_leader_uuid: "d08efaa729434ed4a7a396b571f4c597"
 from {username='slave'} at 127.0.0.1:48854
I20260709 12:25:55.443323 23237 raft_consensus.cc:606] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Received request to transfer leadership to TS d08efaa729434ed4a7a396b571f4c597
I20260709 12:25:55.453408 23237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5069ba21386475b9f811e03482f3859"
dest_uuid: "f89574c003f34931a776f1213874a675"
mode: GRACEFUL
new_leader_uuid: "d08efaa729434ed4a7a396b571f4c597"
 from {username='slave'} at 127.0.0.1:48854
I20260709 12:25:55.454162 23237 raft_consensus.cc:606] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Received request to transfer leadership to TS d08efaa729434ed4a7a396b571f4c597
I20260709 12:25:55.469858 23441 consensus_queue.cc:1048] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:55.492240 23519 consensus_queue.cc:1048] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.502029 23457 consensus_queue.cc:1048] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.509389 23309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca25c8c3f8cd41439402cf6939bc7d9e"
dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
mode: GRACEFUL
new_leader_uuid: "d08efaa729434ed4a7a396b571f4c597"
 from {username='slave'} at 127.0.0.1:56920
I20260709 12:25:55.510147 23309 raft_consensus.cc:606] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Received request to transfer leadership to TS d08efaa729434ed4a7a396b571f4c597
I20260709 12:25:55.514882 23457 raft_consensus.cc:993] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675: : Instructing follower d08efaa729434ed4a7a396b571f4c597 to start an election
I20260709 12:25:55.515548 23442 raft_consensus.cc:1081] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Signalling peer d08efaa729434ed4a7a396b571f4c597 to start an election
I20260709 12:25:55.519974 23427 consensus_queue.cc:1048] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:55.520503 23494 consensus_queue.cc:1048] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:55.525825 23159 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5069ba21386475b9f811e03482f3859"
dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
 from {username='slave'} at 127.0.0.1:39924
I20260709 12:25:55.526647 23159 raft_consensus.cc:493] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:55.527081 23159 raft_consensus.cc:3060] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.533005 23309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ee16d300d1d47edb83146fd64599ac1"
dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
mode: GRACEFUL
new_leader_uuid: "f89574c003f34931a776f1213874a675"
 from {username='slave'} at 127.0.0.1:56920
I20260709 12:25:55.533831 23309 raft_consensus.cc:606] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Received request to transfer leadership to TS f89574c003f34931a776f1213874a675
I20260709 12:25:55.539724 23486 raft_consensus.cc:993] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675: : Instructing follower d08efaa729434ed4a7a396b571f4c597 to start an election
I20260709 12:25:55.540438 23486 raft_consensus.cc:1081] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Signalling peer d08efaa729434ed4a7a396b571f4c597 to start an election
I20260709 12:25:55.546450 23457 consensus_queue.cc:1048] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:55.565824 23162 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22afdeda3e8a4f98be141363034871c8"
dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
 from {username='slave'} at 127.0.0.1:39924
I20260709 12:25:55.566541 23162 raft_consensus.cc:493] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:55.566949 23162 raft_consensus.cc:3060] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.569715 23518 consensus_queue.cc:1048] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.571848 23159 raft_consensus.cc:515] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.576620 23159 leader_election.cc:290] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 2 election: Requested vote from peers f89574c003f34931a776f1213874a675 (127.9.131.66:39573), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:55.601078 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5069ba21386475b9f811e03482f3859" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f89574c003f34931a776f1213874a675"
I20260709 12:25:55.601946 23236 raft_consensus.cc:3055] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:55.602324 23236 raft_consensus.cc:740] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Running, Role: LEADER
I20260709 12:25:55.605805 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5069ba21386475b9f811e03482f3859" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:55.606505 23309 raft_consensus.cc:3060] T c5069ba21386475b9f811e03482f3859 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.593065 23159 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26af7ad3266a463a97cd0546dd3ddc2c"
dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
mode: GRACEFUL
new_leader_uuid: "f89574c003f34931a776f1213874a675"
 from {username='slave'} at 127.0.0.1:39942
I20260709 12:25:55.614085 23162 raft_consensus.cc:515] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.603327 23236 consensus_queue.cc:260] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.622921 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22afdeda3e8a4f98be141363034871c8" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:55.622416 23159 raft_consensus.cc:606] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [term 1 LEADER]: Received request to transfer leadership to TS f89574c003f34931a776f1213874a675
I20260709 12:25:55.631873 23310 raft_consensus.cc:3060] T 22afdeda3e8a4f98be141363034871c8 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.621129 23236 raft_consensus.cc:3060] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.624298 23237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22afdeda3e8a4f98be141363034871c8" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f89574c003f34931a776f1213874a675"
I20260709 12:25:55.634939 23237 raft_consensus.cc:3055] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:55.635440 23237 raft_consensus.cc:740] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Running, Role: LEADER
I20260709 12:25:55.638700 23237 consensus_queue.cc:260] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.628664 23162 leader_election.cc:290] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 2 election: Requested vote from peers f89574c003f34931a776f1213874a675 (127.9.131.66:39573), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:55.638648 23309 raft_consensus.cc:2468] T c5069ba21386475b9f811e03482f3859 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 2.
I20260709 12:25:55.646365 23311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a8dd1f9f24249ff809ccce3a9a25811"
dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
mode: GRACEFUL
new_leader_uuid: "f89574c003f34931a776f1213874a675"
 from {username='slave'} at 127.0.0.1:56920
I20260709 12:25:55.647141 23311 raft_consensus.cc:606] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Received request to transfer leadership to TS f89574c003f34931a776f1213874a675
I20260709 12:25:55.646430 23237 raft_consensus.cc:3060] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.654486 23307 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc1c17f0a66d425fb526791ee677b8f9"
dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
mode: GRACEFUL
new_leader_uuid: "f89574c003f34931a776f1213874a675"
 from {username='slave'} at 127.0.0.1:56920
I20260709 12:25:55.655187 23307 raft_consensus.cc:606] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Received request to transfer leadership to TS f89574c003f34931a776f1213874a675
I20260709 12:25:55.656778 23519 raft_consensus.cc:993] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee: : Instructing follower d08efaa729434ed4a7a396b571f4c597 to start an election
I20260709 12:25:55.657279 23519 raft_consensus.cc:1081] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Signalling peer d08efaa729434ed4a7a396b571f4c597 to start an election
I20260709 12:25:55.658994 23310 raft_consensus.cc:2468] T 22afdeda3e8a4f98be141363034871c8 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 2.
I20260709 12:25:55.659602 23237 raft_consensus.cc:2468] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 2.
I20260709 12:25:55.661516 23126 leader_election.cc:304] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d08efaa729434ed4a7a396b571f4c597, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:55.662325 23462 raft_consensus.cc:2804] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:55.662878 23462 raft_consensus.cc:697] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597 [term 2 LEADER]: Becoming Leader. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Running, Role: LEADER
I20260709 12:25:55.663815 23462 consensus_queue.cc:237] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.665082 23236 raft_consensus.cc:2468] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 2.
I20260709 12:25:55.665307 23160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a419a938289f4c16abab61929f5d6914"
dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
mode: GRACEFUL
new_leader_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
 from {username='slave'} at 127.0.0.1:39942
I20260709 12:25:55.666071 23160 raft_consensus.cc:606] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [term 1 LEADER]: Received request to transfer leadership to TS 1d6cace6e70d433b9c0eb3d0d514e3ee
I20260709 12:25:55.666527 23126 leader_election.cc:304] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d08efaa729434ed4a7a396b571f4c597, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:55.667486 23494 raft_consensus.cc:2804] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:55.668037 23494 raft_consensus.cc:697] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597 [term 2 LEADER]: Becoming Leader. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Running, Role: LEADER
I20260709 12:25:55.668967 23494 consensus_queue.cc:237] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.669474 23427 raft_consensus.cc:993] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597: : Instructing follower 1d6cace6e70d433b9c0eb3d0d514e3ee to start an election
I20260709 12:25:55.669588 23160 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca25c8c3f8cd41439402cf6939bc7d9e"
dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
 from {username='slave'} at 127.0.0.1:39930
I20260709 12:25:55.670111 23427 raft_consensus.cc:1081] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [term 1 LEADER]: Signalling peer 1d6cace6e70d433b9c0eb3d0d514e3ee to start an election
I20260709 12:25:55.670388 23160 raft_consensus.cc:493] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:55.671379 23160 raft_consensus.cc:3060] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.677599 23160 raft_consensus.cc:515] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.680526 23309 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a419a938289f4c16abab61929f5d6914"
dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
 from {username='slave'} at 127.0.0.1:56908
I20260709 12:25:55.681151 23309 raft_consensus.cc:493] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:55.681782 23309 raft_consensus.cc:3060] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.681027 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25c8c3f8cd41439402cf6939bc7d9e" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f89574c003f34931a776f1213874a675"
I20260709 12:25:55.682888 23236 raft_consensus.cc:3060] T ca25c8c3f8cd41439402cf6939bc7d9e P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.687254 23059 catalog_manager.cc:5697] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597 reported cstate change: term changed from 1 to 2, leader changed from f89574c003f34931a776f1213874a675 (127.9.131.66) to d08efaa729434ed4a7a396b571f4c597 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "d08efaa729434ed4a7a396b571f4c597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.689091 23059 catalog_manager.cc:5697] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597 reported cstate change: term changed from 1 to 2, leader changed from f89574c003f34931a776f1213874a675 (127.9.131.66) to d08efaa729434ed4a7a396b571f4c597 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "d08efaa729434ed4a7a396b571f4c597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.689456 23309 raft_consensus.cc:515] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.691488 23160 leader_election.cc:290] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 2 election: Requested vote from peers f89574c003f34931a776f1213874a675 (127.9.131.66:39573), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:55.692875 23237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a419a938289f4c16abab61929f5d6914" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f89574c003f34931a776f1213874a675"
I20260709 12:25:55.693588 23237 raft_consensus.cc:3060] T a419a938289f4c16abab61929f5d6914 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.697077 23236 raft_consensus.cc:2468] T ca25c8c3f8cd41439402cf6939bc7d9e P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 2.
I20260709 12:25:55.698465 23126 leader_election.cc:304] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d08efaa729434ed4a7a396b571f4c597, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:55.699342 23494 raft_consensus.cc:2804] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:55.699828 23494 raft_consensus.cc:697] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [term 2 LEADER]: Becoming Leader. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Running, Role: LEADER
I20260709 12:25:55.700690 23494 consensus_queue.cc:237] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.703092 23158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a419a938289f4c16abab61929f5d6914" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:25:55.703819 23158 raft_consensus.cc:3055] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:55.704146 23158 raft_consensus.cc:740] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Running, Role: LEADER
I20260709 12:25:55.704973 23158 consensus_queue.cc:260] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.705309 23518 consensus_queue.cc:1048] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:55.706135 23158 raft_consensus.cc:3060] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.706295 23237 raft_consensus.cc:2468] T a419a938289f4c16abab61929f5d6914 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 2.
I20260709 12:25:55.707563 23275 leader_election.cc:304] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:55.708156 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25c8c3f8cd41439402cf6939bc7d9e" candidate_uuid: "d08efaa729434ed4a7a396b571f4c597" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:55.708549 23518 raft_consensus.cc:2804] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:55.709292 23310 raft_consensus.cc:3055] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:55.709645 23310 raft_consensus.cc:740] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Running, Role: LEADER
I20260709 12:25:55.710000 23518 raft_consensus.cc:697] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 LEADER]: Becoming Leader. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Running, Role: LEADER
I20260709 12:25:55.710557 23310 consensus_queue.cc:260] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.711071 23518 consensus_queue.cc:237] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.708492 23309 leader_election.cc:290] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 2 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), f89574c003f34931a776f1213874a675 (127.9.131.66:39573)
I20260709 12:25:55.714438 23310 raft_consensus.cc:3060] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.722594 23060 catalog_manager.cc:5697] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee reported cstate change: term changed from 1 to 2, leader changed from d08efaa729434ed4a7a396b571f4c597 (127.9.131.65) to 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67). New cstate: current_term: 2 leader_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:55.725364 23158 raft_consensus.cc:2468] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 2.
I20260709 12:25:55.728391 23310 raft_consensus.cc:2468] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08efaa729434ed4a7a396b571f4c597 in term 2.
I20260709 12:25:55.728416 23059 catalog_manager.cc:5697] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 reported cstate change: term changed from 1 to 2, leader changed from 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67) to d08efaa729434ed4a7a396b571f4c597 (127.9.131.65). New cstate: current_term: 2 leader_uuid: "d08efaa729434ed4a7a396b571f4c597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.760762 23519 consensus_queue.cc:1048] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:55.763520 23474 raft_consensus.cc:993] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee: : Instructing follower f89574c003f34931a776f1213874a675 to start an election
I20260709 12:25:55.764017 23474 raft_consensus.cc:1081] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Signalling peer f89574c003f34931a776f1213874a675 to start an election
I20260709 12:25:55.766027 23237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a8dd1f9f24249ff809ccce3a9a25811"
dest_uuid: "f89574c003f34931a776f1213874a675"
 from {username='slave'} at 127.0.0.1:48838
I20260709 12:25:55.766613 23237 raft_consensus.cc:493] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:55.767014 23237 raft_consensus.cc:3060] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.774950 23237 raft_consensus.cc:515] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.778506 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8dd1f9f24249ff809ccce3a9a25811" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:55.779124 23310 raft_consensus.cc:3055] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:55.779452 23310 raft_consensus.cc:740] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Running, Role: LEADER
I20260709 12:25:55.780224 23310 consensus_queue.cc:260] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.781278 23310 raft_consensus.cc:3060] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.781770 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8dd1f9f24249ff809ccce3a9a25811" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:25:55.782434 23159 raft_consensus.cc:3060] T 5a8dd1f9f24249ff809ccce3a9a25811 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.788501 23310 raft_consensus.cc:2468] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 2.
I20260709 12:25:55.789829 23203 leader_election.cc:304] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:55.790122 23519 raft_consensus.cc:993] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee: : Instructing follower f89574c003f34931a776f1213874a675 to start an election
I20260709 12:25:55.790737 23519 raft_consensus.cc:1081] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Signalling peer f89574c003f34931a776f1213874a675 to start an election
I20260709 12:25:55.791734 23237 leader_election.cc:290] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 2 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:55.792881 23159 raft_consensus.cc:2468] T 5a8dd1f9f24249ff809ccce3a9a25811 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 2.
I20260709 12:25:55.790751 23457 raft_consensus.cc:2804] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:55.794651 23457 raft_consensus.cc:697] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675 [term 2 LEADER]: Becoming Leader. State: Replica: f89574c003f34931a776f1213874a675, State: Running, Role: LEADER
I20260709 12:25:55.795562 23457 consensus_queue.cc:237] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.796455 23237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ee16d300d1d47edb83146fd64599ac1"
dest_uuid: "f89574c003f34931a776f1213874a675"
 from {username='slave'} at 127.0.0.1:48838
I20260709 12:25:55.797097 23237 raft_consensus.cc:493] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:55.797662 23237 raft_consensus.cc:3060] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.805130 23060 catalog_manager.cc:5697] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675 reported cstate change: term changed from 1 to 2, leader changed from 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67) to f89574c003f34931a776f1213874a675 (127.9.131.66). New cstate: current_term: 2 leader_uuid: "f89574c003f34931a776f1213874a675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.807458 23237 raft_consensus.cc:515] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.809499 23237 leader_election.cc:290] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 2 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:55.811931 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee16d300d1d47edb83146fd64599ac1" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:55.812018 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee16d300d1d47edb83146fd64599ac1" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:25:55.812659 23310 raft_consensus.cc:3055] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:55.812887 23159 raft_consensus.cc:3060] T 7ee16d300d1d47edb83146fd64599ac1 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.813072 23310 raft_consensus.cc:740] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Running, Role: LEADER
I20260709 12:25:55.814365 23310 consensus_queue.cc:260] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.815888 23310 raft_consensus.cc:3060] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.821580 23159 raft_consensus.cc:2468] T 7ee16d300d1d47edb83146fd64599ac1 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 2.
I20260709 12:25:55.822396 23310 raft_consensus.cc:2468] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 2.
I20260709 12:25:55.822999 23202 leader_election.cc:304] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d08efaa729434ed4a7a396b571f4c597, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:55.823978 23457 raft_consensus.cc:2804] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:55.824419 23457 raft_consensus.cc:697] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [term 2 LEADER]: Becoming Leader. State: Replica: f89574c003f34931a776f1213874a675, State: Running, Role: LEADER
I20260709 12:25:55.825143 23457 consensus_queue.cc:237] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.833585 23060 catalog_manager.cc:5697] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 reported cstate change: term changed from 1 to 2, leader changed from 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67) to f89574c003f34931a776f1213874a675 (127.9.131.66). New cstate: current_term: 2 leader_uuid: "f89574c003f34931a776f1213874a675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.932684 23441 raft_consensus.cc:993] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee: : Instructing follower f89574c003f34931a776f1213874a675 to start an election
I20260709 12:25:55.933272 23441 raft_consensus.cc:1081] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Signalling peer f89574c003f34931a776f1213874a675 to start an election
I20260709 12:25:55.935753 23237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc1c17f0a66d425fb526791ee677b8f9"
dest_uuid: "f89574c003f34931a776f1213874a675"
 from {username='slave'} at 127.0.0.1:48838
I20260709 12:25:55.936455 23237 raft_consensus.cc:493] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:55.937391 23237 raft_consensus.cc:3060] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.945034 23237 raft_consensus.cc:515] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.947197 23237 leader_election.cc:290] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 2 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:55.948171 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1c17f0a66d425fb526791ee677b8f9" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:25:55.948545 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1c17f0a66d425fb526791ee677b8f9" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:55.948939 23159 raft_consensus.cc:3060] T dc1c17f0a66d425fb526791ee677b8f9 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.949118 23310 raft_consensus.cc:3055] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:55.949505 23310 raft_consensus.cc:740] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Running, Role: LEADER
I20260709 12:25:55.950300 23310 consensus_queue.cc:260] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.951543 23310 raft_consensus.cc:3060] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.956947 23159 raft_consensus.cc:2468] T dc1c17f0a66d425fb526791ee677b8f9 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 2.
I20260709 12:25:55.958588 23310 raft_consensus.cc:2468] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 2.
I20260709 12:25:55.958720 23202 leader_election.cc:304] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d08efaa729434ed4a7a396b571f4c597, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:55.959762 23457 raft_consensus.cc:2804] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:55.960309 23457 raft_consensus.cc:697] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675 [term 2 LEADER]: Becoming Leader. State: Replica: f89574c003f34931a776f1213874a675, State: Running, Role: LEADER
I20260709 12:25:55.961073 23457 consensus_queue.cc:237] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:55.968878 23060 catalog_manager.cc:5697] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675 reported cstate change: term changed from 1 to 2, leader changed from 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67) to f89574c003f34931a776f1213874a675 (127.9.131.66). New cstate: current_term: 2 leader_uuid: "f89574c003f34931a776f1213874a675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:56.048324 23310 raft_consensus.cc:1275] T 22afdeda3e8a4f98be141363034871c8 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Refusing update from remote peer d08efaa729434ed4a7a396b571f4c597: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.050109 23427 consensus_queue.cc:1048] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.051992 23427 raft_consensus.cc:993] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597: : Instructing follower f89574c003f34931a776f1213874a675 to start an election
I20260709 12:25:56.052510 23492 raft_consensus.cc:1081] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [term 1 LEADER]: Signalling peer f89574c003f34931a776f1213874a675 to start an election
I20260709 12:25:56.054385 23237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26af7ad3266a463a97cd0546dd3ddc2c"
dest_uuid: "f89574c003f34931a776f1213874a675"
 from {username='slave'} at 127.0.0.1:48844
I20260709 12:25:56.055063 23237 raft_consensus.cc:493] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:56.055464 23237 raft_consensus.cc:3060] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:56.060688 23236 raft_consensus.cc:1275] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Refusing update from remote peer d08efaa729434ed4a7a396b571f4c597: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.062968 23462 consensus_queue.cc:1048] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.076943 23237 raft_consensus.cc:515] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:56.077944 23236 raft_consensus.cc:1275] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Refusing update from remote peer d08efaa729434ed4a7a396b571f4c597: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.079216 23237 leader_election.cc:290] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 2 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67:33057)
I20260709 12:25:56.080303 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26af7ad3266a463a97cd0546dd3ddc2c" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:25:56.080801 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26af7ad3266a463a97cd0546dd3ddc2c" candidate_uuid: "f89574c003f34931a776f1213874a675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
I20260709 12:25:56.080979 23159 raft_consensus.cc:3055] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:56.081383 23310 raft_consensus.cc:3060] T 26af7ad3266a463a97cd0546dd3ddc2c P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:56.081404 23159 raft_consensus.cc:740] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Running, Role: LEADER
I20260709 12:25:56.082492 23159 consensus_queue.cc:260] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:56.083644 23159 raft_consensus.cc:3060] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:56.079743 23427 consensus_queue.cc:1048] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:25:56.092096 23310 raft_consensus.cc:2468] T 26af7ad3266a463a97cd0546dd3ddc2c P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 2.
I20260709 12:25:56.093138 23159 raft_consensus.cc:2468] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f89574c003f34931a776f1213874a675 in term 2.
I20260709 12:25:56.093523 23203 leader_election.cc:304] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:56.094597 23457 raft_consensus.cc:2804] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:56.095065 23457 raft_consensus.cc:697] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [term 2 LEADER]: Becoming Leader. State: Replica: f89574c003f34931a776f1213874a675, State: Running, Role: LEADER
I20260709 12:25:56.095921 23457 consensus_queue.cc:237] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:56.103928 23309 raft_consensus.cc:1275] T c5069ba21386475b9f811e03482f3859 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Refusing update from remote peer d08efaa729434ed4a7a396b571f4c597: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.105629 23492 consensus_queue.cc:1048] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.110162 23059 catalog_manager.cc:5697] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 reported cstate change: term changed from 1 to 2, leader changed from d08efaa729434ed4a7a396b571f4c597 (127.9.131.65) to f89574c003f34931a776f1213874a675 (127.9.131.66). New cstate: current_term: 2 leader_uuid: "f89574c003f34931a776f1213874a675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:56.163007 23309 raft_consensus.cc:1275] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Refusing update from remote peer d08efaa729434ed4a7a396b571f4c597: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.164546 23462 consensus_queue.cc:1048] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.174106 23237 raft_consensus.cc:1275] T ca25c8c3f8cd41439402cf6939bc7d9e P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Refusing update from remote peer d08efaa729434ed4a7a396b571f4c597: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.175488 23492 consensus_queue.cc:1048] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.223064 23159 raft_consensus.cc:1275] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Refusing update from remote peer 1d6cace6e70d433b9c0eb3d0d514e3ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.224340 23518 consensus_queue.cc:1048] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.232736 23236 raft_consensus.cc:1275] T a419a938289f4c16abab61929f5d6914 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Refusing update from remote peer 1d6cace6e70d433b9c0eb3d0d514e3ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.234509 23519 consensus_queue.cc:1048] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.343639 23159 raft_consensus.cc:1275] T 7ee16d300d1d47edb83146fd64599ac1 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Refusing update from remote peer f89574c003f34931a776f1213874a675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.345309 23457 consensus_queue.cc:1048] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.348914 23159 raft_consensus.cc:1275] T 5a8dd1f9f24249ff809ccce3a9a25811 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Refusing update from remote peer f89574c003f34931a776f1213874a675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.350405 23309 raft_consensus.cc:1275] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Refusing update from remote peer f89574c003f34931a776f1213874a675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.352715 23486 consensus_queue.cc:1048] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.352859 23457 consensus_queue.cc:1048] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.383509 23309 raft_consensus.cc:1275] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Refusing update from remote peer f89574c003f34931a776f1213874a675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.385548 23457 consensus_queue.cc:1048] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.434392 23159 raft_consensus.cc:1275] T dc1c17f0a66d425fb526791ee677b8f9 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Refusing update from remote peer f89574c003f34931a776f1213874a675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.436015 23457 consensus_queue.cc:1048] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.447001 23309 raft_consensus.cc:1275] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Refusing update from remote peer f89574c003f34931a776f1213874a675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.448308 23457 consensus_queue.cc:1048] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.602839 23309 raft_consensus.cc:1275] T 26af7ad3266a463a97cd0546dd3ddc2c P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Refusing update from remote peer f89574c003f34931a776f1213874a675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.604398 23457 consensus_queue.cc:1048] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.614332 23159 raft_consensus.cc:1275] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Refusing update from remote peer f89574c003f34931a776f1213874a675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.620550 23457 consensus_queue.cc:1048] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:58.670047 23060 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52900:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:25:58.689584 23060 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52900:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:25:58.828665  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:58.916805 23574 log.cc:927] Time spent T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:25:59.005107 23582 tablet.cc:1724] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:59.014446 23585 log.cc:927] Time spent T c5069ba21386475b9f811e03482f3859 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:25:58.932550 23575 tablet.cc:1724] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:59.002784 23587 tablet.cc:1724] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:59.034919 23596 tablet.cc:1724] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:59.121932 23597 tablet.cc:1724] T f9ea03eeb5984676938e35a08ecffbba P f89574c003f34931a776f1213874a675: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:59.100241 23592 tablet.cc:1724] T 7ee16d300d1d47edb83146fd64599ac1 P d08efaa729434ed4a7a396b571f4c597: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:59.136495 23607 tablet.cc:1724] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:59.139056 23606 tablet.cc:1724] T ca25c8c3f8cd41439402cf6939bc7d9e P f89574c003f34931a776f1213874a675: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:59.167999 23575 tablet.cc:1724] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:59.172137 23126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.131.66:39573, user_credentials={real_user=slave}} blocked reactor thread for 51996.4us
I20260709 12:25:59.193239 23606 tablet.cc:1724] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:59.191474 23596 tablet.cc:1724] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:59.208489 23607 tablet.cc:1724] T 22afdeda3e8a4f98be141363034871c8 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:59.213593 23609 tablet.cc:1724] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:59.222498 23608 tablet.cc:1724] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:59.235540 23611 tablet.cc:1724] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:59.235682 23612 tablet.cc:1724] T c5069ba21386475b9f811e03482f3859 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:59.423558 23588 log.cc:927] Time spent T a419a938289f4c16abab61929f5d6914 P f89574c003f34931a776f1213874a675: Append to log took a long time: real 0.443s	user 0.005s	sys 0.000s
W20260709 12:25:59.576314 23607 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.365s	user 0.001s	sys 0.000s
I20260709 12:25:59.609534 23607 tablet.cc:1724] T 26af7ad3266a463a97cd0546dd3ddc2c P 1d6cace6e70d433b9c0eb3d0d514e3ee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:59.611821 23611 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.373s	user 0.001s	sys 0.000s
I20260709 12:25:59.616113 23596 tablet.cc:1724] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:59.618868 23592 tablet.cc:1724] T 5a8dd1f9f24249ff809ccce3a9a25811 P d08efaa729434ed4a7a396b571f4c597: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:59.622004 23612 tablet.cc:1724] T f9ea03eeb5984676938e35a08ecffbba P 1d6cace6e70d433b9c0eb3d0d514e3ee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:59.626046 23575 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.422s	user 0.009s	sys 0.000s
I20260709 12:25:59.662945 23596 tablet.cc:1724] T a419a938289f4c16abab61929f5d6914 P f89574c003f34931a776f1213874a675: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:59.672566 23158 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fc33df488b3440f9bb491ec0af24c37"
dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
mode: GRACEFUL
new_leader_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
 from {username='slave'} at 127.0.0.1:45514
W20260709 12:25:59.673955 23608 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.447s	user 0.000s	sys 0.000s
I20260709 12:25:59.674430 23158 raft_consensus.cc:606] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [term 2 LEADER]: Received request to transfer leadership to TS 1d6cace6e70d433b9c0eb3d0d514e3ee
I20260709 12:25:59.674079 23606 tablet.cc:1724] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:59.676028 23612 tablet.cc:1724] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:59.678355 23607 tablet.cc:1724] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:59.684095 23609 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.463s	user 0.000s	sys 0.000s
I20260709 12:25:59.686522 23575 tablet.cc:1724] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:59.700750 23309 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.015s	sys 0.009s
W20260709 12:25:59.701186 23309 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.016s	sys 0.010s
I20260709 12:25:59.708616 23592 tablet.cc:1724] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:59.699186 23162 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.007s	sys 0.042s
W20260709 12:25:59.714620 23162 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.007s	sys 0.042s
I20260709 12:25:59.743111 23579 raft_consensus.cc:993] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597: : Instructing follower 1d6cace6e70d433b9c0eb3d0d514e3ee to start an election
I20260709 12:25:59.743647 23579 raft_consensus.cc:1081] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [term 2 LEADER]: Signalling peer 1d6cace6e70d433b9c0eb3d0d514e3ee to start an election
I20260709 12:25:59.749341 23608 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:39908 (request call id 20) took 1045 ms. Trace:
I20260709 12:25:59.752168 23306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fc33df488b3440f9bb491ec0af24c37"
dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
 from {username='slave'} at 127.0.0.1:56908
I20260709 12:25:59.754559 23306 raft_consensus.cc:493] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:59.756011 23575 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:39908 (request call id 21) took 1052 ms. Trace:
I20260709 12:25:59.760188 23575 rpcz_store.cc:276] 0709 12:25:58.703906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.704740 (+   834us) service_pool.cc:224] Handling call
0709 12:25:59.755909 (+1051169us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:58.719460 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0709 12:25:58.720051 (+   591us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0709 12:25:58.720083 (+    32us) alter_schema_op.cc:66] Acquired schema lock
0709 12:25:58.720128 (+    45us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0709 12:25:58.720250 (+   122us) alter_schema_op.cc:128] START. Timestamp: 1783599958720179
0709 12:25:58.720282 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:25:58.720991 (+   709us) log.cc:844] Serialized 204 byte log entry
0709 12:25:58.791175 (+ 70184us) spinlock_profiling.cc:243] Waited 8.63 ms on lock 0x7b180005c740. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade73522 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:25:58.823281 (+ 32106us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b180005c740. stack: 00007f9bade41343 00007f9bade41240 00007f9bad7d01d4 00007f9bb750e304 00007f9bb750e299 00007f9bb6d3bab1 00007f9bb6d48281 00007f9bade73557 00007f9bade757c1 00007f9bade75779 00007f9bade75709 00007f9bade756d1 00007f9bade749cd 0000000000388634 0000000000388479 00007f9bade5683a
0709 12:25:59.682466 (+859185us) op_driver.cc:464] REPLICATION: finished
0709 12:25:59.686395 (+  3929us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0709 12:25:59.688246 (+  1851us) log.cc:844] Serialized 5 byte log entry
0709 12:25:59.754289 (+ 66043us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:59.754995 (+   706us) log.cc:844] Serialized 14 byte log entry
0709 12:25:59.755717 (+   722us) alter_schema_op.cc:73] Released schema lock
0709 12:25:59.755757 (+    40us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":3680,"prepare.queue_time_us":13656,"prepare.run_cpu_time_us":46151,"prepare.run_wall_time_us":61404,"raft.queue_time_us":1471,"raft.run_cpu_time_us":2278,"raft.run_wall_time_us":2279,"replication_time_us":962048,"spinlock_wait_cycles":24352512,"thread_start_us":64374,"threads_started":2,"wal-append.queue_time_us":65842}]]}
I20260709 12:25:59.764606 23575 tablet.cc:1724] T dc1c17f0a66d425fb526791ee677b8f9 P d08efaa729434ed4a7a396b571f4c597: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:59.752156 23608 rpcz_store.cc:276] 0709 12:25:58.703497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.704076 (+   579us) service_pool.cc:224] Handling call
0709 12:25:59.749234 (+1045158us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:58.723237 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0709 12:25:58.723872 (+   635us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0709 12:25:58.723913 (+    41us) alter_schema_op.cc:66] Acquired schema lock
0709 12:25:58.723960 (+    47us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0709 12:25:58.724086 (+   126us) alter_schema_op.cc:128] START. Timestamp: 1783599958724018
0709 12:25:58.724109 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:25:58.760487 (+ 36378us) log.cc:844] Serialized 204 byte log entry
0709 12:25:59.177541 (+417054us) op_driver.cc:464] REPLICATION: finished
0709 12:25:59.198695 (+ 21154us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0709 12:25:59.226932 (+ 28237us) log.cc:844] Serialized 5 byte log entry
0709 12:25:59.694877 (+467945us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:59.735364 (+ 40487us) log.cc:844] Serialized 14 byte log entry
0709 12:25:59.749094 (+ 13730us) alter_schema_op.cc:73] Released schema lock
0709 12:25:59.749133 (+    39us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":10045,"prepare.queue_time_us":11301,"prepare.run_cpu_time_us":34938,"prepare.run_wall_time_us":131221,"raft.queue_time_us":78985,"raft.run_cpu_time_us":3178,"raft.run_wall_time_us":83172,"replication_time_us":453301,"thread_start_us":83508,"threads_started":3,"wal-append.queue_time_us":48899}]]}
I20260709 12:25:59.765883 23306 raft_consensus.cc:3060] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:59.796656 23306 raft_consensus.cc:515] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:59.799950 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc33df488b3440f9bb491ec0af24c37" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:25:59.800618 23159 raft_consensus.cc:3055] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:59.800868 23306 leader_election.cc:290] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 3 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), f89574c003f34931a776f1213874a675 (127.9.131.66:39573)
I20260709 12:25:59.801365 23237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc408da3258243a69dec87746d508e0b"
dest_uuid: "f89574c003f34931a776f1213874a675"
mode: GRACEFUL
new_leader_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:59.801991 23237 raft_consensus.cc:606] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [term 2 LEADER]: Received request to transfer leadership to TS 1d6cace6e70d433b9c0eb3d0d514e3ee
I20260709 12:25:59.802209 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc33df488b3440f9bb491ec0af24c37" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f89574c003f34931a776f1213874a675"
I20260709 12:25:59.802836 23234 raft_consensus.cc:3060] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:59.803434  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:59.804193  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:59.800937 23159 raft_consensus.cc:740] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d08efaa729434ed4a7a396b571f4c597, State: Running, Role: LEADER
I20260709 12:25:59.806241 23159 consensus_queue.cc:260] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:59.807371 23159 raft_consensus.cc:3060] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:59.811789 23234 raft_consensus.cc:2468] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 3.
I20260709 12:25:59.814509 23275 leader_election.cc:304] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, f89574c003f34931a776f1213874a675; no voters: 
I20260709 12:25:59.815670 23519 raft_consensus.cc:2804] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:59.815721 23159 raft_consensus.cc:2468] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 3.
I20260709 12:25:59.816332 23519 raft_consensus.cc:697] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 3 LEADER]: Becoming Leader. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Running, Role: LEADER
I20260709 12:25:59.817373 23519 consensus_queue.cc:237] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:25:59.825206 23060 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17: soft_deleted_table [id=3ed58ad9051545f48ff8248146015ea4] alter complete (version 1)
I20260709 12:25:59.882032 23060 catalog_manager.cc:5697] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee reported cstate change: term changed from 2 to 3, leader changed from d08efaa729434ed4a7a396b571f4c597 (127.9.131.65) to 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67). New cstate: current_term: 3 leader_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:00.111953 23590 raft_consensus.cc:993] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675: : Instructing follower 1d6cace6e70d433b9c0eb3d0d514e3ee to start an election
I20260709 12:26:00.112880 23595 raft_consensus.cc:1081] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [term 2 LEADER]: Signalling peer 1d6cace6e70d433b9c0eb3d0d514e3ee to start an election
I20260709 12:26:00.115224 23311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc408da3258243a69dec87746d508e0b"
dest_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee"
 from {username='slave'} at 127.0.0.1:56900
I20260709 12:26:00.116003 23311 raft_consensus.cc:493] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:00.116447 23311 raft_consensus.cc:3060] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:00.128212 23311 raft_consensus.cc:515] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:26:00.131646 23311 leader_election.cc:290] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 3 election: Requested vote from peers d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095), f89574c003f34931a776f1213874a675 (127.9.131.66:39573)
I20260709 12:26:00.131595 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc408da3258243a69dec87746d508e0b" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d08efaa729434ed4a7a396b571f4c597"
I20260709 12:26:00.132642 23159 raft_consensus.cc:3060] T fc408da3258243a69dec87746d508e0b P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:00.132936 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc408da3258243a69dec87746d508e0b" candidate_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f89574c003f34931a776f1213874a675"
I20260709 12:26:00.133502 23234 raft_consensus.cc:3055] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:00.133695 23234 raft_consensus.cc:740] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f89574c003f34931a776f1213874a675, State: Running, Role: LEADER
I20260709 12:26:00.134583 23234 consensus_queue.cc:260] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:26:00.136209 23234 raft_consensus.cc:3060] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:00.141743 23159 raft_consensus.cc:2468] T fc408da3258243a69dec87746d508e0b P d08efaa729434ed4a7a396b571f4c597 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 3.
I20260709 12:26:00.142989 23276 leader_election.cc:304] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6cace6e70d433b9c0eb3d0d514e3ee, d08efaa729434ed4a7a396b571f4c597; no voters: 
I20260709 12:26:00.143970 23519 raft_consensus.cc:2804] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:00.144379 23519 raft_consensus.cc:697] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 3 LEADER]: Becoming Leader. State: Replica: 1d6cace6e70d433b9c0eb3d0d514e3ee, State: Running, Role: LEADER
I20260709 12:26:00.145467 23234 raft_consensus.cc:2468] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6cace6e70d433b9c0eb3d0d514e3ee in term 3.
I20260709 12:26:00.145572 23519 consensus_queue.cc:237] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } }
I20260709 12:26:00.157572 23060 catalog_manager.cc:5697] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee reported cstate change: term changed from 2 to 3, leader changed from f89574c003f34931a776f1213874a675 (127.9.131.66) to 1d6cace6e70d433b9c0eb3d0d514e3ee (127.9.131.67). New cstate: current_term: 3 leader_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6cace6e70d433b9c0eb3d0d514e3ee" member_type: VOTER last_known_addr { host: "127.9.131.67" port: 33057 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:00.217129 23091 debug-util.cc:398] Leaking SignalData structure 0x7b080030bc40 after lost signal to thread 9744
W20260709 12:26:00.218917 23091 debug-util.cc:398] Leaking SignalData structure 0x7b0800016cc0 after lost signal to thread 23094
W20260709 12:26:00.220561 23091 debug-util.cc:398] Leaking SignalData structure 0x7b08001e7fe0 after lost signal to thread 23186
W20260709 12:26:00.222052 23091 debug-util.cc:398] Leaking SignalData structure 0x7b080021f0c0 after lost signal to thread 23261
W20260709 12:26:00.223510 23091 debug-util.cc:398] Leaking SignalData structure 0x7b080007f260 after lost signal to thread 23335
W20260709 12:26:00.224050 23091 debug-util.cc:398] Leaking SignalData structure 0x7b080018a280 after lost signal to thread 23543
I20260709 12:26:00.304186 23234 raft_consensus.cc:1275] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [term 3 FOLLOWER]: Refusing update from remote peer 1d6cace6e70d433b9c0eb3d0d514e3ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:00.305843 23519 consensus_queue.cc:1048] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:00.319236 23159 raft_consensus.cc:1275] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [term 3 FOLLOWER]: Refusing update from remote peer 1d6cace6e70d433b9c0eb3d0d514e3ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:00.320998 23519 consensus_queue.cc:1048] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:00.697000 23159 raft_consensus.cc:1275] T fc408da3258243a69dec87746d508e0b P d08efaa729434ed4a7a396b571f4c597 [term 3 FOLLOWER]: Refusing update from remote peer 1d6cace6e70d433b9c0eb3d0d514e3ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:00.698232 23519 consensus_queue.cc:1048] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d08efaa729434ed4a7a396b571f4c597" member_type: VOTER last_known_addr { host: "127.9.131.65" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:00.712042 23234 raft_consensus.cc:1275] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [term 3 FOLLOWER]: Refusing update from remote peer 1d6cace6e70d433b9c0eb3d0d514e3ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:00.715127 23630 consensus_queue.cc:1048] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89574c003f34931a776f1213874a675" member_type: VOTER last_known_addr { host: "127.9.131.66" port: 39573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:00.805672  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:00.820142  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:00.820676  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:01.821883  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:01.827019  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:01.827502  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:02.828574  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:02.836841  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:02.837532  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:03.838603  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:03.848804  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:03.849294  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:04.850272  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:04.857860  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:04.859529  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:05.861330  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:05.866695  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:05.867146  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:06.868381  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:06.873725  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:06.874212  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:07.875201  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:07.880574  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:07.881032  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:08.882016  9741 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:08.887249  9741 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:08.887681  9741 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:09.992970  9741 tablet_server.cc:179] TabletServer@127.9.131.65:0 shutting down...
I20260709 12:26:10.039400  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:10.040706  9741 tablet_replica.cc:333] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597: stopping tablet replica
I20260709 12:26:10.042142  9741 raft_consensus.cc:2243] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:10.043649  9741 raft_consensus.cc:2272] T c5069ba21386475b9f811e03482f3859 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.048213  9741 tablet_replica.cc:333] T 5a8dd1f9f24249ff809ccce3a9a25811 P d08efaa729434ed4a7a396b571f4c597: stopping tablet replica
W20260709 12:26:10.048213 23202 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 16 similar messages]
I20260709 12:26:10.049752  9741 raft_consensus.cc:2243] T 5a8dd1f9f24249ff809ccce3a9a25811 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.051062  9741 raft_consensus.cc:2272] T 5a8dd1f9f24249ff809ccce3a9a25811 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:10.052219 23202 consensus_peers.cc:597] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675 -> Peer d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095): Couldn't send request to peer d08efaa729434ed4a7a396b571f4c597. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:10.053910 23202 consensus_peers.cc:597] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675 -> Peer d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095): Couldn't send request to peer d08efaa729434ed4a7a396b571f4c597. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:10.055546  9741 tablet_replica.cc:333] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597: stopping tablet replica
I20260709 12:26:10.056432  9741 raft_consensus.cc:2243] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.057169  9741 raft_consensus.cc:2272] T 26af7ad3266a463a97cd0546dd3ddc2c P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.060324  9741 tablet_replica.cc:333] T dc1c17f0a66d425fb526791ee677b8f9 P d08efaa729434ed4a7a396b571f4c597: stopping tablet replica
I20260709 12:26:10.061061  9741 raft_consensus.cc:2243] T dc1c17f0a66d425fb526791ee677b8f9 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.061837  9741 raft_consensus.cc:2272] T dc1c17f0a66d425fb526791ee677b8f9 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.065420  9741 tablet_replica.cc:333] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597: stopping tablet replica
I20260709 12:26:10.066133  9741 raft_consensus.cc:2243] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:10.067996  9741 raft_consensus.cc:2272] T ca25c8c3f8cd41439402cf6939bc7d9e P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:10.069562 23202 consensus_peers.cc:597] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 -> Peer d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095): Couldn't send request to peer d08efaa729434ed4a7a396b571f4c597. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:10.071743  9741 tablet_replica.cc:333] T fc408da3258243a69dec87746d508e0b P d08efaa729434ed4a7a396b571f4c597: stopping tablet replica
I20260709 12:26:10.072666  9741 raft_consensus.cc:2243] T fc408da3258243a69dec87746d508e0b P d08efaa729434ed4a7a396b571f4c597 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.073468  9741 raft_consensus.cc:2272] T fc408da3258243a69dec87746d508e0b P d08efaa729434ed4a7a396b571f4c597 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.076462  9741 tablet_replica.cc:333] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597: stopping tablet replica
I20260709 12:26:10.077174  9741 raft_consensus.cc:2243] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.077932  9741 raft_consensus.cc:2272] T a419a938289f4c16abab61929f5d6914 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.081293  9741 tablet_replica.cc:333] T fe0d8886980a40428832e06881de2a28 P d08efaa729434ed4a7a396b571f4c597: stopping tablet replica
I20260709 12:26:10.081992  9741 raft_consensus.cc:2243] T fe0d8886980a40428832e06881de2a28 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.082937  9741 raft_consensus.cc:2272] T fe0d8886980a40428832e06881de2a28 P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.087493  9741 tablet_replica.cc:333] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597: stopping tablet replica
I20260709 12:26:10.088357  9741 raft_consensus.cc:2243] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:26:10.089498 23276 consensus_peers.cc:597] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee -> Peer d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095): Couldn't send request to peer d08efaa729434ed4a7a396b571f4c597. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:10.090479  9741 raft_consensus.cc:2272] T f9ea03eeb5984676938e35a08ecffbba P d08efaa729434ed4a7a396b571f4c597 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.093792  9741 tablet_replica.cc:333] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597: stopping tablet replica
I20260709 12:26:10.094458  9741 raft_consensus.cc:2243] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:10.096004  9741 raft_consensus.cc:2272] T 533a483e22a54a949dd7813032a5258b P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.098897  9741 tablet_replica.cc:333] T 68466758e88a4c1db2d233627c8bb383 P d08efaa729434ed4a7a396b571f4c597: stopping tablet replica
I20260709 12:26:10.099681  9741 raft_consensus.cc:2243] T 68466758e88a4c1db2d233627c8bb383 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.100402  9741 raft_consensus.cc:2272] T 68466758e88a4c1db2d233627c8bb383 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.103448  9741 tablet_replica.cc:333] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597: stopping tablet replica
I20260709 12:26:10.104126  9741 raft_consensus.cc:2243] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:10.105382  9741 raft_consensus.cc:2272] T 22afdeda3e8a4f98be141363034871c8 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.108268  9741 tablet_replica.cc:333] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597: stopping tablet replica
I20260709 12:26:10.108850  9741 raft_consensus.cc:2243] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.109551  9741 raft_consensus.cc:2272] T 5ffc3ac9d2274edb9db5701cafc9f598 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.112619  9741 tablet_replica.cc:333] T 7ee16d300d1d47edb83146fd64599ac1 P d08efaa729434ed4a7a396b571f4c597: stopping tablet replica
I20260709 12:26:10.113258  9741 raft_consensus.cc:2243] T 7ee16d300d1d47edb83146fd64599ac1 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.114006  9741 raft_consensus.cc:2272] T 7ee16d300d1d47edb83146fd64599ac1 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.117023  9741 tablet_replica.cc:333] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597: stopping tablet replica
I20260709 12:26:10.117718  9741 raft_consensus.cc:2243] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.118355  9741 raft_consensus.cc:2272] T 1fc33df488b3440f9bb491ec0af24c37 P d08efaa729434ed4a7a396b571f4c597 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.121321  9741 tablet_replica.cc:333] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597: stopping tablet replica
I20260709 12:26:10.121913  9741 raft_consensus.cc:2243] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:10.123508  9741 raft_consensus.cc:2272] T f169737ec5ce479d8965c1a1aacbc999 P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.126325  9741 tablet_replica.cc:333] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597: stopping tablet replica
I20260709 12:26:10.126924  9741 raft_consensus.cc:2243] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:10.128432  9741 raft_consensus.cc:2272] T ad581a43dcff4560afed00e7a0d3897f P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.131489  9741 tablet_replica.cc:333] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597: stopping tablet replica
I20260709 12:26:10.132058  9741 raft_consensus.cc:2243] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.132836  9741 raft_consensus.cc:2272] T 87c1f73ef3a347d9b95becab3beaa1ee P d08efaa729434ed4a7a396b571f4c597 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:10.161178 23276 consensus_peers.cc:597] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee -> Peer d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095): Couldn't send request to peer d08efaa729434ed4a7a396b571f4c597. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:10.191970  9741 tablet_server.cc:196] TabletServer@127.9.131.65:0 shutdown complete.
W20260709 12:26:10.202044 23202 consensus_peers.cc:597] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675 -> Peer d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095): Couldn't send request to peer d08efaa729434ed4a7a396b571f4c597. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:10.212399 23202 consensus_peers.cc:597] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675 -> Peer d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095): Couldn't send request to peer d08efaa729434ed4a7a396b571f4c597. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:10.242274 23202 consensus_peers.cc:597] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 -> Peer d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095): Couldn't send request to peer d08efaa729434ed4a7a396b571f4c597. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:10.245535 23276 consensus_peers.cc:597] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee -> Peer d08efaa729434ed4a7a396b571f4c597 (127.9.131.65:43095): Couldn't send request to peer d08efaa729434ed4a7a396b571f4c597. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.65:43095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:10.249271  9741 tablet_server.cc:179] TabletServer@127.9.131.66:0 shutting down...
I20260709 12:26:10.284471  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:10.285291  9741 tablet_replica.cc:333] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675: stopping tablet replica
I20260709 12:26:10.286109  9741 raft_consensus.cc:2243] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:10.287086  9741 raft_consensus.cc:2272] T dc1c17f0a66d425fb526791ee677b8f9 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.289698  9741 tablet_replica.cc:333] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675: stopping tablet replica
I20260709 12:26:10.290334  9741 raft_consensus.cc:2243] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.290907  9741 raft_consensus.cc:2272] T c5069ba21386475b9f811e03482f3859 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.293421  9741 tablet_replica.cc:333] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675: stopping tablet replica
I20260709 12:26:10.294067  9741 raft_consensus.cc:2243] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:10.294978  9741 raft_consensus.cc:2272] T 5a8dd1f9f24249ff809ccce3a9a25811 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.297449  9741 tablet_replica.cc:333] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675: stopping tablet replica
I20260709 12:26:10.298074  9741 raft_consensus.cc:2243] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:10.298979  9741 raft_consensus.cc:2272] T 26af7ad3266a463a97cd0546dd3ddc2c P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.301354  9741 tablet_replica.cc:333] T ca25c8c3f8cd41439402cf6939bc7d9e P f89574c003f34931a776f1213874a675: stopping tablet replica
I20260709 12:26:10.301957  9741 raft_consensus.cc:2243] T ca25c8c3f8cd41439402cf6939bc7d9e P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.302506  9741 raft_consensus.cc:2272] T ca25c8c3f8cd41439402cf6939bc7d9e P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.305017  9741 tablet_replica.cc:333] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675: stopping tablet replica
I20260709 12:26:10.305588  9741 raft_consensus.cc:2243] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:10.306433  9741 raft_consensus.cc:2272] T 5ffc3ac9d2274edb9db5701cafc9f598 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.309742  9741 tablet_replica.cc:333] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675: stopping tablet replica
I20260709 12:26:10.310526  9741 raft_consensus.cc:2243] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.311331  9741 raft_consensus.cc:2272] T 22afdeda3e8a4f98be141363034871c8 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:10.312206 23275 consensus_peers.cc:597] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee -> Peer f89574c003f34931a776f1213874a675 (127.9.131.66:39573): Couldn't send request to peer f89574c003f34931a776f1213874a675. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:10.313949  9741 tablet_replica.cc:333] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675: stopping tablet replica
I20260709 12:26:10.314663  9741 raft_consensus.cc:2243] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.315213  9741 raft_consensus.cc:2272] T 1fc33df488b3440f9bb491ec0af24c37 P f89574c003f34931a776f1213874a675 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.317489  9741 tablet_replica.cc:333] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675: stopping tablet replica
I20260709 12:26:10.318106  9741 raft_consensus.cc:2243] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:10.319048  9741 raft_consensus.cc:2272] T 7ee16d300d1d47edb83146fd64599ac1 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.321533  9741 tablet_replica.cc:333] T f9ea03eeb5984676938e35a08ecffbba P f89574c003f34931a776f1213874a675: stopping tablet replica
I20260709 12:26:10.322165  9741 raft_consensus.cc:2243] T f9ea03eeb5984676938e35a08ecffbba P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.322696  9741 raft_consensus.cc:2272] T f9ea03eeb5984676938e35a08ecffbba P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.325003  9741 tablet_replica.cc:333] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675: stopping tablet replica
I20260709 12:26:10.325575  9741 raft_consensus.cc:2243] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:10.326582  9741 raft_consensus.cc:2272] T fe0d8886980a40428832e06881de2a28 P f89574c003f34931a776f1213874a675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.328939  9741 tablet_replica.cc:333] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675: stopping tablet replica
I20260709 12:26:10.329495  9741 raft_consensus.cc:2243] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.330020  9741 raft_consensus.cc:2272] T 68466758e88a4c1db2d233627c8bb383 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.332309  9741 tablet_replica.cc:333] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675: stopping tablet replica
I20260709 12:26:10.332841  9741 raft_consensus.cc:2243] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.333323  9741 raft_consensus.cc:2272] T 533a483e22a54a949dd7813032a5258b P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.335760  9741 tablet_replica.cc:333] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675: stopping tablet replica
I20260709 12:26:10.336304  9741 raft_consensus.cc:2243] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:10.337213  9741 raft_consensus.cc:2272] T 87c1f73ef3a347d9b95becab3beaa1ee P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.339514  9741 tablet_replica.cc:333] T a419a938289f4c16abab61929f5d6914 P f89574c003f34931a776f1213874a675: stopping tablet replica
I20260709 12:26:10.340068  9741 raft_consensus.cc:2243] T a419a938289f4c16abab61929f5d6914 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.340602  9741 raft_consensus.cc:2272] T a419a938289f4c16abab61929f5d6914 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.342801  9741 tablet_replica.cc:333] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675: stopping tablet replica
I20260709 12:26:10.343315  9741 raft_consensus.cc:2243] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.343791  9741 raft_consensus.cc:2272] T fc408da3258243a69dec87746d508e0b P f89574c003f34931a776f1213874a675 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.346110  9741 tablet_replica.cc:333] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675: stopping tablet replica
I20260709 12:26:10.346617  9741 raft_consensus.cc:2243] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.347153  9741 raft_consensus.cc:2272] T ad581a43dcff4560afed00e7a0d3897f P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.349330  9741 tablet_replica.cc:333] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675: stopping tablet replica
I20260709 12:26:10.349783  9741 raft_consensus.cc:2243] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.350306  9741 raft_consensus.cc:2272] T f169737ec5ce479d8965c1a1aacbc999 P f89574c003f34931a776f1213874a675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.394327  9741 tablet_server.cc:196] TabletServer@127.9.131.66:0 shutdown complete.
W20260709 12:26:10.412160 23275 consensus_peers.cc:597] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee -> Peer f89574c003f34931a776f1213874a675 (127.9.131.66:39573): Couldn't send request to peer f89574c003f34931a776f1213874a675. Status: Network error: Client connection negotiation failed: client connection to 127.9.131.66:39573: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:10.437426  9741 tablet_server.cc:179] TabletServer@127.9.131.67:0 shutting down...
I20260709 12:26:10.467334  9741 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:10.468088  9741 tablet_replica.cc:333] T 26af7ad3266a463a97cd0546dd3ddc2c P 1d6cace6e70d433b9c0eb3d0d514e3ee: stopping tablet replica
I20260709 12:26:10.468886  9741 raft_consensus.cc:2243] T 26af7ad3266a463a97cd0546dd3ddc2c P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.469440  9741 raft_consensus.cc:2272] T 26af7ad3266a463a97cd0546dd3ddc2c P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.471813  9741 tablet_replica.cc:333] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee: stopping tablet replica
I20260709 12:26:10.472532  9741 raft_consensus.cc:2243] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.473057  9741 raft_consensus.cc:2272] T ca25c8c3f8cd41439402cf6939bc7d9e P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.475286  9741 tablet_replica.cc:333] T c5069ba21386475b9f811e03482f3859 P 1d6cace6e70d433b9c0eb3d0d514e3ee: stopping tablet replica
I20260709 12:26:10.475891  9741 raft_consensus.cc:2243] T c5069ba21386475b9f811e03482f3859 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.476395  9741 raft_consensus.cc:2272] T c5069ba21386475b9f811e03482f3859 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.478508  9741 tablet_replica.cc:333] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee: stopping tablet replica
I20260709 12:26:10.479101  9741 raft_consensus.cc:2243] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.479651  9741 raft_consensus.cc:2272] T 5a8dd1f9f24249ff809ccce3a9a25811 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.482728  9741 tablet_replica.cc:333] T fe0d8886980a40428832e06881de2a28 P 1d6cace6e70d433b9c0eb3d0d514e3ee: stopping tablet replica
I20260709 12:26:10.483659  9741 raft_consensus.cc:2243] T fe0d8886980a40428832e06881de2a28 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.484408  9741 raft_consensus.cc:2272] T fe0d8886980a40428832e06881de2a28 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.487123  9741 tablet_replica.cc:333] T f9ea03eeb5984676938e35a08ecffbba P 1d6cace6e70d433b9c0eb3d0d514e3ee: stopping tablet replica
I20260709 12:26:10.487697  9741 raft_consensus.cc:2243] T f9ea03eeb5984676938e35a08ecffbba P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.488273  9741 raft_consensus.cc:2272] T f9ea03eeb5984676938e35a08ecffbba P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.490450  9741 tablet_replica.cc:333] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee: stopping tablet replica
I20260709 12:26:10.490952  9741 raft_consensus.cc:2243] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.491458  9741 raft_consensus.cc:2272] T dc1c17f0a66d425fb526791ee677b8f9 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.493681  9741 tablet_replica.cc:333] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee: stopping tablet replica
I20260709 12:26:10.494210  9741 raft_consensus.cc:2243] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:10.495071  9741 raft_consensus.cc:2272] T 68466758e88a4c1db2d233627c8bb383 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.497339  9741 tablet_replica.cc:333] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee: stopping tablet replica
I20260709 12:26:10.497856  9741 raft_consensus.cc:2243] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.498375  9741 raft_consensus.cc:2272] T 533a483e22a54a949dd7813032a5258b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.500478  9741 tablet_replica.cc:333] T 87c1f73ef3a347d9b95becab3beaa1ee P 1d6cace6e70d433b9c0eb3d0d514e3ee: stopping tablet replica
I20260709 12:26:10.501008  9741 raft_consensus.cc:2243] T 87c1f73ef3a347d9b95becab3beaa1ee P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.501468  9741 raft_consensus.cc:2272] T 87c1f73ef3a347d9b95becab3beaa1ee P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.503700  9741 tablet_replica.cc:333] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee: stopping tablet replica
I20260709 12:26:10.504292  9741 raft_consensus.cc:2243] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:10.505115  9741 raft_consensus.cc:2272] T a419a938289f4c16abab61929f5d6914 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.507221  9741 tablet_replica.cc:333] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee: stopping tablet replica
I20260709 12:26:10.507792  9741 raft_consensus.cc:2243] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:10.508721  9741 raft_consensus.cc:2272] T fc408da3258243a69dec87746d508e0b P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.510990  9741 tablet_replica.cc:333] T ad581a43dcff4560afed00e7a0d3897f P 1d6cace6e70d433b9c0eb3d0d514e3ee: stopping tablet replica
I20260709 12:26:10.511597  9741 raft_consensus.cc:2243] T ad581a43dcff4560afed00e7a0d3897f P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.512116  9741 raft_consensus.cc:2272] T ad581a43dcff4560afed00e7a0d3897f P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.514225  9741 tablet_replica.cc:333] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee: stopping tablet replica
I20260709 12:26:10.514780  9741 raft_consensus.cc:2243] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.515260  9741 raft_consensus.cc:2272] T f169737ec5ce479d8965c1a1aacbc999 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.517521  9741 tablet_replica.cc:333] T 22afdeda3e8a4f98be141363034871c8 P 1d6cace6e70d433b9c0eb3d0d514e3ee: stopping tablet replica
I20260709 12:26:10.518076  9741 raft_consensus.cc:2243] T 22afdeda3e8a4f98be141363034871c8 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.518538  9741 raft_consensus.cc:2272] T 22afdeda3e8a4f98be141363034871c8 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.520692  9741 tablet_replica.cc:333] T 5ffc3ac9d2274edb9db5701cafc9f598 P 1d6cace6e70d433b9c0eb3d0d514e3ee: stopping tablet replica
I20260709 12:26:10.521183  9741 raft_consensus.cc:2243] T 5ffc3ac9d2274edb9db5701cafc9f598 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.521682  9741 raft_consensus.cc:2272] T 5ffc3ac9d2274edb9db5701cafc9f598 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.523756  9741 tablet_replica.cc:333] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee: stopping tablet replica
I20260709 12:26:10.524273  9741 raft_consensus.cc:2243] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.524756  9741 raft_consensus.cc:2272] T 7ee16d300d1d47edb83146fd64599ac1 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.526809  9741 tablet_replica.cc:333] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee: stopping tablet replica
I20260709 12:26:10.527233  9741 raft_consensus.cc:2243] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:10.528103  9741 raft_consensus.cc:2272] T 1fc33df488b3440f9bb491ec0af24c37 P 1d6cace6e70d433b9c0eb3d0d514e3ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.589569  9741 tablet_server.cc:196] TabletServer@127.9.131.67:0 shutdown complete.
I20260709 12:26:10.626798  9741 master.cc:562] Master@127.9.131.126:36999 shutting down...
I20260709 12:26:10.649863  9741 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:10.650646  9741 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.651075  9741 tablet_replica.cc:333] T 00000000000000000000000000000000 P 734775a1bdcb4ca7ba926ea30fa9ee17: stopping tablet replica
I20260709 12:26:10.697966  9741 master.cc:584] Master@127.9.131.126:36999 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (21848 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (45456 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (442734 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 12:26:10.752283  9741 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2304 messages since previous log ~35 seconds ago
I20260709 12:26:10.752511  9741 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2304 messages since previous log ~35 seconds ago
I20260709 12:26:10.752688  9741 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2304 messages since previous log ~35 seconds ago
I20260709 12:26:10.752875  9741 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~54 seconds ago
I20260709 12:26:10.753048  9741 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~54 seconds ago
I20260709 12:26:10.753247  9741 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~113 seconds ago
I20260709 12:26:10.753430  9741 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 4 messages since previous log ~195 seconds ago
I20260709 12:26:10.753611  9741 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:5227: suppressed but not reported on 3 messages since previous log ~156 seconds ago
I20260709 12:26:10.753856  9741 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 11 messages since previous log ~0 seconds ago
I20260709 12:26:10.754145  9741 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 51 messages since previous log ~20 seconds ago
